Meta plans to replace 90% of content moderation processes with AI

The news: Meta will replace more than 90% of its content review employees with AI by the end of the year for certain types of content, the Financial Times reported Thursday. That will place the vast majority of Meta’s ads and content review under the control of Meta’s LLMs.

The news comes as Meta invests hundreds of billions into its evolving AI systems.

Why it matters: Meta’s AI moderation shift could make enforcement faster but less predictable, raising brand safety risks and giving advertisers less clarity or control over content and account decisions.

  • AI can make decisions and mistakes at a much faster pace and greater volume than humans, amplifying the risk of ads appearing near harmful, inappropriate, or misclassified content as autonomous ad buying systems already reduce human oversight.
  • Meta’s reduced reliance on human moderators may speed up violation detection and lower costs for the tech giant, but it also places more content decisions in the hands of opaque AI systems, reducing predictability and control for users, creators, and brands.
  • Enforcement could become more inconsistent without human oversight, especially amid rapid policy shifts. Brands may also have less clarity into why certain content is flagged, removed, or approved, making it harder to plan campaigns or appeal decisions.
  • The issue is especially acute because AI still struggles with nuance, including satire, cultural context, sensitive topics, and edge cases that human reviewers are often better equipped to assess.
  • That lack of nuance raises the risk of erroneous content removals, account restrictions, or permanent bans that could abruptly cut brands off from key audiences, disrupting marketing strategies, customer relationships, and paid media performance.

These potential issues are especially notable given Meta’s massive social media reach and importance to many brands’ audience engagement strategies.

Implications for brands and marketers: Automated content moderation will help Meta reduce costs but could raise issues for the marketers and brands who rely on Meta platforms if the broader rollout doesn’t align with improvements in accuracy, transparency, and human escalation processes.

Still, Meta’s increased focus on brand safety protocols could offer a cushion for concerned brands and advertisers if those tools give marketers clearer control over where ads appear and how content decisions are made.

This content is part of EMARKETER’s subscription Briefings, where we pair daily updates with data and analysis from forecasts and research reports. Our Briefings prepare you to start your day informed, to provide critical insights in an important meeting, and to understand the context of what’s happening in your industry. Non-clients can click here to get a demo of our full platform and coverage.

You've read 0 of 2 free articles this month.

Get more articles - create your free account today!