In the weeks before the most consequential shopping season of the year, Facebook's automated moderation systems began silencing the very small businesses that depend on the platform most — flagging dog posters as misinformation, necklaces as adult content, and onions as nudity. The company had anticipated such errors when it shifted to AI-driven enforcement during the pandemic, yet built no adequate safety net for those caught in the machine's mistakes. What emerges is an old and familiar story: the powerful absorb disruption, while the vulnerable absorb the cost.
Facebook's AI Wrongly Bans Small Advertisers, Leaving Them Without Support During Holiday Season
Small business owners lost tens of thousands of dollars in revenue when accounts were wrongly suspended during critical holiday shopping periods.
It's my main way of advertising and this is just so risky
Mark
Why does Facebook's AI keep making these mistakes with such benign products?
Mimi
The company shifted to heavier automation when it sent content moderators home during the pandemic. The AI was trained to catch policy violations, but it's casting an enormous net—flagging things that don't actually violate anything. It's the classic problem of false positives at scale.
Mark
But Facebook must know this is happening. Why not just fix it?
Mimi
They do know. Zuckerberg acknowledged it would happen. But fixing it requires human review capacity, which they've actually reduced. Appeals for organic posts dropped 95 percent. The infrastructure to correct mistakes has shrunk while the volume of mistakes has grown.
Mark
So the real issue is customer support, not the AI itself?
Mimi
It's both. But the customer support is where the cruelty lives. A major advertiser gets a dedicated person to call. A small business gets a chat window and waits a month for an answer, losing tens of thousands in revenue while they wait.
Mark
Can't these advertisers just go somewhere else?
Mimi
Not really. A business making $100,000 on Facebook might make $25,000 on Snapchat. You can't replace that. Facebook knows this. That's why they can afford to be indifferent.
Mark
Is this new, or has Facebook always been like this?
Mimi
Google did something similar in 2015—banned 214,000 accounts. But Google eventually built better support systems. It took three years. Facebook has shown no sign it's in a hurry. They have 10 million advertisers. Losing a few hundred probably doesn't register.
Mark
What happens next?
Mimi
Smaller advertisers will keep losing money during critical seasons. Some will shift spending to Google or TikTok where they can. But most will stay because they have no choice. Facebook's dominance is its own kind of trap.
The Pulse
- Small business owners are losing tens of thousands of dollars in revenue as Facebook's AI wrongly suspends their ad accounts during the holiday season — the period many depend on most to survive the year.
- The errors are not minor edge cases: the system has flagged onions for nudity, necklaces for obscenity, and a dog poster for spreading false news — decisions that reveal an algorithm operating far beyond its competence.
- Appeals that Facebook promises will resolve in 24 to 48 hours are stretching into months, and some advertisers have exhausted their appeal limits entirely, leaving them with no path to restoration.
- A two-tier support system has emerged in which advertisers spending $10,000 or more per month receive dedicated human representatives, while smaller spenders are routed to anonymous chat agents with no special access or authority.
- Advertisers acknowledge they cannot easily leave — Facebook's reach so far outperforms competitors that switching platforms would mean accepting a fraction of the revenue, trapping them in a relationship they describe as a 'love-hate' dependency.
- With 10 million advertisers and $21.5 billion in quarterly revenue, Facebook faces little structural pressure to reform quickly, and the precedent of Google's years-long correction offers small businesses little immediate comfort.
In the weeks before the most consequential shopping season of the year, Facebook's automated moderation systems began silencing the very small businesses that depend on the platform most — flagging dog posters as misinformation, necklaces as adult content, and onions as nudity. The company had anticipated such errors when it shifted to AI-driven enforcement during the pandemic, yet built no adequate safety net for those caught in the machine's mistakes. What emerges is an old and familiar story: the powerful absorb disruption, while the vulnerable absorb the cost.
Facebook's shift to automated content moderation during the pandemic — a move CEO Mark Zuckerberg acknowledged would produce errors — has ensnared hundreds of small advertisers in a wave of false positives arriving at the worst possible moment. As the holiday shopping season opens, business owners are finding their accounts locked for weeks, their ads rejected for violations they never committed.
The cases are striking in their absurdity. An ad for onions was blocked for nudity. Necklaces were flagged as adult toys. A dog poster was labeled false news by a fact-checker, restored after the seller contacted the checker directly, then blocked again by the algorithm. One jewelry seller had his account disabled six times in a single year. Each time, Facebook eventually reversed course — but the reviews took over a month, and in the interim he estimates losing $35,000 in revenue.
The platform's support structure compounds the injury. Advertisers spending at least $10,000 monthly receive a dedicated account representative. Everyone else reaches a chat window staffed by randomly assigned agents with no special access. Seven business owners and ad agencies described the same experience: smaller spenders are effectively on their own. Even agencies managing multiple client campaigns report knowing no more about why an ad disappeared than the clients themselves.
The enforcement numbers tell their own story. Facebook removed 112 million organic posts in the first nine months of 2020 — a 35 percent increase over the prior year — while appeals dropped 95 percent as COVID-19 reduced review capacity. The volume of errors grew as the infrastructure to correct them shrank.
Small advertisers are caught in a bind that larger brands are not. When major corporations boycotted Facebook over hate speech policies in July, the platform absorbed the pressure without meaningful change. A small jewelry seller cannot afford the same leverage. Facebook's reach so vastly outperforms competitors that leaving would mean accepting a fraction of the revenue — a trade most cannot make. 'It's my main way of advertising,' one seller said. 'But it's also the most powerful. So it's kind of a love-hate relationship.'
Some draw comparisons to Google's 2015 purge of bad ads, which eventually prompted years of support improvements — but those changes took until 2018 to arrive. With 10 million advertisers and billions in quarterly revenue, Facebook may feel no urgency to move faster. The question, as the holiday season deepens and more accounts go dark without explanation, is how long dominance can substitute for accountability.
Facebook's artificial intelligence systems have begun blocking ads for dog posters and women's necklaces, flagging them as violations of policies they don't breach. The company, which shifted to heavier reliance on automated moderation after sending content reviewers home during the pandemic, has caught hundreds of small advertisers in what amounts to a dragnet of false positives—exactly the kind of error CEO Mark Zuckerberg said the company anticipated when it announced the pivot in March.
The timing could hardly be worse. As November arrives and the holiday shopping season begins, small business owners who depend almost entirely on Facebook to reach customers are finding their accounts locked down for weeks at a time, sometimes multiple times in a single year. One jewelry seller in Simon Wagner's position has had his account disabled six times in 2020 alone. Each time, Facebook eventually reversed the decision after he appealed. But the review process stretched past a month in some cases, even though a customer support representative told him via chat that decisions typically take 24 to 48 hours. In the interim, Wagner estimates he lost around $35,000 in revenue.
The problem runs deeper than occasional glitches. In October, Facebook's system blocked an ad for onions, incorrectly determining it violated the platform's nudity policy. In Facebook groups, advertisers report that the AI has mistaken necklaces for adult toys and arcades for gambling establishments. A dog products seller watched his poster ad get flagged as false news by an independent fact checker, managed to get it restored after contacting the checker directly, only to have Facebook's algorithm block it again weeks later. Because Facebook caps the number of appeals an advertiser can file, he gave up rather than risk broader consequences to his account.
What separates the haves from the have-nots on Facebook is spending. Advertisers who commit at least $10,000 per month receive a dedicated account representative to help navigate problems. Everyone else gets a chat window with a randomly assigned customer service agent. The seven business owners and ad agencies who spoke to Business Insider all described this as a two-tier system that leaves smaller spenders essentially abandoned. "If you're not spending millions and don't have a rep, you're basically going to be treated unfairly," the dog products owner said. Even ad agencies that manage campaigns for multiple clients report having no more access to information than their clients themselves—leaving them unable to explain to customers why their ads disappeared.
The scale of Facebook's enforcement has accelerated dramatically. The company removed 112 million organic posts in the first nine months of 2020, up more than 35 percent from the same period in 2019. Meanwhile, the company reported that appeals concerning organic posts dropped 95 percent during the same window, citing reduced review capacity due to COVID-19. Facebook declined to disclose how many ad-related appeals it received, but advertisers describe a similar bottleneck. The company's own statement acknowledged that "both the company's AI and human reviewers make mistakes," yet the infrastructure to correct those mistakes has contracted precisely when the volume of errors has grown.
Smaller advertisers face a bind that larger brands do not. When Coca-Cola, Starbucks, and Unilever temporarily boycotted Facebook in July over hate speech policies, the company weathered the storm without meaningful change. But a small jewelry business or dog products seller cannot afford to abandon Facebook, even if the platform has become unreliable. A client generating $100,000 in annual revenue on Facebook might earn only $25,000 on Snapchat or another platform—not enough to justify the switch. "It's my main way of advertising and this is just so risky," one seller said. "But it's also the most powerful, right? So it's kind of a love-hate relationship that we all have with Facebook."
Some observers see parallels to Google's own reckoning with advertiser trust. In 2015, Google banned 214,000 accounts in a purge of "bad ads." The company eventually improved its support infrastructure—adding phone lines, dedicated representatives, responsive email support—but those changes took until around 2018 to materialize. Facebook, with 10 million advertisers and $21.5 billion in quarterly revenue, may not feel the same pressure to move quickly. A few hundred advertisers shifting budget to Google or TikTok likely won't move the needle. But as the holiday season unfolds and more small business owners watch their accounts freeze without explanation or recourse, the question is whether Facebook's dominance can indefinitely insulate it from the consequences of its own mistakes.
Notable Quotes
If you're not spending millions and don't have a rep, you're basically going to be treated unfairly.— Dog products business owner
They're just getting stricter and stricter and are banning accounts more often and providing no explanation, no real appeal process, no proper customer support.— Jay Topp, founder of Lion Social ad agency
Want the full story?
Read the original at Business Insider India ↗
Technology