Where Facebook's AI Slop Comes From
Facebook is struggling with AI-generated spam, driven by creators in developing countries exploiting the platform for profit. The Creator Bonus Program incentivizes sensational content, overwhelming moderation efforts.
Read original articleFacebook is facing a significant issue with AI-generated spam content, often referred to as "AI slop." This phenomenon is largely driven by creators in countries like India, Vietnam, and the Philippines, who are incentivized to produce bizarre and emotional images that garner high engagement on the platform. These creators learn their techniques from YouTube influencers and utilize tools like Microsoft's AI Image Creator to generate content. The Facebook Creator Bonus Program pays users for viral posts, which has led to a surge in the production of sensational images, including those depicting poverty and disaster, as they tend to attract more likes and shares. Influencers teach others how to exploit Facebook's algorithms and content moderation systems, often sharing strategies through videos and guides. Despite Facebook's efforts to manage this spam, the company's content moderation teams are reportedly overwhelmed, allowing these tactics to proliferate. The result is a cycle where creators continuously adapt to new trends and vulnerabilities in Facebook's system, leading to a flood of low-quality, AI-generated content that dominates user feeds.
- Facebook's AI spam problem is fueled by creators in developing countries seeking to monetize viral content.
- The Creator Bonus Program incentivizes the production of sensational and emotional AI-generated images.
- Influencers share strategies for exploiting Facebook's algorithms, leading to widespread spam.
- Content moderation efforts at Facebook are reportedly insufficient to keep up with the volume of spam.
- The phenomenon reflects a broader trend of using AI tools to generate engaging but low-quality content.
Related
AI Is Ruining the Internet
A teenager earns $21,000 monthly using AI tools on his phone, showcasing AI's impact on tech firms. Concerns arise over AI-generated content's accuracy verification, affecting human interaction online. Facebook's unsettling features and the challenge of addressing strange content are highlighted.
The Economy of Spam (2022)
Social media platforms promote benefits for small businesses but harbor a hidden spam economy. Fraudulent activities thrive through sophisticated methods, exploiting platforms and users. Researchers infiltrate and expose this underground world.
Facebook Is the 'Zombie Internet'
Facebook, dubbed the "Zombie Internet," is flooded with AI-generated content, impacting user interactions and blurring reality. Mark Zuckerberg revealed 30% of posts are AI-driven, raising concerns about authenticity and deception.
Google Researchers Publish Paper About How AI Is Ruining the Internet
Google researchers warn that generative AI contributes to the spread of fake content, complicating the distinction between truth and deception, and potentially undermining public understanding and accountability in digital information.
Where Facebook's AI Slop Comes From
Facebook faces a significant issue with AI-generated spam content, driven by creators in developing countries incentivized by the Creator Bonus Program, using bizarre images to exploit engagement and algorithms.
This story has surprisingly altered the way I feel about this AI spam on Facebook. While it’s disconcerting and annoying content to look at… I have to give props to these folks for finding clever ways to suck money out of lazy rich tech companies. Respect for the international hustle.
The part of the ecosystem missing from this story is the revenue stream to Facebook. Are advertisers actually ok with their ads showing up next to this crap, and getting charged by Facebook for the privilege? Maybe? Not all ads are run by big conservative image-conscious consumer companies. If ads get real clicks, maybe that’s enough for some advertisers, regardless of how silly the AI content next door.
Still, there are ones even stranger than the trash AI images targeting the attention of idiots. I saw a post seemingly advertising a real book, but for some reason, in the content of the post. The claimed the book was written by [Person A] while the photo of the book they posted clearly noted the author as [Person B]. Didn't seem like a simple accident either. The actual author had a name that looked to be of middle eastern origin, while the fale author was some west-African insert.
are the people of facebook OK?
I saw it on forums with revenue sharing all the way back in the 90s and 00s. You had people from all kinds of less well off countries signing up and posting junk en masse because the tiny amount that Adsense paid out was a king's ransom in those parts of the world.
And it's been a constant ever since. 'Web 3.0' games that paid people to play had these people turn them into full-time jobs, Quora has an endless deluge of junk being posted because of their contributor program, and the same is true of everything from Medium to YouTube to TikTok and Instagram. Any time there's a way to 'make money from home', then it turns into a get rich quick scheme/full-time business for those in low cost regions or with few other options.
But hey, it's inevitable. If posting junk online pays better than local businesses and jobs do, then of course you're going to see an increasing number of people trying to get in on the hustle.
How could we design incentives which produce a positive outcome for everyone?
Related
AI Is Ruining the Internet
A teenager earns $21,000 monthly using AI tools on his phone, showcasing AI's impact on tech firms. Concerns arise over AI-generated content's accuracy verification, affecting human interaction online. Facebook's unsettling features and the challenge of addressing strange content are highlighted.
The Economy of Spam (2022)
Social media platforms promote benefits for small businesses but harbor a hidden spam economy. Fraudulent activities thrive through sophisticated methods, exploiting platforms and users. Researchers infiltrate and expose this underground world.
Facebook Is the 'Zombie Internet'
Facebook, dubbed the "Zombie Internet," is flooded with AI-generated content, impacting user interactions and blurring reality. Mark Zuckerberg revealed 30% of posts are AI-driven, raising concerns about authenticity and deception.
Google Researchers Publish Paper About How AI Is Ruining the Internet
Google researchers warn that generative AI contributes to the spread of fake content, complicating the distinction between truth and deception, and potentially undermining public understanding and accountability in digital information.
Where Facebook's AI Slop Comes From
Facebook faces a significant issue with AI-generated spam content, driven by creators in developing countries incentivized by the Creator Bonus Program, using bizarre images to exploit engagement and algorithms.