NSFW: Facebook’s AI-Generated Stickers Go Off Rails With Nude, Offensive Imagery NSFW
Illustration 239454609 © Hollyharryoz | Dreamstime.com
Meta recently unloaded a bevy of features onto its close to four billion monthly active users, including the ability to generate any stickers they wished using generative artificial intelligence on Facebook Messenger. Sounds fun and wholesome. What could go wrong?
As it turns out, everything. In less than a week, the tool has become arguably the most unhinged AI art generator the community has seen yet, despite it currently being limited to a handful of users. With their newfound unfettered powers, people are leaning into the repressed sides of their imagination and cooking up pop-culture characters with weapons and in suggestive settings.
ya the new facebook AI stickers feature is crazy pic.twitter.com/ieHrULzjJE
— SUNSHINE REVIVAL (@SeanMombo) October 4, 2023
With the new feature, users can conjure up chat stickers using simple text prompts, and then use them somewhat like emojis in Facebook Messenger and Instagram Messenger. The update is trained on Meta’s Llama 2 language model and Emu image generation system, and it’s apparently built with guardrails to weed out unwanted and offensive output.
Still, obscene imagery and artwork with violent insinuations abound, among which are depictions of copyright-protected characters like Waluigi wielding a rifle and Mickey Mouse and Elmo brandishing knives.
found out that facebook messenger has ai generated stickers now and I don't think anyone involved has thought anything through pic.twitter.com/co987cRhyu
— defend trans rights🏳️⚧️ - podesbiens.bsky.social (@Pioldes) October 3, 2023
Other graphics include Justin Trudeau mooning his beholder, and “Karl Marx with large breasts.” Some stickers are too lewd to share here.
facebook shipping AI stickers to 1,000,000,000 MAUs is the type of bravado other incumbents wish they had pic.twitter.com/qWHWH3QtD7
— near (@nearcyan) October 5, 2023
While Meta has yet to make a comment about the inadvertently deranged feature, it noted during the launch of AI-generated stickers that the ability would soon be available on WhatsApp too. Hopefully, the busty Super Mario Bros and naked Donald Trumps don’t find their way there.
This is going right in the syllabus for the module on AI & copyright https://t.co/lSDaYDXSQK
— John Horton (@johnjhorton) October 4, 2023
[via Dexerto and Ars Technica, images via various sources]
