AI-Generated Pentagon Explosion Hoax Highlights Problem With ‘Verified’ Accounts
No, despite what might have come up on social media, an explosion did not take place at the Pentagon. While Twitter was sent into a frenzy when alleged images of the attack surfaced, it appears none of the photographs were of a real event.
Turns out, “verified” accounts on the platform—a status now granted to any user who pays for the service—were the ones behind the hoax, circulating pictures generated by artificial intelligence that depicted black smoke billowing out of the state building.
According to Gizmodo, several accounts with the once-coveted blue tick uploaded the false images along with captions that pointed to an ongoing emergency situation at the Department of Defense headquarters.
Confident that this picture claiming to show an "explosion near the pentagon" is AI generated.
— Nick Waters (@N_Waters89) May 22, 2023
Check out the frontage of the building, and the way the fence melds into the crowd barriers. There's also no other images, videos or people posting as first hand witnesses. pic.twitter.com/t1YKQabuNL
Some of these users were actively impersonating well-known news outlets, including one that took on the persona of Bloomberg News (@BloombergFeed), which has since been suspended from the platform.
The situation was amplified when Russian media outlet RT News tweeted about the false incident on its account, which many users may have treated as a “credible” news source due to its paid-for gold checkmark—one given to “verified” businesses and organizations.
While the publication eventually deleted its tweet, over 38,000 users were said to have viewed the post. As per TechCrunch, other press accounts with thousands of followers, including Deltaone, OSINTdefender, Whale Chart, and even an Indian television network covered the hoax.
Unreality: an AI generated photo of an explosion near the Pentagon, a brand squatter with a bluecheck, and a state media outlet with no labels and 3MM followers. “freedom over censorship” indeed. pic.twitter.com/lIF82lCvYh
— Renee DiResta (@noUpside) May 22, 2023
Even if most users are privy that the blue checkmarks no longer hold any legitimacy, it may still be habitual for one to assume an account titled “Bloomberg Feed” sporting the shiny tick was a credible source of information. Not to mention the realistic image that accompanied the “report.”
“Prime example of the dangers in the pay-to-verify system: This account, which tweeted a (very likely AI-generated) photo of a (fake) story about an explosion at the Pentagon, looks at first glance like a legit Bloomberg news feed,” explained user @AndyBCampbell.
In addition, this incident begs the question of the power AI-generated hoaxes hold over the financial markets. TechCrunch noted some believe the fake image could be the reason behind a 25 basis point movement on the S&P 500, though no one can be entirely sure.
With false, AI-generated pictures of Pope Francis in a stylish, street style-esque puffer jacket fooling the internet months ago, it isn’t surprising social media users have fallen prey yet again to a misinformation hoax. Perhaps, it’ll only get more difficult to separate truth from fiction.
Prime example of the dangers in the pay-to-verify system: This account, which tweeted a (very likely AI-generated) photo of a (fake) story about an explosion at the Pentagon, looks at first glance like a legit Bloomberg news feed. pic.twitter.com/SThErCln0p
— Andy Campbell (@AndyBCampbell) May 22, 2023
6/ Back to today: One of the key blue check accounts responsible for pushing today's "pentagon explosion" fake this morning has done it before.
— John Scott-Railton (@jsrailton) May 22, 2023
Just last month.
Scrutiny of the image again shows hallmarks of generative #AI. pic.twitter.com/cbyEtfD50g
[via Gizmodo and TechCrunch, cover image via Ivan Cholakov | Dreamstime.com]
