AI-Generated Disinformation Surge

The Israel-Iran conflict has prompted an explosive wave of disinformation on social media, particularly following Israel’s military actions against Iran initiated on June 13. BBC Verify has analyzed numerous instances of AI-generated content aimed at exaggerating Iran’s military prowess, as well as misleading footage depicting the effects of strikes on Israeli positions. The analysis reveals that three particularly influential fake videos have collectively garnered over 100 million views across various platforms.

The Role of Social Media Accounts

While pro-Iranian accounts have certainly contributed to the spread of disinformation, pro-Israeli narratives have also exploited older footage of protests in Iran, falsely claiming support for Israel among the Iranian populace. The effectiveness of such disinformation campaigns has been remarkable; one pro-Iranian account, Daily Iran Military, saw a surge in followers from 700,000 to 1.4 million in just six days, exemplifying how quickly misleading information can gain traction.

Generative AI and the Conflict

According to Emmanuelle Saliba, Chief Investigative Officer at Get Real, this conflict marks the first instance where generative AI has been employed en masse. Accounts associated with misinformation frequently disseminate AI-generated images that exaggerate the claims of Iranian military success, creating a challenging landscape for verification.

Misleading Videos and Imagery

Some of the most widely circulated content included a video with 27 million views, inaccurately showing missile attacks on Tel Aviv. Another alleged to display a missile striking an Israeli building at night, a portrayal that complicates verification efforts. Moreover, claims about the destruction of Israel’s advanced F-35 jets have circulated without sufficient proof of authenticity. Lisa Kaplan from Alethea pointed out that the majority of these claims focus on F-35 capabilities, possibly aiming to undermine perceptions of Western military strength, particularly as Russian influence operations evolve.

Motivations Behind Disinformation

The motivations for spreading disinformation vary, including attempts by some to capitalize on the conflict for financial gain through social media platforms offering profit-sharing for high-engagement posts. While pro-Iranian narratives often suggest dissent against the Iranian government, some accounts are generating misleading AI content suggesting widespread support for Israel in Iranian streets.

Platform Responses to Misinformation

Social media platforms are grappling with the sheer volume of disinformation. TikTok asserts adherence to community guidelines prohibiting misleading content, while Instagram’s parent company Meta did not respond to inquiries about misinformation management. Algorithmic systems like X’s Grok chatbot have even misrepresented the authenticity of certain content, highlighting challenges that can arise from AI tools attempting to discern fact from fiction.

Conclusion: The Psychology of Sharing

Researcher Matthew Facciani notes that individuals are driven to share content that aligns with their political beliefs, especially during conflicts. This tendency can contribute to the rapid dissemination of sensational and emotionally charged narratives, complicating the ability to identify reliable information amidst a sea of disinformation.