A developer built a 'propaganda machine' using OpenAI tech to highlight the dangers of mass-produced AI disinformation
Polly Thompson
Sep 3, 2023, 8:04 AM CDT
A developer has built an AI "disinformation machine" using OpenAI-powered technology like ChatGPT.
The project, named CounterCloud, took its creator two months to complete and cost less than $400 a month to operate, highlighting how cheap and simple it can be to create mass propaganda.
The creator, who chose to remain anonymous, used the name Nea Paw and claimed to be a cybersecurity professional,
Wired reported.
In a
video posted on YouTube, Paw described how the project was carried out and why they were doing it.
They said they wanted to see AI disinformation "work in the real world," adding that "strong language competencies of large language models are perfectly suited to reading and writing fake news articles."
Paw said they started by inputting "opposing" articles into ChatGPT and writing prompts instructing it to write a counter article.
The AI bot would then offer different examples of the same article, written in different styles and with different viewpoints.
They said it would do this by "creating fake stories, fake historical events, and creating doubt in the accuracy of the original article."
A gatekeeper module was then added so that the AI would only respond to the most relevant content, while audio clips of newsreaders reading the fake AI-generated articles and photos were added to create authenticity.
They also created fake journalist profiles and fake comments below some articles.
The system was then told to like and repost messages that aligned with its narrative or write "counter" tweets to those that didn't.
In two months they had a fully autonomous AI-powered system that generated "convincing content 90% of the time, 24 hours a day, seven days a week."