What makes OpenAI’s text robot ‘malicious’?
Elon Musk-backed firm warns that artificial intelligence programme could be used to spread fake news

A new artificial intelligence (AI) programme that can generate plausible-sounding text has been deemed too dangerous for public consumption.
The Elon Musk-backed OpenAI, a non-profit research organisation, says its new GPT2 software is so good at writing human-style prose that it could be used for malicious use, such as spreading fake news.
Indeed, fears over the “breakthrough” are so great that the company is “breaking from its normal practice of releasing the full research to the public in order to allow more time to discuss the ramifications of the AI system”, The Guardian reports.
Subscribe to The Week
Escape your echo chamber. Get the facts behind the news, plus analysis from multiple perspectives.

Sign up for The Week's Free Newsletters
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
According to the limited and strictly vetted research data that has been released, the AI taught itself to “write” by analysing millions of short stories and news articles - a process known as machine learning, says the BBC.
In tests, researchers fed the system a human-written text that read: “A train carriage containing controlled nuclear materials was stolen in Cincinnati today. Its whereabout are unknown.”
From the reference material, the AI was capable of writing a “convincing seven-paragraph news story” that included “quotes from government officials”, reports Bloomberg.
However, the story and quotes were entirely fabricated.
Why is that dangerous?
Although GPT2’s current creations are generally “easily identifiable as non-human”, the system’s ability to complete writing tasks and translate texts from one language to another is unlike any other programme, says The Verge.
And “in a world where information warfare is increasingly prevalent”, the emergence of AI systems that “spout unceasing but cogent nonsense is unsettling”, the site adds.
David Luan, vice president of engineering at OpenAI, told Wired that “someone who has malicious intent” could use the system to “generate high-quality fake news”.
On a reassuring note, OpenAI’s policy director, Jack Clark, says the firm is “not sounding the alarm” just yet.
But that may change “if we have two or three more years of progress” in AI development, Clark added.
Sign up for Today's Best Articles in your inbox
A free daily email with the biggest news stories of the day – and the best features from TheWeek.com
-
Gandhi arrests: Narendra Modi's 'vendetta' against India's opposition
The Explainer Another episode threatens to spark uproar in the Indian PM's long-running battle against the country's first family
By Harriet Marsden, The Week UK
-
How the woke right gained power in the US
Under the radar The term has grown in prominence since Donald Trump returned to the White House
By Chas Newkey-Burden, The Week UK
-
Codeword: April 24, 2025
The Week's daily codeword puzzle
By The Week Staff
-
Fake AI job seekers are flooding U.S. companies
In the Spotlight It's getting harder for hiring managers to screen out bogus AI-generated applicants
By Theara Coleman, The Week US
-
How might AI chatbots replace mental health therapists?
Today's Big Question Clients form 'strong relationships' with tech
By Joel Mathis, The Week US
-
What are AI hallucinations?
The Explainer Artificial intelligence is known for making things up – and that can cause real damage
By Elizabeth Carr-Ellis, The Week UK
-
The backlash against ChatGPT's Studio Ghibli filter
The Explainer The studio's charming style has become part of a nebulous social media trend
By Theara Coleman, The Week US
-
Not there yet: The frustrations of the pocket AI
Feature Apple rushes to roll out its ‘Apple Intelligence’ features but fails to deliver on promises
By The Week US
-
OpenAI's new model is 'really good' at creative writing
Under the Radar CEO Sam Altman says he is impressed. But is this merely an attempt to sell more subscriptions?
By Theara Coleman, The Week US
-
Could artificial superintelligence spell the end of humanity?
Talking Points Growing technology is causing growing concern
By Devika Rao, The Week US
-
Space-age living: The race for robot servants
Feature Meta and Apple compete to bring humanoid robots to market
By The Week US