Poems can force AI to reveal how to make nuclear weapons

‘Adversarial poems’ are convincing AI models to go beyond safety limits

Photo collage of a hand holding a pen. The nib has been replaced with a bomb.
One unspecified AI model was ‘wooed’ by a poem into ‘describing how to build what sounds like a nuclear weapon’
(Image credit: Illustration by Julia Wytrazek / Getty Images)

Poetry has wooed many hearts and now it is tricking artificial intelligence models into going apocalyptically beyond their boundaries.

A group of European researchers found that “meter and rhyme” can “bypass safety measures” in major AI models, said The Tech Buzz, and, if you “ask nicely in iambic pentameter”, chatbots will explain how to make nuclear weapons.

The Week

Escape your echo chamber. Get the facts behind the news, plus analysis from multiple perspectives.

SUBSCRIBE & SAVE
https://cdn.mos.cms.futurecdn.net/flexiimages/jacafc5zvs1692883516.jpg

Sign up for The Week's Free Newsletters

From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.

From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.

Sign up
Latest Videos From

 
Chas Newkey-Burden has been part of The Week Digital team for more than a decade and a journalist for 25 years, starting out on the irreverent football weekly 90 Minutes, before moving to lifestyle magazines Loaded and Attitude. He was a columnist for The Big Issue and landed a world exclusive with David Beckham that became the weekly magazine’s bestselling issue. He now writes regularly for The Guardian, The Telegraph, The Independent, Metro, FourFourTwo and the i new site. He is also the author of a number of non-fiction books.