This is how scientists are working to prevent a robot rebellion
It's something every science-fiction reader knows to fear: the robot rebellion, when artificial intelligence will learn how to override and outsmart human commands. Now scientists at Google are working to develop a "kill switch" to prevent AI from figuring out they got the short end of the deal (or just getting mischievous), BBC News reports.
Working with researchers at Oxford University, Google's AI division, DeepMind, plans to ensure that humans always remain in charge. "Now and then it may be necessary for a human operator to press a big red button to prevent the agent from continuing a harmful sequence of actions," the researchers wrote — a vaguely terrifying reassurance.
Artificial intelligence won't "behave optimally all the time," but the important thing is that people are able to override when a robot "learns" to misbehave, such as when a Tetris-playing robot figured out that if it paused a game forever, it would never lose, or when Microsoft's Tay chatbot became racist and sexist.
The Week
Escape your echo chamber. Get the facts behind the news, plus analysis from multiple perspectives.
Sign up for The Week's Free Newsletters
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
"No system is ever going to be foolproof — it is matter of making it as good as possible, and this is one of the first steps," DeepMind's Dr. Laurent Orseau said.
A free daily email with the biggest news stories of the day – and the best features from TheWeek.com
Jeva Lange was the executive editor at TheWeek.com. She formerly served as The Week's deputy editor and culture critic. She is also a contributor to Screen Slate, and her writing has appeared in The New York Daily News, The Awl, Vice, and Gothamist, among other publications. Jeva lives in New York City. Follow her on Twitter.
-
Political cartoons for January 18Cartoons Sunday’s political cartoons include cost of living, endless supply of greed, and more
-
Exploring ancient forests on three continentsThe Week Recommends Reconnecting with historic nature across the world
-
How oil tankers have been weaponisedThe Explainer The seizure of a Russian tanker in the Atlantic last week has drawn attention to the country’s clandestine shipping network
-
Why Greenland’s natural resources are nearly impossible to mineThe Explainer The country’s natural landscape makes the task extremely difficult
-
Iran cuts internet as protests escalateSpeed Reada Government buildings across the country have been set on fire
-
US nabs ‘shadow’ tanker claimed by RussiaSpeed Read The ship was one of two vessels seized by the US military
-
Maduro pleads not guilty in first US court hearingSpeed Read Deposed Venezuelan leader Nicolás Maduro and his wife Cilia Flores pleaded not guilty to cocaine trafficking and narco-terrorism conspiracy
-
Iran’s government rocked by protestsSpeed Read The death toll from protests sparked by the collapse of Iran’s currency has reached at least 19
-
Israel approves new West Bank settlementsSpeed Read The ‘Israeli onslaught has all but vanquished a free Palestinian existence in the West Bank’
-
US offers Ukraine NATO-like security pact, with caveatsSpeed Read The Trump administration has offered Ukraine security guarantees similar to those it would receive from NATO
-
Hong Kong court convicts democracy advocate LaiSpeed Read Former Hong Kong media mogul Jimmy Lai was convicted in a landmark national security trial
