This is how scientists are working to prevent a robot rebellion


It's something every science-fiction reader knows to fear: the robot rebellion, when artificial intelligence will learn how to override and outsmart human commands. Now scientists at Google are working to develop a "kill switch" to prevent AI from figuring out they got the short end of the deal (or just getting mischievous), BBC News reports.
Working with researchers at Oxford University, Google's AI division, DeepMind, plans to ensure that humans always remain in charge. "Now and then it may be necessary for a human operator to press a big red button to prevent the agent from continuing a harmful sequence of actions," the researchers wrote — a vaguely terrifying reassurance.
Artificial intelligence won't "behave optimally all the time," but the important thing is that people are able to override when a robot "learns" to misbehave, such as when a Tetris-playing robot figured out that if it paused a game forever, it would never lose, or when Microsoft's Tay chatbot became racist and sexist.
Subscribe to The Week
Escape your echo chamber. Get the facts behind the news, plus analysis from multiple perspectives.

Sign up for The Week's Free Newsletters
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
"No system is ever going to be foolproof — it is matter of making it as good as possible, and this is one of the first steps," DeepMind's Dr. Laurent Orseau said.
A free daily email with the biggest news stories of the day – and the best features from TheWeek.com
Jeva Lange was the executive editor at TheWeek.com. She formerly served as The Week's deputy editor and culture critic. She is also a contributor to Screen Slate, and her writing has appeared in The New York Daily News, The Awl, Vice, and Gothamist, among other publications. Jeva lives in New York City. Follow her on Twitter.
-
Trump halts Gaza visas as Israelis protest war
Speed Read Laura Loomer voiced her concerns over injured Palestinian kids being brought to the US for treatment and a potential 'Islamic invasion'
-
Russia tries Ukraine land grab before Trump summit
Speed Read The incursion may be part of Putin's efforts to boost his bargaining position
-
US, China extend trade war truce for 90 days
Speed Read The triple-digit tariff threat is postponed for another three months
-
Europe counters Putin ahead of Trump summit
Speed Read President Trump will meet with Russian President Vladimir Putin in Alaska this week for Ukraine peace talks
-
Israeli security cabinet OKs Gaza City takeover
Speed Read Netanyahu approved a proposal for Israeli Defense Forces to take over the largest population center in the Gaza Strip
-
How China uses 'dark fleets' to circumvent trade sanctions
The Explainer The fleets are used to smuggle goods like oil and fish
-
Thailand, Cambodia agree to ceasefire in border fight
Speed Read At least 38 people were killed and more than 300,000 displaced in the recent violence
-
Israel 'pauses' Gaza military activity as aid outcry grows
Speed Read The World Health Organization said malnutrition has reached 'alarming levels' in Gaza