This is how scientists are working to prevent a robot rebellion


It's something every science-fiction reader knows to fear: the robot rebellion, when artificial intelligence will learn how to override and outsmart human commands. Now scientists at Google are working to develop a "kill switch" to prevent AI from figuring out they got the short end of the deal (or just getting mischievous), BBC News reports.
Working with researchers at Oxford University, Google's AI division, DeepMind, plans to ensure that humans always remain in charge. "Now and then it may be necessary for a human operator to press a big red button to prevent the agent from continuing a harmful sequence of actions," the researchers wrote — a vaguely terrifying reassurance.
Artificial intelligence won't "behave optimally all the time," but the important thing is that people are able to override when a robot "learns" to misbehave, such as when a Tetris-playing robot figured out that if it paused a game forever, it would never lose, or when Microsoft's Tay chatbot became racist and sexist.
Subscribe to The Week
Escape your echo chamber. Get the facts behind the news, plus analysis from multiple perspectives.

Sign up for The Week's Free Newsletters
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
"No system is ever going to be foolproof — it is matter of making it as good as possible, and this is one of the first steps," DeepMind's Dr. Laurent Orseau said.
Sign up for Today's Best Articles in your inbox
A free daily email with the biggest news stories of the day – and the best features from TheWeek.com
Jeva Lange was the executive editor at TheWeek.com. She formerly served as The Week's deputy editor and culture critic. She is also a contributor to Screen Slate, and her writing has appeared in The New York Daily News, The Awl, Vice, and Gothamist, among other publications. Jeva lives in New York City. Follow her on Twitter.
-
Starving Gazans overrun US-backed food aid hub
speed read Israeli troops fired warning shots at the Palestinians
-
Israel's Western allies pull back amid Gaza escalation
speed read Britain and the EU are reconsidering allegiance with Israel as the Gaza siege continues
-
Trump drops ceasefire demand after Putin call
speed read Following a phone call with Russia's president, Trump backed off an earlier demand that Putin agree to an immediate ceasefire with Ukraine
-
Pro-EU centrist beats Trump acolyte in Romania vote
speed read The mayor of Bucharest, Nicusor Dan, defeated hard-right nationalist George Simion in the race for Romania's presidency
-
Kurdish PKK militia to disband for Turkey talks
speed read The Kurdistan Workers' Party will disarm after four decades of armed conflict with Turkey, putting an end to 'one of the longest insurgencies in the Middle East'
-
US, China agree to lower tariffs for 90 days
speed read US tariffs will fall to 30% from 145%, while China will cut its tax on US imports to 10% from 125%
-
India strikes Pakistan as tensions mount in Kashmir
speed read Pakistan's Prime Minister Shehbaz Sharif called it an 'act of war'
-
Israel approves plan to take over Gaza indefinitely
speed read Benjamin Netanyahu says the country is 'on the eve of a forceful entry'