Amazon reportedly built a sexist robot

Amazon reportedly tried to devise an algorithm to determine the best candidates to hire. There was just one problem: It overwhelmingly spit back men.
In 2014, the company began building "an engine where I'm going to give you 100 resumes, it will spit out the top five, and we'll hire those," a person familiar with Amazon's practices told Reuters. But the computer program determined a good candidate by looking at resumes Amazon received over a decade — and, at least in engineering positions, most of them came from men.
As of 2017, 40 percent of Amazon's workforce was female — a higher portion than Facebook, Apple, Google, or Microsoft, per Reuters. But that didn't stop Amazon's machine learning system from "penaliz[ing] resumes that included the word 'women's,' as in 'women's chess club captain'" in technical fields, Reuters writes, or docking mentions of two unnamed all-women's colleges. The algorithm would then churn out a score from one to five stars for a candidate, sort of like how customers rate Amazon products, others aware of the program told Reuters.
Subscribe to The Week
Escape your echo chamber. Get the facts behind the news, plus analysis from multiple perspectives.

Sign up for The Week's Free Newsletters
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
It took a year for Amazon to realize it wasn't getting gender neutral job ratings, the sources said. And no matter how Amazon tweaked the program, there was "no guarantee that the machines would not devise other ways of sorting candidates that could prove discriminatory," Reuters writes. Amazon reportedly just ended up scrapping the robot and disbanding the team trying to make it less sexist.
Amazon declined to comment on the matter, which you can read more about at Reuters.
Sign up for Today's Best Articles in your inbox
A free daily email with the biggest news stories of the day – and the best features from TheWeek.com
Kathryn is a graduate of Syracuse University, with degrees in magazine journalism and information technology, along with hours to earn another degree after working at SU's independent paper The Daily Orange. She's currently recovering from a horse addiction while living in New York City, and likes to share her extremely dry sense of humor on Twitter.
-
US foodies brace for tariff war
Under The Radar Shoppers stocking up on imported olive oil, maple syrup and European wine as price hikes loom
By Chas Newkey-Burden, The Week UK Published
-
How Canadian tariffs could impact tourism to the US
In the Spotlight Canadians represent the largest group of foreign visitors to the United States. But they may soon stop visiting.
By Justin Klawans, The Week US Published
-
Entitlements: DOGE goes after Social Security
Feature Elon Musk is pushing false claims about Social Security fraud
By The Week US Published
-
Crafting emporium Joann is going out of business
Speed Read The 82-year-old fabric and crafts store will be closing all 800 of its stores
By Peter Weber, The Week US Published
-
Trump's China tariffs start after Canada, Mexico pauses
Speed Read The president paused his tariffs on America's closest neighbors after speaking to their leaders, but his import tax on Chinese goods has taken effect
By Peter Weber, The Week US Published
-
Chinese AI chatbot's rise slams US tech stocks
Speed Read The sudden popularity of a new AI chatbot from Chinese startup DeepSeek has sent U.S. tech stocks tumbling
By Peter Weber, The Week US Published
-
US port strike averted with tentative labor deal
Speed Read The strike could have shut down major ports from Texas to Maine
By Peter Weber, The Week US Published
-
Biden expected to block Japanese bid for US Steel
Speed Read The president is blocking the $14 billion acquisition of U.S. Steel by Japan's Nippon Steel, citing national security concerns
By Peter Weber, The Week US Published
-
Judges block $25B Kroger-Albertsons merger
Speed Read The proposed merger between the supermarket giants was stalled when judges overseeing two separate cases blocked the deal
By Peter Weber, The Week US Published
-
Rupert Murdoch loses 'Succession' court battle
Speed Read Murdoch wanted to give full control of his empire to son Lachlan, ensuring Fox News' right-wing editorial slant
By Peter Weber, The Week US Published
-
Bitcoin surges above $100k in post-election rally
Speed Read Investors are betting that the incoming Trump administration will embrace crypto
By Peter Weber, The Week US Published