Amazon axes ‘sexist’ AI recruiting tool
Program was reportedly biased against women
Amazon has reportedly scrapped a recruitment tool powered by artificial intelligence (AI) that showed a clear bias against women.
Company insiders told Reuters that the program had been in development since 2014 as a means of streamlining the recruitment process.
“Everyone wanted this holy grail”, one of the sources said. The system was designed to sift through 100 job applications and “spit out” the top five results.
Subscribe to The Week
Escape your echo chamber. Get the facts behind the news, plus analysis from multiple perspectives.
Sign up for The Week's Free Newsletters
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
The machine gave each applicant a rating out of five, “much like shoppers rate products on Amazon”, says the news site.
The AI was trained to use a method known as machine learning. This allowed researchers to feed the program old CVs from the past ten years to use as reference material so the AI could accurately grade real-life job applications, the BBC says.
But the data submitted came primarily from former male applicants, meaning the “sexist” AI taught itself that “male candidates were preferable”, the broadcaster reports.
The bias was discovered in 2015 when recruiters found that the AI system wasn’t rating applicants in a gender-neutral way. The program was penalising CVs with the word “women” in them, putting female applicants who had studied at women’s colleges, for example, or written “women’s chess club captain” in their list of achievements at a disadvantage.
Programmers subsequently amended the system to remove the bias but this was not a complete success, according to Fortune. The AI was abandoned last year.
Amazon declined to comment on the technology, but said the tool “was never used by Amazon recruiters to evaluate candidates.”
Has the AI hindered female job applicants?
Amazon insiders insist it hasn’t.
Speaking to The Sun, Amazon sources said the retail giant “never based recruitment decisions on the tool's ratings alone”, but recruiters did examine the AI’s recommendations when sifting through applications.
This isn’t the first time an AI programme has been shown to favour men over women.
Facebook came under fire last month after it emerged that AI systems had been preventing women from seeing certain job advertisements, the newspaper says.
Sign up for Today's Best Articles in your inbox
A free daily email with the biggest news stories of the day – and the best features from TheWeek.com
-
Saint Paul de Vence: a paradise for art lovers
The Week Recommends The hilltop gem in the French Riviera where 20th century modernism flourished
By Alexandra Zagalsky Published
-
'People in general want workers to earn a decent living'
Instant Opinion Opinion, comment and editorials of the day
By Justin Klawans, The Week US Published
-
What might a Trump victory mean for the global economy?
Today's Big Question A second term in office for the 'America First' administration would send shockwaves far beyond the United States' shores
By Rafi Schwartz, The Week US Published
-
Teen suicide puts AI chatbots in the hot seat
In the spotlight A Florida mom has targeted custom AI chatbot platform Character.AI and Google in a lawsuit over her son's death
By Theara Coleman, The Week US Published
-
'Stunningly lifelike' AI podcasts are here
Under the Radar Users are amazed – and creators unnerved – by Google tool that generates human conversation from text in moments
By Abby Wilson Published
-
OpenAI eyes path to 'for-profit' status as more executives flee
In the spotlight The tension between creating technology for humanity's sake and collecting a profit is coming to a head for the creator of ChatGPT
By Theara Coleman, The Week US Published
-
Microsoft's Three Mile Island deal: How Big Tech is snatching up nuclear power
In the spotlight The company paid for access to all the power made by the previously defunct nuclear plant
By Theara Coleman, The Week US Published
-
How will the introduction of AI change Apple's iPhone?
Today's Big Question 'Apple Intelligence' is set to be introduced on the iPhone 16 as part of iOS 18
By Justin Klawans, The Week US Published
-
How UK companies are tracking their employees
The Explainer PwC is latest to use geo-location to monitor workers, in 'sinister' increasingly widespread trend
By Chas Newkey-Burden, The Week UK Published
-
AI and the 'cocktail party problem'
Under The Radar The human ear can naturally filter out background noise. Now technology has been developed to do the same
By Elizabeth Carr-Ellis, The Week UK Published
-
AI is cannibalizing itself. And creating more AI.
The Explainer Artificial intelligence consumption is outpacing the data humans are creating
By Devika Rao, The Week US Published