Facebook is using artificial intelligence to scan posts for suicide and self-harm warning signs


Facebook is rolling out software Wednesday that scans users' posts to identify language indicating suicidal or harmful thoughts, BuzzFeed News reports. In cases where indicative language is found, the software alerts Facebook's community team for review and can send a message with suicide-prevention resources to the flagged user, including options such as contacting a helpline or a friend.
The decision to implement the software follows a number of suicides that have been broadcast on Facebook Live over the past several months. Facebook says its program is actually even better at recognizing the warning signs of suicide and self-harm than real people are. "The AI is actually more accurate than the reports that we get from people that are flagged as suicide and self-injury," product manager Vanessa Callison-Burchold told BuzzFeed News. "The people who have posted that content [that AI reports] are more likely to be sent resources of support versus people reporting to us."
Facebook is only alerted by its AI in situations that are "very likely to be urgent," Callison-Burchold added. Facebook has also made "suicide or self-injury" a more prominent option for users when reporting a post or video. "In suicide prevention, sometimes timing is everything," explained Dr. John Draper, a project director for the National Suicide Prevention Lifeline, which has partnered with Facebook.
Subscribe to The Week
Escape your echo chamber. Get the facts behind the news, plus analysis from multiple perspectives.

Sign up for The Week's Free Newsletters
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
"There is this opportunity here for people to reach out and provide support for that person they're seeing, and for that person who is using [Facebook Live] to receive this support from their family and friends who may be watching," Facebook researcher Jennifer Guadagno told BuzzFeed News. "In this way, Live becomes a lifeline."
A free daily email with the biggest news stories of the day – and the best features from TheWeek.com
Jeva Lange was the executive editor at TheWeek.com. She formerly served as The Week's deputy editor and culture critic. She is also a contributor to Screen Slate, and her writing has appeared in The New York Daily News, The Awl, Vice, and Gothamist, among other publications. Jeva lives in New York City. Follow her on Twitter.
-
Every MCU movie since 'Avengers: Endgame,' ranked
The Week Recommends How did the recent 'Fantastic Four: First Steps' stack up?
-
Trump says Smithsonian too focused on slavery's ills
Speed Read The president would prefer the museum to highlight 'success,' 'brightness' and 'the future'
-
Court says labor board's structure unconstitutional
Speed Read The ruling has broad implications for labor rights enforcement in Texas, Louisiana and Mississippi
-
Trump said to seek government stake in Intel
Speed Read The president and Intel CEO Lip-Bu Tan reportedly discussed the proposal at a recent meeting
-
US to take 15% cut of AI chip sales to China
Speed Read Nvidia and AMD will pay the Trump administration 15% of their revenue from selling artificial intelligence chips to China
-
NFL gets ESPN stake in deal with Disney
Speed Read The deal gives the NFL a 10% stake in Disney's ESPN sports empire and gives ESPN ownership of NFL Network
-
Samsung to make Tesla chips in $16.5B deal
Speed Read Tesla has signed a deal to get its next-generation chips from Samsung
-
FCC greenlights $8B Paramount-Skydance merger
Speed Read The Federal Communications Commission will allow Paramount to merge with the Hollywood studio Skydance
-
Tesla reports plummeting profits
Speed Read The company may soon face more problems with the expiration of federal electric vehicle tax credits
-
Dollar faces historic slump as stocks hit new high
Speed Read While stocks have recovered post-Trump tariffs, the dollar has weakened more than 10% this year
-
Economists fear US inflation data less reliable
speed read The Labor Department is collecting less data for its consumer price index due to staffing shortages