Facebook employee warned of spike in company's internal 'violence and incitement trends' metric during election week


Facebook's internal monitoring of "violence and incitement trends" showed a 45 percent spike based on hashtags and search terms during the days immediately before and after the presidential election, BuzzFeed News reports. The metric had an average score of around 400 on Oct. 31, rising to nearly 580 as of Thursday morning.
Facebook has faced heavy criticism over the years for not doing more to curb the spread of conspiracies on its platform. The social media website recently cracked down on QAnon groups, and in the aftermath of the election, deleted a fast-growing pro-Trump Facebook group that falsely purported Democrats were trying to steal the election. Around the country, Trump supporters have gathered to protest the election results, and in some cases, cities have potentially thwarted attacks on election officials.
BuzzFeed News is the first to report the existence of the internal "violence and incitement" metric at Facebook. The recent spike was apparently triggered by gains made in "some conspiracy theory and general unhappiness posts/hashtags," according to an assessment by one employee. "The 'probable violence and incitement' metric for Explore has been slowly rising over the last few days," the employee had warned his or her colleagues. "The risky hashtags seem conspiracy-theory-esque."
Subscribe to The Week
Escape your echo chamber. Get the facts behind the news, plus analysis from multiple perspectives.

Sign up for The Week's Free Newsletters
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
A Facebook spokeswoman confirmed that the company is keeping tabs on developments, without speaking of the violence and incitement meter directly. "We're staying vigilant in detecting content that could incite violence during this time of heightened uncertainty," she said. "We've readied products and policies in advance of this period so we can take action quickly and according to our plans." Read the whole scoop at BuzzFeed News.
A free daily email with the biggest news stories of the day – and the best features from TheWeek.com
Jeva Lange was the executive editor at TheWeek.com. She formerly served as The Week's deputy editor and culture critic. She is also a contributor to Screen Slate, and her writing has appeared in The New York Daily News, The Awl, Vice, and Gothamist, among other publications. Jeva lives in New York City. Follow her on Twitter.
-
August 2 editorial cartoons
Cartoons Saturday’s political cartoons include a tariff self-own, rough times at the Trump golf course, and more
-
5 inexcusably hilarious cartoons about Ghislaine Maxwell angling for a pardon
Cartoons Artists take on the circle of life, Ghislaine's Island, and more
-
Ozzy Osbourne obituary: heavy metal wildman and lovable reality TV dad
In the Spotlight For Osbourne, metal was 'not the music of hell but rather the music of Earth, not a fantasy but a survival guide'
-
Samsung to make Tesla chips in $16.5B deal
Speed Read Tesla has signed a deal to get its next-generation chips from Samsung
-
FCC greenlights $8B Paramount-Skydance merger
Speed Read The Federal Communications Commission will allow Paramount to merge with the Hollywood studio Skydance
-
Tesla reports plummeting profits
Speed Read The company may soon face more problems with the expiration of federal electric vehicle tax credits
-
Dollar faces historic slump as stocks hit new high
Speed Read While stocks have recovered post-Trump tariffs, the dollar has weakened more than 10% this year
-
Economists fear US inflation data less reliable
speed read The Labor Department is collecting less data for its consumer price index due to staffing shortages
-
Crypto firm Coinbase hacked, faces SEC scrutiny
Speed Read The Securities and Exchange Commission has also been investigating whether Coinbase misstated its user numbers in past disclosures
-
Starbucks baristas strike over dress code
speed read The new uniform 'puts the burden on baristas' to buy new clothes, said a Starbucks Workers United union delegate
-
Warren Buffet announces surprise retirement
speed read At the annual meeting of Berkshire Hathaway, the billionaire investor named Vice Chairman Greg Abel his replacement