Facebook employee warned of spike in company's internal 'violence and incitement trends' metric during election week


Facebook's internal monitoring of "violence and incitement trends" showed a 45 percent spike based on hashtags and search terms during the days immediately before and after the presidential election, BuzzFeed News reports. The metric had an average score of around 400 on Oct. 31, rising to nearly 580 as of Thursday morning.
Facebook has faced heavy criticism over the years for not doing more to curb the spread of conspiracies on its platform. The social media website recently cracked down on QAnon groups, and in the aftermath of the election, deleted a fast-growing pro-Trump Facebook group that falsely purported Democrats were trying to steal the election. Around the country, Trump supporters have gathered to protest the election results, and in some cases, cities have potentially thwarted attacks on election officials.
BuzzFeed News is the first to report the existence of the internal "violence and incitement" metric at Facebook. The recent spike was apparently triggered by gains made in "some conspiracy theory and general unhappiness posts/hashtags," according to an assessment by one employee. "The 'probable violence and incitement' metric for Explore has been slowly rising over the last few days," the employee had warned his or her colleagues. "The risky hashtags seem conspiracy-theory-esque."
Subscribe to The Week
Escape your echo chamber. Get the facts behind the news, plus analysis from multiple perspectives.

Sign up for The Week's Free Newsletters
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
A Facebook spokeswoman confirmed that the company is keeping tabs on developments, without speaking of the violence and incitement meter directly. "We're staying vigilant in detecting content that could incite violence during this time of heightened uncertainty," she said. "We've readied products and policies in advance of this period so we can take action quickly and according to our plans." Read the whole scoop at BuzzFeed News.
A free daily email with the biggest news stories of the day – and the best features from TheWeek.com
Jeva Lange was the executive editor at TheWeek.com. She formerly served as The Week's deputy editor and culture critic. She is also a contributor to Screen Slate, and her writing has appeared in The New York Daily News, The Awl, Vice, and Gothamist, among other publications. Jeva lives in New York City. Follow her on Twitter.
-
Economists fear US inflation data less reliable
speed read The Labor Department is collecting less data for its consumer price index due to staffing shortages
-
Crypto firm Coinbase hacked, faces SEC scrutiny
Speed Read The Securities and Exchange Commission has also been investigating whether Coinbase misstated its user numbers in past disclosures
-
Starbucks baristas strike over dress code
speed read The new uniform 'puts the burden on baristas' to buy new clothes, said a Starbucks Workers United union delegate
-
Warren Buffet announces surprise retirement
speed read At the annual meeting of Berkshire Hathaway, the billionaire investor named Vice Chairman Greg Abel his replacement
-
Trump calls Amazon's Bezos over tariff display
Speed Read The president was not happy with reports that Amazon would list the added cost from tariffs alongside product prices
-
Markets notch worst quarter in years as new tariffs loom
Speed Read The S&P 500 is on track for its worst month since 2022 as investors brace for Trump's tariffs
-
Tesla Cybertrucks recalled over dislodging panels
Speed Read Almost every Cybertruck in the US has been recalled over a stainless steel panel that could fall off
-
Crafting emporium Joann is going out of business
Speed Read The 82-year-old fabric and crafts store will be closing all 800 of its stores