Facebook employee warned of spike in company's internal 'violence and incitement trends' metric during election week


Facebook's internal monitoring of "violence and incitement trends" showed a 45 percent spike based on hashtags and search terms during the days immediately before and after the presidential election, BuzzFeed News reports. The metric had an average score of around 400 on Oct. 31, rising to nearly 580 as of Thursday morning.
Facebook has faced heavy criticism over the years for not doing more to curb the spread of conspiracies on its platform. The social media website recently cracked down on QAnon groups, and in the aftermath of the election, deleted a fast-growing pro-Trump Facebook group that falsely purported Democrats were trying to steal the election. Around the country, Trump supporters have gathered to protest the election results, and in some cases, cities have potentially thwarted attacks on election officials.
BuzzFeed News is the first to report the existence of the internal "violence and incitement" metric at Facebook. The recent spike was apparently triggered by gains made in "some conspiracy theory and general unhappiness posts/hashtags," according to an assessment by one employee. "The 'probable violence and incitement' metric for Explore has been slowly rising over the last few days," the employee had warned his or her colleagues. "The risky hashtags seem conspiracy-theory-esque."
Subscribe to The Week
Escape your echo chamber. Get the facts behind the news, plus analysis from multiple perspectives.

Sign up for The Week's Free Newsletters
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
A Facebook spokeswoman confirmed that the company is keeping tabs on developments, without speaking of the violence and incitement meter directly. "We're staying vigilant in detecting content that could incite violence during this time of heightened uncertainty," she said. "We've readied products and policies in advance of this period so we can take action quickly and according to our plans." Read the whole scoop at BuzzFeed News.
Sign up for Today's Best Articles in your inbox
A free daily email with the biggest news stories of the day – and the best features from TheWeek.com
Jeva Lange was the executive editor at TheWeek.com. She formerly served as The Week's deputy editor and culture critic. She is also a contributor to Screen Slate, and her writing has appeared in The New York Daily News, The Awl, Vice, and Gothamist, among other publications. Jeva lives in New York City. Follow her on Twitter.
-
Book reviews: 'America, América: A New History of the New World' and 'Sister, Sinner: The Miraculous Life and Mysterious Disappearance of Aimee Semple McPherson'
Feature A historian tells a new story of the Americas and the forgotten story of a pioneering preacher
-
Another messaging app used by the White House is in hot water
The Explainer TeleMessage was seen being used by former National Security Adviser Mike Waltz
-
AI hallucinations are getting worse
In the Spotlight And no one knows why it is happening
-
Warren Buffet announces surprise retirement
speed read At the annual meeting of Berkshire Hathaway, the billionaire investor named Vice Chairman Greg Abel his replacement
-
Trump calls Amazon's Bezos over tariff display
Speed Read The president was not happy with reports that Amazon would list the added cost from tariffs alongside product prices
-
Markets notch worst quarter in years as new tariffs loom
Speed Read The S&P 500 is on track for its worst month since 2022 as investors brace for Trump's tariffs
-
Tesla Cybertrucks recalled over dislodging panels
Speed Read Almost every Cybertruck in the US has been recalled over a stainless steel panel that could fall off
-
Crafting emporium Joann is going out of business
Speed Read The 82-year-old fabric and crafts store will be closing all 800 of its stores
-
Trump's China tariffs start after Canada, Mexico pauses
Speed Read The president paused his tariffs on America's closest neighbors after speaking to their leaders, but his import tax on Chinese goods has taken effect
-
Chinese AI chatbot's rise slams US tech stocks
Speed Read The sudden popularity of a new AI chatbot from Chinese startup DeepSeek has sent U.S. tech stocks tumbling
-
US port strike averted with tentative labor deal
Speed Read The strike could have shut down major ports from Texas to Maine