How Instagram is using AI to tackle bullying
Automated systems will flag images and captions that show signs of hurtful content
Instagram is turning to artificial intelligence (AI) to spot signs of bullying in photos and comments.
Due to roll out across the social network within the coming weeks, the algorithm will automatically scan images and captions for content that violates the company’s community guidelines, according to the Daily Mail.
For instance, the AI can “detect if a photo is criticising a person’s appearance or character”, the newspaper says, or if an image “is making a threat to someone’s wellbeing”.
Subscribe to The Week
Escape your echo chamber. Get the facts behind the news, plus analysis from multiple perspectives.
Sign up for The Week's Free Newsletters
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
Once an image is flagged by the algorithm, it is then sent to Instagram’s Community Operations team to be evaluated by a moderator.
The Verge believes this human reviewer could be the key to the AI’s success as automated systems often have difficulty understanding “context and nuance”.
“Automation without oversight is a recipe for disaster,” the site says.
It’s hoped the algorithm will help protect Instagram’s younger users, as they experience the “highest rates of bullying online”, Digital Trends reports.
Adam Mosseri, the company’s new chief executive, said: “Online bullying is complex, and we know we have more work to do to further limit bullying and spread kindness on Instagram.
“We are now using machine learning technology to proactively detect bullying in photos and their captions and send them to our Community Operations team to review,” he said.
“This change will help us identify and remove significantly more bullying - and it’s a crucial next step since many people who experience or observe bullying don’t report it.”
Mosseri has been at the helm of the company for less than two weeks, says tech news site geek.com.
He took over the position of Instagram’s chief executive after company co-founders Kevin Systrom and Mike Krieger resigned from the social network last month.
Create an account with the same email registered to your subscription to unlock access.
Sign up for Today's Best Articles in your inbox
A free daily email with the biggest news stories of the day – and the best features from TheWeek.com
-
How the brain changes during pregnancy
In The Spotlight 'Baby brain' has some scientific basis but not in the way we first thought
By Chas Newkey-Burden, The Week UK Published
-
What 'day one rights' could mean for employees and their bosses
The Explainer Staff set to get protections from day one of a new job
By Marc Shoffman, The Week UK Published
-
What are the options for covering long-term care?
The explainer Nursing homes are expensive, but there are smart ways to start saving
By Becca Stanek, The Week US Published
-
Threads turns one: where does the Twitter rival stand?
In the Spotlight Although Threads is reporting 175 million active monthly users, it has failed to eclipse X as a meaningful cultural force
By Keumars Afifi-Sabet, The Week UK Published
-
The growing dystopian AI influencer economy
In the Spotlight AI-generated digital personas are giving human influencers a run for their money
By Theara Coleman, The Week US Published
-
Social media could come with a warning label
Talking Points Do Facebook and TikTok need the notifications that come on cigarettes?
By Joel Mathis, The Week US Published
-
What happens if TikTok is banned?
Today's Big Question Many are fearful that TikTok's demise could decimate the content creator community
By Justin Klawans, The Week US Published
-
Instagram hopes that blurring nudity in messages will make teens safer
The Explainer The option will be turned on by default for users under 18
By Justin Klawans, The Week US Published
-
How social media is limiting political content
The Explainer Critics say Meta's 'extraordinary move' to have less politics in users' feeds could be 'actively muzzling civic action'
By Chas Newkey-Burden, The Week UK Published
-
Cyberflashing, fake news and the new crimes in the Online Safety Act
The Explainer UK's first conviction demonstrates scope of controversial law that critics describe as a threat to privacy and free speech
By Harriet Marsden, The Week UK Last updated
-
TikTok predicts 'creative bravery' trends for 2024
talking point Will it be a banner year for the platform, or will it isolate its biggest audience?
By Theara Coleman, The Week US Published