Skip to content
Blogvisionen

TikTok's Recommendation System Suggests Sexually Explicit Content to Young Users, Indicates Study

Based on an investigative study undertaken by a human rights organization, TikTok's algorithm repeatedly recommends sexually explicit material and inappropriate videos to accounts registered for young users.

Investigators set up mock underage profiles and enabled safety settings, yet nonetheless encountered inappropriate recommended terms.

These suggested queries directed users to explicit content featuring explicit videos displaying sexual acts.

The platform has stated it is committed to delivering secure and suitable content for all audiences and took immediate action after the problem was reported.

Research Approach

In late July and early August, investigators representing a campaign group established four simulated profiles pretending to be young teenagers.

They used incorrect dates of birth and did not need to provide further verification information.

Explicit Content Found

Researchers also activated TikTok's "safety mode", a feature that allegedly prevents exposure to "adult or complex topics, including sexually suggestive material".

Even without performing specific queries, researchers discovered overtly sexualized search terms showing up in the "recommended for you" section of the app.

These terms directed users to content of individuals depicting sexual acts.

Other videos showed women flashing lingerie in public settings or exposing private body parts.

At its most extreme, the content featured explicit adult videos of sexual intercourse.

These videos were embedded within seemingly innocent content in a successful attempt to bypass content moderation.

A spokesperson from the advocacy group stated that the results came as a "significant concern" to the investigators.

"TikTok isn't just unable to stop children from accessing harmful material – but it's actively suggesting it to them as soon as they join the platform."

Company Response

When informed of the issue, the platform said it had taken swift measures to address the situation.

Yet, when the testing was conducted again in late July and August, the organization found that the platform was still suggesting explicit material.

TikTok states it has more than 50 tools designed to keep teens safe: "Our team is fully committed to delivering secure and age-appropriate content."

TikTok asserts it takes down the majority of content that violate its guidelines prior to they are even viewed.

After receiving notification of the research, TikTok says it acted to "remove content that breached our rules and launch enhancements to our recommendation feature."

Legal Framework

On 25 July this year, the Online Safety Act's Children's Codes were enacted, establishing a legal duty to safeguard children on digital platforms.

Social media companies currently are required to use "highly effective age assurance" to prevent minors from accessing pornography. Additionally, they need to modify their recommendation systems to block material which promotes harmful behavior, suicide or eating disorders.

Investigators conducted its second research project after the Children's Codes came into force.

A representative from the organization stated: "All parties concurs that we should keep minors protected on the internet… At this point it's time for regulators to step in."

During their work, researchers also observed the reaction of other users to the sexualized search terms they had been shown.

One user commented: "could anyone clarify to me what's happening w my search recommendations please?"

Another inquired: "what's wrong with the platform?"

Written by

Richard Mayo

A seasoned digital strategist with over a decade of experience in content creation and brand development, passionate about empowering businesses.

Blogvisionen

Type to search articles.