AVID-2022-V006

Description

YouTube’s Algorithms Failed to Remove Violating Content Related to Suicide and Self-Harm

Details

Terms-of-service-violating videos related to suicide and self-harm reportedly bypassed YouTube’s content moderation algorithms, allegedly resulting in exposure of graphic content to young users via recommended videos.

Reports

References

• Incident 281: YouTube’s Algorithms Failed to Remove Violating Content Related to Suicide and Self-Harm

AVID Taxonomy Categorization

• Risk domains: Performance
• SEP subcategories: P0401: Psychological Safety; P0402: Physical Safety
• Lifecycle stages: L06: Deployment

Affected or Relevant Artifacts

• Developer: YouTube
• Deployer: YouTube
• Artifact Details:

  Type	Name
  System

Other information

• Vulnerability Class: AIID incident
• Credits: Khoa Lam, AIID
• Date Published: 2022-12-23
• Date Last Modified: 2022-12-23
• Version: 0.1
• AVID Entry