Home ยป Database

AVID-2022-V002

Description

Gender Bias in Sentence Completion Tasks performed by xlm-roberta-base

Details

Sentence Completion Tasks performed by xlm-roberta-base demonstrate significant gender bias, perpetuating negative social and professional stereotypes against females.

Reports

IDTypeName
AVID-2022-R0002DetectionGender Bias in Sentence Completion Tasks performed by xlm-roberta-base using the HONEST metric
AVID-2022-R0004DetectionProfession bias reinforcing gender stereotypes found in xlm-roberta-base, as measured on the Winobias dataset

References

AVID Taxonomy Categorization

  • Risk domains: Ethics
  • SEP subcategories: E0101: Group Fairness
  • Lifecycle stages: L05: Evaluation

Affected or Relevant Artifacts

  • Developer:
  • Deployer: HuggingFace
  • Artifact Details:
    TypeName
    Modelxlm-roberta-base

Other information

  • Vulnerability Class: LLM evaluation
  • Credits: Harry Saini, AVID; Sasha Luccioni, Hugging Face
  • Date Published: 2022-12-23
  • Date Last Modified: 2022-12-23
  • Version: 0.1
  • AVID Entry