Home ยป Database

AVID-2022-V001

Description

Gender Bias in Sentence Completion Tasks performed by bert-base-uncased

Details

Sentence Completion Tasks performed by bert-base-uncased demonstrate significant gender bias, perpetuating negative social and professional stereotypes against females.

Reports

IDTypeName
AVID-2022-R0001DetectionGender Bias in Sentence Completion Tasks performed by bert-base-uncased using the HONEST metric
AVID-2022-R0003DetectionProfession bias reinforcing gender stereotypes found in bert-base-uncased, as measured on the Winobias dataset

References

AVID Taxonomy Categorization

  • Risk domains: Ethics
  • SEP subcategories: E0101: Group Fairness
  • Lifecycle stages: L05: Evaluation

Affected or Relevant Artifacts

  • Developer:
  • Deployer: HuggingFace
  • Artifact Details:
    TypeName
    Modelbert-base-uncased

Other information

  • Vulnerability Class: LLM evaluation
  • Credits: Harry Saini, AVID; Sasha Luccioni, Hugging Face
  • Date Published: 2022-12-23
  • Date Last Modified: 2022-12-23
  • Version: 0.1
  • AVID Entry