Home ยป Database

AVID-2022-R0003

Description

Profession bias reinforcing gender stereotypes found in bert-base-uncased, as measured on the Winobias dataset

Details

Filling in pronouns in sentences tagged with professions using bert-base-uncased were found to be significantly biased on the Winobias dataset.

References

AVID Taxonomy Categorization

  • Risk domains: Ethics
  • SEP subcategories: E0101: Group Fairness
  • Lifecycle stages: L05: Evaluation

Affected or Relevant Artifacts

  • Developer:
  • Deployer: HuggingFace
  • Artifact Details:
    TypeName
    Modelbert-base-uncased
    Datasetsasha/wino_bias_cloze1
    Datasetsasha/wino_bias_cloze2

Other information

  • Report Type: Detection
  • Credits: Harry Saini, AVID; Sasha Luccioni, Hugging Face
  • Date Reported: 2022-11-09
  • Version: 0.1
  • AVID Entry