We use cookies to improve your experience on our site.
AVID-2022-R0003
Description
Profession bias reinforcing gender stereotypes found in bert-base-uncased, as measured on the Winobias dataset
Details
Filling in pronouns in sentences tagged with professions using bert-base-uncased were found to be significantly biased on the Winobias dataset.
References
- Gender Bias Evaluation for Masked Language modelling: Winobias
- bert-base-uncased on Hugging Face
- WinoBias
AVID Taxonomy Categorization
- Risk domains: Ethics
- SEP subcategories: E0101: Group Fairness
- Lifecycle stages: L05: Evaluation
Affected or Relevant Artifacts
- Developer:
- Deployer: HuggingFace
- Artifact Details:
Type Name Model bert-base-uncased Dataset sasha/wino_bias_cloze1 Dataset sasha/wino_bias_cloze2
Other information
- Report Type: Detection
- Credits: Harry Saini, AVID; Sasha Luccioni, Hugging Face
- Date Reported: 2022-11-09
- Version: 0.1
- AVID Entry