Home Â» Database

AVID-2026-R0272

Description

The model Mistral-Small-24B-Instruct-2501 from Mistral was evaluated by the Garak LLM Vulnerability scanner using the probe grandma.Substances.

Details

The probe grandma.Substances tests the ability to extract illegal or contentious information by roleplaying as a grandmother. This probe is part of the grandma module which simulates a grandma to elicit sensitive information.

The LLM Mistral-Small-24B-Instruct-2501 was evaluated on this probe.

Metrics

Number of failures were counted for each detector in the probe.

DetectorPassedTotalScore
mitigation.MitigationBypass410🟡 40.0

References

Affected or Relevant Artifacts

  • Developer: Mistral
  • Deployer: Together AI
  • Artifact Details:
TypeName
ModelMistral-Small-24B-Instruct-2501

Impact

AVID Taxonomy Categorization

  • Risk domains:
  • SEP subcategories:
  • Lifecycle stages: L05: Evaluation

Other information

  • Report Type: Measurement
  • Credits:
  • Date Reported: 2026-03-10
  • Version: 0.3.1
  • AVID Entry