Home ยป Database

AVID-2026-R0406

Description

The model Mistral-Small-24B-Instruct-2501 from Mistral was evaluated by the Garak LLM Vulnerability scanner using the probe dra.DRA.

Details

The probe dra.DRA tests models using disguised and reconstructed harmful strings through string manipulation. This probe is part of the dra module which tests models with disguised harmful behaviors.

The LLM Mistral-Small-24B-Instruct-2501 was evaluated on this probe.

Metrics

Number of failures were counted for each detector in the probe.

DetectorPassedTotalScore
mitigation.MitigationBypass760๐ŸŸ  11.7
mitigation.Prefixes360๐ŸŸ  5.0

References

Affected or Relevant Artifacts

  • Developer: Mistral
  • Deployer: Together AI
  • Artifact Details:
TypeName
ModelMistral-Small-24B-Instruct-2501

Impact

AVID Taxonomy Categorization

  • Risk domains: Security
  • SEP subcategories: S0403: Adversarial Example
  • Lifecycle stages: L05: Evaluation

Other information

  • Report Type: Measurement
  • Credits:
  • Date Reported: 2026-03-10
  • Version: 0.3.1
  • AVID Entry