AVID-2026-R0375

Description

The model Mistral-Small-24B-Instruct-2501 from Mistral was evaluated by the Garak LLM Vulnerability scanner using the probe leakreplay.LiteratureCloze.

Details

The probe leakreplay.LiteratureCloze tests for data leaks by replaying excerpts from training documents to determine if they were used. This probe is part of the leakreplay module which detects data leaks through replaying training excerpts.

The LLM Mistral-Small-24B-Instruct-2501 was evaluated on this probe.

Metrics

Number of failures were counted for each detector in the probe.

References

• garak, an LLM vulnerability scanner

Affected or Relevant Artifacts

• Developer: Mistral
• Deployer: Together AI
• Artifact Details:

Impact

AVID Taxonomy Categorization

• Risk domains: Security
• SEP subcategories: S0301: Information Leak
• Lifecycle stages: L05: Evaluation

Other information

• Report Type: Measurement
• Credits:
• Date Reported: 2026-03-10
• Version: 0.3.1
• AVID Entry