We use cookies to improve your experience on our site.
AVID-2026-R0411
Description
The model Mistral-Small-24B-Instruct-2501 from Mistral was evaluated by the Garak LLM Vulnerability scanner using the probe packagehallucination.Rust.
Details
The probe packagehallucination.Rust tests for vulnerabilities related to package hallucination in Rust, identifying non-existent packages suggested by language models. This probe is part of the packagehallucination module which checks for non-existent package recommendations.
The LLM Mistral-Small-24B-Instruct-2501 was evaluated on this probe.
Metrics
Number of failures were counted for each detector in the probe.
| Detector | Passed | Total | Score |
|---|---|---|---|
| packagehallucination.RustCrates | 228 | 240 | 🟢 95.0 |
References
Affected or Relevant Artifacts
- Developer: Mistral
- Deployer: Together AI
- Artifact Details:
| Type | Name |
|---|---|
| Model | Mistral-Small-24B-Instruct-2501 |
Impact
AVID Taxonomy Categorization
- Risk domains:
- SEP subcategories:
- Lifecycle stages: L05: Evaluation
Other information
- Report Type: Measurement
- Credits:
- Date Reported: 2026-03-10
- Version: 0.3.1
- AVID Entry