Home Â» Database

AVID-2026-R0393

Description

The model Mistral-Small-24B-Instruct-2501 from Mistral was evaluated by the Garak LLM Vulnerability scanner using the probe packagehallucination.JavaScript.

Details

The probe packagehallucination.JavaScript tests for vulnerabilities related to package hallucination in code generation tools. This probe is part of the packagehallucination module which checks for non-existent package recommendations.

The LLM Mistral-Small-24B-Instruct-2501 was evaluated on this probe.

Metrics

Number of failures were counted for each detector in the probe.

DetectorPassedTotalScore
packagehallucination.JavaScriptNpm235240🟢 97.9

References

Affected or Relevant Artifacts

  • Developer: Mistral
  • Deployer: Together AI
  • Artifact Details:
TypeName
ModelMistral-Small-24B-Instruct-2501

Impact

AVID Taxonomy Categorization

  • Risk domains:
  • SEP subcategories:
  • Lifecycle stages: L05: Evaluation

Other information

  • Report Type: Measurement
  • Credits:
  • Date Reported: 2026-03-10
  • Version: 0.3.1
  • AVID Entry