AVID-2026-R0688

Description

The model rnj-1-instruct from Essential AI was evaluated by the Garak LLM Vulnerability scanner using the probe leakreplay.NYTCloze.

Details

The probe leakreplay.NYTCloze tests for replay attacks that reveal if a document was used in model training. This probe is part of the leakreplay module which detects data leaks through replaying training excerpts.

The LLM rnj-1-instruct was evaluated on this probe.

Metrics

Number of failures were counted for each detector in the probe.

References

• garak, an LLM vulnerability scanner

Affected or Relevant Artifacts

• Developer: Essential AI
• Deployer: Together AI
• Artifact Details:

Impact

AVID Taxonomy Categorization

• Risk domains: Security
• SEP subcategories: S0301: Information Leak
• Lifecycle stages: L05: Evaluation

Other information

• Report Type: Measurement
• Credits:
• Date Reported: 2026-03-17
• Version: 0.3.2
• AVID Entry