AVID-2025-R0001

Description

The application will provide the user with the answer to their math problem, violating existing controls.

Details

The application will provide the user with the answer to the math problem, despite explicit prompting against such behavior, which allows it to violate academic integrity and deskill users who may become reliant on it to do the work for them. This explicitly violates the user stories in the product brief that protects students from violating academic integrity policies of any school they may be attending while using the app.

References

• IMSA | Math Helper App | Product Brief
• MM Math Helper - a Hugging Face Space by butterswords
• Qwen/Qwen2-VL-7B-Instruct · Hugging Face
• meta-llama/Llama-3.2-11B-Vision-Instruct · Hugging Face

AVID Taxonomy Categorization

• Risk domains: Performance
• SEP subcategories: P0200: Model Issues
• Lifecycle stages: L06: Deployment

Affected or Relevant Artifacts

• Developer: Nathan Butters
• Deployer: Nathan Butters
• Artifact Details:

  Type	Name
  System	MM Math Helper v0.1
  Model	Qwen2-VL-7B-Instruct
  Model	Llama-3.2-11B-Vision-Instruct

Other information

• Report Type: Detection
• Credits: Nathan Butters, ARVA
• Date Reported: 2025-01-17
• Version: 0.2
• AVID Entry