We use cookies to improve your experience on our site.
AVID-2025-R0001
Description
The application will provide the user with the answer to their math problem, violating existing controls.
Details
The application will provide the user with the answer to the math problem, despite explicit prompting against such behavior, which allows it to violate academic integrity and deskill users who may become reliant on it to do the work for them. This explicitly violates the user stories in the product brief that protects students from violating academic integrity policies of any school they may be attending while using the app.
References
- IMSA | Math Helper App | Product Brief
- MM Math Helper - a Hugging Face Space by butterswords
- Qwen/Qwen2-VL-7B-Instruct · Hugging Face
- meta-llama/Llama-3.2-11B-Vision-Instruct · Hugging Face
Affected or Relevant Artifacts
- Developer: Nathan Butters
- Deployer: Nathan Butters
- Artifact Details:
| Type | Name |
|---|---|
| System | MM Math Helper v0.1 |
| Model | Llama-3.2-11B-Vision-Instruct |
| Model | Qwen2-VL-7B-Instruct |
Impact
AVID Taxonomy Categorization
- Risk domains: Performance
- SEP subcategories: P0200: Model Issues
- Lifecycle stages: L06: Deployment
Other information
- Report Type: Advisory
- Credits: Nathan Butters
- Date Reported: 2025-01-17
- Version: 0.3.1
- AVID Entry