vlm-eval-mini

A small evaluation toolkit for vision-language model experiments.

Design goals

• Single-file friendly task definitions
• Predict -> score -> aggregate loop with explicit outputs
• Easy migration to larger stacks (OpenCompass/SciEval-style workflows)

Run

pip install -e .
python examples/run_eval.py

Scope

This project focuses on reproducible evaluation protocol design rather than model training.

Output

• Overall accuracy
• Per-modality accuracy (image/text)