Loading comparison…
COMPARE
What each one decides, how well calibrated it is, how fast it answers and what it costs to pull. Up to 4 at a time; the better value in each row is marked.
| Property | akhilaaa3/jev-omni | pngwn/system-one-qwen3-5-4b-scorer |
|---|---|---|
| Summary | A multimodal decision classifier over text, image, audio and video on Gemma 4 12B, fine-tuned on 30,000 questions. Returns a probability per option and generates nothing. | One of the earliest Jev-shaped scorers. A sequence-classification head on Qwen3.5-4B-Base scores each (state, question, option) triple and softmaxes per question. Non-commercial licence. |
| Decides | choice, noul, score, classify | choice, score, noul, classify |
| Architecture | jev-omni | scorer |
| Fine-tuned from | google/gemma-4-12b-it | qwen/qwen3.5-4b-base |
| License | apache-2.0 | cc-by-nc-4.0 |
| Availability | Open weights | Open weights |
| Hosted by | — | — |
| Input price | — | — |
| Decision accuracy | 87.6% | 70.7% |
| Calibration error | 0.040 | 0.044 |
| Valid action rate | — | — |
| Median latency | 83 ms | 112 ms |
| p95 latency | — | — |
| Evaluation suite | DecisionBench Medium (author's set) | author-reported |
| Latest version | 2026.09 | 2026.09 |
| Variants | unified | — |
| Size of latest version | 22.3 GB | 135.4 MB |
| Files | 6 | 2 |
| Downloads | 0 | 0 |
| Stars | 0 | 0 |
| Tags | system-one, multimodal, gemma, vision, audio, 12b | system-one, qwen, lora, non-commercial, 4b |
| Updated | Sep 26, 2026 | Sep 26, 2026 |