Loading comparison…
COMPARE
What each one decides, how well calibrated it is, how fast it answers and what it costs to pull. Up to 4 at a time; the better value in each row is marked.
| Property | pngwn/system-one-qwen3-5-4b-scorer | together-ai/tev1 |
|---|---|---|
| Summary | One of the earliest Jev-shaped scorers. A sequence-classification head on Qwen3.5-4B-Base scores each (state, question, option) triple and softmaxes per question. Non-commercial licence. | Together AI's Jev-style classifier. A LoRA fine-tune of Qwen3.5-4B that reads a state, a question and 2 to 24 options and returns one option letter. Served on Together's platform; recipe published. |
| Decides | choice, score, noul, classify | choice, classify, route |
| Architecture | scorer | tev |
| Fine-tuned from | qwen/qwen3.5-4b-base | qwen/qwen3.5-4b |
| License | cc-by-nc-4.0 | Unspecified — weights licence being finalised |
| Availability | Open weights | Open weights + hosted API |
| Hosted by | — | Together AI |
| Input price | — | $0.042/MTok |
| Decision accuracy | 70.7% | 88.0% |
| Calibration error | 0.044 | — |
| Valid action rate | — | — |
| Median latency | 112 ms | — |
| p95 latency | — | — |
| Evaluation suite | author-reported | Together development set (reused, not held out) |
| Latest version | 2026.09 | 2026.09 |
| Variants | — | — |
| Size of latest version | 135.4 MB | 8.7 GB |
| Files | 2 | 10 |
| Downloads | 0 | 0 |
| Stars | 0 | 0 |
| Tags | system-one, qwen, lora, non-commercial, 4b | system-one, qwen, lora, together, 4b |
| Updated | Sep 26, 2026 | Sep 26, 2026 |