Loading comparison…
COMPARE
What each one decides, how well calibrated it is, how fast it answers and what it costs to pull. Up to 4 at a time; the better value in each row is marked.
| Property | convai-innovations/laya | pngwn/system-one-qwen3-5-4b-scorer |
|---|---|---|
| Summary | An open-weights System One model from Convai Innovations. A fully fine-tuned ModernBERT-large encoder with a from-scratch decision head that scores one marker per option and answers every question in a single 33–39 ms pass. Runs on your own CPU or GPU. | One of the earliest Jev-shaped scorers. A sequence-classification head on Qwen3.5-4B-Base scores each (state, question, option) triple and softmaxes per question. Non-commercial licence. |
| Decides | choice, score, noul, classify, route | choice, score, noul, classify |
| Architecture | laya | scorer |
| Fine-tuned from | answerdotai/modernbert-large | qwen/qwen3.5-4b-base |
| License | apache-2.0 | cc-by-nc-4.0 |
| Availability | Open weights | Open weights |
| Hosted by | — | — |
| Input price | — | — |
| Decision accuracy | — | 70.7% |
| Calibration error | — | 0.044 |
| Valid action rate | — | — |
| Median latency | 39.5 ms | 112 ms |
| p95 latency | — | — |
| Evaluation suite | — | author-reported |
| Latest version | 2026.09.25 | 2026.09 |
| Variants | encoder, eval, multilingual, tokenizer, typed-decisions | — |
| Size of latest version | 2.2 GB | 135.4 MB |
| Files | 19 | 2 |
| Downloads | 0 | 0 |
| Stars | 0 | 0 |
| Tags | system-one, encoder, modernbert, rlcd, multilingual, 421m | system-one, qwen, lora, non-commercial, 4b |
| Updated | Sep 26, 2026 | Sep 26, 2026 |