Loading comparison…
HEAD TO HEAD
Mapika: decider and pngwn: system-one-qwen3-5-4b-scorer, compared on what they decide, where they run, what they cost and what their publishers report.
| Property | mapika/decider | pngwn/system-one-qwen3-5-4b-scorer |
|---|---|---|
| Summary | The most-downloaded open System One reproduction. Merged Qwen3.5 fine-tunes, trained on about 95 public decision sets, then calibration-aware RL and a rank-64 LoRA, that softmax letter logits at an answer slot. | One of the earliest Jev-shaped scorers. A sequence-classification head on Qwen3.5-4B-Base scores each (state, question, option) triple and softmaxes per question. Non-commercial licence. |
| Decides | choice, score, noul, classify, route | choice, score, noul, classify |
| Architecture | decider | scorer |
| Fine-tuned from | qwen/qwen3.5-2b-base | qwen/qwen3.5-4b-base |
| License | apache-2.0 | cc-by-nc-4.0 |
| Availability | Open weights | Open weights |
| Hosted by | — | — |
| Input price | — | — |
| Decision accuracy | 80.2% | 70.7% |
| Calibration error | 0.038 | 0.044 |
| Valid action rate | — | — |
| Median latency | 3.2 ms | 112 ms |
| p95 latency | — | — |
| Evaluation suite | Decider 67-task regression set | author-reported |
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
decider is from Mapika and system-one-qwen3-5-4b-scorer from pngwn. Both have open weights you can download and run. Both answer choice, score, noul and classify questions. Only decider answers route. decider is the smaller model, at 2.0B parameters to 4.0B. decider is licensed apache-2.0; system-one-qwen3-5-4b-scorer, cc-by-nc-4.0.
They report on different suites — decider 80.2% on Decider 67-task regression set, system-one-qwen3-5-4b-scorer 70.7% on author-reported — so the numbers do not rank them. Test both on your own labelled examples.
decider: Free (open weights). system-one-qwen3-5-4b-scorer: Free (open weights). Open weights cost nothing per call beyond your own hardware.
By their publishers’ figures, decider answers in about 3.2 ms at the median and system-one-qwen3-5-4b-scorer in about 112 ms — measured on different hardware, so treat it as a rough guide.
Yes, both: systemone pull mapika/decider and systemone pull pngwn/system-one-qwen3-5-4b-scorer download the weights.
| Latest version | 2026.09 | 2026.09 |
|---|
| Variants | — | — |
|---|
| Size of latest version | 3.5 GB | 135.4 MB |
|---|
| Files | 4 | 2 |
|---|
| Downloads | 0 | 0 |
|---|
| Stars | 0 | 0 |
|---|
| Tags | system-one, qwen, rl, calibrated, 2b | system-one, qwen, lora, non-commercial, 4b |
|---|
| Updated | Sep 26, 2026 | Sep 26, 2026 |
|---|