Loading comparison…
HEAD TO HEAD
pngwn: system-one-qwen3-5-4b-scorer and EldanRing: winnow, compared on what they decide, where they run, what they cost and what their publishers report.
| Property | pngwn/system-one-qwen3-5-4b-scorer | eldanring/winnow |
|---|---|---|
| Summary | One of the earliest Jev-shaped scorers. A sequence-classification head on Qwen3.5-4B-Base scores each (state, question, option) triple and softmaxes per question. Non-commercial licence. | A Gemma 4 12B fine-tune for typed decisions that also chats and reads images. Ships as GGUF for llama.cpp, holds a 64K context on a 16 GB GPU, and serves /v1/systemone next to /v1/chat/completions. |
| Decides | choice, score, noul, classify | choice, score, noul, classify, route |
| Architecture | scorer | winnow |
| Fine-tuned from | qwen/qwen3.5-4b-base | google/gemma-4-12b-it |
| License | cc-by-nc-4.0 | apache-2.0 |
| Availability | Open weights | Open weights |
| Hosted by | — | — |
| Input price | — | — |
| Decision accuracy | 70.7% | 85.7% |
| Calibration error | 0.044 | — |
| Valid action rate | — | — |
| Median latency | 112 ms | 143 ms |
| p95 latency | — | — |
| Evaluation suite | author-reported | JevBench public subset (231 items), Q8_0 |
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
system-one-qwen3-5-4b-scorer is from pngwn and winnow from EldanRing. Both have open weights you can download and run. Both answer choice, score, noul and classify questions. Only winnow answers route. system-one-qwen3-5-4b-scorer is the smaller model, at 4.0B parameters to 12B. system-one-qwen3-5-4b-scorer is licensed cc-by-nc-4.0; winnow, apache-2.0.
They report on different suites — system-one-qwen3-5-4b-scorer 70.7% on author-reported, winnow 85.7% on JevBench public subset (231 items), Q8_0 — so the numbers do not rank them. Test both on your own labelled examples.
system-one-qwen3-5-4b-scorer: Free (open weights). winnow: Free (open weights). Open weights cost nothing per call beyond your own hardware.
By their publishers’ figures, system-one-qwen3-5-4b-scorer answers in about 112 ms at the median and winnow in about 143 ms — measured on different hardware, so treat it as a rough guide.
Yes, both: systemone pull pngwn/system-one-qwen3-5-4b-scorer and systemone pull eldanring/winnow download the weights.
| Latest version | 2026.09 | 2026.09 |
|---|
| Variants | — | gguf, SHA256SUMS, LICENSE, NOTICE |
|---|
| Size of latest version | 135.4 MB | 34.2 GB |
|---|
| Files | 2 | 8 |
|---|
| Downloads | 0 | 0 |
|---|
| Stars | 0 | 0 |
|---|
| Tags | system-one, qwen, lora, non-commercial, 4b | system-one, gemma, gguf, vision, llama-cpp, 12b |
|---|
| Updated | Sep 27, 2026 | Sep 27, 2026 |
|---|