Loading comparison…
HEAD TO HEAD
pngwn: system-one-qwen3-5-4b-scorer and wfzyx: von, compared on what they decide, where they run, what they cost and what their publishers report.
| Property | pngwn/system-one-qwen3-5-4b-scorer | wfzyx/von |
|---|---|---|
| Summary | One of the earliest Jev-shaped scorers. A sequence-classification head on Qwen3.5-4B-Base scores each (state, question, option) triple and softmaxes per question. Non-commercial licence. | A ModernBERT-large encoder with an option-marker head. Premise and options are packed into one sequence and each option's marker is scored in a single bidirectional pass; version 1.2 makes the scoring order-invariant. |
| Decides | choice, score, noul, classify | choice, score, noul, classify |
| Architecture | scorer | von |
| Fine-tuned from | qwen/qwen3.5-4b-base | answerdotai/modernbert-large |
| License | cc-by-nc-4.0 | apache-2.0 |
| Availability | Open weights | Open weights |
| Hosted by | — | — |
| Input price | — | — |
| Decision accuracy | 70.7% | 63.9% |
| Calibration error | 0.044 | 0.045 |
| Valid action rate | — | — |
| Median latency | 112 ms | 18 ms |
| p95 latency | — | — |
| Evaluation suite | author-reported | JevBench public standard tier |
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
system-one-qwen3-5-4b-scorer is from pngwn and von from wfzyx. Both have open weights you can download and run. Both answer choice, score, noul and classify questions. von is the smaller model, at 395M parameters to 4.0B. system-one-qwen3-5-4b-scorer is licensed cc-by-nc-4.0; von, apache-2.0.
They report on different suites — system-one-qwen3-5-4b-scorer 70.7% on author-reported, von 63.9% on JevBench public standard tier — so the numbers do not rank them. Test both on your own labelled examples.
system-one-qwen3-5-4b-scorer: Free (open weights). von: Free (open weights). Open weights cost nothing per call beyond your own hardware.
By their publishers’ figures, von answers in about 18 ms at the median and system-one-qwen3-5-4b-scorer in about 112 ms — measured on different hardware, so treat it as a rough guide.
Yes, both: systemone pull pngwn/system-one-qwen3-5-4b-scorer and systemone pull wfzyx/von download the weights.
| Latest version | 2026.09 | 1.2.0 |
|---|
| Variants | — | — |
|---|
| Size of latest version | 135.4 MB | 2.9 GB |
|---|
| Files | 2 | 2 |
|---|
| Downloads | 0 | 0 |
|---|
| Stars | 0 | 0 |
|---|
| Tags | system-one, qwen, lora, non-commercial, 4b | system-one, encoder, modernbert, 395m |
|---|
| Updated | Sep 26, 2026 | Sep 26, 2026 |
|---|