Loading comparison…
HEAD TO HEAD
Alibi Serikbay: jevk5 and pngwn: system-one-qwen3-5-4b-scorer, compared on what they decide, where they run, what they cost and what their publishers report.
| Property | alibi-serikbay/jevk5 | pngwn/system-one-qwen3-5-4b-scorer |
|---|---|---|
| Summary | Qwen3.5-4B with a merged rank-16 LoRA distilled from 17,408 teacher questions and 30,000 public training rows, read out as a temperature-scaled softmax over answer-letter logits. Also in 9B, 2B and GGUF. | One of the earliest Jev-shaped scorers. A sequence-classification head on Qwen3.5-4B-Base scores each (state, question, option) triple and softmaxes per question. Non-commercial licence. |
| Decides | choice, score, noul, classify, route | choice, score, noul, classify |
| Architecture | jevk5 | scorer |
| Fine-tuned from | qwen/qwen3.5-4b | qwen/qwen3.5-4b-base |
| License | apache-2.0 | cc-by-nc-4.0 |
| Availability | Open weights | Open weights |
| Hosted by | — | — |
| Input price | — | — |
| Decision accuracy | 78.4% | 70.7% |
| Calibration error | 0.035 | 0.044 |
| Valid action rate | — | — |
| Median latency | 13.2 ms | 112 ms |
| p95 latency | — | — |
| Evaluation suite | JevBench public hard tier | author-reported |
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
jevk5 is from Alibi Serikbay and system-one-qwen3-5-4b-scorer from pngwn. Both have open weights you can download and run. Both answer choice, score, noul and classify questions. Only jevk5 answers route. jevk5 is licensed apache-2.0; system-one-qwen3-5-4b-scorer, cc-by-nc-4.0.
They report on different suites — jevk5 78.4% on JevBench public hard tier, system-one-qwen3-5-4b-scorer 70.7% on author-reported — so the numbers do not rank them. Test both on your own labelled examples.
jevk5: Free (open weights). system-one-qwen3-5-4b-scorer: Free (open weights). Open weights cost nothing per call beyond your own hardware.
By their publishers’ figures, jevk5 answers in about 13.2 ms at the median and system-one-qwen3-5-4b-scorer in about 112 ms — measured on different hardware, so treat it as a rough guide.
Yes, both: systemone pull alibi-serikbay/jevk5 and systemone pull pngwn/system-one-qwen3-5-4b-scorer download the weights.
| Latest version | 0.3.0 | 2026.09 |
|---|
| Variants | SHA256SUMS | — |
|---|
| Size of latest version | 7.9 GB | 135.4 MB |
|---|
| Files | 8 | 2 |
|---|
| Downloads | 0 | 0 |
|---|
| Stars | 0 | 0 |
|---|
| Tags | system-one, qwen, lora, distilled, 4b | system-one, qwen, lora, non-commercial, 4b |
|---|
| Updated | Sep 26, 2026 | Sep 26, 2026 |
|---|