Loading comparison…
HEAD TO HEAD
Interfaze AI: lev and pngwn: system-one-qwen3-5-4b-scorer, compared on what they decide, where they run, what they cost and what their publishers report.
| Property | interfaze-ai/lev | pngwn/system-one-qwen3-5-4b-scorer |
|---|---|---|
| Summary | An open System One model from Interfaze AI. A rank-32 LoRA on Qwen3.5-4B reads yes/no, choice and score answers from the logits of one forward pass, returns calibrated probabilities and serves the /v1/systemone API. | One of the earliest Jev-shaped scorers. A sequence-classification head on Qwen3.5-4B-Base scores each (state, question, option) triple and softmaxes per question. Non-commercial licence. |
| Decides | choice, score, noul, classify, route | choice, score, noul, classify |
| Architecture | lev | scorer |
| Fine-tuned from | qwen/qwen3.5-4b | qwen/qwen3.5-4b-base |
| License | apache-2.0 | cc-by-nc-4.0 |
| Availability | Open weights | Open weights |
| Hosted by | — | — |
| Input price | — | — |
| Decision accuracy | 68.9% | 70.7% |
| Calibration error | 0.115 | 0.044 |
| Valid action rate | — | — |
| Median latency | 69 ms | 112 ms |
| p95 latency | — | — |
| Evaluation suite | S1Bench (13 public subsets, macro) | author-reported |
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
lev is from Interfaze AI and system-one-qwen3-5-4b-scorer from pngwn. Both have open weights you can download and run. Both answer choice, score, noul and classify questions. Only lev answers route. lev is licensed apache-2.0; system-one-qwen3-5-4b-scorer, cc-by-nc-4.0.
They report on different suites — lev 68.9% on S1Bench (13 public subsets, macro), system-one-qwen3-5-4b-scorer 70.7% on author-reported — so the numbers do not rank them. Test both on your own labelled examples.
lev: Free (open weights). system-one-qwen3-5-4b-scorer: Free (open weights). Open weights cost nothing per call beyond your own hardware.
By their publishers’ figures, lev answers in about 69 ms at the median and system-one-qwen3-5-4b-scorer in about 112 ms — measured on different hardware, so treat it as a rough guide.
Yes, both: systemone pull interfaze-ai/lev and systemone pull pngwn/system-one-qwen3-5-4b-scorer download the weights.
| Latest version | 2026.09 | 2026.09 |
|---|
| Variants | — | — |
|---|
| Size of latest version | 195.1 MB | 135.4 MB |
|---|
| Files | 8 | 2 |
|---|
| Downloads | 0 | 0 |
|---|
| Stars | 0 | 0 |
|---|
| Tags | system-one, qwen, lora, calibrated, 4b | system-one, qwen, lora, non-commercial, 4b |
|---|
| Updated | Sep 27, 2026 | Sep 27, 2026 |
|---|