An open-weights System One model from Convai Innovations. A fully fine-tuned ModernBERT-large encoder with a from-scratch decision head that scores one marker per option and answers every question in a single 33–39 ms pass. Runs on your own CPU or GPU.
One of the earliest Jev-shaped scorers. A sequence-classification head on Qwen3.5-4B-Base scores each (state, question, option) triple and softmaxes per question. Non-commercial licence.
Decides
choice, score, noul, classify, route
choice, score, noul, classify
Architecture
laya
scorer
Fine-tuned from
answerdotai/modernbert-large
qwen/qwen3.5-4b-base
License
apache-2.0
cc-by-nc-4.0
Availability
Open weights
Open weights
Hosted by
—
—
Input price
—
—
Decision accuracy
—
70.7%
Calibration error
—
0.044
Valid action rate
—
—
Median latency
39.5 ms
112 ms
p95 latency
—
—
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
Questions
What is the difference between laya and system-one-qwen3-5-4b-scorer?
laya is from Convai Innovations and system-one-qwen3-5-4b-scorer from pngwn. Both have open weights you can download and run. Both answer choice, score, noul and classify questions. Only laya answers route. laya is the smaller model, at 421M parameters to 4.0B. laya is licensed apache-2.0; system-one-qwen3-5-4b-scorer, cc-by-nc-4.0.
Which is more accurate, laya or system-one-qwen3-5-4b-scorer?
Only system-one-qwen3-5-4b-scorer publishes an accuracy figure (70.7% on author-reported); laya does not, so there is no comparison to make without your own test.
Which is cheaper, laya or system-one-qwen3-5-4b-scorer?
laya: Free (open weights). system-one-qwen3-5-4b-scorer: Free (open weights). Open weights cost nothing per call beyond your own hardware.
Which is faster, laya or system-one-qwen3-5-4b-scorer?
By their publishers’ figures, laya answers in about 39.5 ms at the median and system-one-qwen3-5-4b-scorer in about 112 ms — measured on different hardware, so treat it as a rough guide.
Can I run laya or system-one-qwen3-5-4b-scorer locally?
Yes, both: systemone pull convai-innovations/laya and systemone pull pngwn/system-one-qwen3-5-4b-scorer download the weights.
