Typed decisions from Google's frozen Gemma-4-12B-it, with no fine-tuning. A small shim over unmodified vLLM letters the options, reads the model's own probability for each letter at one answer position and applies one calibration temperature; one output token per decision.
Qwen3.5-4B with a merged rank-16 LoRA distilled from 17,408 teacher questions and 30,000 public training rows, read out as a temperature-scaled softmax over answer-letter logits. Also in 9B, 2B and GGUF.
Decides
choice, score, noul
choice, score, noul, classify, route
Architecture
cygnet
jevk5
Fine-tuned from
google/gemma-4-12b-it
qwen/qwen3.5-4b
License
mit
apache-2.0
Availability
Open weights
Open weights
Hosted by
—
—
Input price
—
—
Decision accuracy
87.9%
78.4%
Calibration error
—
0.035
Valid action rate
—
—
Median latency
50 ms
13.2 ms
p95 latency
—
—
Evaluation suite
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
Questions
What is the difference between cygnet and jevk5?
cygnet is from Blockbrain Labs and jevk5 from Alibi Serikbay. Both have open weights you can download and run. Both answer choice, score and noul questions. Only jevk5 answers classify and route. jevk5 is the smaller model, at 4.0B parameters to 12B. cygnet is licensed mit; jevk5, apache-2.0.
Which is more accurate, cygnet or jevk5?
They report on different suites — cygnet 87.9% on JevBench public set (231 items), JevBench CLI, jevk5 78.4% on JevBench public hard tier — so the numbers do not rank them. Test both on your own labelled examples.
Which is cheaper, cygnet or jevk5?
cygnet: Free (open weights). jevk5: Free (open weights). Open weights cost nothing per call beyond your own hardware.
Which is faster, cygnet or jevk5?
By their publishers’ figures, jevk5 answers in about 13.2 ms at the median and cygnet in about 50 ms — measured on different hardware, so treat it as a rough guide.
Can I run cygnet or jevk5 locally?
Yes, both: systemone pull blockbrain-labs/cygnet and systemone pull alibi-serikbay/jevk5 download the weights.
