Typed decisions from Google's frozen Gemma-4-12B-it, with no fine-tuning. A small shim over unmodified vLLM letters the options, reads the model's own probability for each letter at one answer position and applies one calibration temperature; one output token per decision.
FrontiersMind's decision model on a base it pre-trained from scratch. Each question reads the state and its own tokens once and a 256-dimension pointer head scores the options; Choice and Score take up to 255 entries, and nothing is generated.
Decides
choice, score, noul
choice, score, noul
Architecture
cygnet
lumma-fev
Fine-tuned from
google/gemma-4-12b-it
frontiersmind/lumma-0.6b-base
License
mit
apache-2.0
Availability
Open weights
Open weights
Hosted by
—
—
Input price
—
—
Decision accuracy
87.9%
64.0%
Calibration error
—
—
Valid action rate
—
—
Median latency
50 ms
45.8 ms
p95 latency
—
—
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
Questions
What is the difference between cygnet and lumma-fev?
cygnet is from Blockbrain Labs and lumma-fev from FrontiersMind. Both have open weights you can download and run. Both answer choice, score and noul questions. cygnet reads up to 16K tokens of state, against 8K tokens for lumma-fev. lumma-fev is the smaller model, at 649M parameters to 12B. cygnet is licensed mit; lumma-fev, apache-2.0.
Which is more accurate, cygnet or lumma-fev?
They report on different suites — cygnet 87.9% on JevBench public set (231 items), JevBench CLI, lumma-fev 64.0% on typed-decisions (maker's table; split not stated) — so the numbers do not rank them. Test both on your own labelled examples.
Which is cheaper, cygnet or lumma-fev?
cygnet: Free (open weights). lumma-fev: Free (open weights). Open weights cost nothing per call beyond your own hardware.
Which is faster, cygnet or lumma-fev?
By their publishers’ figures, lumma-fev answers in about 45.8 ms at the median and cygnet in about 50 ms — measured on different hardware, so treat it as a rough guide.
Can I run cygnet or lumma-fev locally?
Yes, both: systemone pull blockbrain-labs/cygnet and systemone pull frontiersmind/lumma-fev download the weights.
