Hanno Labs' small calibrated decision model. A LoRA on Qwen3-1.7B plus trained decision-token embeddings with stable slots, returning the full distribution over up to 255 caller-defined choices and a null slot for Choice, Score and Noul questions.
Metask Lab's calibrated decision model in 16 languages. Qwen3.5-4B with a merged LoRA trained with the Nimble candidate-logit objective; one forward pass and a softmax over at most 26 answer-letter logits, with one temperature per question type.
Decides
choice, score, noul, classify, route
choice, score, noul, classify, route
Architecture
bosun
metask-jev
Fine-tuned from
qwen/qwen3-1.7b
qwen/qwen3.5-4b
License
apache-2.0
apache-2.0
Availability
Open weights
Open weights
Hosted by
—
—
Input price
—
—
Decision accuracy
84.9%
80.1%
Calibration error
0.050
—
Valid action rate
—
—
Median latency
—
62.8 ms
p95 latency
—
—
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
Questions
What is the difference between bosun and metask-jev?
bosun is from Hanno Labs and metask-jev from Metask Lab. Both have open weights you can download and run. Both answer choice, score, noul, classify and route questions. bosun is the smaller model, at 2.0B parameters to 4.5B.
Which is more accurate, bosun or metask-jev?
They report on different suites — bosun 84.9% on DecisionBench (Hanno-Labs/decision-bench, 23,900 rows; seen task families), metask-jev 80.1% on JevBench v1.2 public set (231 items) at 4,096 tokens, maker's run — so the numbers do not rank them. Test both on your own labelled examples.
Which is cheaper, bosun or metask-jev?
bosun: Free (open weights). metask-jev: Free (open weights). Open weights cost nothing per call beyond your own hardware.
Can I run bosun or metask-jev locally?
Yes, both: systemone pull hanno-labs/bosun and systemone pull metask-lab/metask-jev download the weights.
Evaluation suite
DecisionBench (Hanno-Labs/decision-bench, 23,900 rows; seen task families)
JevBench v1.2 public set (231 items) at 4,096 tokens, maker's run
