Loading comparison…
COMPARE
What each one decides, how well calibrated it is, how fast it answers and what it costs to pull. Up to 4 at a time; the better value in each row is marked.
| Property | bespoke-labs/bespoke-nimble-9b | akhilaaa3/jev-omni |
|---|---|---|
| Summary | An open Jev-style LoRA on Qwen3.5-9B from Bespoke Labs, trained on 2,676 contrastively curated examples to score the allowed answer tokens directly for enums, booleans and rubric levels. Recipe, data and a public benchmark suite are released with it. | A multimodal decision classifier over text, image, audio and video on Gemma 4 12B, fine-tuned on 30,000 questions. Returns a probability per option and generates nothing. |
| Decides | choice, noul, score, classify, route | choice, noul, score, classify |
| Architecture | nimble | jev-omni |
| Fine-tuned from | qwen/qwen3.5-9b | google/gemma-4-12b-it |
| License | apache-2.0 | apache-2.0 |
| Availability | Open weights + hosted API | Open weights |
| Hosted by | Bespoke Labs | — |
| Input price | — | — |
| Decision accuracy | 90.1% | 87.6% |
| Calibration error | 0.054 | 0.040 |
| Valid action rate | — | — |
| Median latency | 106 ms | 83 ms |
| p95 latency | — | — |
| Evaluation suite | Bespoke held-out set (324 examples) | DecisionBench Medium (author's set) |
| Latest version | 2026.09 | 2026.09 |
| Variants | SHA256SUMS | unified |
| Size of latest version | 184.3 MB | 22.3 GB |
| Files | 10 | 6 |
| Downloads | 0 | 0 |
| Stars | 0 | 0 |
| Tags | system-one, qwen, lora, curated-data, 9b | system-one, multimodal, gemma, vision, audio, 12b |
| Updated | Sep 26, 2026 | Sep 26, 2026 |