The first System One model. Reads a state, answers typed Choice, Score and Noul questions in one call with calibrated probabilities, and generates no text. Closed weights, served by TypeSafe AI.
An independent Jev-shaped reproduction on DeBERTa-v3-large. One state and any number of choice, score and yes/no questions go in, and a calibrated distribution per question comes out of one forward pass. Public gold labels only.
Decides
choice, score, noul, classify, route
choice, score, noul, classify
Architecture
jev
open-jev
Fine-tuned from
—
microsoft/deberta-v3-large
License
proprietary
apache-2.0
Availability
Hosted API
Open weights
Hosted by
TypeSafe AI
—
Input price
$0.042/MTok
—
Decision accuracy
—
85.4%
Calibration error
—
0.022
Valid action rate
—
—
Median latency
—
28 ms
p95 latency
—
—
Evaluation suite
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
Questions
What is the difference between jev and open-jev-deberta-v3-large?
jev is from TypeSafe AI and open-jev-deberta-v3-large from Kotoba Labs. jev is only available as a hosted API; open-jev-deberta-v3-large has open weights you can download and run. Both answer choice, score, noul and classify questions. Only jev answers route. jev reads up to 32K tokens of state, against 512 tokens for open-jev-deberta-v3-large. jev is licensed proprietary; open-jev-deberta-v3-large, apache-2.0.
Which is more accurate, jev or open-jev-deberta-v3-large?
Only open-jev-deberta-v3-large publishes an accuracy figure (85.4% on Kotoba held-out test, seen question types (banking77, SST-5, BoolQ)); jev does not, so there is no comparison to make without your own test.
Which is cheaper, jev or open-jev-deberta-v3-large?
jev: $0.042 / $0 per 1M. open-jev-deberta-v3-large: Free (open weights). Open weights cost nothing per call beyond your own hardware.
Can I run jev or open-jev-deberta-v3-large locally?
open-jev-deberta-v3-large yes — systemone pull kotoba-labs/open-jev-deberta-v3-large downloads its weights. The other is only served as a hosted API.
—
Kotoba held-out test, seen question types (banking77, SST-5, BoolQ)