An independent Jev-shaped reproduction on DeBERTa-v3-large. One state and any number of choice, score and yes/no questions go in, and a calibrated distribution per question comes out of one forward pass. Public gold labels only.
A ModernBERT-large encoder with an option-marker head. Premise and options are packed into one sequence and each option's marker is scored in a single bidirectional pass; version 1.2 makes the scoring order-invariant.
Decides
choice, score, noul, classify
choice, score, noul, classify
Architecture
open-jev
von
Fine-tuned from
microsoft/deberta-v3-large
answerdotai/modernbert-large
License
apache-2.0
apache-2.0
Availability
Open weights
Open weights
Hosted by
—
—
Input price
—
—
Decision accuracy
85.4%
63.9%
Calibration error
0.022
0.045
Valid action rate
—
—
Median latency
28 ms
18 ms
p95 latency
—
—
Evaluation suite
Kotoba held-out test, seen question types (banking77, SST-5, BoolQ)
Figures are from each model’s manifest; accuracy and latency are what the publishers report, on their own suites and hardware. Add a third model.
Questions
What is the difference between open-jev-deberta-v3-large and von?
open-jev-deberta-v3-large is from Kotoba Labs and von from wfzyx. Both have open weights you can download and run. Both answer choice, score, noul and classify questions. von reads up to 8K tokens of state, against 512 tokens for open-jev-deberta-v3-large. von is the smaller model, at 395M parameters to 434M.
Which is more accurate, open-jev-deberta-v3-large or von?
They report on different suites — open-jev-deberta-v3-large 85.4% on Kotoba held-out test, seen question types (banking77, SST-5, BoolQ), von 63.9% on JevBench public standard tier — so the numbers do not rank them. Test both on your own labelled examples.
Which is cheaper, open-jev-deberta-v3-large or von?
open-jev-deberta-v3-large: Free (open weights). von: Free (open weights). Open weights cost nothing per call beyond your own hardware.
Which is faster, open-jev-deberta-v3-large or von?
By their publishers’ figures, von answers in about 18 ms at the median and open-jev-deberta-v3-large in about 28 ms — measured on different hardware, so treat it as a rough guide.
Can I run open-jev-deberta-v3-large or von locally?
Yes, both: systemone pull kotoba-labs/open-jev-deberta-v3-large and systemone pull wfzyx/von download the weights.
