GLOSSARY
What is decision accuracy?
Decision accuracyDecision accuracy is the share of questions a System One model answers correctly on an evaluation set, reported as decision_accuracy — a number between 0 and 1 — in systemone.yaml.
An accuracy figure means something only next to the suite it was measured on. Publishers report on different suites — their own held-out sets, JevBench tiers, domain benchmarks — so two numbers from different suites are not a ranking. The registry shows the suite beside every figure.
The number that matters most is the one you measure on your own labelled examples. Laya Studio scores the base model and the fine-tuned one on the same untouched split for exactly that reason.
Read more
Next term: Valid action rate · Every System One model