GLOSSARY
What is confidence gating?
Confidence gatingConfidence gating acts on a model’s answer only when its probability clears a threshold, and sends everything else to a fallback — a person, a larger model or a safe default. The threshold trades coverage for accuracy.
At a threshold of 0 every answer is used; at 0.99 few are, but those few are almost always right. Plot accuracy against coverage on your own labelled data and set the threshold where the trade suits the decision.
Gating only works when the confidence is calibrated. Laya Studio prints the coverage and accuracy table after every fine-tuning run.
Read more
Next term: systemone.yaml · Every System One model