GLOSSARY
What is valid action rate?
Valid action rateValid action rate is the share of a model’s answers that are allowed answers — an option that was offered, a level that is on the scale. A model that only scores the allowed answers reaches 100% by construction.
The metric exists because some decision systems generate their answer and then map it back to the options, and generation can produce something off the list. A System One model that scores each allowed answer directly cannot, which is one of the practical reasons to use one.
Read more
Next term: Decision latency · Every System One model