GLOSSARY
What is the state in a System One model?
StateThe state is the input a System One model reads: the text, JSON, log or conversation that its typed questions are about. One state can be asked many questions in the same request.
The state is encoded once and every question reads from that encoding, which is why several questions cost little more than one. Its size is bounded by the model’s context length — 512 tokens for the English Laya checkpoint, 32K for Jev.
Anything past the context length is cut before the model sees it. Trim long inputs to the part the questions are about rather than letting the end fall off.
Read more
Next term: Calibrated confidence · Every System One model