GLOSSARY
What is LoRA fine-tuning?
LoRA fine-tuningLoRA (low-rank adaptation) fine-tunes a model by training small low-rank matrices added to its weights instead of the weights themselves. It makes adapting a System One model to your own decisions fast and cheap enough for a laptop.
For a decision model the adapters go on the encoder and the decision head is trained in full. The adapters can then be merged back, so the result is an ordinary checkpoint that loads like the original.
Laya Studio does this for Laya on your own machine, measures the base and the tuned model on the same held-out split, and publishes the result to the registry in one step.
Read more
Next term: System One model · Every System One model