laya-zh-eval: Chinese skill routing across all three checkpoints
Twenty real Chinese requests on every checkpoint, measuring accuracy, latency and whether the model's confidence drops when it is wrong.
BUILDS
10 builds made with System One models.
Agents, routers, scorers and games — built on models that decide. Every entry links to the models it uses, so you can pull the same one and start from there.
5 builds
Moroccan Darija sentiment: Jev vs self-hosted Laya
A reproducible zero-shot benchmark on informal Darija reviews written in both Arabic script and Arabizi.
Chinese workplace-chat classification: Jev 64/64, Laya 20/64
A frozen benchmark of synthetic Feishu scenarios with fixed inputs, prompts and labels. Laya answered in 151 ms against Jev's 253 ms but got far fewer right.
Japanese business judgment: Jev 97.6 vs Laya 36.9
Forty questions on automotive, embedded, enterprise software and product decisions, three trials each, published with expected answers, raw responses and an HTML report.
Reranking Finnish legal passages with typed-judgment models
Compares Jev, open-weight Laya, cross-encoders and GPT models as rerankers over a Postgres full-text and pgvector first stage, with cost per 1,000 queries.
Many of the first builds here were collected by madewithlaya.com. Every entry links to its creator’s own post, repository or site.