jevbench: six classifiers compared, calibration included
Jev against GPT-5-mini, Claude Sonnet 5, fine-tuned DistilBERT, BART NLI and Laya on SST-2, AG News and more, reporting accuracy, macro-F1, ECE, latency, throughput and cost.
BUILDS
Agents, routers, scorers and games — built on models that decide. Every entry links to the models it uses, so you can pull the same one and start from there.
63 builds · page 1 of 3
Jev against GPT-5-mini, Claude Sonnet 5, fine-tuned DistilBERT, BART NLI and Laya on SST-2, AG News and more, reporting accuracy, macro-F1, ECE, latency, throughput and cost.
Twenty real Chinese requests on every checkpoint, measuring accuracy, latency and whether the model's confidence drops when it is wrong.
A Unity-native client for local Laya servers and compatible endpoints: game state goes in, typed choices and scores come out.
A native Windows demo on CUDA or CPU showing live probabilities, chosen moves, inference timing and how often the planner stepped in.
A local prototype that reads a draft and updates three signals live — tone as a choice, formality as a 1–5 score and the risk it starts a fight — in 40–110 ms per check.
Describe a past Claude Code, Codex or OpenCode session in plain words; Chat Seek searches the local histories and reranks the matches with Laya.
A reproducible zero-shot benchmark on informal Darija reviews written in both Arabic script and Arabizi.
A frozen benchmark of synthetic Feishu scenarios with fixed inputs, prompts and labels. Laya answered in 151 ms against Jev's 253 ms but got far fewer right.
Laya's author recommends fine-tuning for real use cases and shares a 2×T4 Kaggle notebook that any agentic coding tool can adapt.
A Swift package that reads forms in running Mac apps through the Accessibility API and decides what to fill with Laya on the Neural Engine, around 1 ms per decision.
A self-hosted console that runs VirusTotal lookups for IPs, domains and file hashes through Jev, Von or Laya and scores the models against each other.
Forty questions on automotive, embedded, enterprise software and product decisions, three trials each, published with expected answers, raw responses and an HTML report.
Matched-budget fine-tunes on Banking77 and five more public tasks — prompt injection, SMS spam, emotion and request routing — with about 1,000 examples each.
Collects vacancies from jobnet.dk and jobindex.dk, filters them against a candidate profile and ranks the matches locally.
A zero-dependency Rust runtime compiled to Wasm with WebGPU kernels; one import loads a pinned int8 model and nothing leaves the browser tab.
Give it a numbered list of the page's controls and it picks the action and target — a drop-in for jev-ultrafast tooling that needs no screenshots.
One process serves the model API and an admin UI; agents ask for decisions over MCP, HTTP or the CLI and act on the top choice.
Four controllers ran the same minutes of a Swedish house. Laya with a safety clip cut the bill, but a tariff-aware energy manager did better; p95 was 179 ms per decision.
A Homebrew-installed menu-bar app exposing an OpenAI-compatible endpoint, so n8n's Text Classifier gets Laya decisions in about 40 ms.
Adds a token-budget preflight that reports what would be truncated, a persistent calibration store and structured output to a warm MCP and HTTP server.
A local 15×15 Gomoku game: you play black, and every white move is one Laya choice among up to six candidate points.
A Swift library on Apple MLX with no Python or helper process: download the weights once, then call predict with choice questions.
Runs the checkpoint on Metal Performance Shaders at about 32 ms median and 2.1 GiB of memory on an M5 Pro.
An Agent Skill and MCP tool that gives Codex, Claude Code, OpenCode and Pi a local decision capability for routing work.
Many of the first builds here were collected by madewithlaya.com. Every entry links to its creator’s own post, repository or site.