Laya on an AMD Radeon 6900 XT
VeidtKV ported Laya to gfx1030 hardware, with a Hermes agent doing much of the porting.
BUILDS
Agents, routers, scorers and games — built on models that decide. Every entry links to the models it uses, so you can pull the same one and start from there.
30 builds · page 1 of 2
VeidtKV ported Laya to gfx1030 hardware, with a Hermes agent doing much of the porting.
Laya's author points to anth.us's comparison as evidence that task-specific fine-tuning closes, and usually reverses, the gap.
Laya's author recommends fine-tuning for real use cases and shares a 2×T4 Kaggle notebook that any agentic coding tool can adapt.
A Swift package that reads forms in running Mac apps through the Accessibility API and decides what to fill with Laya on the Neural Engine, around 1 ms per decision.
Nandakishor M's project site and write-up on the multilingual decision engine, its checkpoints, benchmarks and router.
A zero-dependency Rust runtime compiled to Wasm with WebGPU kernels; one import loads a pinned int8 model and nothing leaves the browser tab.
One process serves the model API and an admin UI; agents ask for decisions over MCP, HTTP or the CLI and act on the top choice.
Four controllers ran the same minutes of a Swedish house. Laya with a safety clip cut the bill, but a tariff-aware energy manager did better; p95 was 179 ms per decision.
Anton Lobach ported the decision engine to Jolt, a Clojure implementation running on Chez Scheme.
Adds a token-budget preflight that reports what would be truncated, a persistent calibration store and structured output to a warm MCP and HTTP server.
A Swift library on Apple MLX with no Python or helper process: download the weights once, then call predict with choice questions.
Runs the checkpoint on Metal Performance Shaders at about 32 ms median and 2.1 GiB of memory on an M5 Pro.
Tokenizer, encoder and decision head for the 322M multilingual checkpoint in one binary, with no Python, torch or BLAS.
A Java 17+ port with typed questions, a script-detecting router that picks the right checkpoint, and model downloads from the Hugging Face Hub.
A self-hosted typed-decision server for NVIDIA GPUs and Apple Silicon that speaks Jev's wire format, with integrations for coding agents.
A FastAPI service that bundles all three Laya checkpoints behind a language router, with API keys, presets, OpenAPI docs and bulk inference.
Allen Porter's Assist agent resolves intents and entities in a single Laya pass on CPU, CUDA or Apple Silicon, with nothing sent to the cloud.
Runs the original Laya safetensors through Candle with fused kernels, tiled attention and GEMM dispatch tuned for the M1 Pro.
A ggml-based runtime for all three checkpoints with native tokenization, decision heads and JSON output.
Fetches the official checkpoint on first use and answers typed questions natively, with EMLX on Apple Silicon.
Will Sargent's stdio MCP server lets Claude Code and other clients classify text, score against a rubric or ask yes/no questions locally.
Loads the safetensors directly with candle and runs any checkpoint on CPU, Metal or CUDA — no Python, torch or ONNX export.
524 MB of 8-bit English weights cached in the tab and run with onnxruntime-web, live at laya-web.pages.dev.
A browser runtime on ONNX Runtime Web that uses WebGPU with a SIMD Wasm fallback and works inside Web Workers.
Many of the first builds here were collected by madewithlaya.com. Every entry links to its creator’s own post, repository or site.