Emotion · lora (English)

A Laya decision model. It answers the questions below in one forward pass, with calibrated probabilities and no generated text. Fine-tuned from aac6fef/laya-mlx.

Evaluation

Measured on the held-out test split of Emotion (6 labels).

Metric	Base model	This model
Decision accuracy	47.5%	88.2% [85.3%–90.5%]
Calibration error (ECE)	0.342	0.022
Log loss	2.003	0.369
Brier score	0.826	0.174
Median latency		55.0 ms
p95 latency		61.5 ms
Decisions scored	600	600

Fine-tuning fixed 255 decisions the base model got wrong and broke 11 it got right.

Use it

pip install systemonemodels
systemone pull biplov/emo-en-lora-proper

import json
import laya_mlx as laya  # pip install laya-mlx, on Apple silicon
from systemone import snapshot_download

path = snapshot_download("biplov/emo-en-lora-proper")
agent = laya.load(str(path))
questions = json.loads((path / "questions.json").read_text())
print(agent.predict("your text here", questions)["answers"])

Questions

The questions it was trained to answer. Their wording is part of the model's input, so ask them as written.

{
  "emotion": {
    "type": "choice",
    "instructions": "Which emotion does the writer express?",
    "criteria": {
      "sadness": "sad, hopeless, lonely, hurt",
      "joy": "happy, content, excited, proud",
      "love": "affection, tenderness, longing for someone",
      "anger": "angry, irritated, resentful, offended",
      "fear": "afraid, anxious, nervous, worried",
      "surprise": "surprised, amazed, shocked, curious"
    }
  }
}

Training

{
  "method": "lora",
  "objective": "proper",
  "epochs": 4,
  "batch_size": 8,
  "grad_accum": 2,
  "lr": 0.0002,
  "head_lr": 0.0001,
  "lora_rank": 16,
  "lora_alpha": 32,
  "lora_dropout": 0.05,
  "lora_layers": 0,
  "full_layers": 4,
  "head_dropout": 0.1,
  "weight_decay": 0.01,
  "warmup": 0.06,
  "max_grad_norm": 1.0,
  "shuffle_options": true,
  "class_weighting": "none",
  "patience": 2,
  "grad_checkpoint": "auto",
  "precision": "bfloat16",
  "seed": 13
}

---

Generated by systemone push from the files in this repository. Push a README.md, or edit the card on this page, to replace it.