This skill assumes finetuning-method-selection already routed here because the data shape is preference pairs or unpaired thumbs-up/down feedback, not demonstrations (that's lora-qlora-recipes) or a verifiable reward signal (that's grpo-rlvr-training). What follows is metho. Use it to give an agent explicit responsibilities, steps and constraints.
Follow the best community research in real time.
Publish versioned Markdown. Build focused streams. Give people and agents only the context they need.
Unsloth is a fast-kernel wrapper over PEFT and TRL, not a replacement API — every Unsloth kwarg below has a plain TRL/PEFT equivalent. Use this table to translate an Unsloth config to plain TRL (or back), and to know which knob lives on which object in the current TRL API. Use it to give an agent explicit responsibilities, steps and constraints.
Full tables and a complete worked config backing the summary in SKILL.md. Base models are never named here — every example is labeled by size class only; see finetuning-method-selection's references/model-catalog.md for which actual model to use at a given size class. Use it to give an agent explicit responsibilities, steps and constraints.
This skill assumes the routing decision already happened — finetuning-method-selection should have already pointed here because the data shape is demonstrations (SFT), not preference pairs or a verifiable reward signal. What follows is the current best-practice recipe for confi. Use it to give an agent explicit responsibilities, steps and constraints.
Complete, runnable reward functions for TRL's GRPOTrainer. Every function here follows the current TRL reward-function signature: it accepts completions plus any extra dataset columns as keyword arguments, and returns a list[float] the same length as completions. Base mod. Use it to give an agent explicit responsibilities, steps and constraints.
This skill assumes finetuning-method-selection already routed here because the target behavior has a verifiable pass/fail signal — not demonstrations (lora-qlora-recipes) or preference pairs (preference-optimization). What follows is when RL is the right tool, the reference. Use it to give an agent explicit responsibilities, steps and constraints.
Last verified: 2026-07-13 — refresh when a new size-class anchor is validated or optimizer/dtype defaults change. Use it to give an agent explicit responsibilities, steps and constraints.
This is the router skill for the fine-tuning lifecycle: it decides whether fine-tuning is the right tool at all, and if so, which method and which base-model size class. Every other skill in this plugin assumes this routing already happened — start here before opening lora-qlora. Use it to give an agent explicit responsibilities, steps and constraints.
The full procedure behind SKILL.md's "Judge Calibration Is a Prerequisite" section. Any grader routed to an LLM-judge follows this before its verdicts count toward a pass rate or a checkpoint promotion decision. Use it to give an agent explicit responsibilities, steps and constraints.
Runnable examples for the four grader shapes named in SKILL.md's Graders section: schema-compliance, exact-match with normalization, execution-based, and LLM-judge. Every grader returns a binary pass/fail — never a Likert score — per the plugin-wide rule. Wire each one to exact. Use it to give an agent explicit responsibilities, steps and constraints.
The Phase 0 gate for the whole plugin: finetuning-method-selection and every downstream skill assume this harness exists before a training config gets written. The harness is not a run-end side artifact — it is the data-curation engine. The same labeled traces that build the go. Use it to give an agent explicit responsibilities, steps and constraints.
Full detail backing SKILL.md's Synthetic Data Rules section: the generation-method ranking, the filter funnel candidate generations pass through before joining the training set, and the teacher→student distillation pattern. Base models are never named as recommendations here. Use it to give an agent explicit responsibilities, steps and constraints.
Concrete JSONL examples for every format in SKILL.md's Format Selection table, a template-application code sketch using current TRL conventions, and the ShareGPT→role/content conversion note. Base models are never named here — every code example uses a BASE MODEL placeholder;. Use it to give an agent explicit responsibilities, steps and constraints.
This skill assumes finetuning-method-selection already routed here — the next step is preparing data, not choosing a method. What follows: format selection by target method, the template/packing mechanics behind the most common silent training failures, rules for mixing in synt. Use it to give an agent explicit responsibilities, steps and constraints.
Complete promotion-report.md template, the drift-suite scoring table, the paired-arena protocol, and a replay-mix configuration example referenced from SKILL.md. BASE MODEL and CHECKPOINT are placeholders throughout — no base model family names appear in this file. Benchm. Use it to give an agent explicit responsibilities, steps and constraints.
The Phase 5 gate for the whole plugin: a checkpoint that trains cleanly and beats its task metric still doesn't ship without clearing all four stages below. eval-harness-first built the suite re-run here — this skill is where that suite's baseline decides something. Use it to give an agent explicit responsibilities, steps and constraints.
This command orchestrates the eval-gated fine-tuning lifecycle across seven phases, each owned by a specialist agent and gated by the artifact the prior phase produced:. Use it to give an agent explicit responsibilities, steps and constraints.
You are the fine-tuning training engineer: the workhorse who takes a training-brief.md someone else already justified and turns it into a dataset, a running job, and an exported artifact. You don't re- litigate method or model choice, and you don't decide whether a checkpoint s. Use it to give an agent explicit responsibilities, steps and constraints.
You are the fine-tuning eval engineer: the independent gatekeeper who builds the measuring stick before anyone trains against it, and reads that same measuring stick to decide whether a trained checkpoint ships. You own the two phases that bound the lifecycle — Phase 0 before a t. Use it to give an agent explicit responsibilities, steps and constraints.
You are the fine-tuning architect: a skeptical strategist who decides whether fine-tuning is the right tool at all before anyone opens a training config. You are the gate-keeper standing between "the user wants to fine-tune" and the first line of a training script — most requests. Use it to give an agent explicit responsibilities, steps and constraints.