Fine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment, PPO/GR…
Part of AI Research Skills (Orchestra)Pack · 98 skills
by Orchestra-Research· AI & agentsUnclaimed · Yours? Claim it
About
Fine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment, PPO/GRPO for reward optimization, and reward model training. Use when need RLHF, align model with preferences, or train from human feedback. Works with HuggingFace Transformers.
Skills people install alongside fine-tuning-with-trl.
Runs on your machine.
Runs on your machine.
Runs on your machine.
Runs on your machine.
npx -y degit Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning ~/.copilot/skills/fine-tuning-with-trl
Runs on your machine.
npx -y degit Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning ~/.cursor/skills/fine-tuning-with-trl
Runs on your machine.
npx -y degit Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning ~/.claude/skills/fine-tuning-with-trl
/plugin marketplace add Orchestra-Research/AI-Research-SKILLs /plugin install rag@ai-research-skills
Runs on your machine.
npx -y degit Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning ~/.agents/skills/fine-tuning-with-trl
Runs on your machine.
Runs on your machine.
npx -y degit Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning ~/.gemini/skills/fine-tuning-with-trl
Runs on your machine.
npx -y degit Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning .agents/skills/fine-tuning-with-trl
Runs on your machine.
npx -y degit Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning ~/.openclaw/skills/fine-tuning-with-trl
Runs on your machine.
npx -y degit Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning ~/.config/opencode/skills/fine-tuning-with-trl
Runs on your machine.
npx -y degit Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning ~/.hermes/skills/fine-tuning-with-trl
Scanned and passed · checked 49 min ago
From people who use it
Step by step
Nothing new reaches your agent until a person has looked at it.
Scanned on every change, and again when our rules improve.
No reviews yet. Used fine-tuning-with-trl? Say how it went.
Write a reviewSkills people install alongside fine-tuning-with-trl.
Has your agent write a tight, ready-to-paste prompt for the AI tool you name, from Claude Code and Cursor to Midjourney and Sora.
Turns a task into a copy-ready /goal command for Claude Code or Codex, with a checkable finish line and a stop bound.
The .NET team's skill for picking the right AI or ML stack in .NET 8+ apps, from ML.NET to Microsoft.Extensions.AI and Agent Framework.
Turn a repeated workflow, prompt set or SOP into a tested, packaged agent skill, or audit and improve a skill you already have.
Nobody has shared how they use fine-tuning-with-trl yet.
Security scan
Passed
Safe to install in every agent it supports. Runs in your agent, as instructions.