# fine-tuning-with-trl > Fine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment, PPO/GR… Fine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment, PPO/GRPO for reward optimization, and reward model training. Use when need RLHF, align model with preferences, or train from human feedback. Works with HuggingFace Transformers. - Type: Skill - Made by: Orchestra-Research - Category: AI & agents - Formats: Skills - Version: db36dd8 - Source: https://github.com/orchestra-research/ai-research-skills/tree/HEAD/06-post-training/trl-fine-tuning - Page: https://pluginboard.ai/skills/fine-tuning-with-trl ## Works with - ChatGPT - Claude - Gemini - GitHub Copilot - Cursor - Claude Code - Codex - Antigravity - Gemini CLI - Replit - OpenClaw - OpenCode - Hermes Agent ## Install ### ChatGPT In ChatGPT: Download the fine-tuning-with-trl folder and zip it, then Plugins → Skills → Create → Upload from your computer. Business and Enterprise plans. View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/06-post-training/trl-fine-tuning ### Claude In Claude (web or desktop): Download the fine-tuning-with-trl folder and zip the folder itself, then upload it in Customize → Skills. View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/06-post-training/trl-fine-tuning ### Gemini In Gemini: Download the fine-tuning-with-trl folder, then at gemini.google.com click Customize → Skills → Create → Upload and pick the folder (or a .zip of it). View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/06-post-training/trl-fine-tuning ### GitHub Copilot Run in your terminal: ```shell npx -y degit Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning ~/.copilot/skills/fine-tuning-with-trl ``` View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/06-post-training/trl-fine-tuning ### Cursor Run in your terminal: ```shell npx -y degit Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning ~/.cursor/skills/fine-tuning-with-trl ``` View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/06-post-training/trl-fine-tuning ### Claude Code Run in your terminal: ```shell npx -y degit Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning ~/.claude/skills/fine-tuning-with-trl ``` View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/06-post-training/trl-fine-tuning Or all of AI Research Skills (Orchestra), in Claude Code: ```text /plugin marketplace add Orchestra-Research/AI-Research-SKILLs /plugin install rag@ai-research-skills ``` ### Codex Run in your terminal: ```shell npx -y degit Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning ~/.agents/skills/fine-tuning-with-trl ``` View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/06-post-training/trl-fine-tuning ### Antigravity In Antigravity: Copy the fine-tuning-with-trl folder into ~/.gemini/config/skills (Antigravity app and IDE) or ~/.gemini/antigravity-cli/skills (Antigravity CLI). View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/06-post-training/trl-fine-tuning ### Gemini CLI Run in your terminal: ```shell npx -y degit Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning ~/.gemini/skills/fine-tuning-with-trl ``` View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/06-post-training/trl-fine-tuning ### Replit Run in your terminal: ```shell npx -y degit Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning .agents/skills/fine-tuning-with-trl ``` View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/06-post-training/trl-fine-tuning ### OpenClaw Run in your terminal: ```shell npx -y degit Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning ~/.openclaw/skills/fine-tuning-with-trl ``` View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/06-post-training/trl-fine-tuning ### OpenCode Run in your terminal: ```shell npx -y degit Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning ~/.config/opencode/skills/fine-tuning-with-trl ``` View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/06-post-training/trl-fine-tuning ### Hermes Agent Run in your terminal: ```shell npx -y degit Orchestra-Research/AI-Research-SKILLs/06-post-training/trl-fine-tuning ~/.hermes/skills/fine-tuning-with-trl ``` View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/06-post-training/trl-fine-tuning --- From Pluginboard (https://pluginboard.ai).