# align-human

> Use when the user has a judge/grader and human-labeled data, and wants to measure how well the judge agrees with humans…

Use when the user has a judge/grader and human-labeled data, and wants to measure how well the judge agrees with humans, detect systematic biases, determine whether automatic evaluation can replace human review, or build a human-reduction roadmap. Also use when the user mentions calibration, TPR/TNR, judge validation, inter-rater agreement, Cohen's kappa, bias detection, or "is my automatic evaluation trustworthy." Merges the calibrate and align functions into one skill.

- Type: Skill
- Made by: agentscope-ai
- Category: AI & agents
- Formats: Skills
- Version: 90b1cee
- Source: https://github.com/agentscope-ai/openjudge/tree/HEAD/skills/eval_pipeline/03-align-human
- Page: https://pluginboard.ai/skills/align-human

## Works with

- ChatGPT
- Claude
- Gemini
- GitHub Copilot
- Cursor
- Claude Code
- Codex
- Antigravity
- Gemini CLI
- Replit
- OpenClaw
- OpenCode
- Hermes Agent

## Install

### ChatGPT

In ChatGPT: Download the align-human folder and zip it, then Plugins → Skills → Create → Upload from your computer. Business and Enterprise plans.

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/eval_pipeline/03-align-human

### Claude

In Claude (web or desktop): Download the align-human folder and zip the folder itself, then upload it in Customize → Skills.

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/eval_pipeline/03-align-human

### Gemini

In Gemini: Download the align-human folder, then at gemini.google.com click Customize → Skills → Create → Upload and pick the folder (or a .zip of it).

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/eval_pipeline/03-align-human

### GitHub Copilot

Run in your terminal:

```shell
npx -y degit agentscope-ai/OpenJudge/skills/eval_pipeline/03-align-human ~/.copilot/skills/align-human
```

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/eval_pipeline/03-align-human

### Cursor

Run in your terminal:

```shell
npx -y degit agentscope-ai/OpenJudge/skills/eval_pipeline/03-align-human ~/.cursor/skills/align-human
```

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/eval_pipeline/03-align-human

### Claude Code

Run in your terminal:

```shell
npx -y degit agentscope-ai/OpenJudge/skills/eval_pipeline/03-align-human ~/.claude/skills/align-human
```

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/eval_pipeline/03-align-human

### Codex

Run in your terminal:

```shell
npx -y degit agentscope-ai/OpenJudge/skills/eval_pipeline/03-align-human ~/.agents/skills/align-human
```

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/eval_pipeline/03-align-human

### Antigravity

In Antigravity: Copy the align-human folder into ~/.gemini/config/skills (Antigravity app and IDE) or ~/.gemini/antigravity-cli/skills (Antigravity CLI).

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/eval_pipeline/03-align-human

### Gemini CLI

Run in your terminal:

```shell
npx -y degit agentscope-ai/OpenJudge/skills/eval_pipeline/03-align-human ~/.gemini/skills/align-human
```

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/eval_pipeline/03-align-human

### Replit

Run in your terminal:

```shell
npx -y degit agentscope-ai/OpenJudge/skills/eval_pipeline/03-align-human .agents/skills/align-human
```

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/eval_pipeline/03-align-human

### OpenClaw

Run in your terminal:

```shell
npx -y degit agentscope-ai/OpenJudge/skills/eval_pipeline/03-align-human ~/.openclaw/skills/align-human
```

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/eval_pipeline/03-align-human

### OpenCode

Run in your terminal:

```shell
npx -y degit agentscope-ai/OpenJudge/skills/eval_pipeline/03-align-human ~/.config/opencode/skills/align-human
```

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/eval_pipeline/03-align-human

### Hermes Agent

Run in your terminal:

```shell
npx -y degit agentscope-ai/OpenJudge/skills/eval_pipeline/03-align-human ~/.hermes/skills/align-human
```

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/eval_pipeline/03-align-human

---
From Pluginboard (https://pluginboard.ai).