# 01-auto-arena

> Automatically evaluate and compare multiple AI models or agents without pre-existing test data.

Automatically evaluate and compare multiple AI models or agents without pre-existing test data. Generates test queries from a task description, collects responses from all target endpoints, auto-generates evaluation rubrics, runs pairwise comparisons via a judge model, and produces win-rate rankings with reports and charts. Supports checkpoint resume, incremental endpoint addition, and judge model hot-swap. Use when the user asks to compare, benchmark, or rank multiple models or agents on a custom task, or run an arena-style evaluation.

- Type: Skill
- Made by: agentscope-ai
- Category: AI & agents
- Formats: Skills
- Version: 8044439
- Source: https://github.com/agentscope-ai/openjudge/tree/HEAD/skills/arena-eval/01-auto-arena
- Page: https://pluginboard.ai/skills/01-auto-arena

## Works with

- ChatGPT
- Claude
- Gemini
- GitHub Copilot
- Cursor
- Claude Code
- Codex
- Antigravity
- Gemini CLI
- Replit
- OpenClaw
- OpenCode
- Hermes Agent

## Install

### ChatGPT

In ChatGPT: Download the 01-auto-arena folder and zip it, then Plugins → Skills → Create → Upload from your computer. Business and Enterprise plans.

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/arena-eval/01-auto-arena

### Claude

In Claude (web or desktop): Download the 01-auto-arena folder and zip the folder itself, then upload it in Customize → Skills.

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/arena-eval/01-auto-arena

### Gemini

In Gemini: Download the 01-auto-arena folder, then at gemini.google.com click Customize → Skills → Create → Upload and pick the folder (or a .zip of it).

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/arena-eval/01-auto-arena

### GitHub Copilot

Run in your terminal:

```shell
npx -y degit agentscope-ai/OpenJudge/skills/arena-eval/01-auto-arena ~/.copilot/skills/01-auto-arena
```

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/arena-eval/01-auto-arena

### Cursor

Run in your terminal:

```shell
npx -y degit agentscope-ai/OpenJudge/skills/arena-eval/01-auto-arena ~/.cursor/skills/01-auto-arena
```

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/arena-eval/01-auto-arena

### Claude Code

Run in your terminal:

```shell
npx -y degit agentscope-ai/OpenJudge/skills/arena-eval/01-auto-arena ~/.claude/skills/01-auto-arena
```

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/arena-eval/01-auto-arena

### Codex

Run in your terminal:

```shell
npx -y degit agentscope-ai/OpenJudge/skills/arena-eval/01-auto-arena ~/.agents/skills/01-auto-arena
```

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/arena-eval/01-auto-arena

### Antigravity

In Antigravity: Copy the 01-auto-arena folder into ~/.gemini/config/skills (Antigravity app and IDE) or ~/.gemini/antigravity-cli/skills (Antigravity CLI).

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/arena-eval/01-auto-arena

### Gemini CLI

Run in your terminal:

```shell
npx -y degit agentscope-ai/OpenJudge/skills/arena-eval/01-auto-arena ~/.gemini/skills/01-auto-arena
```

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/arena-eval/01-auto-arena

### Replit

Run in your terminal:

```shell
npx -y degit agentscope-ai/OpenJudge/skills/arena-eval/01-auto-arena .agents/skills/01-auto-arena
```

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/arena-eval/01-auto-arena

### OpenClaw

Run in your terminal:

```shell
npx -y degit agentscope-ai/OpenJudge/skills/arena-eval/01-auto-arena ~/.openclaw/skills/01-auto-arena
```

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/arena-eval/01-auto-arena

### OpenCode

Run in your terminal:

```shell
npx -y degit agentscope-ai/OpenJudge/skills/arena-eval/01-auto-arena ~/.config/opencode/skills/01-auto-arena
```

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/arena-eval/01-auto-arena

### Hermes Agent

Run in your terminal:

```shell
npx -y degit agentscope-ai/OpenJudge/skills/arena-eval/01-auto-arena ~/.hermes/skills/01-auto-arena
```

View the folder on GitHub: https://github.com/agentscope-ai/OpenJudge/tree/HEAD/skills/arena-eval/01-auto-arena

---
From Pluginboard (https://pluginboard.ai).