Loading listing…
01-auto-arena
Security scan passedAutomatically evaluate and compare multiple AI models or agents without pre-existing test data.
Part of OpenJudgePack · 21 skills
by agentscope-ai· AI & agentsUnclaimed · Yours? Claim it
What 01-auto-arena does
About
Automatically evaluate and compare multiple AI models or agents without pre-existing test data. Generates test queries from a task description, collects responses from all target endpoints, auto-generates evaluation rubrics, runs pairwise comparisons via a judge model, and produces win-rate rankings with reports and charts. Supports checkpoint resume, incremental endpoint addition, and judge model hot-swap. Use when the user asks to compare, benchmark, or rank multiple models or agents on a custom task, or run an arena-style evaluation.
Install 01-auto-arena
More from AI & agents
Skills people install alongside 01-auto-arena.
