Loading listing…
01-graders-and-pipeline
Security scan passedBuild custom LLM evaluation pipelines using the OpenJudge framework.
Part of OpenJudgePack · 21 skills
by agentscope-ai· AI & agentsUnclaimed · Yours? Claim it
What 01-graders-and-pipeline does
About
Build custom LLM evaluation pipelines using the OpenJudge framework. Covers selecting and configuring graders (LLM-based, function-based, agentic), running batch evaluations with GradingRunner, combining scores with aggregators, applying evaluation strategies (voting, average), auto-generating graders from data, and analyzing results (pairwise win rates, statistics, validation metrics). Use when the user wants to evaluate LLM outputs, compare multiple models, design scoring criteria, or build an automated evaluation system.
Install 01-graders-and-pipeline
More from AI & agents
Skills people install alongside 01-graders-and-pipeline.
