Loading listing…
align-human
Security scan passedUse when the user has a judge/grader and human-labeled data, and wants to measure how well the judge agrees with humans…
Part of OpenJudgePack · 21 skills
by agentscope-ai· AI & agentsUnclaimed · Yours? Claim it
What align-human does
About
Use when the user has a judge/grader and human-labeled data, and wants to measure how well the judge agrees with humans, detect systematic biases, determine whether automatic evaluation can replace human review, or build a human-reduction roadmap. Also use when the user mentions calibration, TPR/TNR, judge validation, inter-rater agreement, Cohen's kappa, bias detection, or "is my automatic evaluation trustworthy." Merges the calibrate and align functions into one skill.
Install align-human
More from AI & agents
Skills people install alongside align-human.
