byhuman-agent-society· 12 skills
Author a new CORAL task — the three pieces that must line up (task.yaml, seed/, a packaged grader/), the coral init → coral validate → smoke-test loop, and how to pick a grader pattern (stdout float, test pass-rate, ratio-vs-baseline, multi-metric, or an LLM rubric judge). Use whenever the user wants to create a CORAL task, write or wire a grader, port a benchmark into CORAL, score open-ended outputs (reports/memos) with a judge, or debug a grader that crashes on the seed / ranks the leaderboard backwards / leaks the answer key. Deep references for the TaskGrader API, grader patterns, rubric judges, and the full task.yaml schema live alongside this skill.
$npx -y skills add human-agent-society/coral --skill creating-a-coral-taskInstalls into the current project.
Run `npx skills use "https://github.com/human-agent-society/coral" --skill "human-agent-society/coral/creating-a-coral-task"` and follow the generated skill instructions now. Read its complete output, redirecting it to a temporary file first if necessary. Resolve relative paths from the supporting-files directory it provides.
Use the skills in "https://github.com/human-agent-society/coral" that are relevant to the current task. Run `npx skills add "https://github.com/human-agent-society/coral"` and select the relevant skills, then follow their instructions.