byexploreomni· 11 skills
Evaluate Omni AI accuracy using Omni's built-in eval system — define a prompt set, run a judged eval against a model (or branch), and read the accuracy-judge verdicts. Use this skill whenever someone wants to evaluate Omni AI, benchmark Blobby, run regression tests, compare AI output across branches or model-context changes, measure AI quality, run A/B tests on model changes, assess the impact of an ai_context or modeling change, or any variant of "run evals", "test Blobby", "benchmark query generation", "compare AI results", "regression test", "how accurate is the AI", or "measure the impact of my changes".
$npx -y skills add exploreomni/omni-agent-skills --skill omni-ai-evalInstalls into the current project.
Run `npx skills use "https://github.com/exploreomni/omni-agent-skills" --skill "exploreomni/omni-agent-skills/omni-ai-eval"` and follow the generated skill instructions now. Read its complete output, redirecting it to a temporary file first if necessary. Resolve relative paths from the supporting-files directory it provides.
Use the skills in "https://github.com/exploreomni/omni-agent-skills" that are relevant to the current task. Run `npx skills add "https://github.com/exploreomni/omni-agent-skills"` and select the relevant skills, then follow their instructions.