agentsop-domain-eval-set
byagentsope· 48 skills
Build and govern a 50-200 example domain-specific held-out benchmark sampled from real traffic. Distinct from public benchmarks (MMLU/HumanEval/GSM8K via lm-evaluation-harness) which measure GENERAL capability. Only a held-out domain set predicts whether THIS system works on YOUR data. Collect real examples, label, hold out (never train/prompt on it), size 50-200, version it, refresh on drift.
How to install agentsop-domain-eval-set?
agentsope/skillalchemy/agentsop-domain-eval-set
$npx -y skills add agentsope/skillalchemy --skill agentsop-domain-eval-setInstalls into the current project.
›Prefer a prompt? Paste this to your agent
Run `npx skills use "https://github.com/agentsope/skillalchemy" --skill "agentsope/skillalchemy/agentsop-domain-eval-set"` and follow the generated skill instructions now. Read its complete output, redirecting it to a temporary file first if necessary. Resolve relative paths from the supporting-files directory it provides.
Use the skills in "https://github.com/agentsope/skillalchemy" that are relevant to the current task. Run `npx skills add "https://github.com/agentsope/skillalchemy"` and select the relevant skills, then follow their instructions.
Related
6 picksType
- azure-kustoQuery and analyze data in Azure Data Explorer (Kusto/ADX) using KQL for log analytics, telemetry, and time series analysis.Jul 2026
- analyticsWhen the user wants to set up, improve, or audit analytics tracking and measurement.Jul 2026
- firecrawl-dashboard-reportingPull metrics from analytics dashboards and internal web tools with Firecrawl browser.Jun 2026
- data-storytellingTransform data into compelling narratives using visualization, context, and persuasive structure.Jul 2026
- data-visualizationCreate effective data visualizations with Python (matplotlib, seaborn, plotly).Jul 2026
- extension-oqlMake a canister's data queryable by the Caffeine Data Intelligence agent.Jul 2026
