agentsop-metric-design
byagentsope· 48 skills
Decomposed, multi-criteria metric design for LLM pipelines. The metric IS the model — change the metric and the optimizer changes behavior. Decompose by default; bool during compile, float during eval; calibrate against human; mitigate judge bias. Search keywords: LLM-as-judge, llm as judge, eval metric, evaluation score, scoring function, rubric, RAGAS, G-Eval, judge bias, verbosity bias, how to evaluate LLM output.
How to install agentsop-metric-design?
agentsope/skillalchemy/agentsop-metric-design
$npx -y skills add agentsope/skillalchemy --skill agentsop-metric-designInstalls into the current project.
›Prefer a prompt? Paste this to your agent
Run `npx skills use "https://github.com/agentsope/skillalchemy" --skill "agentsope/skillalchemy/agentsop-metric-design"` and follow the generated skill instructions now. Read its complete output, redirecting it to a temporary file first if necessary. Resolve relative paths from the supporting-files directory it provides.
Use the skills in "https://github.com/agentsope/skillalchemy" that are relevant to the current task. Run `npx skills add "https://github.com/agentsope/skillalchemy"` and select the relevant skills, then follow their instructions.
Related
6 picksType
- azure-kustoQuery and analyze data in Azure Data Explorer (Kusto/ADX) using KQL for log analytics, telemetry, and time series analysis.Jul 2026
- analyticsWhen the user wants to set up, improve, or audit analytics tracking and measurement.Jul 2026
- firecrawl-dashboard-reportingPull metrics from analytics dashboards and internal web tools with Firecrawl browser.Jun 2026
- data-storytellingTransform data into compelling narratives using visualization, context, and persuasive structure.Jul 2026
- data-visualizationCreate effective data visualizations with Python (matplotlib, seaborn, plotly).Jul 2026
- extension-oqlMake a canister's data queryable by the Caffeine Data Intelligence agent.Jul 2026
