.fyi
SkillsMCPPluginsSubagents

Browse by category

DevOps & CI/CD SkillsProductivity & Workflow SkillsOther SkillsProduct & Project Management SkillsDocumentation & Knowledge SkillsCode Review & Refactor SkillsBackend & APIs SkillsAgent Meta & Communication SkillsResearch SkillsSecurity SkillsUX UI & Design SkillsTesting & QA SkillsSee all →

Every Claude Code skill, MCP server, plugin and subagent in one directory. Searchable, comparable, and one command from installed. Live stats from GitHub, npm and PyPI.

We're on Product HuntYour agent's app storeCheck it out →
Agent SkillsMCP ServersPluginsSubagentsCoding Agents
CollectionsOfficial publishersGlossaryFAQBlogSearchSavedFeedback
PrivacyTermsllms.txtSitemap

made with ♥ · © 2026 aaaa.fyi

Independent project · real data from public registries

…/agent-skills/agent-observability-eval-pipeline
home/skills/datadog-labs/agent-skills/agent-observability-eval-pipeline
datadog-labs avatar

agent-observability-eval-pipeline

bydatadog-labs· 37 skills

Installs

146

Stars

147

Forks

20

Category

Testing & QA

View on GitHub

TL;DR

End-to-end Agent Observability pipeline for an instrumented ml_app — classify production traces, root-cause failures, bootstrap evaluators, then (optionally) sample + publish a dataset, generate + run an experiment, and analyze results. Six narrated phases with a standardized banner and a "continue" checkpoint between each. Pure orchestration over the agent-observability sub-skills (agent-observability-session-classify, agent-observability-trace-rca, agent-observability-eval-bootstrap, agent-observability-experiment-py-bootstrap, agent-observability-experiment-analyzer). Use when user says "run the eval pipeline", "go from traces to evals", "bootstrap evals end to end", "classify then RCA then bootstrap", "build an eval set from scratch", "onboard me to datasets and experiments", "walk me through experiments", "I have an ml_app, now what", "Agent Observability onboarding", "guided experiment setup", "from traces to experiments", or wants a deterministic, narrated tour from production data through evaluators, datasets, and experiments. Stop early with --stop-after <phase> to short-circuit at evaluators or dataset, or resume mid-flow with --start-at <phase>.

How to install agent-observability-eval-pipeline?

datadog-labs/agent-skills/agent-observability-eval-pipeline
$npx -y skills add datadog-labs/agent-skills --skill agent-observability-eval-pipeline

Installs into the current project.

›Prefer a prompt? Paste this to your agent

Use this skill

Run `npx skills use "https://github.com/datadog-labs/agent-skills" --skill "datadog-labs/agent-skills/agent-observability-eval-pipeline"` and follow the generated skill instructions now. Read its complete output, redirecting it to a temporary file first if necessary. Resolve relative paths from the supporting-files directory it provides.

Use the whole pack

Use the skills in "https://github.com/datadog-labs/agent-skills" that are relevant to the current task. Run `npx skills add "https://github.com/datadog-labs/agent-skills"` and select the relevant skills, then follow their instructions.

Preview

datadog-labs/agent-skillsdatadog-labs/agent-skills

$ npx -y skills add datadog-labs/agent-skills --skill agent-observability-eval-pipeline

▸ installing to .claude/skills…

✓ agent-observability-eval-pipeline ready

Repodatadog-labs/agent-skills
TypeSkills
CategoryTesting & QA
ForDeveloperOps
UpdatedJul 2026
License—
First seenJul 27, 2026

Tags

Skill

Related

6 picks
Type
  1. mattpocock avatartddTest-driven development. Use when the user wants to build features or fix bugs test-first, mentions "red-green-refactor", or wants integration tests.SkillsJul 2026544k189k
  2. obra avatartest-driven-developmentUse when implementing any feature or bugfix, before writing implementation codeSkillsJul 2026181k261k
  3. mattpocock avatarqaInteractive QA session where user reports bugs or issues conversationally, and the agent files GitHub issues.SkillsJul 2026179k189k
  4. obra avatarverification-before-completionUse when about to claim work is complete, fixed, or passing, before committing or creating PRs - requires running verification commands and confirming output…SkillsJul 2026160k261k
  5. anthropics avatarwebapp-testingToolkit for interacting with and testing local web applications using Playwright.SkillsJul 2026123k164k
  6. currents-dev avatarplaywright-best-practicesUse when writing Playwright tests, fixing flaky tests, debugging failures, implementing Page Object Model, configuring CI/CD, optimizing performance, mocking…SkillsJul 202666k340