bydatadog-labs· 37 skills
End-to-end Agent Observability pipeline for an instrumented ml_app — classify production traces, root-cause failures, bootstrap evaluators, then (optionally) sample + publish a dataset, generate + run an experiment, and analyze results. Six narrated phases with a standardized banner and a "continue" checkpoint between each. Pure orchestration over the agent-observability sub-skills (agent-observability-session-classify, agent-observability-trace-rca, agent-observability-eval-bootstrap, agent-observability-experiment-py-bootstrap, agent-observability-experiment-analyzer). Use when user says "run the eval pipeline", "go from traces to evals", "bootstrap evals end to end", "classify then RCA then bootstrap", "build an eval set from scratch", "onboard me to datasets and experiments", "walk me through experiments", "I have an ml_app, now what", "Agent Observability onboarding", "guided experiment setup", "from traces to experiments", or wants a deterministic, narrated tour from production data through evaluators, datasets, and experiments. Stop early with --stop-after <phase> to short-circuit at evaluators or dataset, or resume mid-flow with --start-at <phase>.
$npx -y skills add datadog-labs/agent-skills --skill agent-observability-eval-pipelineInstalls into the current project.
Run `npx skills use "https://github.com/datadog-labs/agent-skills" --skill "datadog-labs/agent-skills/agent-observability-eval-pipeline"` and follow the generated skill instructions now. Read its complete output, redirecting it to a temporary file first if necessary. Resolve relative paths from the supporting-files directory it provides.
Use the skills in "https://github.com/datadog-labs/agent-skills" that are relevant to the current task. Run `npx skills add "https://github.com/datadog-labs/agent-skills"` and select the relevant skills, then follow their instructions.