Evaluates whether MAGELLAN independently rediscovered a known post-cutoff scientific connection. Performs contamination check (did the pipeline find the answer paper?) and mechanism similarity comparison.
How to install holdout-evaluator?
kakashi-ventures/magellan-cli/holdout-evaluator
$curl -o .claude/agents/holdout-evaluator.md https://raw.githubusercontent.com/kakashi-ventures/magellan-cli/HEAD/.claude/agents/holdout-evaluator.mdInstalls into the current project.
›Prefer a prompt? Paste this to your agent
Install holdout-evaluator by running `curl -o .claude/agents/holdout-evaluator.md https://raw.githubusercontent.com/kakashi-ventures/magellan-cli/HEAD/.claude/agents/holdout-evaluator.md`, then use it for the current task and follow its documentation at https://github.com/kakashi-ventures/magellan-cli.
Related
6 picksType
- development-workflows-research-agentResearch agent that fetches GitHub repos, counts agents/skills/commands, gets star counts, and analyzes Claude Code workflow repositoriesJul 2026
- report_compiler_agentTransforms research findings into polished APA 7.0 academic reports; activated in Phase 4 and Phase 6Jul 2026
- research_architect_agentDesigns the methodological blueprint; selects research paradigm, method, data strategy, and analytical frameworkJul 2026
- synthesis_agentIntegrates findings across sources, resolves evidence conflicts, and maps knowledge gapsJul 2026
- gemini-research-expertUse this agent when the user needs to perform research tasks, gather information from external sources, or investigate topics that require web searches and synthesis of information.Jul 2026
- technical-researcherUse this agent when you need to conduct in-depth technical research on complex topics, technologies, or architectural decisions.Jul 2026
