Use when scraping JavaScript-heavy pages or SPAs, crawling multiple URLs concurrently, extracting structured data with reusable CSS/JSON schemas, or building automated web data pipelines. Wraps the Crawl4AI library (crwl CLI and Python SDK) with schema-generation patterns for LLM-free extraction. Triggers on crawl4ai, crwl, scrape JS-heavy site, scrape SPA, headless browser scrape, schema-based extraction, batch crawl, sitemap crawl, web data pipeline. SKIP when a static HTML page can be read with defuddle / fetch-web — those are faster cold-start and don't need a browser.
How to install crawl4ai-skill?
brettdavies/crawl4ai-skill
$npx -y skills add brettdavies/crawl4ai-skill --skill crawl4ai-skillInstalls into the current project.
›Prefer a prompt? Paste this to your agent
Run `npx skills use "https://github.com/brettdavies/crawl4ai-skill" --skill "brettdavies/crawl4ai-skill"` and follow the generated skill instructions now. Read its complete output, redirecting it to a temporary file first if necessary. Resolve relative paths from the supporting-files directory it provides.
Use the skills in "https://github.com/brettdavies/crawl4ai-skill" that are relevant to the current task. Run `npx skills add "https://github.com/brettdavies/crawl4ai-skill"` and select the relevant skills, then follow their instructions.
Related
6 picksType
- agent-browserBrowser automation CLI for AI agents. Use when the user needs to interact with websites, including navigating pages, filling forms, clicking buttons, taking…Jul 2026
- just-scrapeSearch, scrape, crawl, extract structured data, and monitor web pages via the ScrapeGraph AI CLI.Jul 2026
- browser-actBrowser automation CLI for AI agents. NEVER run browser-act commands directly via Bash — always invoke this skill first.Jul 2026
- playwright-cliAutomate browser interactions, test web pages and work with Playwright tests.Jul 2026
- browser-useDirect browser control via CDP for web interaction: automation, scraping, testing, screenshots, and site/app work.Jul 2026
- browser-act-skill-forgeForges reusable Skill packages (SKILL.md + scripts) from website exploration via browser-act — no re-exploration later.Jul 2026
