Fast, free, open-source technical SEO + GEO crawler: built for humans and agents.
How to install crawlie?
spronta/crawlie
$git clone https://github.com/spronta/crawlieInstalls into the current project.
›Prefer a prompt? Paste this to your agent
Install crawlie by running `git clone https://github.com/spronta/crawlie`, then use it for the current task and follow its documentation at https://github.com/spronta/crawlie.
Related
6 picksType
- mcp-server-typescriptA Model Context Protocol (MCP) server for the DataForSEO API, enabling modular and extensible integration of DataForSEO endpoints with support for both HTTP and SSE transports.Jul 2026
- dataforseo-mcp-serverA comprehensive stdio MCP server for DataForSEO APIJun 2026
- mcp-gscGoogle Search Console Insights with Claude AI for SEOsJul 2026
- meta-ads-mcpFacebook / Meta Ads automation with AI: analyze performance, test creatives, optimize spend.Jul 2026
- mcp-server-gscEnhanced Model Context Protocol server for Google Search Console with 25K row limit, regex filters, and automatic quick wins detectionFeb 2026
- postmark-mcpOfficial Postmark MCP server for sending emails via Claude and AI assistantsJul 2026
