SEO Crawler MCP
The SEO Crawler MCP is a self-contained, local website crawling and SEO analysis server backed by SQLite storage. It provides four core tools:
run_seo_audit— Crawl any website (up to 10,000 pages, 10 levels deep) using Chrome or Googlebot user agents, storing page data, links, headers, and metadata in a local SQLite database.analyze_seo— Run 25+ SQL queries across five categories, returning structured reports with affected URLs and fix recommendations in structured, summary, or detailed formats.query_seo_data— Execute individual named queries (e.g.,missing-titles,broken-internal-links,orphan-pages,missing-csp) for targeted results.list_seo_queries— Discover all 28 predefined queries, filterable by category or priority (CRITICAL/HIGH/MEDIUM/LOW).
What gets detected:
Critical: Missing titles, broken internal links, 4xx/5xx errors
Content: Duplicate/missing titles, descriptions, H1s, thin content
Technical: Redirect chains, orphan pages, canonical mismatches, non-HTTPS pages
Security: Missing CSP/HSTS/X-Frame-Options/Referrer-Policy headers, unsafe external links
Optimisation: Title/description length issues, missing images, excessive external links
Everything runs locally with no external API dependencies. It supports both AI assistant orchestration via MCP tools and direct terminal CLI usage for large or scheduled crawls.
Provides an embedded SQLite database for storing website crawl data, allowing AI agents to perform automated SEO audits and custom SQL queries to analyze site structure, metadata, and technical issues.
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@SEO Crawler MCPcrawl https://example.com and audit it for technical SEO issues"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
SEO Crawler MCP - retired
This project has been superseded by SEO Audit Console.
SEO Crawler crawled your whole site into SQLite and gave Claude 25+ analysis queries over the result. The crawler survived the move - it was rewritten to be stdio-safe and it is now the crawl half of a bigger tool.
SEO Audit Console keeps the crawl and adds the thing the crawl could never tell you on its own: what people actually searched for to get there. It merges the crawl with your Google Search Console history and on-demand DataForSEO data, then ranks every finding by the clicks it could recover rather than by severity.
A flat crawler sells you severity. This ranks by yield.
Where to go
git clone https://github.com/houtini-ai/seo-audit.gitDocs and setup: github.com/houtini-ai/seo-audit
Related MCP server: seoagent
What this means for you
The npm package still installs.
@houtini/seo-crawler-mcpis deprecated, not unpublished. Nothing you have running will break.This repository is archived. The code stays readable and every existing link keeps working, but there are no further releases, and issues and pull requests are closed.
The crawler got better on the way over. It no longer depends on Crawlee (which logged to stdout and corrupted MCP's JSON-RPC framing), it seeds discovery from sitemaps and known GSC URLs rather than links alone, and it guards against redirects that wander off-host.
Migrating
Start a crawl on the new tool and it builds its own database:
start_crawl for https://example.com/Run refresh_property instead if you want the crawl, the Search Console sync and URL inspection in one pass.
Part of the Houtini open-source MCP set. Questions: hello@houtini.com.
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Servers
- AlicenseAqualityFmaintenanceDownloads your entire Search Console dataset into a local SQLite database, then gives your LLM a pre-built SQL query library for every standard SEO analysis type, with context available for your LLM to perform any SQL query to answer your questions and analyse for you.122117Apache 2.0
- AlicenseNot gradedqualityCmaintenanceAgent-first SEO toolkit with 24 MCP tools for keyword research, rank tracking, site audits up to 50k pages, competitor analysis, content gap detection, domain reputation, backlink intelligence, Google Search Console integration, and AI-powered strategy generation with Claude, GPT, and Ollama. SQLite-backed and bring-your-own-key.MIT
- AlicenseAqualityDmaintenanceEnables SEO auditing and site analysis by crawling websites, identifying issues, and generating reports like sitemaps and markdown exports.594MIT
- AlicenseNot gradedqualityCmaintenanceOpen-source technical SEO crawler MCP server built on LibreCrawl. Runs full audits inside Claude, Cursor, or Codex — 50+ checks (hreflang, schema.org, security headers, WAF detection on 200-OK pages), chunked-progressive engine for large sites, ephemeral by design (server forgets every audit after download).34MIT
Related MCP Connectors
SEO MCP server: crawl your site, find AI-visibility gaps, and ship the fix from your coding agent.
Technical SEO + GEO (AI-search) site audits: hosted crawls, prioritized fixes, report diffs.
Scrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.
Appeared in Searches
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/houtini-ai/seo-crawler-mcp'
If you have feedback or need assistance with the MCP directory API, please join our Discord server