librecrawl-technical-seo-audit-mcp
Integrates with Google Search Console to fetch search performance data and index coverage.
Integrates with Google PageSpeed Insights API to fetch performance scores and recommendations for crawled URLs.
This server does not currently have a deployable release on Glama. Follow the repository's setup instructions to install and configure it for your MCP client, including any required credentials and local dependencies.
Sitewalk: SEO audit in ChatGPT, and the open-source technical SEO audit server
Ask ChatGPT to audit your website. Find what is broken, what to fix first, and how, in about a minute of your time.
Sitewalk crawls your site the way a search engine bot does and gives you the technical SEO problems ranked by impact, each with a plain fix, a site health score out of 100, and a report you can send to a client or developer.
Two ways to use it
In ChatGPT (hosted) | Self-hosted (this repository) | |
Setup | None. Open the app, ask for an audit | Docker, one command: |
Checks | 200+ in 18 groups | 30+ |
Cost | Free to start, 5 audits a month | Free forever, MIT licence |
Pages per audit | 50 without a confirmed email, 500 with one | No cap, your machine |
Your data | Report links, CSV and PDF | Never leaves your machine |
Best for | Site owners, freelancers, agencies | Developers who want to run it themselves |
Start in ChatGPT: Use Sitewalk in ChatGPT. This repository is the open-source server and nothing else: a Python MCP server that drives the open-source LibreCrawl crawler. The hosted service runs separate code.
Related MCP server: growth-mcp
Try it in 60 seconds
Open Sitewalk in ChatGPT.
Type:
Audit https://yoursite.com for technical SEO problemsThe first time, enter the 6-digit code we email you. No password.
Other things people ask it:
What should I fix first on my site?Find broken links, redirect chains and duplicate titlesIs a noindex tag or robots.txt keeping my pages out of search?Is my site ready for AI search? Check llms.txt and AI crawler accessMonitor yoursite.com and tell me if something breaks
What you get
A site health score out of 100 and every problem ranked worst first, with the pages it affects.
A plain-English fix for each problem, so you can act on it or hand it to a developer.
A web report, plus PDF and CSV downloads.
Checks for broken links and redirect chains, titles and meta descriptions, canonicals and noindex, hreflang, sitemaps, structured data, images, security headers, page speed and AI-search readiness.
Monthly monitoring of a site you have audited, with an email only when something changes.
Politeness built in: it reads robots.txt, identifies itself as SitewalkBot, and keeps a slow pace.
Not covered: backlinks, keyword rankings, Google Search Console or analytics data.
Common questions
Is there a Screaming Frog alternative that works inside ChatGPT? Sitewalk runs the crawl on its own server and returns a ranked list in the chat, so there is nothing to install. Screaming Frog is stronger for very large sites and custom extraction: see the comparison, with dated sources.
Is there a free technical SEO audit tool? Yes. Sitewalk is free for 5 audits a month in ChatGPT, and the self-hosted server is free with no limits.
Does it work on any website? Any public website, within robots.txt. A site that blocks crawlers will say so in the report.
How long does an audit take? A small site usually takes a few minutes, a 500-page audit 20 to 60 minutes. It keeps running if you close the chat, and you get an email when it is done.
A free, open-source Screaming Frog alternative
The self-hosted build in this repository is free and MIT licensed, with no page cap and no account. You run it with Docker, ask your AI assistant to audit a site, and get a ranked list of technical SEO problems, a PDF and CSVs, with your data staying on your machine. It runs 30+ checks: broken links, redirects, canonicals, titles and descriptions, headings, schema, images, hreflang and sitemap gaps.
Screaming Frog is stronger for very large crawls, custom extraction and JavaScript rendering of a whole site. If you want the result inside ChatGPT without hosting anything, use the hosted app (200+ checks, 5 free audits a month). Dated comparison: Sitewalk vs Screaming Frog.
What is MCP?
MCP (Model Context Protocol) is an open standard that lets an AI assistant call outside tools. This repository is one such tool: your assistant asks it to crawl a site and gets the findings back. You do not need to know anything about MCP to use Sitewalk in ChatGPT. It only matters if you run this repository yourself.
Self-host it
You need Docker running. Then:
git clone https://github.com/adityaarsharma/sitewalk.git
cd sitewalk
./setup.shThe script checks your machine, asks one optional question (a Google PageSpeed key), builds and starts the stack, waits until the MCP server answers, and prints exactly how to connect your assistant. The first build takes a few minutes.
Command | What it does |
| Guided setup |
| Same, no questions |
| Only check that your machine can run it |
| Pull the newest release and rebuild |
| Stop it (your reports are kept) |
Without Docker, see the manual route in docs/GETTING-STARTED.md.
Connect an assistant
The server listens on http://127.0.0.1:5081/mcp (streamable HTTP).
ChatGPT and Grok reach servers over the internet, so they need a public https address that forwards to your machine. The server has no sign-in of its own, so put it behind a tunnel that adds access control. Steps in docs/GETTING-STARTED.md.
Clients on your computer (Codex, Windsurf, any stdio-only client) connect through
mcp-remote:
{
"mcpServers": {
"sitewalk": {
"command": "npx",
"args": ["-y", "mcp-remote", "http://127.0.0.1:5081/mcp"]
}
}
}Then ask: Audit https://yoursite.com for technical SEO problems.
Self-hosted details
30+ checks per audit (self-hosted) (broken links, redirects, canonicals, titles and descriptions, headings, schema, images, hreflang, sitemap gaps, and more). Full list and the nine report files: docs/CHECKS.md.
A branded PDF, a Markdown copy and CSVs, zipped in
./reports.Chunked crawling that does not time out, WAF challenge detection, and a crawl delay that adapts to the site.
38 MCP tools: docs/TOOLS.md.
Docs
Guide | What is inside |
Docker and manual setup, connecting clients, your first audit | |
Every environment variable, HTTP and stdio transport | |
All 38 MCP tools | |
The 30+ checks and the report files | |
How the pieces fit | |
Common errors and fixes |
Releases
Every change to the code that lands on main is tested and published as a new GitHub release automatically. Update with ./setup.sh --update.
Licence and credits
Code is MIT: see LICENSE and NOTICE.md. Built on LibreCrawl (MIT), FastMCP and WeasyPrint. No telemetry.
Built by Aditya Sharma.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
This server cannot be deployed
Maintenance
Related MCP Connectors
Free technical-SEO audit MCP: crawl a site, run checks, return an LLM-ready shareable report.
Free MCP server that audits any public URL: technical SEO, Core Web Vitals, indexing checks.
Open-source AI SEO over MCP: audits, ranks, keywords, backlinks + AI visibility (GEO).
Hosted Web Crawler MCP server for Claude, ChatGPT and Cursor, with each action switched per account.
Related MCP Servers
- AlicenseNot gradedqualityDmaintenanceMCP server that exposes OnCrawl's API for use with Claude Code and Claude Desktop. Enables Claude to perform deep technical SEO analysis by querying crawl data, Google Search Console metrics, and crawl-over-crawl comparisons.2MIT
- AlicenseNot gradedqualityDmaintenanceOpen-source MCP server that audits websites for AI search readiness, providing deterministic scoring (0-100) and prioritized fix lists for metrics like JSON-LD, llms.txt, heading hierarchy, and AI crawler access.1MIT
- AlicenseAqualityBmaintenanceAn MCP server that lets an AI agent audit a page for SEO and GEO — on-page tags, structured data, robots.txt, sitemaps, hreflang, and whether ChatGPT, Claude, Perplexity and Gemini can actually crawl and cite you. No API keys required.17216 npm1MIT
- AlicenseNot gradedqualityBmaintenanceAn open-source, local-first MCP server for automated Schema.org JSON-LD generation, GA4 metric validation, /llm.txt auditing, and content stickiness analytics.MIT