Crawlwise
Server Details
SEO audits and AI crawler checks. Honest findings only; no invented scores.
- Status
- Healthy
- Uptime
- 100.0% over the last 24 hours
- OAuth
- Works in Glama
- Last Tested
- Transport
- Streamable HTTP · MCP 2025-06-18
- URL
- Repository
- Adnanarodiya/crawlwise-skills
- GitHub Stars
- 0
- ChatGPT
- –
- Claude
- –
TDQS
Scored across 18 tools
Each tool has a clearly distinct purpose, and descriptions actively draw boundaries between easily confused pairs: audit_page vs crawl_site vs get_audit (start page audit / start site crawl / poll job), and check_ai_crawlers vs verify_bot vs check_agent_readiness (fetch as bot / verify claimed bot IP / agent readability). generate_schema vs validate_schema is similarly clean. No two tools appear to do the same thing.
Consistent snake_case verb_noun pattern throughout: check_*, get_*, generate_*, list_*, audit_page, crawl_site, estimate_cost, explain_finding, validate_schema, verify_bot. No camelCase or mixed-convention outliers.
18 tools is at the upper end of comfortable, but the set partitions cleanly into audits, crawls, generators, validators, bot checks, and account tools, so each tool earns a place. Slightly heavy but not bloated.
Strong lifecycle coverage: start/poll audits, crawl then retrieve issues and link suggestions, cost estimation, credit balance, generation plus validation, and bot verification. Minor gaps: list_sites exists but no add/remove site operation, and no report export or keyword-rank surface (though rank tracking is explicitly out of scope by design).
Publisher details
- Operator
- Crawlwise · Publisher source
- Operator website
- https://crawlwise.site · Publisher source
- Vendor relationship
- First-party · Publisher source
- Documentation
- https://crawlwise.site/docs/mcp · Publisher source
- Trust center
- Not applicable
- Restrictions
- Free MCP tools need no key. Audits and crawls require a signed-in account and credits. API keys require Pro+ at https://crawlwise.site/account/api. OAuth at https://crawlwise.site/agents. · Publisher source
Available Tools
18 toolsaudit_pageAudit a pageAInspect
Start a full page audit. Spends credits (from 1.25 per page; call estimate_cost first for the exact price). Returns a job_id immediately. Poll with get_audit using that job_id until status is complete. Findings are grouped as priority / worth considering / not measured. Does NOT measure keyword ranks, backlinks, traffic, or Search Console data. Does NOT invent scores. Every action cites a real check id.
Inputs: url (required), site_id.
check_agent_readinessCheck agent readinessARead-onlyIdempotentInspect
Read one page the way a browsing agent (ChatGPT agent, Claude in Chrome, Gemini in Chrome) uses it: accessible names, clickable divs, ARIA structure, WebMCP tools (declarative forms and registerTool), llms.txt, Markdown versions of the page, and whether robots.txt lets ChatGPT-User, Claude-User and Perplexity-User fetch it. Each item is ready, needs work, not applicable or not measured. Spends no credits. Does NOT give a score. Does NOT run JavaScript: registerTool calls are read from inline scripts only, not from script files, and layout shift is not measured. Does NOT measure whether an agent succeeds at a task on the page.
Inputs: url (required).
check_ai_crawlersCheck AI crawler accessARead-onlyIdempotentInspect
Fetch the URL as GPTBot, ClaudeBot and other AI crawlers and report allowed / blocked / challenged / not established. Does NOT measure whether a model would cite the page, brand mentions, or ranking in ChatGPT. A 200 is reachability, not visibility.
Inputs: url (required).
check_vitalsCheck Core Web VitalsARead-onlyIdempotentInspect
Core Web Vitals via PageSpeed Insights for one URL and one strategy. Does NOT measure field (CrUX) data unless PageSpeed returns it. Does NOT audit the rest of the site. A missing lab metric is not_measured, never 0.
Inputs: url (required), strategy.
crawl_siteCrawl a siteAInspect
Start a multi-page crawl of a site you own. Spends credits per page fetched (call estimate_cost with operation crawl and units = pages first). Returns a crawl id immediately. Does NOT run keyword or rank checks. Does NOT crawl the whole internet; it stops at the plan page cap. Orphans are not_measured when the crawl was capped.
Inputs: site_id (required), pages, allow_subdomains.
estimate_costEstimate credit costARead-onlyIdempotentInspect
What an operation would cost this account, in credits. Never charges. Never creates a job. Does NOT reserve credits.
Inputs: operation (required), units.
explain_findingExplain a findingARead-onlyIdempotentInspect
Full detail for one check id from an audit job or report. Does NOT add advice that is not already on that check. If the check is not_measured, that is the answer.
Inputs: audit_id (required), check_id (required).
generate_meta_tagsGenerate meta tagsARead-onlyIdempotentInspect
Generate HTML meta tags from the fields you supply. Does NOT fetch the live page. Does NOT check uniqueness across the site.
Inputs: title, canonical, description.
generate_robots_txtGenerate robots.txtARead-onlyIdempotentInspect
Generate a robots.txt from rules you supply. Does NOT fetch the live robots.txt. Does NOT prove crawlers will honour it.
Inputs: rules, sitemaps.
generate_schemaGenerate schema markupARead-onlyIdempotentInspect
Generate JSON-LD for a schema.org type from the fields you supply. Does NOT fetch the live page. Does NOT validate eligibility; use validate_schema for that.
Inputs: kind (required), fields.
get_auditGet audit resultsARead-onlyIdempotentInspect
Poll an audit started with audit_page. Pass the job_id. When status is running, call again. When complete, returns findings grouped as priority / worth considering / not measured. Does NOT start a new audit. Does NOT charge. Does NOT invent checks. An empty group means none, not that the site is perfect.
Inputs: job_id (required), audit_id.
get_crawl_issuesGet crawl issuesARead-onlyIdempotentInspect
Cross-page findings from a finished crawl: duplicate titles, redirect chains, broken internal links, orphans. Does NOT invent issues the crawl did not observe. An empty list means none were found, not that the site is perfect.
Inputs: crawl_id (required).
get_creditsGet credit balanceBRead-onlyIdempotentInspect
Current credit balance and recent spend. Does NOT change the balance. Does NOT show other accounts.
Inputs: no named parameters.
get_internal_link_suggestionsGet internal link suggestionsARead-onlyIdempotentInspect
Internal-link suggestions from a finished crawl. Returns an empty list when there is nothing real to suggest. Does NOT generate links to pages the crawl never saw. Does NOT rewrite your copy.
Inputs: crawl_id (required).
get_query_gapsGet query gaps for a pageARead-onlyIdempotentInspect
For one page of a site: the search queries it already earns impressions for in Google Search Console and Bing Webmaster Tools (merged, grouped into clusters of close variants), whether the page covers each cluster well, weakly or not at all (with the heading or sentence that covers it), a High/Medium/Low priority, and a suggested change. Spends no credits. Needs Search Console and/or Bing connected on the site page. Does NOT write the new copy and does NOT read the live SERP: hand the returned brief to the writer, and check the top results yourself before adding a section. An empty cluster list means no query rows were reported, not that the page has no demand.
Inputs: url (required), site_id (required), range.
list_sitesList sitesBRead-onlyIdempotentInspect
List sites on this account. Does NOT include other users. Does NOT verify domains as a side effect.
Inputs: include_archived.
validate_schemaValidate structured dataARead-onlyIdempotentInspect
Validate JSON-LD / schema.org markup against Rich Results eligibility. Does NOT submit anything to Google. Does NOT measure whether rich results actually appear in search. FAQPage is reported as not a rich-result opportunity.
Inputs: url, json.
verify_botVerify an AI or search botARead-onlyIdempotentInspect
Check whether a visitor claiming to be GPTBot, ClaudeBot, PerplexityBot, Googlebot, Bingbot or Applebot really is, from its IP. Pass one IP or access-log line in ip, or up to 25 in lines. Checks the IP against the ranges each operator publishes and, for Google, Bing and Apple, forward-confirmed reverse DNS. Verdicts: verified, impostor (claims a bot but the IP is outside that operator's ranges), other-bot, unknown, not-checked (a range file could not be fetched). Spends no credits. Does NOT block anything. Does NOT verify bots whose operators publish no ranges; those are unknown, not impostors.
Inputs: ip, lines, user_agent.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
Related MCP Connectors
SEO and AI search audit for any website: technical SEO, schema, AI crawler access and llms.txt.
Technical SEO + GEO (AI-search) site audits: hosted crawls, prioritized fixes, report diffs.
SEO check of any website and AI crawler access test (access pass), and the full Audit.
SEO audit and AI visibility check for your website, plus Search Console keyword opportunities.
Related MCP Servers
- FlicenseNot gradedqualityCmaintenanceAudits any website for SEO issues, providing scored health checks, schema validation, and performance analysis through AI assistants.-
- AlicenseNot gradedqualityBmaintenanceRuns AI visibility (GEO/AEO) audits on websites, checking AI crawler access, schema markup, llms.txt, and content signals, with optional full PDF report.MIT

SEO Score APIofficial
AlicenseNot gradedqualityCmaintenanceAutomated SEO, AEO, ADA auditing for your website or project.69 npmMIT- AlicenseAqualityDmaintenanceAudits AI-bot visibility: robots.txt per-bot for 22 AI user-agents (GPTBot/ClaudeBot/PerplexityBot/etc), Cloudflare flags, JSON-LD, sitemap, llms.txt, SPA shell, plus cross-model brand mentions via Perplexity + OpenRouter. 0-100 score. SSRF-guarded, spend-capped.41MIT
Glama MCP Gateway
Add one secure layer between your agents and this server.