"Understanding Web Crawlers" matching MCP connectors:
Matching Connector Tools:
Brand health & trend footprint across PSFK expert graphs with citable sources, not web summaries.
Answers on AEO, SEO, web and brand from GOJI's published material. Melbourne, Australia.
Finds timely sources across news, social, and the web and writes posts worth publishing.
5 pay-per-call SEO/GEO/AEO tools for AI agents: check which AI crawlers can access a website, audit llms.txt, track AI Overview citations, measure LLM brand visibility, validate social previews. Free discovery + pricing_info tool; paid calls $0.01-0.02 in USDC on Base via x402 — you only pay for successful runs.
Validate HTML and CSS, audit SEO and JSON-LD, and check user-authorized public links.
Security, SEO and AI-visibility scanner for web apps · free scans and focused checks via MCP.
MCP server for SEO and web analysis data including keyword rankings, backlink profiles, site audits, and traffic analytics for AI agents.
Scan any website for SEO, performance, accessibility, and AI search issues. Returns structured issues with fix prompts you can paste into Claude or Cursor to fix immediately. 40+ checks including Core Web Vitals, Open Graph, structured data, and AI search visibility.
SEO automation MCP with 39 tools. 12 free tools (no auth): audit pages, check Core Web Vitals, validate schema, score AI visibility, generate keywords. 27 pro tools with account: manage content calendar, track GSC traffic, monitor AI bot visits (ChatGPT/Perplexity), analyze backlinks, and publish directly to WordPress, Webflow, or Wix.
AEO audit: score any website 0-100 for AI visibility. Checks schema, meta, content, AI crawlers.
Marketing analytics for local businesses — Instagram, ads, web traffic, SEO and reviews.
Turns any URL into SEO metadata, contacts, tech stack, and AI-ready Markdown, in one call.
Web Analitiği MCP sunucusu — in-house on-page SEO denetimi (robots.txt + SSRF korumalı crawl),…
Turns any URL into SEO/OpenGraph metadata, public contact signals, tech-stack fingerprinting, Schema.org product data, a security-headers audit, and clean AI-ready Markdown, in one call. Anti-SSRF hardened (DNS pinned post-resolution, private/loopback/cloud-metadata ranges blocked). Hosted via RapidAPI's MCP gateway - free tier, 500 requests/month, no credit card. Source: https://github.com/JosejuX/rapidapi-metadata-extractor
Manage web personalization campaigns, audiences and visitor data in Personyze.
Read-only website analytics, AI referrals, crawlers, goals, revenue, and funnels.
web3d-mcp is an MCP server for AI-powered 3D scene and ad generation on the web. It provides tools to generate, edit, animate, preview, validate, and export 3D scenes built with React Three Fiber (R3F). Designed for web developers and creative teams, it enables programmatic creation of production-ready interactive 3D web experiences and advertisements through natural language.
AI business intelligence: competitor analysis, web scoring, reviews, market research
Help your AI improve landing pages, grounded in 3,500+ scored sections and 500 real pages.