"Understanding Web Crawlers" matching MCP connectors:

Agent intake desk for property renovation. Read only, CORS open, fail closed, receipts recompute.

SSRF-safe web intelligence: 4 outcomes, 43 paid x402 tools, 3 free tools and a URL preview.

Scan/purge hidden text & score web domains: TLS, DNS, headers, speed. Free scans, $0.01 actions.

Russian-language data endpoints for AI agents: EGRUL/INN company lookup, Cyrillic web search, RU page to Markdown. Pay-per-call via x402 (HTTP 402) in USDC on Base — no API keys, no accounts.

CatchAll is a web search API built for comprehensive event retrieval — not ranked results, but all matching records.

Docs: https://docs.keenable.ai/mcp-server Keenable is a free, remote MCP server that gives agents access to the web index. Search the web with ranked results and date/site filters, then fetch any indexed page as clean markdown. Works out of the box with no account or API key.

Search real-world UI & UX design references for mobile apps, web apps, and websites with Mobbin.

Give your agent web search and authoritative datasets: S&P Global, FRED, OECD, SimilarWeb & more.

Fast, intelligent web search and web crawling. New mcp tool: Exa-code is a context tool for coding

X-Z-CS AI validation with auditable reasoning. 8 active tools; 5 in maintenance. v0.5.61

Deploy a multi-user web app from your agent: hosting, auth, database, and permissions.

Clean web reader for AI agents. Free remote read tier, optional x402 pay-per-call. No API keys.

Price comparison across partner retailers. Read-only, 90-day history, disclosed affiliate.

Reliable web access for AI agents: smart HTTP, rotating proxies, and full-browser rendering.

Web and MCP change memory with native diff UI; later calls return only what changed.

Fetch and process content from specified URLs & sources using the Oxylabs Web Scraper API.

Scrape, crawl and search the web for AI agents via MCP.

Give your agent live data from Twitter, Reddit, the web and GitHub. No API keys, no scraping stack.

Brand health & trend footprint across PSFK expert graphs with citable sources, not web summaries.

Answers on AEO, SEO, web and brand from GOJI's published material. Melbourne, Australia.