"Crawling Websites to Extract Data" matching MCP connectors:

Connect AI to millions of laws and court cases with the Lawstronaut MCP.

Product search and price comparison for AI agents. Search 100M+ products across thousands of retailers by text or image, compare live offers and prices, and turn any merchant URL into structured product data. No API key required to start; add one for unlimited use and affiliate commission.

Docs: https://docs.keenable.ai/mcp-server Keenable is a free, remote MCP server that gives agents access to the web index. Search the web with ranked results and date/site filters, then fetch any indexed page as clean markdown. Works out of the box with no account or API key.

Audits websites for cookie consent compliance across major privacy frameworks. Point it at any URL and get a structured PASS/FAIL checklist with regulatory citations and fix recommendations — no browser, no manual inspection required.

Pay-per-call web scraping for AI agents — no signup, no API keys, just USDC micropayments via the x402 protocol on Base. Six tools: scrape webpages, extract structured data, capture screenshots, parse metadata, manage browser sessions, and run workflows. Runs on Cloudflare Workers with Browser Rendering. Free tier: 10 calls per wallet per 30 days.

Get social media data from Instagram and TikTok: profiles, posts, videos, comments, and more.

Pre-computed navigation recipes for public websites — skip explore-and-discover.

Fast, intelligent web search and web crawling. New mcp tool: Exa-code is a context tool for coding

Read a URL as clean markdown, screenshot a website, url to PDF. Web access for agents, no signup.

Any public page to clean JSON or Markdown, plus Reddit with no API key. Failed calls are free.

Render HTML, Markdown, or URLs to images, PDF, or branded artifacts; extract and watch pages.

Bright Data MCP — Bright Data Web Unlocker + SERP API (brightdata.com)

64 x402 tools: cheap LLM $0.002, web+news search, French residential-IP scraping, FR/UK/US data.

Match shopper intent to a merchant's products and fetch live price, stock and product Q&A.

x402 MCP web parser: URLs to Markdown for agents. USDC on Base, Polygon, Arbitrum, Ethereum.

Search the web and extract clean, readable text from webpages. Process multiple URLs at once to sp…

Web content extraction for AI agents. Pay per call with x402 (USDC on Base). No API key.

URL to clean article markdown/text + metadata and links. Deterministic. $0.001/call via x402.

Web page or HTML to clean LLM-ready Markdown or JSON. x402 pay-per-call, $0.005, no API key.

Convert any public webpage to a PDF. Single narrow tool, not a bloated PDF toolkit.