"Methods for Scraping Internet Data" matching MCP connectors:
GET /v1/connectors – MCP directory API referenceMatching Connector Tools:
Autonomous Website Intelligence & OSINT Suite for AI Agents (10 Tools) Surgically extract clean token-optimized Markdown for RAG, detect 65+ tech stacks, identify corporate mail providers (Google Workspace vs Microsoft 365), and audit SSL/security posture with hardened SSRF protection. Quick Install in Claude Desktop (claude_desktop_config.json): json { "mcpServers": { "webintel": { "command": "npx", "args": ["-y", "@modelcontextprotocol/server-fetch", "https://webintel-apis.vercel.app/api/mcp"] } } }
Fetch public web pages as clean, token-budgeted text for AI agents.
Live web data for AI agents: structured JSON from 248 websites through one API key.
Keyless Base USDC x402 MCP for live AI-crawler, GEO/AEO & JSON-LD citation audits.
5 tools: PDF, Word, Excel, PowerPoint and web pages to Markdown; invoice fields as JSON.
One MCP endpoint for 414 data APIs across 90 platforms, including TikTok, Instagram, YouTube, Amazon, Xiaohongshu (RedNote) and Douyin, plus 17 web search tools and CAPTCHA solving for 52 types. Pay per call from $0.56 per 1,000 calls; failed or empty calls are not charged.
Run saved PDF/office file flows, convert HWP/HWPX to Markdown or DOCX, and call data/text APIs.
Fetch the transcript of any YouTube video (plain text or timestamped segments, in any available caption language), search YouTube for videos and channels, list a channel's uploads, Shorts, playlists and community posts, search inside one channel, and list every video in a playlist. Hosted Streamable HTTP server from getyoutubetranscript.com; sign in with OAuth or an API key. Credit-based: one credit per successful call.
Website QA for your coding agent: audit SEO, performance, security, accessibility over MCP.
The best wallet for your agents: a prepaid balance and spending limits for 4,400+ paid endpoints.
SnapRender gives AI agents eyes on the web through a hosted MCP server. Send a public URL and get the page back as an image, a PDF or clean markdown, with no browser to run or maintain. Capture the viewport or the full page as PNG, JPEG, WebP or PDF, at desktop size or with a phone, tablet or laptop preset, in light or dark mode. Ads and cookie banners are removed by default, and you can hide elements or click one before the capture. extract_content reads the same page as markdown, text, article, links or metadata, so an agent can see a page and read it in one session. Made for monitoring and client work: batch up to 50 URLs in one job, check the cache for free before spending a capture, share signed links that render without an API key, and get webhooks when a batch finishes or a scheduled capture spots a change. Track competitors' pricing and landing pages, or send clients current screenshots of their sites. Connect with OAuth (Google, GitHub or email) or an API key. Works with Claude, ChatGPT, Cursor, VS Code and any MCP client. Free plan: 200 screenshots a month, no credit card. Paid plans from $9 a month for 2,000 up to $199 a month for 200,000. Home: https://snap-render.com Docs: https://snap-render.com/ai-agents
Evidence-backed technical SEO website check. EUR 9.90 via MPP or buyer-approved Stripe Checkout.
Remote MCP server for ProxyLane residential and ISP proxies. AI agents can check the account balance, create residential proxy lists by country, city or ISP, test connections, check IP reputation, and quote ISP proxy orders. OAuth sign-in, works with Claude, ChatGPT and Cursor.
30 tools: web pages, JS apps and PDFs as text, feeds, sitemaps, search. 25 free calls.
Web search and clean-text page fetch for AI agents, with SSRF protection.
Turn any website into an API your AI assistant can call. Describe what you need from a site; Writ builds the API, tests it and saves it as a tool, signed in as you when the site needs a login. The same server reads pages to Markdown, crawls sites into datasets and watches pages for changes. Free plan; usage in credits.
Website audits for AI agents: one-call AI visibility report, schema, WCAG, PageSpeed, AI crawlers.
Search NHS Jobs, the official NHS board for England and Wales, by keyword, by Magnova
Calendar, DNS, RDAP, LEI, URLs, scraping, text, VAT and QR utilities. Pay-per-call USDC.
One MCP URL for web search, page reading, pay-per-result data tools and a browser agent.
Agent tools for discovery, payment safety, data extraction, and DeFi.
Free backlink checker MCP for one public page. Verify an expected link in the HTML and see its anchor text, nofollow status, and any declared canonical URL. No account required.
All public upAPI operations as MCP tools: web scraping, search, screenshots, PDF, OCR and more.
Live Google SERP data, top-100 keyword rank tracking, technical on-page SEO audits, and robots.txt inspection.
Verified web fetch for agents: detects blocks and empty JS pages, falls back, bills only on success.
Clean, matched, AI-ready product data from any website
Official MCP server for e-commerce price intelligence, stockout detection, and MAP compliance auditing across Latin American retail and marketplaces.
Pay-per-call web reading for AI agents over x402 — no account, no API key, billed only when content is delivered, with signed provenance on every paid response. Start free with POST /v1/probe.
Audit websites for SEO from your AI assistant: scores, issues with fixes, Google indexability
Free compare_page_observations for two held JSON pages. No fetch, wallet, or payment.
Public web data as clean JSON for AI agents: Google, Amazon, TikTok, Instagram, YouTube, LinkedIn, Google Maps, Reddit, Zillow and hundreds more websites. One API key, pay per call, failed calls are free.
Turn any web page URL or HTML into clean Markdown or plain text for an LLM to read.
Social data for AI agents: TikTok, RedNote, Douyin, WeChat, X, YouTube and more. Pay per call.
Full-page screenshots, PDFs and Markdown of any site, even bot-protected ones. Built for teams that capture third-party websites for brand protection, compliance evidence, media monitoring and competitor intelligence, with delivery by webhook or to your own S3 bucket. Also clean text, rendered HTML, and Urlbox projects, webhooks, past renders and usage. Sign in with OAuth or send an API key as a Bearer token.
Preserve public web pages as signed, timestamped evidence packages, then verify them, compare versions and monitor pages for changes.
Browser-backed web access, automation and structured data extraction for AI agents.
13 pay-per-result tools: jobs, funding, contacts, teams, phones, tech stacks, DNS, PDFs, reviews
Scan a public homepage for cookies and tracking observed before consent interaction.
First stop for agents: read any page as Markdown, check sites, shared memory, buy for people.
Transcripts of YouTube, TikTok, Instagram Reels and podcasts for AI assistants. Text, SRT or VTT.
Search YouTube and read video, channel and transcript data as JSON. No Google Cloud project.
Scrape any website, extract structured data, and collect web content at scale with AI agents
Web search for agents: page to Markdown, screenshots, news search, metadata, sitemaps and RDAP.
PriceInIndia is a price-comparison assistant for products sold in India. Ask about any product — phones, laptops, cameras, appliances and more — and it searches live listings from Amazon, Flipkart, Croma, Reliance Digital and 50+ other Indian retailers, then shows current prices and the best available offer as interactive product cards with direct links to buy from the retailer. You can also browse product categories to explore. Prices are in INR and come from live listings, so they can change quickly. PriceInIndia is for shopping research only — it does not sell products or process payments.
A real browser for your agent: screenshots, page checks, Markdown and PDFs.
Production web scraping and extraction engine with markdown extraction, DOM pruning, and anti-bot mitigation.
Score a public website 0 to 100 for the design habits that make it look AI-made.
All HasData scraping tools in one MCP server: Google, TikTok, Instagram, maps, e-commerce and more.
Finds Trustpilot reviews that break Trustpilot's guidelines and drafts the reports for them.
Fetch any public web page through managed proxies, with optional JS rendering and extraction rules.
Redfin for-sale, for-rent and sold listings plus full property pages, as structured JSON.
Remote MCP server for Google SERP, SEO research and web scraping. Live Google results, keyword research, rank checks and page scraping for AI agents. Free plan with 250 credits, no card; failed requests never charged.
Zillow for-sale, for-rent and sold listings, and full property details, as structured JSON.
Live crypto, DeFi, stock and web data plus datasets for agents. Pay per call with x402. No API key.
Unified API for every social media data. Get data from 100+ endpoints, with consistent schema and affordable rate
Public Instagram data via MCP: profiles, posts, reels, ads, transcripts. $5/1k credits; 25 free.
Pay-per-call x402 data tools for AI agents: Markdown, Telegram search, YouTube transcript, metadata, sitemap, contacts. USDC on Base. Remote MCP at /mcp.
Web scraping with real-browser rendering, browser automation recipes, full-page screenshots, Google AI Overview and ChatGPT answers, and Booking.com data through one hosted MCP server. Auth via OAuth 2.1 or API key.
Read any web page as clean markdown or text with title, description and links
Check public web pages for common WCAG 2.2 accessibility issues from your MCP client. The free scan_url tool needs no account and returns a score, severity breakdown, WCAG references, affected elements and fix guidance. Automated checks do not establish conformance; manual review is still required. Optional authenticated tools support monitoring your own sites. Documentation: https://allyproof.com/docs/mcp