"How to fetch or scrape data from a website for use in training an LLM" matching MCP connectors:
GET /v1/connectors – MCP directory API referenceMatching Connector Tools:
NeuralVerge is the data layer for agentic AI. Ask a question in plain language and get a structured, cited answer drawn from 300+ sources — e-commerce marketplaces, corporate registries, company intelligence, enrichment and social — plus the open web. Connect over MCP or REST. What's inside: • E-commerce & marketplaces — 128 sources: Amazon, eBay, Walmart, AliExpress, Alibaba, Shopify, Target, Zalando, Rakuten, Flipkart and more • Corporate registries — 95: UK, France, Spain, the Netherlands, Sweden, Norway, Poland, Brazil, Canada, Australia and more • Startup & funding data — 93: Dealroom, PitchBook, Tracxn, Owler, Product Hunt, Y Combinator, Wellfound, Kickstarter, Indiegogo, Seedrs and more • Company intelligence — 16: Crunchbase, Gartner Peer Insights, Capterra, Trustpilot • B2B data — 7: Company and people search, Company and people profiles, Company employees • Enrichment: Email lookup, Phone lookup, LinkedIn Finder, Email finder Teams use NeuralVerge for agentic products, go-to-market, outbound, market research, competitor analysis, brand monitoring, public procurement, e-commerce intelligence, due diligence, KYC/KYB and recruiting. Works with Claude, ChatGPT, Gemini, Cursor and any MCP client. → neuralverge.ai
Fetch public web pages as clean, token-budgeted text for AI agents.
Search the web, fetch any URL and map a site as clean, LLM-ready Markdown.
Video page links to publish-ready metadata: title, thumbnail, tags and ranked embed players.
Pay-per-call web reading for AI agents over x402 — no account, no API key, billed only when content is delivered, with signed provenance on every paid response. Start free with POST /v1/probe.
Turn any public webpage into JSON with AI, save it as a live JSON API, and call it from your agent.
Free website tracking audit, no account needed: GTM, GA4, Meta Pixel, Consent Mode v2, server-side
Official MCP interface for Change Detection.io web page change detection service. Add/change/create web page change monitors and build extremely insightful reports all with MCP
Douyin, Xiaohongshu, TikTok, YouTube, X links to text: transcript, screen text, viral breakdown
Preserve public web pages as signed, timestamped evidence packages, then verify them, compare versions and monitor pages for changes.
Website QA for your coding agent: audit SEO, performance, security, accessibility over MCP.
Lead lists from Google Maps, websites, job boards and German company registers, with verified emails
Check whether a website is trustworthy: trust score, verdict, red flags and a citable report.
One MCP endpoint for 414 data APIs across 90 platforms, including TikTok, Instagram, YouTube, Amazon, Xiaohongshu (RedNote) and Douyin, plus 17 web search tools and CAPTCHA solving for 52 types. Pay per call from $0.56 per 1,000 calls; failed or empty calls are not charged.
Verified web fetch for agents: detects blocks and empty JS pages, falls back, bills only on success.
Free AI visibility check: can AI crawlers read a site, and do ChatGPT, Gemini, Perplexity cite it?
Crawl and scrape websites to clean markdown, and track what changed between crawls.
Live web data for AI agents: structured JSON from 248 websites through one API key.
PriceInIndia is a price-comparison assistant for products sold in India. Ask about any product — phones, laptops, cameras, appliances and more — and it searches live listings from Amazon, Flipkart, Croma, Reliance Digital and 50+ other Indian retailers, then shows current prices and the best available offer as interactive product cards with direct links to buy from the retailer. You can also browse product categories to explore. Prices are in INR and come from live listings, so they can change quickly. PriceInIndia is for shopping research only — it does not sell products or process payments.
Get public profiles, posts, and feeds from Instagram, X, and TikTok through ReachSocial. Connect once and get JSON your app or agent can use. Pay for each successful request in USDC. No subscription or prepaid credit pack.
Score a public website 0 to 100 for the design habits that make it look AI-made.
Check which AI bots a site lets in, then write a fixed robots.txt.
Search YouTube and read video, channel and transcript data as JSON. No Google Cloud project.
32 tools: web pages, JS apps and PDFs as text, feeds, sitemaps, search. 25 free calls.
Fetch any public web page through managed proxies, with optional JS rendering and extraction rules.
DuckDuckGo search as JSON. Ranked results, ads in their own array, 37 regions.
YouTube video details, transcripts, search ranks and top comments. Pay per result.
Agent tools for discovery, payment safety, data extraction, and DeFi.
Redfin for-sale, for-rent and sold listings plus full property pages, as structured JSON.
Unified API for every social media data. Get data from 100+ endpoints, with consistent schema and affordable rate