"API for Claude AI" matching MCP servers:

Provides web access tools (fetch, search, sitemap crawl) through String AI's API, automatically handling anti-bot bypass, CAPTCHA, and JavaScript rendering.

Ad-free web scraping and search exposed as 3 MCP tools. fetch_page, fetch_pages_batch, search_web. Works with Claude Desktop, Cursor, Cline.

Checks a website's robots.txt and Cloudflare settings to identify AI crawler blocking. Also generates llms.txt content to improve visibility to AI answer engines.

Fetches and analyzes website content to provide business context to AI agents, designed for Voice AI in GoHighLevel.

Analyze and generate robots.txt files with AI crawler awareness. Fetch any site's robots.txt, detect which AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended) are blocked or allowed, and generate optimized robots.txt with toggle controls for 20+ AI crawlers.

Enables web search on Chinese internet content using Bocha AI, returning results as Markdown or JSON with configurable freshness and summary options.

MCP server that wraps Shopify, Amazon, and Google Maps intelligence tools. AI agents pay autonomously in USDC on Base via x402 — no API keys or accounts needed.

Fetch live Amazon product data using Amazon Scraper API MCP server

Gives Claude control of a real, headed Chromium browser via Playwright, enabling web navigation, clicking, typing, screenshots, and JavaScript evaluation.

MCP server that extracts structured JSON from public URLs for AI agents using schemas like product, article, and company.

Scrapes the official Telegram Bot API documentation and provides tools for querying methods, types, fields, and relationships.

Enables AI agents to check whether a public website is crawlable, understandable, and ready for AI search workflows through local-only audits of robots.txt, sitemaps, metadata, and llms.txt.

Combines Bing Webmaster data, GA4 AI-traffic opportunity matching, technical SEO scanning, AI-search content audits, approval-gated WordPress fix preparation, live verification, Bing URL submission, and IndexNow integration to help marketers improve pages for human readers and AI search.

An MCP server that provides access to Jina AI's powerful web services (page reading, web search, fact checking) through Claude.

Enables AI agents to drive real Google Chrome with stealth and captcha handling, using Patchright to avoid bot detection.

Enables access to YouTube data including channel videos, live streams, shorts, video details, transcripts, screenshots, and related content through the Yt API with support for localization and pagination.

Enables access to TikTok data without watermarks, including trending users, hashtags, post analytics, user profiles, and download links for specific countries. Supports searching by username, user ID, or post links.

Interact with WebScraping.AI API for web data extraction and scraping

Enables AI agents to capture any public URL as PNG, JPEG, or PDF via REST API or MCP tools, including screenshot capture, page description, and PDF rendering.

Provides MCP tools to fetch and filter schedules for groups, teachers, and rooms from VSUET's timetable site, with support for JSON or text output.