"Web scraping and crawling tools" matching MCP servers:

An MCP Server for Web scraping and Crawling, built using Crawl4AI

Enables web scraping, crawling, structured data extraction, and browser automation through multiple AI agents including OpenAI's CUA, Anthropic's Claude Computer Use, and Browser Use.

A Model Context Protocol server that allows LLMs to interact with web content through standardized tools, currently supporting web scraping functionality.

pay-per-call x402 API endpoints as MCP tools — web search, page-to-markdown, PDF extract, JSON repair/validate, crypto price, weather, IP geo, DNS, markdown lint + 20 agent-commerce aliases. Each tool proxies to vibes-coded.com and settles via x402 (USDC/Solana). Free-trial endpoints need no auth; paid ones need an x402 signature. Catalog is fetched live, so new endpoints appear automatically.

Enables Claude to fetch web pages from the user's own local network connection instead of AI datacenter IPs, including optional authenticated sessions, with verdicts for bot challenges, login walls, and other failures.

Open-source browser automation API with anti-detection for AI agents, web scraping, and automation, providing undetectable Chrome via MCP and REST API with Cloudflare bypass.

An MCP proxy that embeds tool definitions and returns only the top-k semantically relevant tools per query, reducing context usage and routing calls to upstream MCP servers.

Enables Codex to send text tasks to ChatGPT web, await responses, continue conversations, choose reasoning effort, and manage projects through MCP tools on macOS.

Discover and invoke AI services on AIMarket with prices and signed receipts. Also fetch public web pages, search the web, and request Metis verification. Five tools over stdio or self-hosted HTTP; marketplace search needs no API key.

An MCP server that exposes 43 domain tools behind 4 meta-tools, applying guardrails such as budgets, rate limits, schema validation, human-in-the-loop confirmation for mutations, PII redaction, and an append-only audit log while reducing context window usage.

Sub-15ms edge intelligence tools for Claude Desktop, Cursor, and LLM agent loops. Provides sub-millisecond LLM JSON repair, web-to-markdown token compression (cuts context tokens up to 90%), PII redaction, and RFC 5322 B2B email deliverability verification at zero marginal token cost.

A meta-MCP server that aggregates authoritative web search and browser research tools, providing a unified interface with a cost-efficient fetch ladder for web research.

Enables Codex to use an authenticated ChatGPT Web session as a reasoning and coding backend through isolated browser sessions, without granting ChatGPT direct workspace access.

Enables Claude Code to browse and import conversations from a user's claude.ai account, making mobile chat history available in the editor. Includes tools to list, read, and save web conversations locally.

An MCP server that enables web search capabilities using OpenAI's o3 model, allowing AI assistants to perform text-based web searches and return AI-powered results.

An MCP server that orchestrates structured multi-round debates between ChatGPT Web and Gemini Web in the same Chrome browser via CDP, requiring no API keys.

Enables web ChatGPT to drive durable, sandboxed Claude Code sessions on a local Mac, with controlled read, modify, verify, and recover operations via six session control tools.

Central registry for AI tools with vector search and knowledge graph, enabling intelligent tool discovery, chaining, and execution via MCP.

Enables building and evaluating LangGraph agents over a protocol-level MCP server to measure failure rates across four agent topologies.

A Model Context Protocol server that enables AI agents to interact with local Logseq knowledge graphs, supporting operations like creating/editing pages and blocks, searching content, and managing journal entries.