"Resources for Learning Web Scraping" matching MCP servers:

Enables AI assistants to fetch public web pages as readable text or HTML, with caching, live refresh, and parallel job handling.

LLM routing proxy that cuts API costs 60-90% by auto-selecting the cheapest capable model across OpenAI, Anthropic, and Google. Provides stats, config, and model comparison tools via MCP.

Thunderbit MCP lets AI agents search, scrape, and extract structured data from any website.

Enables web research through multi-provider search, documentation lookup, public code search, and clean Markdown extraction from static or JavaScript-rendered pages via five read-only tools.

Ultra-lightweight headless browser for AI agents. Provides MCP tools for navigating URLs, extracting structured content, and building autonomous agent workflows.

MCP server that parses web pages into clean markdown via Crawl4AI's HTTP API, exposing parse_page and health-check tools with configurable proxy and timeout.

Implementation of an MCP server for the RAG Web Browser Actor. This Actor serves as a web browser for large language models (LLMs) and RAG pipelines, similar to a web search in ChatGPT.

Enables AI agents to check a list of websites by running an Apify Actor through one tool, returning per-site tech stack, on-page SEO issues and score, robots.txt rules for AI crawlers, sitemap, llms.txt presence, and an AI-readiness score. Supports local stdio operation with an Apify token for tool calls.

Enables coding agents to drive a real Playwright-backed browser session, navigating, observing, interacting, and capturing proof on web pages via MCP tools across stdio and Streamable HTTP transports.

A client-side MCP proxy that injects OAuth 2.0 bearer tokens or API keys into MCP requests, enabling MCP clients to connect to OAuth/API-key-protected MCP servers like Amazon Bedrock AgentCore Gateway. It automatically fetches and refreshes credentials using AgentCore Identity or static values.

Provides tools for discovering, building, deploying, and troubleshooting AWS Deep Learning Containers (DLC) images. Supports multiple frameworks and instance recommendations.

Enables autonomous agents to inspect live web pages, prune noisy DOM content down to semantic essentials, and bind each form field to agent state by matching input attributes, autocomplete hints, and regex validations. It also converts HTML/Markdown tables into type-inferred JSON records and scores agent action trajectories for precision, recall, and edit distance.

Enables autonomous web form inspection and schema auto-mapping by matching input attributes, autocomplete hints, and regex validations to agent state, while also pruning DOMs and converting tables into structured JSON for web agents.

Enables MCP-compatible agents to scrape web pages and distill them into clean Markdown by removing cookie banners, navbars, and ads for efficient consumption.

MCP server for SrezAI providing web search, page reading, screenshots, and schema-based extraction as native agent tools.

Enables MCP clients such as GitHub Copilot, Codex, Claude... to explore a SQL Server 2017+ database read-only: databases, schemas, tables, views, procedures, functions, indexes and dependency graphs, plus filtered, grouped, sampled and paginated queries capped by row limits.

Provides web access tools (fetch, search, sitemap crawl) through String AI's API, automatically handling anti-bot bypass, CAPTCHA, and JavaScript rendering.

Enables an AI agent to host a shared folder or join an invite link as a participant in a collaborative editing session, reading, editing, and writing the files the room shares. Runs the same sync engine and wire protocol as editor clients, so an agent and a person or another agent converge on the same documents and see each other's changes.

Unleashes LLM-powered agents to autonomously execute and debug web apps directly in your code editor, with features like webapp navigation, network traffic capture, and console error collection.

Well-designed PDFs from a single prompt. Describe what you need, get a professional document.

Open end-to-end encrypted messaging protocol and MCP server (a4a-mcp) that gives AI agents a cryptographic address (apub1...) to exchange messages, tasks, and signed agreements directly across NAT without port forwarding.

MCP Server for Apache Pinot

An implementation of Model Context Protocol (MCP) server for Argo CD.

Enables Cursor IDE to interact with Tealfabric platform, allowing management of webapps, processes, and documents through natural language.

Connects AI coding assistants to Snyk API & Web for onboarding scan targets, configuring authentication, running DAST scans, and triaging findings through natural language.

Enables agents to find relevant documentation with source URLs, evidence, and freshness, search and browse an llms.txt directory, validate or draft llms.txt files, and manage site registration, verification, and change watches.

Manage a fleet of OPNsense firewalls from an AI agent, inside guardrails it can't drive around. MCP server for central management of OPNsense firewall fleets. 129 tools across devices, config sync, tasks, schedules, templates, backups and remote consoles - destructive actions confirmation-gated, MCP-issued tokens lifetime-bounded, backup and storage secrets excluded from the toolset entirely.

Connects MCP clients to a telephony account so users can manage phone numbers, SIP accounts, routing, SMS, calls, and billing in plain language. It exposes search, schema lookup, and execute tools to run permitted API operations, with confirmation required for paid or destructive actions.

Enables web search for AI agents with pay-per-search in USDC, no API keys needed.

Enables AI assistants to directly control and interact with the Unreal Editor through natural language, allowing tasks such as spawning actors, building levels, creating materials, and running Python scripts.