"Resources for Learning Web Scraping" matching MCP servers:

LLM routing proxy that cuts API costs 60-90% by auto-selecting the cheapest capable model across OpenAI, Anthropic, and Google. Provides stats, config, and model comparison tools via MCP.

Enables retrieval and cleaning of official documentation content for popular AI/Python libraries (uv, langchain, openai, llama-index) through web scraping and LLM-powered content extraction. Uses Serper API for search and Groq API to clean HTML into readable text with source attribution.

Provides stateful prompt optimization using research-backed techniques like APE and OPRO, learning from historical performance data via a vector database. It enables users to automatically refine prompts, retrieve high-performing examples, and track performance analytics through iterative feedback.

An MCP server that runs Apify scraping actors with quality-gated validation, scoring, and retries, returning embedding-ready chunks for AI agents.

A focused MCP server that provides a single web_search tool for web searches, integrating Tavily and Brave with automatic fallback and key rotation.

Enables extracting clean, structured markdown from any URL—stripping nav, ads, and scripts—for RAG pipelines and AI research agents, with pay-per-call micropayments via x402.

MCP server for semantic search over PDF documents using RAG, pgvector, and OpenAI embeddings. Includes a web app for document upload and management.

Provides free web search, content fetching, image search, and deep research via SearXNG, no API keys required.

MCP server for searching web documentation via sitemap.xml, enabling semantic search across multiple documentation sites using Ollama embeddings.

Provides standard MCP tools for web search, page fetching with content extraction, and a combined research workflow that returns sources with excerpts, plus a session resource and fact-check prompt template.

MCP server that provides web search via LLM API gateways with server-side search, returning cited answers and multi-provider fallback.

A fast, dependency-light MCP server that converts web pages into clean Markdown, structured metadata, and classified links for language models.

An Operit-compatible adapter of the Exa MCP server, enabling web search, code search, and company research capabilities in AI assistants. It fixes MCP handshake compatibility issues, allowing tools like web_search_exa and web_fetch_exa to load and run reliably.

MCP server that fetches web pages and uses local Qwen models to answer questions about their content, with site-scoped search and map-reduce chunking for long pages.

A Model Context Protocol server that gives AI assistants access to 7 search providers with intelligent auto-routing. Analyzes query intent and picks the best provider automatically — no manual switching needed. Install, configure your keys, and go.

An MCP server that enables AI models to perform Google Web searches using the Gemini API, complete with citations and grounding metadata for accurate information retrieval. It is compatible with Claude Desktop and other MCP clients for real-time web access.

Enables AI agents and users to query Perplexity AI's premium models (GPT-5.4, Claude 4.6 Opus, Gemini 3.1 Pro, etc.) via MCP tools, CLI, or API, with support for deep research, model council, and multi-turn conversations.

MCP for Azure DevOps Boards is a MCP server that lets your favourite AI browse, query and update Azure DevOps work items as if it were a project manager. Written in Rust and optimized for tokens usagem, It runs via stdio or HTTP mode and uses standard Azure authentication with az login.

Implementation of an MCP server for the RAG Web Browser Actor. This Actor serves as a web browser for large language models (LLMs) and RAG pipelines, similar to a web search in ChatGPT.

A proof of concept MCP server for Apache OFBiz