"How to add a web scraper" matching MCP servers:

Enables AI agents to fetch any web page and receive clean, token-efficient Markdown, escalating only as needed from direct HTTP with browser TLS fingerprints to headless-browser rendering and residential proxies when a site blocks access. Supports question-focused passage retrieval with BM25 ranking, pagination, caching, JS rendering control, and safe-by-default restrictions on local and private-network URLs.

Enables an agent to run ten ready-made research and monitoring workflows — competitor digests, cited reports, paper alerts, market maps, regulatory and due-diligence watches — pulling from Firecrawl, Tavily, GitHub and landing results in Notion, Slack, Google Docs, Sheets and Linear. Fields are filed with the user's own keys held in the operating system keychain, and every action that creates, sends or changes anything is shown and approved first.

A scraper tool that leverages the Oxylabs Web Scraper API to fetch and process web content with flexible options for parsing and rendering pages, enabling efficient content extraction from complex websites.

Enables extracting clean, structured markdown from any URL—stripping nav, ads, and scripts—for RAG pipelines and AI research agents, with pay-per-call micropayments via x402.

MCP server for semantic search over PDF documents using RAG, pgvector, and OpenAI embeddings. Includes a web app for document upload and management.

Enables AI agents to provide e-commerce customer service with product search, RAG-based FAQ answers, human handoff, and automated security auditing with a review workflow.

Provides AI assistants with real-time web search, reasoning, and research capabilities through Perplexity's Agent API and Search API, enabling tools for search, conversational Q&A, deep research, and advanced reasoning.

Provides clean, bounded web content to AI by filtering HTML noise and optionally summarizing, preventing context window overflow.

A fast, dependency-light MCP server that converts web pages into clean Markdown, structured metadata, and classified links for language models.

Converts AI Skills (following Claude Skills format) into MCP server resources, enabling LLM applications to discover, access, and utilize self-contained skill directories through the Model Context Protocol. Provides tools to list available skills, retrieve skill details and content, and read supporting files with security protections.

A production-ready Model Context Protocol server that enables language models to leverage AI-powered web scraping capabilities, offering tools for transforming webpages to markdown, extracting structured data, and executing AI-powered web searches.

An MCP server that runs Apify scraping actors with quality-gated validation, scoring, and retries, returning embedding-ready chunks for AI agents.

A stdio MCP server that provides a single tool to query Gemini with Google Search grounding for current web information, returning synthesized answers with source links.

Enables AI agents to scrape, crawl, clean, chunk, and index website content into Azure AI Search for full-text retrieval.

Integrates Perplexity AI's chat capabilities with real-time web search, enabling users to ask questions and receive AI-powered answers with up-to-date information and citations from verified web sources.

Enables AI assistants to search a curated database of 200+ AI tool cards with pricing, platforms, use cases, and source links, so users can ask which tool to use for a task and get grounded recommendations.

Self-hosted Go MCP server that crawls documentation sites into local Markdown/JSONL corpora and lets agents read pages, run crawls, check freshness, and diff changes with zero network access at read time. Single static binary, no CGO, Apache-2.0.

A basic MCP server setup guide demonstrating how to configure and run Python-based MCP servers with integration examples for Bright Data web scraping and Apify Actors for product data collection.

Free, unlimited web search MCP server using Gemini CLI's Google Search grounding to provide cited, live web results for any AI agent.

Enables MCP clients to search the live web and fetch any URL as clean text through Ollama's web search and fetch APIs, returning ranked results with page text and outgoing links. Runs as a single dependency-free stdio server, so agents can ground their answers with current web content without a separate search vendor.