"Information about web crawlers or scraping techniques" matching MCP servers:

Enables AI-powered web searches using DuckDuckGo with automatic summarization via Google's Gemini AI. Supports both summary and detailed analysis modes for search results.

An MCP server that enables web searching, URL content extraction, and summarization without requiring API keys. It also provides advanced mathematical evaluation and multi-language Wikipedia summary retrieval tools.

MCP server that provides web content fetching, summarization, comparison, and extraction capabilities, handling up to 20 URLs per request.

Allows you to search the web using DuckDuckGo and optionally fetch and summarize content from search results.

Enables intelligent web searching using SearXNG with content crawling via Creeper, then summarizes webpage content using LLM to avoid token limit issues. Supports smart filtering with domain blacklist/whitelist and optional LLM-based relevance filtering.

Provides web search, URL fetching, summarization, math evaluation, and Wikipedia tools for LM Studio without needing an API key.

MCP server that searches the web, reads pages, and returns concise summaries with cited sources via the research_web and read_url tools.

A Python MCP server for web research that enables fetching web pages, searching, batch-fetching, extracting links, and summarizing content via client-side sampling, with optional local file access.

Provides clean, bounded web content to AI by filtering HTML noise and optionally summarizing, preventing context window overflow.

A small MCP server that gives agents rich context about a YouTube video — its transcript, jump-to-the-moment deep links, metadata, and most-replayed moments — so they can answer questions, summarize, pull quotes, or surface highlights.

tooltrim reduces the tokens agents spend re-reading bloated tool results. Run it as an MCP server exposing compress and expand_tool_output, or as a gateway in front of any upstream MCP server: it re-exposes the upstream tools unchanged and shrinks each result (HTML/JSON/logs/tables) before it reaches the model, keeping the relevant content only.

23 developer & data API tools for AI agents - IP/DNS/WHOIS/SSL lookups, web scraping & screenshots, text AI (summarize, translate, sentiment, grammar, redact), and dev utilities (hash, UUID, QR, JWT, cron, IBAN/VAT/email validation, breach check).

A FastMCP server that enables AI assistants to extract structured information from unstructured text using Google's langextract library through a secure, optimized Model Context Protocol interface.

An MCP implementation that integrates the Brave Search API, providing comprehensive search capabilities including web, local business, image, video, news searches, and AI-powered summarization.

Provides MCP-compatible AI clients with offline text analysis and rewriting tools, including statistics, extractive summaries, keywords, readability scores, case conversion, entity extraction, and diffing, all running locally without API keys or network calls.

MCP server for extracting links from text dumps, checking duplicates, extracting YouTube transcripts (with fallbacks including speech-to-text), and preparing workspace-ready page payloads for your note-taking or saving tools. It does not write to your workspace; it hands off prepared content to your existing tools.

MCP server for HumanPen that lets AI agents work on real documents (.docx, .pptx, .pdf) — humanizing content to lower AI-detection scores, converting citations, condensing, and translating while preserving formatting, tables, images, and citations.

Fetches, parses, and summarizes ETSI telecommunications and media standards documents, enabling Claude to autonomously look up and ingest standards mid-conversation for answering questions, generating conformant code, or writing XML.

Generates natural, fluent Chinese content that reads like human writing using the Qwen3-Next-80B-A3B model. Supports web search for latest information and direct file saving with customizable writing rules.

Automates Grammarly's web interface to check AI detection and plagiarism scores, then uses Claude to iteratively rewrite text until it meets target thresholds for humanized content.