"Web scraping and crawling tools" matching MCP servers:

An MCP server providing web search, image search, and page scraping tools to LLMs without requiring API keys.

MCP server for scraping with declarative configs

MCP server for AI-powered web research — search (Google, Brave, Serper, SearXNG), scrape any page, extract PDFs/DOCX/YouTube transcripts, academic & patent search. Single Go binary. Works with Claude, Cursor, Copilot, and any MCP client.

MCP server for file operations with non-UTF-8/Unicode encoding: Cyrillic, CP1251, CP1252, ISO-8859, KOI8 auto-detection

Encoding-aware, indentation-smart file tools for AI coding agents. 20+ tools including read/edit with automatic encoding detection, smart indentation conversion, SSH, SFTP, process management, and system utilities.

DATPAQ exposes 34 production data & utility APIs — IP geolocation, DNS/WHOIS/MX lookups, email & phone validation, currency & precious-metals rates, aircraft/VIN lookups, web scraping & screenshots, and more — through one hosted, streamable-HTTP MCP endpoint.

Official Thordata MCP server. Gives AI assistants real-time web scraping, SERP extraction, and global residential proxy capabilities to access live web data seamlessly.

A high-performance, asynchronous MCP server that provides comprehensive Google search and web content scraping capabilities through the Firecrawl API, designed for LLMs to retrieve external information efficiently.

Perform DNS lookups, WHOIS queries, connectivity testing, TLS certificate analysis, HTTP endpoint monitoring, and hostname resolution, all from your trusty AI.

A Go-based MCP server that provides comprehensive access to the Serper Google Search API, including tools for images, news, maps, and scholar results. It also features a dedicated endpoint for scraping webpage content directly.

A web scraping CLI tool that converts web pages to markdown and also runs as an MCP server for agent integration.

A self-contained web-research MCP server that lets local LLM agents search, fetch, and synthesize web content using tools like web_search, web_fetch, and web_research.

Enables room agents to generate or edit images (published directly into the room's Docs rather than passed through the model's context) and transcribe audio attachments, using the deployment's media providers with the room itself acting as the credential.

Go Development MCP Server for Claude Desktop and other AI tools

Records Chrome network requests and responses for LLM knowledge bases, and exposes query and browser control capabilities via MCP tools like list_sessions, navigate, and evaluate.

MCP server that provides web search via LLM API gateways with server-side search, returning cited answers and multi-provider fallback.

CNN's Fear & Greed index for the US stock market: current score and rating, the seven component indicators, and about a year of daily history. Go standard library only, no API key required.

An MCP server for querying Grafana Loki directly with a discovery-first workflow — labels, values, series, and LogQL queries without requiring Grafana.

ContextLattice is an HTTP-first, MCP-compatible memory/context/task orchestrator that persists writes and returns fused recall from specialized stores with local-first defaults. Primary URL: https://contextlattice.io/ Install: https://contextlattice.io/installation.html Troubleshooting: https://contextlattice.io/troubleshooting.html

Fetches documents by URL, DOI, ISBN, PMID or PMCID, and reports a block as a block, never as an empty success.