"Information about web crawlers or scraping techniques" matching MCP servers:

Web extraction MCP server for AI agents. Extract structured data from any URL with built-in Cloudflare bypass, JavaScript rendering, and intelligent parsing. Returns clean markdown or JSON.

An MCP server that gives models semantic context about a data warehouse, including table meaning, units, lineage, and health, to reduce guessing.

Answers "sales dropped since last week — where?" by comparing a target period against a weekday-adjusted baseline and localizing which attribute combinations (e.g. channel=web, or Tuesday nights) explain the shift. Runs fully offline on your own CSV — no API key, no ML training, read-only.

Provides sandboxed file operations, web scraping, data transformation, and authenticated HTTP requests with SSRF protection.

MCP server for Formula 1 data via the FastF1 library. Ask Claude (or any MCP-compatible client) about race results, lap times, telemetry, standings, pit stops, and qualifying — with historical data back to 1950 via the Ergast API.

MCP server for Durable energy trading analytics that connects Claude Desktop to Snowflake data, enabling natural-language queries about spreads, constraints, generators, and prices.

Bridges Claude (or any MCP client) to manufacturing data via the i3X standard, enabling natural language queries about equipment status, hierarchy, and historical trends.

A tutorial implementation MCP server that enables analysis of CSV and Parquet files. Allows users to summarize data and query file information through natural language interactions.

Enables unified querying of GA4, Cloudflare Web Analytics, Vercel Analytics, and Google Search Console through a single MCP interface, with cross-tracker comparisons and discrepancy reporting.

Direct access to 40+ scraping and search tools. Extract structured data from Google (Search, Maps, Trends), Amazon, Airbnb, Social Media, and any web page directly into your AI agent.

Enables you to interact with your Fivetran environment through natural language, supporting read-only queries about connections and syncs, and write operations like updating sync frequency when enabled.

An MCP server that provides access to Cronometer nutrition data, enabling users to pull food logs, macro and micronutrient summaries, and biometric data into Claude or Cursor. It supports daily nutrition tracking and raw CSV exports by interfacing with the Cronometer web protocol.

A Model Context Protocol server that allows interaction with the RubyGems.org API to fetch metadata about Ruby packages, search gems, and explore dependencies and ownership information.

An MCP server that integrates with Hunter.io API to find and verify email addresses using domain and name information.

Exposes various Marketstack API endpoints as MCP tools, providing access to financial market data including EOD, intraday, splits, dividends, tickers, exchanges, and other financial information.

Read-only MCP tools for TROCCO API, enabling workflow and BigQuery datamart audit information retrieval.

A Python MCP server that retrieves requirements and bug data from TAPD platform to provide AI clients with project management information.

MCP server that exposes the AHDB RB209 Nutrient Management Guide Web API v2 as tools, enabling nutrient planning and access to all 97 endpoints.

A Model Context Protocol server that provides real-time Bitcoin blockchain and mempool data to AI clients, allowing access to comprehensive Bitcoin network information through various data tools.

Enables comprehensive interaction with DHIS2 health information systems through 40+ tools covering complete Web API functionality. Supports data management, tracker programs, analytics, and bulk operations for DHIS2 development and administration.