"A query related to 'crawl' and its contexts" matching MCP servers:

MCP server for Cloudflare Browser Rendering Crawl API. Fetches and crawls web pages, returning clean Markdown optimized for LLM consumption.

Enables LLMs to crawl websites via Cloudflare's Browser Rendering API, providing tools to start, monitor, cancel crawls, and retrieve structured content with AI extraction.

Provides preflight checks and domain intelligence so agents can skip domains that will refuse them or charge a fee, covering robots.txt, edge refusals, and HTTP 402 paywalls.

MCP server for Common Crawl CDX that enables backlink discovery, expired domain finding, and competitor gap analysis without requiring API keys.

MCP server and CLI for querying Common Crawl via AWS Athena, enabling users to check a domain's presence in crawls, analyze dynamics, compare domains, and inspect page text.

Enables fetching, crawling, and analyzing web pages with 29 tools for SEO audits, content extraction, and more.

An MCP server for Dart AI task management that enables bulk operations using DartQL selectors to minimize token usage and context rot. It provides tools for batch updates, task and document CRUD, and safe CSV imports with integrated dry-run capabilities.

Token-efficient Figma MCP server with image export, query DSL, and design token support.

Enables querying and comparing products from MM's retail (B2C) and wholesale (B2B) platforms in Vietnam, including price comparisons, stock availability checks, and multi-store support with Vietnamese language integration.

Enables AI assistants to search arXiv papers, retrieve metadata, browse categories, and read paper text.

Checks a website's AI readiness: can ChatGPT, Claude, Perplexity, Google AI and 50+ other AI crawlers (GPTBot, ClaudeBot, PerplexityBot) access it? Scores the site, then generates llms.txt, an AI-crawler robots.txt and JSON-LD, and reads LLM Monitor trends, from Claude Desktop, Cursor and other MCP clients.

Enables querying GoldSrc game servers (e.g., Half-Life, Counter-Strike 1.6) for server info, player lists, rules, and RCON commands.

MCP server for running read-only SQL queries across MySQL and PostgreSQL databases with safety guardrails, credentials stored outside source, and support for multiple databases.

Enables querying official Brazilian Central Bank PTAX dollar closing exchange rates by specific date, date range, or most recent available quotation.

Crawls Korean stock market data from Naver Finance, providing real-time information on top searched stocks and detailed stock information by stock code.

Enables AI assistants to query the Ubergraph biomedical ontology SPARQL endpoint with tools for custom SPARQL queries, term lookup, search, and hierarchy traversal.

Enables MCP clients like Claude to query Chinese A-share market data, including K-line charts with forward/backward adjustment, limit-up and limit-down pools, per-stock fund flows, index quotes, and stock news, with automatic symbol normalization and retry handling for throttled data sources.

Provides A-share (Chinese stock market) quantitative analysis through tools for stock screening, northbound capital flow tracking, dragon-tiger list analysis, margin trading, sector analysis, technical indicators, IPO info, and limit-up/down statistics using akshare data.

Enables AI coding agents to request a second opinion from a different frontier model via a single tool call, with PII scrubbed before transit, live web search, and support for Claude, ChatGPT, Cursor, and Gemini.

提供A股实时行情、历史K线、财务报表、技术指标等全方位数据查询的MCP服务器，支持盘中即时更新及批量查询。