"Information about crawer or crawler" matching MCP servers:

MCP server that provides OpenRouter model pricing data, enabling price lookups, trending/cheapest lists, and model searches without an API key.

An MCP (Model Context Protocol) server that gives AI agents live, structured ad intelligence across Facebook, Google, and Instagram — data that no base model can produce from training alone. Powered by Apify actors. Works with any MCP-compatible client: Cursor, Claude, etc.

A comprehensive website crawler and SEO analyzer that stores site data in a local SQLite database for AI-driven auditing. It enables users to detect technical SEO issues, broken links, and security vulnerabilities through natural language queries or terminal commands.

HandaaS的MCP服务器，提供全域资讯搜索、企业新闻、行业资讯、主题跟踪和企业动态监控能力，帮助用户开展行业研究和舆情分析。

This server crawls documentation sites and provides search and page-retrieval tools through MCP, enabling users to query indexed documentation content.

An MCP server for crawling websites and extracting comprehensive data including images, SEO metadata, security headers, and business intelligence. It features twelve distinct extraction modes to perform detailed audits for e-commerce sites and general web analysis.

Enables crawling news articles by category (politics, economy, society, etc.) and generates blog-ready markdown summaries. Provides MCP tools for listing categories, crawling news, getting article details, and saving to files.

An MCP server that fetches RSS feeds and shares them with LLMs, allowing AI assistants to access and present the latest news and articles from configured feeds.

Enables searching and retrieving images from Wikipedia Commons with detailed metadata including licenses and authors.

An intelligent web crawling server that uses Cloudflare's headless browser to render dynamic pages and Workers AI to extract relevant links based on natural language queries. It enables AI assistants to search and filter website content while providing secure access through GitHub OAuth authentication.

Enables agents to read any web page or document as markdown, html, links, screenshots or extracted JSON, map and crawl entire sites, and drive a persistent browser session that stays open between calls so pages can be inspected and clicked without reloading. Callers pay per request with a wallet over x402 — no API key or signup — and every route answers its own free GET with the fields it expects.

Enables AI clients to query financial news from Yahoo Finance, CNBC, configurable RSS feeds, and 鉅亨網 (cnYES), and to fetch historical OHLCV market data from Yahoo and Investing.com. Supports stock and keyword search, category subscriptions, time filtering, article body extraction, and stdio integration with Cursor, Claude Desktop, and Spring AI.

An MCP server that implements Retrieval-Augmented Generation to efficiently retrieve and process important information from various sources, providing accurate and contextually relevant responses.

Enables querying parking lot information through an MCP server built with fastMCP, allowing users to retrieve parking facility data via API calls.

An MCP server that provides access to NS (Dutch Railways) travel information.

Enables access to South Korea's Ministry of Gender Equality and Family youth activity information through public data API, supporting regional searches, keyword filtering, and activity discovery for youth programs.

An MCP server that provides real-time delay information for JR East train lines, accessible via MCP clients like Claude Desktop through the 'getDelays' tool.

Enables AI agents to query Korean listed companies' financial statements, public disclosures, executive information, and shareholder structures in real-time using the DART API.

Self-hosted MCP toolkit providing web search, Wikipedia, and arXiv access without mandatory API keys, delivered as a Docker Compose bundle.

Provides real-time access to the latest announcements and notices from Myongji University's official website through AI-powered web scraping.

Provides four free tools to assess AI visibility: crawler access, entity recognition, off-page gaps, and shopping agent compatibility, without requiring an API key.

Ask about the Saudi economy in plain English or Arabic. No API key or database required.

A Model Context Protocol server that retrieves detailed geographic information about IP addresses using the ipinfo.io API, helping determine user location and network details.

Enables AI assistants to search, compare, and get detailed information about MCP servers from the mcpcatalogs.com directory.

Search and retrieve detailed information about Swiss companies from the official Zefix register, including company profiles, corporate structures, and SHAB publications.

Enables AI assistants to search and retrieve transcripts from the Entra.Chat podcast about Microsoft Entra ID, with timestamped YouTube links and guest information.

MCP server that provides AI assistants with real-time, current information about AI models from OpenAI, Anthropic, and Google, including pricing, capabilities, and context windows.

Analyze and generate robots.txt files with AI crawler awareness. Fetch any site's robots.txt, detect which AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended) are blocked or allowed, and generate optimized robots.txt with toggle controls for 20+ AI crawlers.

MCP-NixOS is a Model Context Protocol server that provides real-time, accurate information about NixOS packages, options, Home Manager, and nix-darwin configurations, preventing AI assistants from hallucinating about NixOS resources and enabling them to deliver factual system configuration guidance.

Provides access to geographical and tourism information about Colombia, including regions, departments, cities, and tourist attractions through the API Colombia service.