"Information about crawer or crawler" matching MCP servers:

An MCP server that provides information about Utkarsh, including bio, skills, work experience, and portfolio projects, accessible via local stdio or remote HTTP with OAuth.

Web-crawler MCP server that fetches web pages with static parsing or headless browser fallback, enabling Claude to fetch, extract links, crawl sites, and select content via CSS selectors.

An MCP (Model Context Protocol) server that gives AI agents live, structured ad intelligence across Facebook, Google, and Instagram — data that no base model can produce from training alone. Powered by Apify actors. Works with any MCP-compatible client: Cursor, Claude, etc.

A comprehensive website crawler and SEO analyzer that stores site data in a local SQLite database for AI-driven auditing. It enables users to detect technical SEO issues, broken links, and security vulnerabilities through natural language queries or terminal commands.

Enables comprehensive website SEO analysis including crawling, on-page audits, site structure visualization, and content topic classification with taxonomy mapping.

This server crawls documentation sites and provides search and page-retrieval tools through MCP, enabling users to query indexed documentation content.

Enables site-wide crawling of internal links with BFS traversal, time/title/URL filtering, and page operations like summarization and link clicking, with results persisted to SQLite.

Enables keyword, creator, or item-based image and video retrieval and downloading from Douyin, Xiaohongshu, Weibo, Bilibili, X, and Instagram. It adds intent parsing, semantic and visual re-ranking, quality filtering, and deduplication so results are relevant rather than every image on a page.

A server for automated crawling of academic papers and GitHub repositories, downloading PDFs, extracting content, AI-generating Gumroad product descriptions, and publishing to Gumroad.

Enables crawling websites, including JavaScript-rendered pages, and returns extracted page content as JSON with structured error reporting.

Enables searching and retrieving images from Wikipedia Commons with detailed metadata including licenses and authors.

Provides real-time system metrics and information through a Model Context Protocol interface, enabling access to CPU usage, memory statistics, disk information, network status, and running processes.

Enables users to retrieve and structure shipment tracking information from DB Schenker's website using natural language queries.

An MCP server that provides access to NS (Dutch Railways) travel information.

Enables detection of AI-generated content in images, videos, audio, and text via the AI or Not API. Supports media analysis tools for deepfakes, synthetic voices, and AI-written text.

Enables MCP-compatible clients like Claude Desktop, Claude Code, Codex, and local-model hosts to inspect Proxmox VE clusters, nodes, VMs, containers, storage, snapshots, and tasks, with opt-in write operations for starting, stopping, cloning, backing up, and migrating guests. Read-only by default, it supports both stdio and Streamable HTTP transports.

A single-process MCP server that crawls web pages, handles anti-bot challenges, converts HTML to Markdown, and caches results in PostgreSQL, providing tools to fetch and read web content.

Provides tools to monitor host system health including CPU load, disk usage, and network status while enabling file system management tasks like searching and moving files. It includes built-in safety guards to prevent operations on critical system directories.

An MCP server that provides real-time weather alerts, forecasts, stock market data, and news information through various API integrations.

Enables MCP-compatible agents to access KaiRouter's video generation API, providing tools to list available video models, generate videos (text-to-video or image-to-video) asynchronously, check job status, and list recent jobs.

Enables MCP clients to query proxy sub-accounts, traffic, pricing, and inventory, and to place orders, renew, and modify configurations after user confirmation.

MCP server for audio transcription using OpenRouter models, supporting verbatim, cleaned, and custom transcription modes.

Enables a bot to inspect, query, create, edit, and script Roblox Studio instances in token-cheap batches, plus run Luau, playtests, screenshots, and inputs through Roblox's official Studio MCP connection. It runs locally over stdio or an authenticated local HTTP endpoint, returning small structured answers instead of dumping whole games into context.

An MCP server that detects affiliate links and provides information about Tracklix, enabling AI assistants to answer affiliate-link-related questions without any network calls or API keys.

Audit a site for AI readiness: AI-crawler access, schema, FAQ and content structure. Generates the fixes.

Enables AI assistants to search, compare, and get detailed information about MCP servers from the mcpcatalogs.com directory.

Enables AI assistants to provide information about ZeroCode Ventures' AI solutions for Dutch SMBs, including industry-specific advice, pricing, and savings calculations.

Enables AI assistants to search and retrieve information about Terraform providers and modules from the public Terraform registry, including detailed documentation, version information, and resource specifications.

Provides curated, meaningful information about Voi ecosystem protocols, applications, assets, and names, enabling identification and search through natural language.

Connects MCP-compatible coding agents to VMware vCenter to query information about virtual machines, hosts, clusters, datastores, datacenters, and networks.