"Information about web crawlers or scraping techniques" matching MCP servers:

MCP server that provides AI access to a local terminal, enabling command execution, directory navigation, and system operations with persistent session state.

Local MCP server bridging ChatGPT Web to local tools for file, shell, git, test, and process management with secure policy controls.

Enables local code execution via Codex (Luna) through MCP, using ChatGPT Web conversations as a planner. Provides file, terminal, and code execution tools while keeping long-running jobs manageable.

Remote MCP / x402 / USDC / Base / Solana / OpenAPI / Google ADK / Gemini Xcatcher is an agent-first Remote MCP server (Streamable HTTP) for high-throughput crawling of fresh/latest posts across large sets of X (Twitter) usernames. It supports x402 pay-as-you-go top-ups using USDC on Base and Solana.

Enables AI assistants to interact with serial port devices by sending commands, capturing output, and managing connections, with real-time browser-based terminal monitoring.

Enables file operations and bash command execution on the local workspace, securely exposed to ChatGPT via OpenAI Tunnel.

Runs as an MCP server providing file system operations, shell execution, and system information tools, allowing Claude or any MCP client to edit files and control the machine.

Provides AI coding agents with structured, evidence-based diagnostics about the local development environment, detecting tech stack, runtime mismatches, dependency state, services, ports, and Git status without exposing secrets or using network calls.

About AI/ML-powered diagnostic engine for SRE Observability on Konflux and OpenShift. It uses the Model Context Protocol (MCP) and 40+ tools to analyze logs, metrics, and traces, enabling automated RCA and predictive analysis.

Enables AI clients to execute Windows commands, manage files, query system information, and perform code checks via MCP protocol.

MCP server that enables AI to fully control macOS — mouse, keyboard, terminal, screenshots, window management, UI element detection, and provides AI-optimized information reporting.

Provides Unix command documentation directly within Claude conversations, allowing users to retrieve help pages, man pages, and usage information without leaving the chat interface.

A simple MCP server that provides waiting functionality to pause until other tasks finish, with progress reporting and support for CLI or HTTP server with SSE.

A FastMCP-based tool for monitoring server statistics that retrieves CPU, memory, and uptime information from both local and remote servers via SSH.

An educational MCP server exposing shell command execution (PowerShell and sh) and a benign tool for learning about MCP tools, resources, and security risks like tool poisoning.

Enables AI assistants to execute security testing tools on a Kali Linux machine over SSH, including reconnaissance, web app scanning, and static/dynamic analysis.

Enables Claude to execute PowerShell commands and scripts in a persistent interactive terminal on Windows, with real-time output streaming to a web terminal.

Enables MCP clients such as Notion AI to execute native OpenCode file, search, shell, web-fetch, and todo tools with job management and permission approvals.

A plug-and-play MCP toolkit providing AI agents with web search (Chinese sources prioritized), file operations, and shell command execution capabilities.

A modular MCP server providing file operations, web search, URL scraping, and sandboxed command execution for LLM interactions.