"Information about web crawlers or related technology" matching MCP servers:

The MCP for the Web Speed Agent SDK that enables post-auth agents.

Ultra-lightweight headless browser for AI agents. Provides MCP tools for navigating URLs, extracting structured content, and building autonomous agent workflows.

Enables AI shopping agents to search products, check stock, apply promotions, manage cart sessions, and create cryptographically signed checkout sessions on e-commerce storefronts, while giving merchants analytics into agent intent and catalog demand gaps.

Remote MCP server (HTTP/OAuth) exposing a self-hosted Honcho instance to claude.ai custom connectors and other MCP clients.

A Node.js application that connects WhatsApp Web with AI models through the Model Context Protocol, enabling automated messaging, contact management, and group chat functionality through AI-driven workflows.

Enables human-in-the-loop checkpoints for AI agents, allowing them to pause and wait for human input via a web UI, then seamlessly resume execution.

Guardrails for AI coding agents that enforces rules via compliance receipts, blocking destructive actions and syncing rules across all AI tools.

Enables Claude Code to delegate tasks to OpenCode subagents asynchronously, with tools for starting tasks, polling status, and fetching results.

Exposes web search and page fetching tools via the MCP protocol, allowing integration with AI editors like Cursor for autonomous research workflows.

Connects to SolidWorks 2022 over COM to run, test, and auto-fix VBA macros, returning structured diagnostics for iterative correction by Claude.

Enables structured multi-LLM critique of concepts using three specialized agents (Innovation, Ethics, Security) with multi-vendor LLM support. Provides 13 free tools for validation, template management, and coordination.

Controls coding agents by enforcing structured implementation plans with PRs and commits as work units, requiring user review at each commit checkpoint to prevent agents from going off track. Includes a visualization dashboard for tracking progress in real-time.

Enables supervised, visible control of a Windows desktop from an MCP client, providing real mouse and keyboard input, screenshots, local safety controls, and a teaching mode for guidance without injection.

Allows AI agents to control and interact with VS Code webviews by providing tools for navigation, element interaction, and state retrieval. It facilitates automated tasks like clicking elements, inputting text, and reading the DOM structure within a VS Code tab.

Enables agent-driven CAD design through deterministic source files (.kcad.ts), including model evaluation, validation, and export to STEP/STL via MCP tools for review and introspection.

Enables Claude to monitor and execute Binance trading strategies through a bounded MCP tool interface, with risk controls and audit logging.

A master control program that orchestrates intelligent agents with a plug-and-play architecture, enabling seamless coordination and management of AI agent workflows.

An MCP server that lets Claude directly operate a commercial insurance contracts app through WebMCP, enabling natural-language queries, renewals, updates, and reporting against live React state and Postgres.

An MCP server that implements iterative refinement of responses through self-critique cycles, breaking the process into discrete steps to avoid timeouts and show progress.

Enables autonomous AI agents to conduct non-custodial commerce using JPYC stablecoin on Polygon, with trust scoring, task evaluation, negotiation, and on-chain verification via Soulbound Tokens.