"Web crawling techniques and tools" matching MCP servers:

Relays a result screenshot to Slack so you can review a coding agent's output without opening the app.

MCP server that exposes tools to route natural language queries to typed IDs, describe catalog entries, and list repository verification commands for the m-dev-tools organization.

MCP server that lets AI editors execute JavaScript, read console output, and simulate clicks/input on static web pages. Supports multiple browser pages and can be deployed remotely via HTTP transport.

Enables web performance analysis using Google PageSpeed Insights and Chrome UX Report APIs, providing compact metrics and diagnostics without local browser automation.

Provides deterministic tools for transforming, formatting, and inspecting structured data for AI agents.

A local Model Context Protocol (MCP) server that exposes custom tools to Claude Desktop, enabling direct interaction with your local environment. It provides a framework for building and integrating custom TypeScript tools into the Claude interface.

Local MCP servers that give Claude Code access to other tools mid-session.

Enables users to select UI elements on localhost pages and send fix requests to MCP-compatible coding agents, which retrieve the captures and edit the code, with masking of sensitive values.

Enables AI agents to read any web page as clean Markdown and inspect its metadata, structure and technology stack, plus check redirects, TLS certificates, security headers, robots.txt, sitemaps, feeds, domains, SEO, broken links, email authentication (SPF/DMARC/DKIM) and SSO (SAML/OIDC). It also provides developer utilities such as cron, regex, color, Unicode and time-zone tools along with Hyperliquid perpetuals market data, all hosted remotely on Apify with pay-per-call pricing.

Transforms any API into an intelligent MCP agent in seconds, enabling natural language interaction with APIs through the Model Context Protocol.

Enables AI agents to perform common utility tasks through a streamable HTTP MCP endpoint, including JSON inspection, regex testing, cron parsing, hashing, base64 encoding/decoding, URL analysis, color conversion, text diffing, CSV parsing, JWT decode/verification, Markdown-to-HTML rendering, and UUID/token generation without API keys.

Enables coding agents to publish HTML artifacts that users can review and comment on in a sandboxed browser viewer, with feedback loop support for iterative versions.

MCP stdio server that exposes 95 headless it-tools utilities (crypto, encoding, converters, generators, text, math, and more) through three routing tools (categories, list, execute), with flat JSON schemas, worked examples, and deterministic seeded execution designed for small router models.

Provides tools for AI-powered graph analysis, including relationship extraction, adjacency matrix creation, and network centrality calculations. It enables users to perform complex structural analysis and generate interactive D3.js visualizations from structured data.

A modular multi-server architecture providing development automation, JIRA management, and performance reporting for Claude Code. It features specialized tools for PR health analysis, code reviews, and generating comprehensive team and individual quarterly reports.

MCP server providing browser compatibility data for the entire Web Platform.

Provides AI coding assistants with on-demand access to component specs, test scenarios, accessibility requirements, and build guides from the Web UI Component Specification.

Enables generating JSON Schema from sample data, generating TypeScript types, validating data against schemas, creating mock data from schemas, and comparing schemas for differences.

Webhook management and testing tools for AI agents. Provides tools for sending, validating, generating, and debugging webhooks.

MCP server providing npm registry search, package details, dependency auditing, bundle size estimation, and package comparison tools for AI agents.