"Web scraping and crawling tools" matching MCP servers:

Enables ChatGPT plugins and other MCP clients to fetch live web pages and documents as Markdown and to call HTTP APIs via self-hosted Cloudflare Workers.

Enables fetching content from any URL with support for different HTTP methods, custom headers, and request bodies. Designed to work with ChatGPT and other AI assistants for web scraping and API interactions.

Lets AI assistants safely explore a Matrix42 instance by discovering web services and the data model, running validated ASQL queries, searching the service desk, and previewing ticket actions — read-only by default and without exposing credentials.

MCP server for scraping with declarative configs

Automated QA for .NET microservice backends and React frontends, enabling API contract testing, UI crawling, YAML flows, and run diffing against a stage environment.

Webhook management and testing tools for AI agents. Provides tools for sending, validating, generating, and debugging webhooks.

Security intelligence API for AI models. CVE lookup with EPSS/KEV, domain recon (DNS, WHOIS, SSL, subdomains, WAF), and code security checks (secrets, injection, headers). 16 tools, no API key required.

A TypeScript-based MCP server that enables AI assistants to execute HTTP requests with full control over methods, headers, and body content. It facilitates seamless interaction with web APIs and endpoints through a versatile tool that handles automatic JSON formatting and response truncation.

A reusable MCP server for QA automation testing that enables running tests across web apps, APIs, CLI tools, and more directly from Claude Desktop.

Universal HTTP client tool for LLM agents. Enables Claude and other MCP-compatible agents to perform GET, POST, PUT, DELETE, and other HTTP requests to any URL, including localhost and internal network addresses.

Zero-telemetry local developer execution layer for AI coding agents. Provides deterministic tools to inspect listening network ports and processes, calculate IPv4 CIDR subnet ranges and usable hosts, decode embedded creation timestamps from distributed IDs (UUIDv7, ULID, Snowflake, MongoDB ObjectId), and convert Unix epoch timestamps to UTC, ISO 8601, and local time.

A comprehensive suite of HTTP and API testing tools that enables AI agents to perform requests, check endpoint health, and decode JWTs. It also provides utilities for URL parsing and detailed security analysis of HTTP response headers.

A Swagger/OpenAPI query tool for MCP clients like Cursor, enabling AI assistants to browse, search, and retrieve detailed API type information.

MCP server that provides tools for exploring and testing APIs through Swagger/OpenAPI documentation.

A comprehensive HTTP client MCP server for security testing, API testing, and web automation that provides full-featured HTTP tools with detailed logging capabilities.

A Model Context Protocol server that enables AI assistants to make HTTP requests (GET, POST, PUT, DELETE) to external APIs through standardized MCP tools.

Enables measuring, comparing, and health-checking endpoint response times through natural language, using tools to probe URL latency and compare two URLs.

Enables AI tools to search, create, update, and manage YApi API interfaces, projects, and categories through natural language.

Provides tools to communicate with a service dependency API, enabling users to query and interact with service relationship data and dependency mappings.

An MCP server that generates AI agent tools from Postman collections and requests. This server integrates with the Postman API to convert API endpoints into type-safe code that can be used with various AI frameworks.