"Web crawling techniques and tools" matching MCP servers:

Webhook management and testing tools for AI agents. Provides tools for sending, validating, generating, and debugging webhooks.

A comprehensive suite of HTTP and API testing tools that enables AI agents to perform requests, check endpoint health, and decode JWTs. It also provides utilities for URL parsing and detailed security analysis of HTTP response headers.

Enables interaction with Users and Products through a CRUD service REST API, providing tools for listing, creating, reading, updating, and deleting records via HTTP transport.

A TypeScript-based MCP server that enables AI assistants to execute HTTP requests with full control over methods, headers, and body content. It facilitates seamless interaction with web APIs and endpoints through a versatile tool that handles automatic JSON formatting and response truncation.

A Swagger/OpenAPI query tool for MCP clients like Cursor, enabling AI assistants to browse, search, and retrieve detailed API type information.

Enables AI assistants to execute GraphQL queries and retrieve schema information from any GraphQL endpoint.

Provides a standardized MCP interface for interacting with HTTP tools and services, enabling unified API access and management.

An MCP server that integrates various penetration testing tools, enabling security professionals to perform reconnaissance, vulnerability scanning, and API testing through natural language commands in compatible LLM clients like Claude Desktop.

Exposes read-only and write probes over a remote Streamable-HTTP /mcp endpoint so users can verify that ChatGPT Web discovers and calls remote tools, and test whether write actions actually execute on their plan. Real HWPX document editing is not yet supported; this P0 release only measures connectivity and read/write action boundaries.

Converts Dify tools' API to MCP (Model Control Protocol) compatible API, allowing tools created in Dify to be accessed from MCP clients like Cherry Studio.

Enables fetching content from any URL with support for different HTTP methods, custom headers, and request bodies. Designed to work with ChatGPT and other AI assistants for web scraping and API interactions.

A Model Context Protocol (MCP) server that enables interaction with JIRA APIs through Claude Desktop, allowing users to search, create, update, and manage JIRA issues using natural language commands.

Universal HTTP client tool for LLM agents. Enables Claude and other MCP-compatible agents to perform GET, POST, PUT, DELETE, and other HTTP requests to any URL, including localhost and internal network addresses.

Implements a secure MCP server with API Key and JWT authentication, providing tools like echo, login, secure_action, and admin_action. Includes MCP Inspector integration for testing and debugging.

Provides access to Ics Ap Apis API endpoints with authentication support, enabling API interactions through the MCP protocol.

Enables AI assistants to interact with Dev Proxy for creating configurations, finding documentation, and discovering best practices via the MCP standard.

Enables precise measurement of live HTTP and WebSocket services while maintaining an append-only, evidence-based ledger of claims that agents can query with explicit timestamps, staleness indicators, and instructions for re-verification.

This server facilitates scalable discovery and execution of OpenAPI endpoints using semantic search and high-performance processing, overcoming limitations of large spec handling for streamlined API interactions.

Lets AI assistants safely explore a Matrix42 instance by discovering web services and the data model, running validated ASQL queries, searching the service desk, and previewing ticket actions — read-only by default and without exposing credentials.

Automated QA for .NET microservice backends and React frontends, enabling API contract testing, UI crawling, YAML flows, and run diffing against a stage environment.