"Information about web scraping or crawling" matching MCP servers:

A TypeScript-based MCP server that enables AI assistants to execute HTTP requests with full control over methods, headers, and body content. It facilitates seamless interaction with web APIs and endpoints through a versatile tool that handles automatic JSON formatting and response truncation.

Enables interaction with Qonto's Business API for banking operations. Supports all API key-accessible endpoints for managing business banking transactions and account information.

Exposes read-only and write probes over a remote Streamable-HTTP /mcp endpoint so users can verify that ChatGPT Web discovers and calls remote tools, and test whether write actions actually execute on their plan. Real HWPX document editing is not yet supported; this P0 release only measures connectivity and read/write action boundaries.

Enables fetching content from any URL with support for different HTTP methods, custom headers, and request bodies. Designed to work with ChatGPT and other AI assistants for web scraping and API interactions.

Universal HTTP client tool for LLM agents. Enables Claude and other MCP-compatible agents to perform GET, POST, PUT, DELETE, and other HTTP requests to any URL, including localhost and internal network addresses.

Lets AI assistants safely explore a Matrix42 instance by discovering web services and the data model, running validated ASQL queries, searching the service desk, and previewing ticket actions — read-only by default and without exposing credentials.

Enables AI agents to connect to any GraphQL endpoint, introspect schemas, and execute queries or mutations through auto-generated tools.

Security intelligence API for AI models. CVE lookup with EPSS/KEV, domain recon (DNS, WHOIS, SSL, subdomains, WAF), and code security checks (secrets, injection, headers). 16 tools, no API key required.

MCP server for scraping with declarative configs

Automated QA for .NET microservice backends and React frontends, enabling API contract testing, UI crawling, YAML flows, and run diffing against a stage environment.

Validates OpenAPI specs from files, inline content, or URLs, and generates prompts for agent developers based on the API analysis.

An MCP server for interacting with Treasure Data API, allowing users to retrieve database information and check server status through natural language queries.

An MCP server that turns Zod schemas into mocks, violations, and contract tests, enabling AI agents to reason about API contracts without manually crafting payloads.

A reusable MCP server for QA automation testing that enables running tests across web apps, APIs, CLI tools, and more directly from Claude Desktop.

Enables turning any docs URL (OpenAPI, llms.txt, or HTML) into lean, callable MCP tools with add/list/call operations, plus timeout and truncation guards.

Precisely filter and fetch API documentation from Apifox or any OpenAPI URL, reducing context bloat by fetching only needed endpoints.

Enables agents to verify real-world assertions like content being posted or PRs merged by fetching live evidence from URLs and GitHub, returning a verified boolean plus raw evidence.

Discover and compare L402 and x402 paid API services from satring.com. Search, filter, and rank services by price, rating, or composite score across the best curated Lightning and USDC API directory.

Discovers, inspects, and executes requests against OpenAPI or Swagger APIs directly from documentation URLs or specification files. It enables users to trace parameter usage across an API and perform authenticated HTTP requests through a structured toolset.

A Swagger/OpenAPI query tool for MCP clients like Cursor, enabling AI assistants to browse, search, and retrieve detailed API type information.