"Web scraping and crawling tools" matching MCP servers:

Delivers comprehensive company intelligence in a single tool call, aggregating profiles, tech stacks, key people, news, and corporate data from any domain or company name. Sources data from Wikipedia, GitHub, OpenCorporates, and web scraping to provide structured business insights using only free public APIs.

Unified API for Government Data and Web Scraping

CompanyLens MCP gives your AI assistant access to real corporate data from official government sources. No web scraping, no hallucinations — verified data from SEC EDGAR, UK Companies House, OpenSanctions, and USAspending.gov.

Local read-only MCP server for Kwangwoon University notices, providing metadata-only crawling and cached notice access through a local STDIO server.

High-value scientific tools for AI agents — literature search (PubMed, arXiv, Semantic Scholar), chemical compound lookup (PubChem, ChEMBL), patent prior art search (USPTO, EPO), GPU spot prices across 4 providers, and real-time earth science data (USGS, NASA, OpenAQ). Per-call billing via API key. Keys issued instantly at https://mcp-site.com/keys/request

Enables MCP-compatible AI clients to look up UK postcode details, find nearest postcodes by coordinates, and retrieve upcoming bank holidays through keyless public APIs.

MCP server for answering questions about official statistics from a single publication URL, with tools to check query scope, retrieve overview, text, data files, and search.

Provides access to the Reuters Business and Financial News API to retrieve articles, trending news, and market data. It enables searching and filtering financial content by date, author, category, and keywords.

Enables AI agents to look up US NHTSA and EU Safety Gate car recalls and complaints, compare a model's years by risk score, check UK MOT failure rates, retrieve EU vehicle specifications with WLTP CO2 and fuel consumption, and verify Cyprus company records, EU VAT numbers via VIES and LEIs. It draws only on official open data and is hosted through Apify, so nothing needs to be installed.

Fetches live weather data from Open-Meteo without an API key and returns structured JSON with location disambiguation, enabling weather queries in LM Studio chat.

Provides AI agents with tools to detect website tech stacks, enrich company profiles, monitor sitemaps for new or changed URLs, check URL indexability, and retrieve EU fuel prices as clean JSON, billed per result.

87+ specialized tools for German and European energy data. Direct AI access to Marktstammdatenregister (MaStR), ENTSO-E, Redispatch 2.0, and Grid Operations for utilities and datacenters.

A security pentesting MCP server with 89 tools across 10 categories, enabling comprehensive reconnaissance, web security, OSINT, and exploitation tasks. It features a native Windows/WSL bridge for Kali Linux tools and scope-aware permission tiers for safe and efficient scanning.

An MCP server that enables AI assistants to call weather tools, read resources, and use prompt templates for live weather data integration.

MCP server that provides tools to query Korean financial products (savings, deposits, pensions, mortgages, loans) via the FSS Open API, enabling search by company or product type.

Free remote MCP server for GIS/ArcGIS Online automation — coordinate/EPSG conversion, GeoJSON validation and geometry operations, ArcGIS FeatureServer inspection (feature count/query, schema, health check), and Shapefile/KML/GPX/WKT format conversion. Works with public ArcGIS layers without a token;

Provides queryable access to official UAE open data through MCP tools, resources, and prompts, with bilingual support and multiple data connectors.

A comprehensive MCP server that exposes multiple OSINT tools to AI assistants like Claude, enabling sophisticated reconnaissance and information gathering tasks using industry-standard OSINT tools.

Enables AI assistants to retrieve live Hong Kong banking data—ATM and branch locations, HIBOR/HKD rates, and bank legitimacy checks—from official HKMA public APIs, with no credentials or scraping.

All in one Osint tools