"Web scraping and crawling tools" matching MCP servers:

Enables fetching any public web page through managed proxies, with optional JavaScript rendering, returning markdown, text, HTML, or structured JSON.

An MCP-native pipeline for collecting structured intelligence on higher education institutions using the WHED schema, enabling scraping, extraction, validation, and saving of profiles.

A Firecrawl MCP server with built-in support for multiple API key rotation, enabling web search, scraping, crawling, extraction, and more via MCP clients.

Give AI agents cited funding, money-market, FX and capital-market evidence through 16 public MCP tools. Keep source dates, freshness checks and coverage gaps attached; China macro coverage is metadata-only. No API key is required for the public surface. Research context only; no trade execution.

Enables language models to search biomedical literature, fetch sequences, and follow links across Entrez databases through eleven read-only tools wrapping the nine NCBI Entrez E-utilities. It handles URL building, pacing, redirects, response caps, and API-key redaction so queries can be answered without a browser or scraping.

Classifies company sites as B2B or B2C and as SaaS, online store, agency, manufacturer, wholesaler, distributor, or marketplace, while matching your own buyer phrases and returning the quoted text and page as evidence. Runs deterministically on Apify, giving one row per domain with grace-free status rows for unreachable, blocked, or empty sites.

Deterministic US equity-compensation tax optimizer. Six tools cover ISO/AMT exercise scheduling, NSO sell-vs-hold, RSU vest-and-sell, single-stock concentration, protective put / zero-cost collar pricing, and Section 1202 QSBS qualification. Federal plus 50-state plus DC tax math.

Connect AI assistants to your Gramps Web family tree. Search and edit genealogy records, explore ancestors, descendants, relationships and timelines, and read document scans with vision-capable models. Includes guided research workflows, source citations, read-only mode, and privacy-aware media previews. Install with Docker or a Claude Desktop bundle.

Zero-auth hosted MCP for AI builders: optimize/convert images (WebP/AVIF/JPEG), paste-ready SVG QR codes, plus cited Cleanor Labs data on device storage capacity and next-gen image-format savings. No API key or signup.

An MCP server for Perplexity's Agent API, enabling multi-step web research with citations through tools to start, collect, and cancel research runs.

Delivers comprehensive company intelligence in a single tool call, aggregating profiles, tech stacks, key people, news, and corporate data from any domain or company name. Sources data from Wikipedia, GitHub, OpenCorporates, and web scraping to provide structured business insights using only free public APIs.

Enables MCP clients to screen lab results against published criteria with deterministic Python, search Australian contaminated-land guidance with cited passages, and draft guarded results sections whose numbers and citations are validated. All four tools are read-only and keep figures and citations under code control for a qualified person to check.

Given a company domain or name, it checks ten app marketplaces — HubSpot, Salesforce AppExchange, Slack, Zapier, Shopify, Atlassian, Chrome Web Store, Microsoft, Google Workspace, and WordPress — to report where the company is listed, with each listing's URL, installs, rating, review count, and match confidence. Useful for competitive research and partner-ecosystem audits across many domains in a single run.

Enables AI coding agents to run Tavily-powered web searches and asynchronous, cited research through MCP, with tools for focused search, task creation, and status retrieval.

Enables chatting with your site's SEO using real data, including crawling, on-page auditing, Google Search Console performance, Core Web Vitals, and competitor comparison from MCP clients like Claude or Cursor.

Enables users to pull portfolio company lists from Y Combinator, a16z, Sequoia, Accel, and other investors or any portfolio page URL, returning one row per company with name, domain, website, description, and stage or batch. Runs on Apify and produces Clay-ready output, with YC results filterable by batch, industry, region, status, and search terms.

Provides actionable financial intelligence tools for AI agents including insider buying signals, earnings IV plays, market pulse, stock analysis, and options strategies via free public data sources.

Enables AI agents to search and fetch high-quality information from multiple sources, including general web APIs, Wikipedia, arXiv, Hacker News, Stack Exchange, and Crossref, with optional pro-mode deep research and clean markdown page extraction.

Exposes 26 structured analytical tools over Climate Finance Update datasets, enabling fund-level financial analysis, portfolio aggregations, and data quality diagnostics without requiring the client to write data access code.

An MCP server for managing pandoc/CSL-YAML bibliographies and verifying citations in documents.