Extract structured data and text content from web pages using specific instructions and defined schemas for scraping, information gathering, or content retrieval.
Apache 2.0
135,158 tools. Last updated 2026-05-25 22:38
"Information about web scraping or crawling" matching MCP tools:
- Extract structured data and text content from web pages using specific instructions and JSON schemas for scraping, information gathering, or content retrieval.Apache 2.0
- Extract structured data and text content from web pages using specific instructions and JSON schemas for scraping, information gathering, or content collection.Apache 2.0
- Extract structured data and text content from web pages using specific instructions and JSON schemas for scraping, information gathering, or content collection.Apache 2.0
- Extract structured data and text content from web pages using specific instructions and a defined schema for scraping information.Apache 2.0
- Extract structured data and text content from web pages using specific instructions and JSON schema for scraping, information gathering, or content collection.Apache 2.0
Matching MCP Servers
- FlicenseAqualityCmaintenanceEnables retrieval and cleaning of official documentation content for popular AI/Python libraries (uv, langchain, openai, llama-index) through web scraping and LLM-powered content extraction. Uses Serper API for search and Groq API to clean HTML into readable text with source attribution.Last updated11
- FlicenseBqualityCmaintenanceEnables web page scraping via Jina reader API and searching FastMCP documentation using minsearch. Supports fetching markdown content from URLs and querying indexed documentation files.Last updated3
Matching MCP Connectors
40+ web scraping tools from Firecrawl, Bright Data, Jina, Olostep, ScrapeGraph, Notte, and Riveter. Scrape, crawl, screenshot, and extract from any website. Starts at $0.01/call. Get your API key at app.xpay.sh or xpay.tools
Generic URL crawl + HTML extraction — fallback for sites without dedicated MCPs.
- Submit URLs to Google Indexing API for fast crawling and indexing. Use to notify Google about new, updated, or deleted web pages.MIT
- Extract structured data and text content from web pages using specific instructions and JSON schemas for scraping information, gathering content, or pulling targeted data from websites.Apache 2.0
- Extract structured data and text from web pages using specific instructions and JSON schema for scraping content or gathering information.Apache 2.0
- Extract structured data and text content from web pages using specific instructions and a defined schema for data scraping and information gathering.Apache 2.0
- Analyze a website's robots.txt file to determine crawl permissions and ensure compliance with ethical web scraping practices. Provides insights into allowed and disallowed paths for crawling.
- Conduct comprehensive web research by crawling, searching, and analyzing content to gather detailed information on any topic.MIT
- Conduct deep web research on any query using crawling, search, and AI analysis to gather comprehensive information from multiple sources.MIT
- Retrieve French tax information from cached data when web scraping fails, providing reliable access to official tax brackets and calculations for residents.
- Automatically discover and map a web application's structure by creating an analysis suite and dispatching an AI crawling agent in one step.MIT
- Start multi-page web crawling to extract structured data with AI or convert content to markdown from a starting URL.MIT
- Retrieve results from an asynchronous web crawling operation by polling with a request ID until completion, providing structured data or markdown content from processed webpages.MIT
- Search the web for current information, news, articles, and websites to find up-to-date content, research topics, or answer questions about recent events.Apache 2.0
- Extract, sanitize, and normalize unstructured web content into clean Markdown or JSON, designed for LLM context windows and complex structures.MIT
- Retrieve threat intelligence data about a web domain. Provide the domain to get its security analysis and risk assessment.Apache 2.0