Create JSON configuration files for scraping documentation websites to extract structured data for AI training and RAG knowledge bases.
MIT
111,386 tools. Last updated 2026-04-18 20:04
- Generate critical instructions for web scraping tools to handle proxy rotation and bypass anti-bot measures when extracting data from websites.
- Bypass bot detection and anti-scraping measures to access web content, extract data, and capture screenshots from websites with protection mechanisms.
- Extract structured data from websites by scraping URLs with customizable HTTP methods, headers, proxies, JavaScript rendering, and anti-bot protection.
- Discover websites implementing the llms.txt standard by listing known compliant sites, with options to filter for specific file types.
- Extract comprehensive web content, including images, using deep scraping techniques with customizable parameters such as scroll depth, image size, and pagination. Output data to a specified directory for thorough analysis.MIT
Matching MCP Servers
- AsecurityAlicenseBqualityProvides tools to fetch IIIF manifests and retrieve specific image regions or scaled images for analysis. This server enables detailed interaction with International Image Interoperability Framework resources, supporting tasks like image description and transcription.Last updated35MIT
- -securityAlicense-qualityA Model Context Protocol server that enables AI-powered image generation through Stability AI and Black Forest Labs APIs, allowing users to create images from detailed text prompts with customizable settings and comprehensive metadata tracking.Last updatedMIT
Matching MCP Connectors
Web scraping for AI agents. Extract text and metadata from any URL worldwide. $0.005/page.
40+ web scraping tools from Firecrawl, Bright Data, Jina, Olostep, ScrapeGraph, Notte, and Riveter. Scrape, crawl, screenshot, and extract from any website. Starts at $0.01/call. Get your API key at app.xpay.sh or xpay.tools