Extract web content from URLs using Bittensor's decentralized scraping network. Pay per use via blockchain for automated data collection.
164,693 tools. Last updated 2026-05-31 09:32
"Understanding Web Scraping" matching MCP tools:
- Retrieve French tax information from cached data when web scraping fails, providing reliable access to official tax brackets and calculations for residents.
- Extract focused web content with optimized scraping, limited scrolls, and customizable image extraction for efficient data collection on Prysm MCP Server.
- Extract structured data from web pages by supplying URLs and a prompt, with options for web search and retries.MIT
- Search the web using DuckDuckGo to find relevant information, web pages, and summaries for any query. Get results with titles, URLs, and detailed content to access real-time web data.Apache 2.0
- Search academic papers on Google Scholar by query, author, or publication year to find relevant research publications.MIT
Matching MCP Servers
- FlicenseAqualityCmaintenanceEnables retrieval and cleaning of official documentation content for popular AI/Python libraries (uv, langchain, openai, llama-index) through web scraping and LLM-powered content extraction. Uses Serper API for search and Groq API to clean HTML into readable text with source attribution.Last updated11
- AlicenseBqualityCmaintenanceA comprehensive web scraping server that transforms web content into clean, agent-ready Markdown with automatic citations and efficient caching. It features a robust suite of tools for metadata extraction, sentiment analysis, SEO auditing, and security scanning while strictly adhering to robots.txt policies.Last updated481813MIT
Matching MCP Connectors
40+ web scraping tools from Firecrawl, Bright Data, Jina, Olostep, ScrapeGraph, Notte, and Riveter. Scrape, crawl, screenshot, and extract from any website. Starts at $0.01/call. Get your API key at app.xpay.sh or xpay.tools
Web scraping for AI agents. Extract text and metadata from any URL worldwide. $0.005/page.
- Search the web to find information and return relevant results for queries, supporting AI agents with web data retrieval.MIT
- Check real-time train ticket prices for routes in Spain. Uses web scraping to provide actual pricing with pagination support.MIT
- Extract structured data, full content, or brand identity from any webpage using JSON, markdown, or specialized formats for web scraping needs.
- Fetch up to 25 web pages in parallel and return each as clean Markdown. Reduces wait time for batch scraping tasks.MIT
- Extract clean readable content from up to 20 URLs: text, title, author, date. Eliminates scraping. Feed web pages into AI agent context windows.MIT
- Fetch detailed Vinted item info including price, photos, and seller details by item ID or URL. Automatically falls back to HTML scraping when API is unavailable.MIT
- Retrieve URLs, titles, and snippets from web search to selectively scrape or filter results yourself.MIT
- Answers complex queries by combining file analysis, image understanding, web/X search, and code execution. Supports multi-agent collaboration and persistent history.MIT
- Discover available integrations and apps in Agentled to identify tools for building workflows, including LinkedIn enrichment, email finder, web scraping, and CRM connections.MIT
- Check the status of an asynchronous web scraping job to monitor progress and retrieve results when ready. Supports pending, processing, completed, failed, and cancelled statuses.MIT
- Submit asynchronous scraping jobs for long-running requests like heavy JavaScript rendering, batch processing, or pages requiring extended load times, returning a job ID for status polling.MIT
- Check the status of a running crawl job by providing its job ID. Returns 'scraping' if in progress, or 'completed', 'failed', or 'cancelled' when done. On completion, retrieves all crawled page content. Poll every 2–5 seconds until the job finishes.MIT
- Extract structured data and text content from web pages using specific instructions and JSON schema for scraping, information gathering, or content collection.Apache 2.0
- Extract structured data and text content from web pages using specific instructions and JSON schemas for scraping, information gathering, or content collection.Apache 2.0