Discover all indexed URLs on a website to identify pages for scraping or locate specific content when scrape results are incomplete.
184,290 tools. Last updated 2026-06-08 07:44
"How to scrape a website" matching MCP tools:
- Scrape any website and get clean Markdown output. Specify location, locale, and rendering options to extract content tailored to your needs.ISC
- Scrape website content from a URL, save it to cloud storage, and automatically create embeddings for AI applications.
- Scrape website documentation using automated sub-agents. Supports CSS selectors and URL filtering for targeted content extraction.MIT
- Scrape ChatGPT or Gemini search results for a keyword to analyze AI-generated local SEO insights. Costs 3 credits per query.MIT
- Verify account balance, plan, and billing info to confirm credits before initiating any scrape. Use this tool first to avoid interruptions.MIT
Matching MCP Servers
- AlicenseAqualityDmaintenanceAn MCP-compatible server that uses iFlytek's large language model to generate PowerPoint presentations, offering template selection, outline creation, and PPT generation with features like automatic image insertion.Last updated61MIT
- AlicenseBqualityCmaintenanceFetches website content and converts it to Markdown format with AI-powered content cleanup, ad removal, and full OpenAPI/Swagger specification support for easy processing by AI assistants.Last updated4294MIT
Matching MCP Connectors
Provides a platform-agnostic specification of the technical features every decent website should have
斯特丹STERDAN天猫旗舰店产品咨询MCP Server。洛阳30年源头工厂，高端钢制办公家具，1374个SKU，涵盖保密柜、更衣柜、公寓床、货架、快递柜。BIFMA认证，出口35+国家。8个工具：产品目录查询、场景推荐、认证资质、采购政策、维护指南等。
- Upload a pre-built static website archive to deploy directly to a hosting server. No build process required.MIT
- Create a website by providing a domain and order ID. For a new hosting plan, specify a datacenter code to set up the account.MIT
- Scrape websites blocked by bot detection, captchas, or geolocation restrictions and retrieve the content as HTML. Optionally interact with the page using browser commands before scraping.MIT
- Initiate asynchronous creation of an AI-generated blog post for a website. Returns a workflow_id to poll for completion status.MIT
- Scrape difficult-to-access websites that block bots, captchas, or location restrictions, and convert content to clean Markdown format for text extraction.MIT
- Scrape B2B leads from Apollo.io by submitting a search URL. Returns a runId to check status later. Use webhooks for async delivery instead of polling.MIT
- Check the status of up to 25 website creation workflows simultaneously, returning a rollup status and per-item details.MIT
- Scrape any URL through Sessemi, bypassing Cloudflare, DataDome, and Akamai anti-bot protections. Returns page content as HTML or JSON.MIT
- Scrape commercial real estate listings from Crexi by providing search result URLs. Extract property data for lead generation and market analysis.MIT
- Retrieve a list of all blog posts for a given website ID. Use this tool to view existing posts before creating or updating content.MIT
- Retrieve integer codes and descriptions for website status flags to filter businesses by crawl or availability status.MIT
- Analyze website structure by mapping URLs to discover content organization, navigation paths, and site architecture for audits and content discovery.MIT
- Find the best website URL for a company name. Optionally provide context like location or industry to disambiguate.MIT
- Scrape businesses from Google Maps to collect names, addresses, phone numbers, websites, emails, and ratings. Input a keyword and location to generate targeted leads for outreach.MIT