Scan and extract all unique URLs from a website by recursively crawling from a given URL up to a specified depth. Designed for web content analysis.
MIT
205,128 tools. Last updated 2026-06-15 05:53
"Retrieve Website Titles Based on Given URLs" matching MCP tools:
- Retrieves all Instagram profile highlights with cover images, titles, and permalink URLs for a given user ID.MIT
- Crawl a website from a given URL to a specified depth and generate an XML sitemap with discovered URLs, up to a defined limit, for improved site navigation and indexing.MIT
- Discover all URLs on a website quickly and cheaply. Use this tool to survey a site before deciding what to crawl deeply. Optionally filter results by search term, limit output, or control sitemap usage. Returns URLs with optional titles and descriptions.MIT
- List all open browser tabs to retrieve their IDs, URLs, and titles for tab management and automation.MIT
- Discover all URLs on a website by parsing sitemaps and extracting links. Use patterns to scope discovery and search to rank by relevance.MIT
Matching MCP Servers
- Alicense-quality-maintenanceAn MCP server for indexing and searching local text files using late-interaction retrieval (ColBERT-style MaxSim), enabling token-level relevance matching.Last updatedMIT
- Apache 2.0
Matching MCP Connectors
Provides a platform-agnostic specification of the technical features every decent website should have
Improve security writing, score it against rubrics, plan IR, CTI, vuln, and product strategy.
- Discover all URLs on a website via sitemaps and link extraction. Use before crawling to understand site structure or build a URL list for selective fetching.Apache 2.0
- Discover all indexed URLs on a website to identify pages for scraping or locate specific site sections. Returns a list of found URLs.MIT
- Discover all indexed URLs on a website to identify pages for scraping or locate specific sections. Returns an array of found URLs.MIT
- Discover all indexed URLs on a website by mapping its structure. Ideal for finding specific sections of a site before scraping.MIT
- Discover all indexed URLs on a website to identify pages for scraping or locate specific sections before content extraction.MIT
- Retrieve a list of all open browser tabs, including their URLs and titles, to access current browsing context.MIT
- Discover all indexed URLs on a website to identify pages for scraping or locate specific sections of a site. Returns an array of found URLs.MIT
- Retrieve all posts from your WriteFreely account, displaying their IDs, titles, and URLs.MIT
- Retrieve a list of all open browser tabs including URLs, titles, and active status to manage browsing sessions efficiently.MIT
- List published AI marketing pages for any website, returning URLs, titles, and publish dates with pagination support.MIT
- Retrieve AI-generated short video clips from a completed request, including video URLs, titles, descriptions, viral scores, and durations sorted by popularity.MIT
- Predicts tools that typically follow a given tool based on usage patterns, helping streamline your workflow.MIT
- Retrieve a list of all open browser tabs, including their IDs, titles, and URLs, to enable tab management and navigation.MIT
- List all open Safari tabs with their titles and URLs for quick access and navigation.