Retrieve a list of AWS Glue crawlers to monitor data cataloging jobs, configure crawler settings, and manage data discovery workflows.
BSD 3-Clause
101,275 tools. Last updated 2026-04-13 02:17
- Create structured website maps to analyze site structure, discover content, and audit navigation paths for better understanding of web architecture.MIT
- Create structured website maps to analyze site architecture, discover content, and audit navigation paths for better understanding of web structure.MIT
- Generate structured website maps to analyze site architecture, navigation paths, and content organization. Ideal for site audits, content discovery, and understanding web structure with customizable depth and breadth settings.
- Extract visible text content from web pages using CSS selectors to scope extraction to specific sections. Returns page title, URL, and text content for understanding page information without custom JavaScript.MIT
- Stop web crawlers from indexing a specific document by disabling its crawling functionality.
Matching MCP Servers
- -securityFlicense-qualityAn intelligent web crawling server that uses Cloudflare's headless browser to render dynamic pages and Workers AI to extract relevant links based on natural language queries. It enables AI assistants to search and filter website content while providing secure access through GitHub OAuth authentication.Last updated 8 months ago3
- AsecurityFlicense-qualityProvides web connectivity tools for searching the web via DuckDuckGo or SerpAPI, fetching URL content, and extracting readable text from web pages.Last updated 5 months ago3
Matching MCP Connectors
Search the web and extract clean, readable text from webpages. Process multiple URLs at once to sp…
MCP server for SEO and web analysis data including keyword rankings, backlink profiles, site audits, and traffic analytics for AI agents.