Skip to main content
Glama
670,915 tools. Updated 2026-10-17 20:19

"A query related to 'crawl' and its contexts" matching MCP tools:

  • Find knowledge base entries similar to a given entry by comparing tags and content, returning ranked results to discover related patterns and examples.
    MIT
  • Retrieve data a saved crawl already collected on its most recent completed run. Use to access existing crawl results at any age without starting a new crawl.
    MIT
  • List current Appium contexts or switch to a native or webview context for mobile automation.
    Apache 2.0
  • Browse and filter existing context entries by workspace, project, type, tag, scope, or memory kind without a search query. Use optional limits and pagination to list stored contexts.
    MIT
  • Check a site's crawl freshness to decide whether to query existing crawl data or initiate a new crawl. Returns last crawl times, page count, mode, age, and running job status.
    Apache 2.0

Matching MCP Servers

Matching MCP Connectors

  • Ask before you fetch: will this domain serve your crawler, refuse it, or charge it?

  • Bounded crawl-readiness check for agent access: robots.txt, sitemap.xml, llms.txt, homepage.