Skip to main content
Glama
lucasmartins-ai

LookaCrawler

by lucasmartins-ai
OverviewSchemaSourceRelated ServersDiscussionsAdmin
TypeScript

crawl_website

Recursively crawl an entire website or documentation section with depth limits, URL pattern filtering, and token accounting.

Instructions

Recursively crawl an entire website or documentation section with depth limits, URL pattern filtering, and token accounting.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
modeNoCrawl mode ('fast' native fetch or 'deep' Playwright browser).fast
max_depthNoMaximum link traversal depth (default: 2).
max_pagesNoMaximum total pages to crawl (default: 5, max: 20).
start_urlYesRoot URL to start the recursive crawl from.
image_modeNoFormatting of images.ignore
link_formatNoFormatting of extracted hyperlinks.inline
exclude_patternsNoSubstring patterns (`*` = wildcard) for URLs to ignore (e.g. ['/login', '/tags/']). Max 10.
include_patternsNoSubstring patterns (`*` = wildcard) that candidate URLs must match (e.g. ['/docs/']). Max 10.

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed6 schema fields changedv1.1.2
    • changedInput schema / properties / exclude_patterns / description
      Previous value: -"Regex patterns for URLs to ignore (e.g. ['/login', '/tags/'])."New value: +"Substring patterns (`*` = wildcard) for URLs to ignore (e.g. ['/login', '/tags/']). Max 10."
    • addedInput schema / properties / exclude_patterns / items / maxLength
      Added value: +200
    • addedInput schema / properties / exclude_patterns / maxItems
      Added value: +10
    • changedInput schema / properties / include_patterns / description
      Previous value: -"Regex patterns that candidate URLs must match (e.g. ['/docs/'])."New value: +"Substring patterns (`*` = wildcard) that candidate URLs must match (e.g. ['/docs/']). Max 10."
    • addedInput schema / properties / include_patterns / items / maxLength
      Added value: +200
    • addedInput schema / properties / include_patterns / maxItems
      Added value: +10
  2. Addedv1.1.1

TDQS

Score is being calculated.

Deploy Server

Other Tools