Skip to main content
Glama

clear-line-ops

Crawl a website

crawl_site

Crawl a site breadth-first from a starting URL, staying on the same domain, and return the clean text of each page. Useful for building a knowledge base or RAG corpus. Cost: 5 credits per call.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
urlYesPublic http(s) page URL
max_pagesNo
max_chars_per_pageNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

Score is being calculated.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.