Johto Data crawl
crawlRead-onlyIdempotent
Crawl up to 20 pages under a start URL into Markdown: url, HTTP status, title, description, markdown, token estimate, content hash, truncated flag, depth and load time per page. Not charged if no page is read. ?url=https://docs.example.com&pages=20&max_chars=20000 Use when: you need a docs site or one section of a site (up to 20 pages under a start URL) as Markdown. Don't use when: you need a single page (use /v1/read), more than 20 pages, pages outside the start URL path, or content behind a login or paywall. Price: $0.0045 per call over x402 (USDC on Base). Set sample:true for a free sample.
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Start URL, http(s). Only pages under it are crawled. | |
| pages | No | Max pages, 1-20 (default 20) | |
| sample | No | true: return the free sample (no payment, other arguments ignored) | |
| max_chars | No | Max Markdown characters per page, 500-20000 (default 20000) |