crawl_markdown
Crawl a URL and extract clean markdown content. Optionally persist the original page in cloud storage and receive an RID for later access.
Instructions
Crawl a URL and extract clean markdown content. Pass store=true to persist the original page in Cloud Storage and return only the RID + metadata.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The URL to crawl | |
| store | No | Push the result to Crawlbase Cloud Storage. When true, returns only RID + metadata; retrieve later with storage_get (use as=markdown to convert). | |
| device | No | Device type for crawling | |
| user_agent | No | Custom user agent string |