crawl_url
Fetch and extract web content from a single URL using HTTP or browser rendering. Supports HTML, PDF, DOCX, and more, with auto-escalation and prompt injection scanning.
Instructions
Fetch and extract one URL using fast HTTP, browser rendering, or automatic escalation.
Supports HTML, text, JSON, XML, PDF, DOCX, XLSX, CSV and TSV. Content returned to an agent is marked as untrusted and scanned for common prompt-injection text.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| headers | No | ||
| wait_ms | No | ||
| max_chars | No | ||
| use_cache | No | ||
| screenshot | No | ||
| render_mode | No | auto | |
| include_links | No | ||
| output_format | No | markdown | |
| include_images | No | ||
| respect_robots | No | ||
| remove_selectors | No | ||
| cache_ttl_seconds | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||