veroq_crawl
Extract structured content and analyze link structures from webpages by crawling URLs with configurable depth and page limits.
Instructions
Crawl a URL and extract structured content with optional link following.
WHEN TO USE: When you need to extract and analyze content from a specific webpage, or crawl a site's link structure. RETURNS: Page content, metadata, and discovered links per page crawled. COST: 3 credits. EXAMPLE: { "url": "https://sec.gov/cgi-bin/browse-edgar?action=getcompany&CIK=AAPL", "depth": 1 } CONSTRAINTS: Max depth 3, max 10 pages per crawl.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | URL to crawl and extract content from | |
| depth | No | Crawl depth (default 1) | |
| max_pages | No | Max pages to crawl (default 5) | |
| include_links | No | Include extracted links in response |