agent
Plan queries and URLs from a natural-language prompt, fetch pages in parallel, extract structured data with JSON Schema, and synthesize results with full step transparency.
Instructions
Natural-language data gathering across sources. Plans queries + URLs from a prompt, executes in parallel, optionally extracts structured fields, synthesizes. Full step transparency.
Key parameters:
prompt: NL description of what to gather (e.g. "pricing for the top 5 CRM tools").
urls: optional seed URLs.
schema: optional JSON Schema — extracts matching fields from each page and merges.
max_pages: default 10.
max_time_ms: default 60000.
stream: progress notifications per step.
max_tokens_out / include_full_markdown / citation_format: budget + shape controls.
Pipeline: plan → search+fetch in parallel within budget → optional schema extraction → synthesize. steps[] exposes every action with timing. Uses MCP sampling when supported; falls back to keyword extraction otherwise.
Returns result, sources[], pages_fetched, steps[], total_time_ms, sampling_supported.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| urls | No | Specific URLs to include in the data gathering | |
| prompt | Yes | Natural-language description of what data to gather | |
| schema | No | Optional JSON Schema -- extract structured data matching this schema from each page | |
| stream | No | Send progress notifications as each step completes | |
| max_pages | No | Maximum pages to fetch (default 10, max 100) | |
| max_time_ms | No | Maximum execution time in milliseconds (default 60000) | |
| max_tokens_out | No | Token-budget cap on total output. Uses cl100k-base BPE; non-OpenAI tokenizer counts may drift ~5-15%. When both max_tokens_out and max_chars are set, max_tokens_out wins. | |
| citation_format | No | Citation rendering style. 'numbered' (default) inline [N] markers; 'json' returns a citations[] array; 'anthropic_tags' wraps sources in <source id='...'> tags. | |
| include_full_markdown | No | Include full markdown body in the response. Default false on multi-result tools (returns evidence excerpts only); set true to restore. |