scrape_url
Validate and/or scrape HTTP(S) URLs. DEFAULT mode=check: fast ping of one or many links/images (up to 20) — returns status (200/301/404/etc), ok, content-type, final URL after redirects. Use this to verify widget images, logos, CDN assets, booking links, or any URL before putting it on an agent. mode=scrape: full Convocore crawler scrape of ONE page (waits up to ~120s) for text/colours/favicon/images when building branded agents. After scrape, CHECK image URLs then call read_image on every important photo so you know what each picture is before putting it in the agent prompt. Default useProxy=false (~1 credit). CRITICAL — proxy: ONLY if a normal (useProxy=false) scrape fails/blocks AND the user explicitly confirms. Proxy is MUCH more expensive (~60 credits/page) and CONSUMES Convocore workspace credits. Requires useProxy=true + confirmExpensiveProxy=true. Never enable proxy proactively. Do NOT use scrape for KB ingest (use create_kb_from_urls). Workspace is resolved internally — never pass workspaceId.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "scrape_url"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | No | Single URL (optional if urls is set) | |
| mode | No | check = HTTP status ping (default). scrape = full page scrape (one URL only). | |
| urls | No | URLs to check (preferred for validating multiple image/page links) | |
| useProxy | No | mode=scrape only. Default false. true = expensive proxy scrape (~60 credits/page). ONLY after normal scrape failed AND user confirmed the extra credit cost. | |
| confirmExpensiveProxy | No | Must be true together with useProxy=true. Confirms the user approved burning extra Convocore workspace credits for proxy scraping. |