scrape_url
Validate up to 20 HTTP(S) links or images with quick status pings, or scrape a single page for text, colours, favicon and images when building branded agents.
Instructions
Validate and/or scrape HTTP(S) URLs. DEFAULT mode=check: fast ping of one or many links/images (up to 20) — returns status (200/301/404/etc), ok, content-type, final URL after redirects. Use this to verify widget images, logos, CDN assets, booking links, or any URL before putting it on an agent. mode=scrape: full Convocore crawler scrape of ONE page (waits up to ~120s) for text/colours/favicon/images when building branded agents. After scrape, CHECK image URLs then call read_image on every important photo so you know what each picture is before putting it in the agent prompt. Default useProxy=false (~1 credit). CRITICAL — proxy: ONLY if a normal (useProxy=false) scrape fails/blocks AND the user explicitly confirms. Proxy is MUCH more expensive (~60 credits/page) and CONSUMES Convocore workspace credits. Requires useProxy=true + confirmExpensiveProxy=true. Never enable proxy proactively. Do NOT use scrape for KB ingest (use create_kb_from_urls). Workspace is resolved internally — never pass workspaceId.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | No | Single URL (optional if urls is set) | |
| mode | No | check = HTTP status ping (default). scrape = full page scrape (one URL only). | |
| urls | No | URLs to check (preferred for validating multiple image/page links) | |
| useProxy | No | mode=scrape only. Default false. true = expensive proxy scrape (~60 credits/page). ONLY after normal scrape failed AND user confirmed the extra credit cost. | |
| confirmExpensiveProxy | No | Must be true together with useProxy=true. Confirms the user approved burning extra Convocore workspace credits for proxy scraping. |