Fetch Page Content
infobroker_fetch_pageFetch a URL and extract clean content through the configured renderer chain (Jina Reader primary, native-HTTP fallback; Wikipedia, Internet Archive, arXiv, and Stack Exchange alternatives).
Instructions
Fetch a URL and extract clean content through the configured renderer chain (Jina Reader primary, native-HTTP fallback; Wikipedia, Internet Archive, arXiv, and Stack Exchange alternatives). Use when you have a URL and need readable text, passages ranked against a question, or the page's last-updated date. Do NOT use for topic search (use infobroker_search_web) or cross-source claim verification (use infobroker_verify_claims). question returns passages ranked against it, sized by passage_size and capped by max_passages; crawl bounds the same-origin crawl to config caps; extract adds JSON-LD, OpenGraph, and microdata; renderer pins a single backend, and when it is omitted the configured chain runs with native_fetch as the keyless fallback when Jina is slow, throttled, errors, or serves an anti-bot challenge. max_length truncates the returned text only; a truncated page is written in full to a temp file. Makes external HTTP calls and needs no API key. A fresh knowledge-base copy is returned before an outbound fetch when available. Fetched pages auto-index into the knowledge base unless the content policy flags them (see infobroker_manage_kb): flag mode returns without storage, block mode refuses. Unreachable URLs return an [ERROR] envelope with remediation; when a DOI resolves, a blocked page falls back to Crossref metadata or an open-access copy, then to an Internet Archive snapshot, and reports meta.fallback_kind. Paywalls, access restrictions, and anti-bot blocks return access_blocked; connectivity failures return network_error; a non-http(s) URL returns invalid_input naming the read tool. Success returns an [OK] envelope with status, provider, results, and meta.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"url": "<url>"
},
"name": "infobroker_fetch_page"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| raw | No | Return the extracted page text directly instead of a JSON envelope (single URL; not with crawl or extract) | |
| url | Yes | URL to fetch: a single URL, or up to five URLs fetched in parallel | |
| crawl | No | Bounded same-origin crawl: recursively fetch same-origin pages up to config caps (default off) | |
| extract | No | Return structured metadata (JSON-LD, OpenGraph, microdata) alongside the content (default off) | |
| question | No | Question to extract ranked passages for, instead of returning the whole page | |
| renderer | No | Renderer: omit to run the configured content-fetch chain (`jina` primary, then native HTTP), or pin one of jina, native_fetch, wikipedia, internet_archive, arxiv, or stack_exchange | |
| max_length | No | Maximum characters to return (default 50000) | |
| detect_date | No | Detect and report the page's date (default from config; applies to plain, crawl, and extract responses — crawl and extract read document metadata, not headers) | |
| max_passages | No | Number of passages to return (default from config) | |
| passage_size | No | Target words per passage (default from config) |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| meta | No | ||
| error | No | ||
| status | Yes | ||
| notices | No | ||
| results | No | ||
| provider | Yes |