URL Extract
url_extractExtract normalized main text and optional links from any public HTTP(S) URL with bounded fetch size, no JavaScript execution, and SSRF protection.
Instructions
Extract normalized main text and optional links from a public HTTP or HTTPS document. Returns title, author, publication time, language, content hash, truncation and cache state. Output size and fetch time are bounded; JavaScript is not executed. Pass url as an absolute public HTTP(S) URL. Set include_links=true only when normalized links are needed. Keep fresh=false to reuse cache.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Absolute public HTTP or HTTPS URL to inspect. Private, loopback, link-local, metadata-service and otherwise SSRF-sensitive destinations are rejected. | |
| fresh | No | Set true only when a new upstream fetch is required; false allows the bounded cached result and is cheaper for the origin. | |
| include_links | No | Set true to include bounded normalized links in extraction output; false returns the main document text without the optional link list. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| text | Yes | ||
| links | Yes | ||
| title | Yes | ||
| author | Yes | ||
| quality | No | ||
| language | Yes | ||
| truncated | Yes | ||
| url_final | Yes | ||
| checked_at | Yes | ||
| from_cache | Yes | ||
| request_id | Yes | ||
| text_length | Yes | ||
| content_hash | Yes | ||
| published_at | Yes |