URL Extract
url_extractExtract normalized main text and optional links from any public HTTP/HTTPS URL. Returns title, author, publication time, language, and content hash.
Instructions
Extract normalized main text and optional links from a public HTTP or HTTPS document. Returns title, author, publication time, language, content hash, truncation and cache state. Output size and fetch time are bounded; JavaScript is not executed. Pass url as an absolute public HTTP(S) URL. Set include_links=true only when normalized links are needed. Keep fresh=false to reuse cache.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Absolute public HTTP or HTTPS URL to inspect. Private, loopback, link-local, metadata-service and otherwise SSRF-sensitive destinations are rejected. | |
| fresh | No | Set true only when a new upstream fetch is required; false allows the bounded cached result and is cheaper for the origin. | |
| include_links | No | Set true to include bounded normalized links in extraction output; false returns the main document text without the optional link list. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| text | Yes | ||
| links | Yes | ||
| title | Yes | ||
| author | Yes | ||
| quality | No | ||
| language | Yes | ||
| truncated | Yes | ||
| url_final | Yes | ||
| checked_at | Yes | ||
| from_cache | Yes | ||
| request_id | Yes | ||
| text_length | Yes | ||
| content_hash | Yes | ||
| published_at | Yes |