Fetch any URL and return clean, LLM-ready Markdown with token count, metadata, and 6h caching.

WHEN TO USE:

• You have a specific URL whose content you need.

• You want to cap response size to stay inside your context window.

• You want repeat fetches to be cheap (cache hits ≈ $0.0001).

• The URL might be JS-rendered, a PDF, or behind a paywall — this tool auto-routes to the right fetcher (Trafilatura → Jina → FireCrawl → PDF).

WHEN NOT TO USE:

• You don't know which URL to fetch — use search_and_fetch instead.

• You have many URLs to fetch — use fetch_multiple instead.

Args: url: The URL to fetch. max_tokens: Hard cap on response size. Default unlimited. Pass this if you're tight on context budget — cheaper than over-fetching. format: "markdown" (default — recommended), "text", or "json". use_cache: True returns a cached copy if one exists (≤6h old). Pass False only when freshness matters (live news, prices).

Returns: { "url": str, "success": bool, "markdown": str, "metadata": {title, author, published_date, domain, word_count, token_count, reading_time_seconds, content_type, language}, "cache": {hit, cached_at, expires_at}, "fetch_info": {fetcher_used, fetch_time_ms, cost_credits}, "error": str | None }

Estimate token count of a URL's content WITHOUT fetching the body.

WHEN TO USE:

• You're considering fetching a URL but unsure if it fits your remaining context window. This call is ~10x cheaper than a full fetch.

• You want to triage a list of candidate URLs before deciding which to actually retrieve.

IMPORTANT: Many servers omit Content-Length on dynamic / chunked responses. When that happens, this tool returns confident=false and estimated_tokens=null. In that case, call fetch_url with a max_tokens cap instead of trusting the estimate.

Args: url: The URL to estimate.

Returns: { "url": str, "success": bool, "estimated_tokens": int | null, "byte_size": int | null, "content_type": str, "confident": bool, "note": str }

Fetch up to 20 URLs concurrently. Each result is the same shape as fetch_url.

WHEN TO USE:

• You have a list of URLs (search results, links from a doc, sitemap) and want them retrieved in parallel rather than one at a time.

Args: urls: 1–20 URLs. Larger batches: split into multiple calls. max_tokens_each: Per-result cap. Apply this to keep total response inside your context budget — total ≈ len(urls) * max_tokens_each. use_cache: True for cache-aware fetching (default).

Returns: {"count": int, "results": [, ...]}

Web search + fetch top results in one call.

WHEN TO USE:

• You have a research question, not specific URLs. E.g. "what's the latest on X", "find docs for Y library", "recent news about Z".

• You'd otherwise have to call a search tool, parse results, then call fetch — this collapses that into one round-trip.

Args: query: Search query (2–500 chars). num_results: Top N to fetch (1–10, default 3). max_tokens_each: Per-result cap (default 2000).

Returns: {"query": str, "count": int, "results": [, ...]}