Bintu Scrape Text
bintu_scrape_textFetch a public webpage and extract its readable article or main text, removing page clutter. Return clean text, chunked content, or sentence summaries for AI-agent context.
Instructions
Fetch one public absolute HTTP or HTTPS URL and extract readable text. Only HTML/XHTML is supported, with a 1 MiB decoded-body limit and extracted text capped at 6,000 characters. Article/main content is preferred and common page furniture is omitted. Default mode=scrape returns the extraction envelope. Use mode=chunk (accepted alias: chunked) for approximately budgeted chunks, or mode=summarize for sentence-based truncation. Chunking preserves words, URLs, and recognized table rows; an intact URL, word, or table row may exceed max_tokens. Whitespace can be normalized during chunking. tokens and approx_tokens are character-based sizing estimates, not tokenizer counts or exact billing measurements. tokens_saved_estimate compares source HTML and delivered text estimates when the baseline is available; cached results may preserve the original extraction economics. Savings are not limited to summarize mode. truncated reports content truncation; split reports multiple chunks. The character cap applies before mode transformation. max_tokens is ignored in scrape mode. Set cache=false to bypass cache reads; successful fresh results may still be written to cache. JavaScript rendering is available only when enabled by the operator. If render_js_disabled is returned, retry with render_js=false. Execution failures are reported in-band with isError=true.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Absolute public HTTP or HTTPS URL to extract. Unsafe targets fail with invalid_or_unsafe_url. | |
| mode | No | scrape returns extracted text in the envelope; chunk creates approximately budgeted chunks; summarize selects leading sentences within an approximate budget. The accepted chunked alias normalizes to chunk. | scrape |
| cache | No | Read available memory/persistent caches. False bypasses cache reads but does not disable writes of fresh results. | |
| persist | No | Allow a fresh successful result to be written to the persistent cache. False prevents that write; memory caching and extraction are unchanged. | |
| render_js | No | Render in Chromium before extraction when enabled by the operator. If render_js_disabled is returned, retry with false. | |
| max_tokens | No | Approximate token budget for chunk/summarize modes; ignored in scrape mode. Accepted alias: chunk_token_budget. The extracted-text character cap applies first. Indivisible units in chunk mode, and a first oversized sentence in summarize mode, may exceed the budget. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| mode | Yes | ||
| split | Yes | ||
| chunks | Yes | ||
| tokens | Yes | Compatibility alias of approx_tokens. | |
| cache_hit | Yes | ||
| truncated | Yes | ||
| source_url | Yes | ||
| cache_layer | Yes | ||
| chunk_count | Yes | ||
| html_tokens | Yes | ||
| extracted_at | Yes | ||
| token_method | Yes | ||
| approx_tokens | Yes | ||
| limiting_factor | Yes | ||
| tokens_saved_estimate | Yes |