Content
contentExtract structured webpage data, metadata, links, HTML, and Markdown in one request to support SEO, monitoring, indexing, and automation.
Instructions
Content. CaptureKit Content API extracts structured webpage data, metadata, links, HTML/Markdown: in one request for SEO, monitoring, indexing and automation. Credit cost: 1 credit per call.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The URL of the webpage to capture. | |
| cache | No | Cache the response. Default: false. | |
| delay | No | Delay in seconds before capturing the screenshot. Default: 0. | |
| proxy | No | Specify a proxy server to route your request through. | |
| fields | No | Comma-separated list of fields to keep in the response, with dot notation for nested fields (e.g. name,location.city). Does not change the credit cost. | |
| cache_ttl | No | Cache the response for a custom TTL (in seconds). Default: 2592000. | |
| block_urls | No | Comma-separated list of URL patterns to block (e.g., “analytics,tracking,advertisement”). | |
| remove_ads | No | Automatically remove ads before capturing. Default: false. | |
| wait_until | No | Define when to capture. Allowed values: domcontentloaded, load, networkidle0, networkidle2. | |
| include_html | No | Include the raw HTML of the webpage in the response. Default: false. | |
| use_defuddle | No | Use Defuddle to clean and extract the main content from web pages. This popular library removes unnecessary elements like comments, sidebars, headers, footers, and other non-essential elements, leaving only the primary content. When enabled, the HTML response will be processed through Defuddle befo… Default: false. | |
| block_resources | No | Comma-separated list of resource types to block (e.g., “image,stylesheet,font”). Allowed values: document, eventsource, fetch, font, image, manifest, media, other, script, stylesheet, texttrack, websocket, xhr. | |
| include_sitemap | No | Include the sitemap of the website in the response. Default: false. | |
| include_markdown | No | Include the Markdown of the webpage in the response. Default: false. | |
| remove_selectors | No | A comma-separated list of elements to hide before capturing (e.g., ads, popups). | |
| wait_for_selector | No | Wait for a specific element to appear before taking the screenshot. | |
| remove_cookie_banners | No | Automatically remove cookie banners before capturing. Default: false. |