scrape_website
Scrape any web page by URL. Automatically detects static or JavaScript-rendered content and returns page title, clean text, internal/external links, and metadata.
Instructions
Scrape a single web page. Automatically detects whether the page is static (uses httpx + BeautifulSoup) or dynamic/JS-rendered (uses Playwright headless Chromium). Returns the page title, clean content, all internal/external links, and page metadata.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Full URL of the page to scrape (e.g. https://example.com). |