Scrape URL and respond with Markdown
scrape_url_markdownScrape difficult-to-access websites that block bots, captchas, or location restrictions, and convert content to clean Markdown format for text extraction.
Instructions
Use a URL to scrape a website using the ScrAPI service and retrieve the result as Markdown. Use this for scraping website content that is difficult to access because of bot detection, captchas or even geolocation restrictions. The result will be in Markdown which is preferable if the text content of the webpage is important and not the structural information of the page.
BROWSER COMMANDS: You can optionally provide browser commands to interact with the page before scraping (e.g., clicking buttons, filling forms, scrolling). Provide commands as a JSON array string. Available commands:
Click: {"click": "#buttonId"} - Click an element using CSS selector
Input: {"input": {"input[name='email']": "value"}} - Fill an input field
Select: {"select": {"select[name='country']": "USA"}} - Select from dropdown
Scroll: {"scroll": 1000} - Scroll down (negative values scroll up)
Wait: {"wait": 5000} - Wait milliseconds (max 15000)
WaitFor: {"waitfor": "#elementId"} - Wait for element to appear
JavaScript: {"javascript": "console.log('test')"} - Execute custom JS Example: [{"click": "#accept-cookies"}, {"wait": 2000}, {"input": {"input[name='search']": "query"}}]
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The URL to scrape | |
| browserCommands | No | Optional JSON array of browser commands to execute before scraping. See tool description for available commands and format. |