oxylabs_scraper
Extract web content using Oxylabs Web Scraper API, enabling customizable parsing and rendering for efficient data retrieval from complex websites.
Instructions
Scrape url using Oxylabs Web Api
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| parse | No | Should result be parsed. If result should not be parsed then html will be stripped and converted to markdown file | |
| render | No | Whether a headless browser should be used to render the page. See: https://developers.oxylabs.io/scraper-apis/web-scraper-api/features/javascript-rendering `html` will return rendered html page `None` will not use render for scraping. | |
| url | Yes | Url to scrape |
Input Schema (JSON Schema)
{
"properties": {
"parse": {
"anyOf": [
{
"type": "boolean"
},
{
"type": "null"
}
],
"default": null,
"description": "Should result be parsed. If result should not be parsed then html will be stripped and converted to markdown file",
"title": "Parse"
},
"render": {
"anyOf": [
{
"enum": [
"html",
"None"
],
"type": "string"
},
{
"type": "null"
}
],
"default": null,
"description": "Whether a headless browser should be used to render the page. See: https://developers.oxylabs.io/scraper-apis/web-scraper-api/features/javascript-rendering `html` will return rendered html page `None` will not use render for scraping.",
"title": "Render"
},
"url": {
"description": "Url to scrape",
"title": "Url",
"type": "string"
}
},
"required": [
"url"
],
"title": "scrape_urlArguments",
"type": "object"
}