Generate JSON from a web page with AI
pulpminer_generate_jsonScrape a web page and convert it to structured JSON with an LLM (PulpMiner POST /external/ai/json). Pass jsonFormat to force an exact output shape; omit it to let the AI infer a flat JSON. Does not save anything. Costs 0.25 credits (+0.1 with renderJs). Can take 10-60s+. Needs only the PulpMiner API key (PULPMINER_API_KEY locally, or Authorization: Bearer <key> on the hosted server).
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| llm | No | LLM used to convert HTML to JSON. llm_2 = OpenAI GPT (default), llm_1 = Google Gemini, llm_3 = Groq (only if enabled for the account; otherwise the API returns 'bad request'). | llm_2 |
| url | Yes | Full URL of the web page to extract data from (http/https). | |
| scraper | No | Scraper backend. scraper_1 (default, supports useSession) or scraper_2. Try the other one if a site blocks scraping. | scraper_1 |
| renderJs | No | Render JavaScript in a headless browser before extracting (default true; adds 0.1 credits). | |
| selector | No | CSS selector to limit extraction to part of the page, e.g. "main" or "#results". Default: whole body. | |
| jsonFormat | No | Sample JSON whose keys define the output shape, e.g. {"title": "", "price": "", "items": [{"name": ""}]}. Key names are kept exactly; values are extracted from the page. | |
| useSession | No | Use a persistent scraping session (scraper_1 only; ignored for lifetime-plan accounts). | |
| extraLLMInfo | No | Extra natural-language instructions for the LLM, e.g. 'only the first 10 products, prices as numbers'. |