webscraping_ai_selected

Implementation Reference

• src/index.js:311-329 (registration)

  Registration of the 'webscraping_ai_selected' tool with the MCP server. Defines the input schema (url, selector, format, commonOptionsSchema) and the handler callback.

  server.tool(
    'webscraping_ai_selected',
    {
      url: z.string().describe('URL of the target page.'),
      selector: z.string().describe('CSS selector to extract content for.'),
      format: z.enum(['json', 'text']).optional().default('json').describe('Response format (json or text).'),
      ...commonOptionsSchema
    },
    async ({ url, selector, format, ...options }) => {
      try {
        const result = await client.selected(url, selector, options);
        const content = format === 'json' ? JSON.stringify({ html: result }) : result;
        return createSanitizedResponse(content, url);
      } catch (error) {
        const errorObj = JSON.parse(error.message);
        return createSanitizedResponse(JSON.stringify(errorObj), url, true);
      }
    }
  );

• src/index.js:319-328 (handler)

  Handler function for the 'webscraping_ai_selected' tool. Calls client.selected() to extract content matching a CSS selector, formats response as JSON or text, and handles errors.

  async ({ url, selector, format, ...options }) => {
    try {
      const result = await client.selected(url, selector, options);
      const content = format === 'json' ? JSON.stringify({ html: result }) : result;
      return createSanitizedResponse(content, url);
    } catch (error) {
      const errorObj = JSON.parse(error.message);
      return createSanitizedResponse(JSON.stringify(errorObj), url, true);
    }
  }

• src/index.js:312-318 (schema)

  Input schema for the 'webscraping_ai_selected' tool: url (string), selector (string), format (enum json/text, default json), and spread commonOptionsSchema.

  'webscraping_ai_selected',
  {
    url: z.string().describe('URL of the target page.'),
    selector: z.string().describe('CSS selector to extract content for.'),
    format: z.enum(['json', 'text']).optional().default('json').describe('Response format (json or text).'),
    ...commonOptionsSchema
  },

• src/index.js:104-110 (helper)

  The WebScrapingAIClient.selected() method that makes the actual API request to the '/selected' endpoint.

  async selected(url, selector, options = {}) {
    return this.request('/selected', {
      url,
      selector,
      ...options
    });
  }

• src/index.js:216-228 (helper)

  Common options schema (commonOptionsSchema) shared across all tools, including timeout, js, proxy, country, device, etc.

  const commonOptionsSchema = {
    timeout: z.number().optional().default(DEFAULT_TIMEOUT).describe(`Maximum web page retrieval time in ms (${DEFAULT_TIMEOUT} by default, maximum is 30000).`),
    js: z.boolean().optional().default(DEFAULT_JS_RENDERING).describe(`Execute on-page JavaScript using a headless browser (${DEFAULT_JS_RENDERING} by default).`),
    js_timeout: z.number().optional().default(DEFAULT_JS_TIMEOUT).describe(`Maximum JavaScript rendering time in ms (${DEFAULT_JS_TIMEOUT} by default).`),
    wait_for: z.string().optional().describe('CSS selector to wait for before returning the page content.'),
    proxy: z.enum(['datacenter', 'residential']).optional().default(DEFAULT_PROXY_TYPE).describe(`Type of proxy, datacenter or residential (${DEFAULT_PROXY_TYPE} by default).`),
    country: z.enum(['us', 'gb', 'de', 'it', 'fr', 'ca', 'es', 'ru', 'jp', 'kr', 'in']).optional().describe('Country of the proxy to use (US by default).'),
    custom_proxy: z.string().optional().describe('Your own proxy URL in "http://user:password@host:port" format.'),
    device: z.enum(['desktop', 'mobile', 'tablet']).optional().describe('Type of device emulation.'),
    error_on_404: z.boolean().optional().describe('Return error on 404 HTTP status on the target page (false by default).'),
    error_on_redirect: z.boolean().optional().describe('Return error on redirect on the target page (false by default).'),
    js_script: z.string().optional().describe('Custom JavaScript code to execute on the target page.')
  };