"Techniques for Scraping Dynamic Websites with JavaScript and Handling CAPTCHA or Proxy Issues" matching MCP tools:

• atlas_technique_searchA

  ContrastAPIA

  Search the MITRE ATLAS catalog of AI/ML attack techniques by keyword, tactic, or maturity. Default response is SLIM (description truncated to 240 chars per row); pass include='full' for the verbose record. Pass exclude_id when chaining from atlas_technique_lookup to skip self in sibling-tactic searches. Use this to discover techniques matching a threat-model question, e.g. 'what techniques target LLM serving infrastructure?'. Drill into atlas_technique_lookup with any returned technique_id for the full description, ATT&CK bridge, and pivot hints. For broader cross-referencing: when a result has attack_reference_id, that bridges to D3FEND mitigations via d3fend_defense_for_attack. Free: 30/hr, Pro: 500/hr. Returns {query (echoed filters), total, results [{technique_id, name, description (truncated by default), tactics, inherited_tactics, maturity, attack_reference_id, subtechnique_of}], next_calls}.

  ConnectorNo auth

• find_similar_sitesA

  mcpA

  Find similar or competitor websites based on classification. Takes a URL, classifies it (or uses cached classification), and returns other websites from the same category and subcategory. Useful for competitive analysis and discovering related content. Rate limited to 1 request per minute per domain. Args: url: The website URL to find similar sites for. limit: Maximum number of similar sites to return (1-50, default 10). Returns: Dictionary with: - url: The input URL (normalized) - classification: The URL's category and subcategory - similar_sites: List of similar URLs from the same category - total_in_category: Total sites in this category/subcategory - cached: Whether the classification was from cache

  ConnectorNo auth

• foura_browserA

  mcpA

  Load a public URL in a full browser session. JavaScript runs, the DOM renders, and cookies come back with the response. Use it for single-page apps, lazy-loaded content, or supported browser challenges. You can set your own headers, cookies and userAgent, and checkStatus or checkText turn a navigation that rendered the wrong page into a failure instead of returning it as content. For a protected page, call foura_proxy first and pass its returned proxy ID here to reuse that same exit, instead of starting a new selection here; with no proxy the session leaves from one fixed address. Set unblocker:false when you want the page exactly as it loads, challenge included. It is the most expensive of the four tools and the slowest, so prefer foura_single or foura_proxy whenever the content is already in the HTML. One FourA API key authenticates every call, the result reports the credits it spent, and a refusal by your own plan arrives as a plan_limit_ code, including plan_limit_browser_daily when the daily browser allowance is spent.

  ConnectorNo auth

• scrapeA

  X1-BaaS Scraping APIA

  Scrape a URL and return content in your preferred format. Supported output formats: - markdown (default): Clean LLM-ready Markdown text - screenshot: PNG/JPEG image of the page - pdf: PDF document of the page - csv: Table data extracted as CSV - html: Sanitized HTML with scripts/ads removed This tool handles: - JavaScript rendering (SPA, dynamic content) - Anti-bot bypass (Cloudflare Turnstile, Datadome) - DOM cleaning (strips scripts, nav, footer, ads) - HTML-to-Markdown conversion (Mozilla Readability engine) - Automatic retry with escalating wait strategies - Domain cooldown to avoid rate-limiting - Response caching (5 min TTL) Args: url: The URL to scrape (must start with http:// or https://) output: Output format: "markdown" (default), "screenshot", "pdf", "csv", "html" wait_for_selector: Optional CSS selector to wait for before extraction (e.g., ".article-content") timeout_ms: Navigation timeout in milliseconds (default: 20000, max: 120000) block_media: Block images/fonts/video for faster loading (default: true) wait_strategy: Wait strategy: "default", "spa", "heavy", "cloudflare" (auto-detected if omitted) retry: Enable automatic retry on failure (default: true) bypass_cache: Skip cache, force fresh scrape (default: false) javascript: Custom JavaScript to execute after page load (e.g., "window.scrollTo(0, 1000)") Returns: Content in the requested format, or an error message.

  ConnectorNo auth

• create_dynamic_endpointA

  TessryxA

  Dynamic endpoint authoring — create a BRAND-NEW dynamic endpoint (mints the endpoint + its version 1). The definition binds the endpoint to a workflow (by versioned-slug reference) plus a cache setting; fetch its JSON Schema with get_dynamic_endpoint_definition_schema and author against it. Pass publish=true to take the endpoint live in one step, or publish later with publish_dynamic_endpoint. (To add a version to a dynamic endpoint that already exists, use create_dynamic_endpoint_version.)

  ConnectorOAuth

• get_accountA

  BlogSEOA

  Recommended first call. Returns every website this connection may use (the websites chosen on the consent screen, or all of them when none were excluded), each with its website_id (needed by the other tools when the account has several websites), the user's role on it (owner or admin: websites where the user is only a member are never available over MCP and are not listed), its credit balances (AI brain credits for AI features, article credits for generation, backlink credits) and its plan (subscription status, whether it is active, period end, billing interval, articles per month, whether the current user is the payer). Credits cannot be bought through this server: send the user to buy_credits_url.

  ConnectorOAuth

• list_product_issuesA

  FeedShine: Shopify Google Shopping FeedA

  Google Merchant Center issues for this store, as of the app's last nightly sync: one row per issue code with severity, affected product counts, sample products and the destinations it applies to. Account-level issues are included. Covers the whole account (file feeds and the native channel too). Call this FIRST when the merchant asks why products are disapproved or wants to fix issues. Then inspect specific products with preview_product and fix via set_product_override or update_feed_settings.

  ConnectorAPI key

• bulk_atlas_technique_lookupA

  ContrastAPIA

  Bulk ATLAS technique lookup — retrieve full records for up to 50 techniques in a single request instead of N separate atlas_technique_lookup calls. Designed as the natural follow-up to atlas_case_study_lookup, whose techniques_used array can be passed directly. Each item is the same shape as atlas_technique_lookup, including parent-tactics inheritance for sub-techniques (inherited_tactics=true flag) and per-item next_calls (D3FEND bridge when attack_reference_id present, sibling-technique search by tactic, parent lookup for sub-techniques). Free: 30/hr (1 per item), Pro: 500/hr. Returns {results [{technique_id, status (ok|not_found|invalid_format), technique, error}], total, successful, failed, partial, summary}.

  ConnectorNo auth

• gvt_run_visibility_testA

  iGods GEO Visibility ToolA

  Run a GEO visibility test on a URL. Analyzes 7 categories: JavaScript dependencies (js), no-JS rendering (nojs), semantic HTML5, heading structure, schema.org markup, social tags, and accessibility. This is an async operation — it returns a tid immediately. Pass that tid to gvt_get_test_results to retrieve scores and issues once the test completes (poll until status is not "pending" or "running").

  ConnectorOAuth

• gvt_run_visibility_testA

  iGods GEO Visibility Tool (GVT)A

  Run a GEO visibility test on a URL. Analyzes 7 categories: JavaScript dependencies (js), no-JS rendering (nojs), semantic HTML5, heading structure, schema.org markup, social tags, and accessibility. This is an async operation — it returns a tid immediately. Pass that tid to gvt_get_test_results to retrieve scores and issues once the test completes (poll until status is not "pending" or "running").

  ConnectorNo auth

• get_captcha_pricingA

  Verify-apiA

  Retrieve current x402 pricing per 1,000 CAPTCHA solves across all supported types (Turnstile, hCaptcha, reCAPTCHA v2, Arkose, Cloudflare). Free endpoint with zero parameters. When to use: Check current rates and atomic USDC requirements before calling solve_captcha. When NOT to use: Do NOT use to submit or solve CAPTCHA challenges.

  ConnectorNo auth

• check_keyword_densityA

  BlogSEOA

  Computes keyword density for a public page URL or a block of text (exactly one of url or text): total and unique words, sentences, reading time, and the most frequent one-, two- and three-word phrases with count and density. With target_keyword it also returns its count, density, a verdict (ideal between 0.5% and 2.5%) and whether it appears in the title, meta description, H1 and first 100 words (placement flags are null for pasted text). Pages are fetched server-side as Googlebot with a Chrome fallback, JavaScript is not executed, at most 1 MB of HTML is read and the extracted text is cached for 1 hour. Fails for pages behind bot protection, non-HTML URLs or JavaScript-only pages: pass the page text instead. Any public page can be checked, not only the user's websites. Limited to 20 checks per 15 minutes. Free.

  ConnectorOAuth

• get_captcha_pricingA

  verify-apiA

  Retrieve current x402 pricing per 1,000 CAPTCHA solves across all supported types (Turnstile, hCaptcha, reCAPTCHA v2, Arkose, Cloudflare). Free endpoint with zero parameters. When to use: Check current rates and atomic USDC requirements before calling solve_captcha. When NOT to use: Do NOT use to submit or solve CAPTCHA challenges.

  ConnectorNo auth

• update_proxyA

  FeelingSurfB

  Pause or resume a proxy. Only `enabled` can change. Pausing or resuming clears `last_error` and its error history, and a resumed proxy is checked again at once, so this also brings back a proxy that was switched off after failing. To change the host, port or credentials, delete the proxy and add it again.

  Connector

  Destructive

  No auth

• get_sourcesA

  TheAIMetersA

  List the complete TheAIMeters source catalog with stable IDs, names, URLs and categories. Use this for an overview of references. For sources supporting one specific meter, use get_methodology with its slug. Does not fetch the referenced external websites.

  ConnectorNo auth

• scrapingdog_scrapeA

  ScrapingdogA

  Scrape any website through Scrapingdog's rotating proxies and return its content. Returns HTML by default, or clean markdown with format:"markdown" (ideal for feeding an LLM). Set dynamic:true to render JavaScript in a headless browser for SPAs and dynamic pages (costs 5 credits instead of 1), premium:true for hard-to-scrape sites (residential proxies, 10 credits), and country to geotarget the proxy. Example: scrapingdog_scrape({ url: "https://example.com", format: "markdown", dynamic: true, _apiKey: "your-key" })

  ConnectorNo auth

• read_urlA

  agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)A

  Fetch one publicly reachable URL and return clean, LLM-ready markdown (title + page description + word count + markdown). HTML pages are extracted to markdown — including HTML tables, which become GitHub-flavored Markdown tables; URLs pointing straight at a Markdown or plain-text document (raw READMEs, llms.txt, docs) are passed through verbatim. Polite by design: honors the origin's robots.txt for our user-agent, identifies honestly, read-only GET, never bypasses anti-bot/CAPTCHA/paywalls. Free. JavaScript-rendered pages are not supported yet.

  ConnectorNo auth

• proxy_1gbA

  US Company Intelligence for AI Agents (SEC EDGAR, x402)A

  Get a working HTTP/HTTPS proxy on a real French home line (Caribbean, Outremer Telecom) with 1 GB of traffic, as a key you use in curl -x, valid 30 days. Buy 1 GB of French West Indies residential proxy bandwidth for scraping and agent traffic, delivered as a ready-to-use key in the form http://buyer:KEY@host, valid 30 days and metered per gigabyte at 3.50 USD. The exit is a real FTTH home line in the French West Indies on Outremer Telecom / SFR Caraibe (AS20776), reverse DNS ftthcc.*.sfrcaraibe.fr. Geolocation is split across databases and we say so rather than pick the flattering one: ipinfo and ipwho.is place it in Martinique (MQ), ip-api and db-ip place it in mainland France (FR). Reachability, carrier and proxy-blacklist status are probed from the public internet before every sale: the address currently comes back clean, not flagged as a proxy or VPN. If no exit is verified live you are not charged. A Caribbean residential exit is rare, so a site fingerprinting by region sees an address no datacenter range can imitate. — $3.500000/call, paid per request via x402 (USDC). Use when asked: "residential proxy, pay per gb", "get a residential ip for my agent", "http proxy with a french home ip".

  ConnectorNo auth

• search_docsA

  Handsontable Docs MCP ServerA

  Semantic (meaning-based) search over the Handsontable + HyperFormula documentation knowledge base — docs guides, code recipes, blog posts, release notes and GitHub issues. Returns ranked page-level snippets with title, content, relevance score, url and provenance (framework, kind, htVersion/hfVersion). `url` is null when no public page exists (recipes, releases, issues) — never fabricate a link. Scores are rank-only. Guides repeat once per framework (javascript/react/angular/vue) — dedupe on url/title when you need distinct documents. Pass ht_version/hf_version (your installed releases) to get an explicit coverage note when the KB documents a different version.

  ConnectorNo auth

• brightdata_unlockA

  Bright DataA

  Fetch any URL through Bright Data Web Unlocker — rotating residential proxies with automatic anti-bot bypass and CAPTCHA solving, built for the hardest-to-scrape sites (Cloudflare, PerimeterX, Akamai fronted). Returns the page content with status and length; large pages are truncated. Calls proxy the fetch synchronously and can take 10-30 seconds. BYOK: Bright Data API token via _apiKey + a Web Unlocker zone configured in your dashboard (first zone is auto-named "web_unlocker1"); pay-per-request pricing on the Bright Data side. Example: brightdata_unlock({ url: "https://example.com", _apiKey: "your-brightdata-token" })

  ConnectorNo auth

• list_brandsA

  ProofsourceA

  The brands this workspace tracks in AI answers, with ids and websites. Call first; every other tool takes a brand_id.

  ConnectorNo auth