Skip to main content
Glama

⚡ What is OpticParse?

OpticParse is a multimodal AI scraping, visual extraction, and security threat detection suite engineered for modern developers and autonomous AI agents. Unlike legacy scrapers that rely on fragile CSS selectors or break on Cloudflare Turnstile, OpticParse uses Computer Vision heuristics, headless Playwright rendering, and multi-model routing to extract clean, structured JSON from any webpage on Earth.

This repository contains the open-source client SDKs, Model Context Protocol (MCP) server, Chrome extensions, and developer tooling.

                     ┌──────────────────────────────────────────────┐
                     │           DEVELOPER INTEGRATIONS            │
                     │  • Python SDK (opticparse-py)                │
                     │  • MCP Server (Claude, Cursor, Windsurf)     │
                     │  • RapidAPI 5-Endpoint Gateway               │
                     │  • PhishVision Chrome Extension              │
                     └──────────────────────┬───────────────────────┘
                                            │
                                            ▼
                     ┌──────────────────────────────────────────────┐
                     │          CLOUDFLARE EDGE GATEWAY             │
                     │  • Global Anycast (285+ cities)              │
                     │  • 150 Pre-Built Extraction Templates        │
                     │  • Sub-second Semantic KV Cache              │
                     └──────────────────────┬───────────────────────┘
                                            │
                                            ▼
                     ┌──────────────────────────────────────────────┐
                     │          VISION & ENGINE CLUSTER             │
                     │  • Visual Heuristic Phishing Detection       │
                     │  • Dynamic JS & Anti-Bot Bypass              │
                     │  • Forensic Threat Report Synthesis          │
                     └──────────────────────────────────────────────┘

Related MCP server: Hyperbrowser MCP Server

🚀 4 Ways to Integrate

Choose the workflow that fits your stack:

1. 🐍 Python SDK (opticparse-py)

Install the official Python client:

pip install opticparse-py
from opticparse import OpticParse

# Initialize with your API key
client = OpticParse(api_key="your_api_key_here")

# 1. Vision Scrape: Extract structured data from any webpage
data = client.scrape(
    target_url="https://news.ycombinator.com",
    extraction_query="Extract top 5 stories with title, url, points, and author as JSON"
)
print(data)

# 2. Template Scrape: Use any of our 150 pre-built enterprise templates
products = client.scrape_with_template(
    target_url="https://amazon.com/dp/B08N5WRWNW",
    template_id="amazon-price-undercut-alert"
)

# 3. PhishVision: Analyze URL for zero-day phishing, brand spoofing & malware
threat = client.detect_phishing("https://suspect-banking-login.com")
print(f"Verdict: {threat['verdict']} | Score: {threat['score']}/100")

2. 🤖 Model Context Protocol (MCP for AI Agents)

Connect Claude Desktop, Cursor IDE, Windsurf, or any MCP-compatible agent directly to the live web.

Install via Smithery:

npx @smithery/cli install @parastejpal987-cmyk/opticparse-public --client claude

Manual Claude Desktop / Cursor Config (claude_desktop_config.json):

{
  "mcpServers": {
    "opticparse": {
      "command": "python",
      "args": ["-m", "mcp_server"],
      "env": {
        "OPTICPARSE_API_KEY": "your_api_key_here"
      }
    }
  }
}

Supported MCP Tools:

  • opticparse_scrape: Autonomous AI vision web scraping and schema enforcement.

  • phishvision_detect: Real-time threat, brand impersonation, and JS skimmer analysis.

  • search_lessons: Query indexed threat telemetry records.


3. 🌐 REST API & RapidAPI Hub

For teams preferring REST / OpenAPI integration with unified Pay-As-You-Go billing at $0.008/request:

  • Live Gateway Base URL: https://opticparse-rapidapi-gateway.parastejpal987.workers.dev

  • Direct cURL Example:

curl -X POST https://opticparse-rapidapi-gateway.parastejpal987.workers.dev/scrape \
  -H "Content-Type: application/json" \
  -H "X-API-Key: your_api_key_here" \
  -d '{
    "target_url": "https://example.com",
    "extraction_query": "Extract the main heading, summary paragraph, and all navigation links"
  }'

Available Endpoints:

  1. POST /scrape: Autonomous AI vision scraper

  2. POST /poison: Streaming adversarial anti-scraping tag injector

  3. GET /proxy?url=...: Global unblockable fetcher proxy

  4. GET /sentiment: Real-time threat & telemetry database feed


4. 🧩 Chrome Extensions

  • PhishVision Sentinel: Real-time visual threat detector that protects users against zero-day phishing, credential harvesters, and malicious redirects.

  • BYOB Extractor: Local DOM & screenshot capture extension for extracting data using your own authenticated session.


📚 150 Pre-Built Extraction Templates

OpticParse includes 150 production-grade extraction templates across 13 industries, ready to invoke without writing custom parsers:

Category

Templates

Sample Templates

🛒 E-Commerce & Retail

15

amazon-price-undercut-alert, shopify-new-product-alert, flipkart-flash-sale-auto-cart

🏢 Real Estate

10

zillow-rent-estimate-aggregator, airbnb-pricing-spy, foreclosure-auction-monitor

💼 B2B & Lead Gen

15

product-hunt-maker-extractor, hiring-signal-aggregator, yc-founder-scraper

📊 Finance & Crypto

10

crypto-exchange-arbitrage, dex-liquidity-pool-watcher, sec-10k-filing-summarizer

🛡️ PhishVision Threat Intel

70

typosquatting-auto-assassin, zero-day-phishing-kit-extractor, ransomware-leak-site-tracker

🧑‍💻 Developer Operations

10

npm-package-vulnerability-alert, cve-zero-day-radar, docker-hub-vulnerability-alert

👉 View the Complete 150-Template Catalog in TEMPLATES.md


🛡️ PhishVision GitHub Action

Add automated prompt injection and URL threat auditing to your CI/CD workflow:

name: Security Audit Pipeline
on: [push, pull_request]

jobs:
  security-audit:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
      - name: Run PhishVision Audit
        uses: parastejpal987-cmyk/opticparse-public@main
        with:
          target_dir: '.'
          output_dir: './audits'

📊 Master Datasets & Verified Benchmark

OpticParse continuously auto-feeds its AI knowledge base with verified multi-industry telemetry (+1,250 records/24 hours). Explore our open datasets and benchmarks:


🛡️ Interactive Threat DB Directory (21 Brands)

Explore real-time visual safety evaluations and impersonation forensics:


🤝 Community & Contributing

We welcome contributions to SDKs, MCP adapters, and extraction templates!


📄 License

This project is open-sourced under the MIT License. OpticParse & PhishVision are trademarks of the OpticParse Project.

A
license - permissive license
Not graded
quality - not tested
A
maintenance

Maintenance

Maintainers
Response time
Release cycle
1Releases (12mo)
Commit activity

Related MCP Servers

View all related MCP servers

Related MCP Connectors

  • Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.

  • Stealth scraping & search. Bypasses Cloudflare, DataDome & LinkedIn via Cyborg HITL approach.

  • AI-powered browser automation — navigate, click, fill forms, and extract data from any website.

View all MCP Connectors

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/parastejpal987-cmyk/opticparse-public'

If you have feedback or need assistance with the MCP directory API, please join our Discord server