Skip to main content
Glama
genpark-agent-web-stealth-scraper-distiller-skill

genpark-agent-web-stealth-scraper-distiller-skill

by Alpha-Park

genpark-agent-web-stealth-scraper-distiller-skill

Python 3.9+ License MIT MCP Compatible GenPark AI Zero Dependencies

🌐 GenPark MCP Hub β€’ πŸ“¦ GenPark Official β€’ πŸ“– Documentation


πŸ“Œ Overview & Capability

genpark-agent-web-stealth-scraper-distiller-skill is a deterministic, high-performance, zero-dependency Python tool and native Model Context Protocol (MCP) server designed for autonomous AI agents, multi-agent frameworks (LangGraph, CrewAI, AutoGen, OpenAI Swarm), and developer environments (Cursor, Windsurf, Claude Desktop).

Executive Capability: Zero-dependency web page scraper & markdown distiller stripping cookie banners, navbars & ads for clean agent consumption.

⚑ Key Highlights

  • 🐍 Zero External pip Dependencies: Implemented entirely with pure Python standard library for instant zero-overhead execution.

  • πŸ”Œ Native Model Context Protocol (MCP): Plugs directly into any MCP-compliant client via JSON-RPC 2.0 stdio.

  • ⚑ Sub-Millisecond Execution: Slashes token burn and latency by resolving routine agent tasks deterministically without frontier LLM round-trips.

  • πŸ›‘οΈ Production-Hardened: Comprehensive error handling, boundary validation, and telemetry.


Related MCP server: Website to Markdown MCP

πŸ—οΈ Architecture

graph LR
    Agent([πŸ€– Autonomous Agent / IDE]) -->|MCP Protocol / JSON-RPC| Server[⚑ genpark-agent-web-stealth-scraper-distiller-skill Server]
    Server --> Core[🧠 Deterministic Processing Core]
    Core --> Out[πŸ“Š Actionable Result & Telemetry]
    Out --> Agent

πŸš€ Quickstart & Usage

1. Direct Python Client Execution

python example_usage.py

2. Programmatic Integration

from client import AgentWebStealthScraperDistiller

client = AgentWebStealthScraperDistiller()
result = client.run_benchmark_web_distiller()
print(result)

πŸ”Œ Model Context Protocol (MCP) Setup

Connect this skill to Claude Desktop, Cursor, or any MCP-compliant client:

claude_desktop_config.json

{
  "mcpServers": {
    "genpark-agent-web-stealth-scraper-distiller-skill": {
      "command": "python",
      "args": ["/path/to/genpark-agent-web-stealth-scraper-distiller-skill/mcp_server.py"]
    }
  }
}

Direct MCP Testing

python mcp_server.py --test

πŸ“Š Technical Specifications

Parameter

Type

Required

Description

payload

string / dict

Yes

Primary context, code, schema, or content input

options

dict

No

Execution flags, compression ratios, or risk bounds


Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

Loading tool schema changelog…

    Related MCP Connectors

    Related MCP Servers

    • F
      license
      Not graded
      quality
      B
      maintenance
      Enables MCP-compatible agents to scrape web pages and distill them into clean Markdown by removing cookie banners, navbars, and ads for efficient consumption.
      7
      -
    • A
      license
      A
      quality
      C
      maintenance
      Enables AI agents to fetch one or many web pages concurrently and receive clean, LLM-ready Markdown with navigation, ads and boilerplate stripped away, plus extracted metadata such as title, description, author, Open Graph tags and canonical URL. It runs locally over stdio with no API key or account, requiring only a single command.
      3
      MIT
    • F
      license
      Not graded
      quality
      A
      maintenance
      Enables AI agents and MCP clients to fetch webpages and crawl sites, extract main content, and convert it into clean Markdown with preserved links for fast, token-efficient scraping.
      -