Gremlin Web Scraper MCP

GremlinScraper is a lightweight HTTP MCP module designed to scrape visible text from any publicly accessible webpage. It runs locally, integrates directly with VS Code’s MCP system, and speaks plain JSON.

This is Part 1 of the GremlinOS Runtime Suite from StatikFinTech LLC.

Make your Own App:

Just a funny, this app is cool though, I use it as a Game

⚠️ Just Until GremlinGPT is booting, Soon ⚠️

Ascend Institute Traffic

The world’s first RS-RACS
Recursive, Self-Referential Autonomous Cognitive System

Support This Project

If you find this project valuable and want to support its continued development, consider sponsoring or contributing

Sponsor via:

Support Options

Funding and Infrastructure Goals

GremlinGPT is growing. It learns(as do I while finishing GremlinGPT). It Launches(Soon). The project is reaching the limits of what a solo builder can finish without external support. The next stage—deployment, agent orchestration, and memory stability, an infrastructure investment to move into full time Development.

Funding Target is $500,000

Funds will be used to secure:

A Trading account to be able to move into Full-Time Development
Dedicated small GPU cluster (RTX 4090 × 2 minimum)
Persistent vector DB for others and hosted runtime servers for others who cant afford a system
Ensuring Secure DevOps pipeline for offline + encrypted agents for the ones who cant secure thier own hardware.

If You Are

A founder with cloud real estate and idle GPUs
A data center operator who understands sovereign AI
An investor looking for a stake in recursive autonomy

🧬 Paging:
@elonmusk
@openai
@deepmind
@mistralAI

If you get it, run the loop.

🧠 Features

MCP-Compatible: Shows up in VS Code’s MCP list with metadata.
Simple API: POST a URL, receive clean text in return.
CORS-Ready: Built-in CORS support for cross-origin requests.
Logging: Uses loguru to log all activity to rotating files.
Timeouts + Error Handling: Gracefully deals with slow or weird sites.
Human UA Header: Doesn’t look like a bot (unless you read the name).

🔧 Usage

Clone or drop this repo into your .vscode/mcps/ or wherever your MCPs live.
Add "gremlinScraper" to .mcp.json.
Click “Start Server” in the VS Code MCP tab.
Or run it manually:
pip install -r requirements.txt python server.py

📦 Endpoints & Examples

1. POST /scrape

Fetch a single page’s visible text:

curl -X POST http://localhost:8742/scrape \
  -H 'Content-Type: application/json' \
  -d '{"url":"https://example.com"}'

Response:

{
  "text": "Example Domain\n\nThis domain is for use in illustrative examples in documents.\n..."
}

2. POST /crawl

Recursively crawl same-domain links:

curl -X POST http://localhost:8742/crawl \
  -H 'Content-Type: application/json' \
  -d '{
    "url":"https://example.com",
    "max_pages":10,
    "max_depth":2,
    "concurrency":5
  }'

Response:

{
  "https://example.com": "Example Domain\n\nThis domain is for use…",
  "https://example.com/about": "About Us\n\n…",
  "...": "…"
}

3. POST /crawl-stream

Stream each page as soon as it’s fetched:

curl -N -X POST http://localhost:8742/crawl-stream \
  -H 'Content-Type: application/json' \
  -d '{"url":"https://example.com","max_pages":5}'

Response (NDJSON):

{"url":"https://example.com","text":"Example Domain\n…"}
{"url":"https://example.com/link1","text":"Link One\n…"}
…

4. GET /ping

Health check endpoint:

curl http://localhost:8742/ping

Response:

pong

5. GET /mcp/metadata

MCP discovery metadata:

curl http://localhost:8742/mcp/metadata

Response:

{
  "name":"Gremlin Web Scraper MCP",
  "description":"Scrapes and crawls text from URLs via HTTP endpoints…",
  "version":"0.0.1",
  "author":"StatikFinTech LLC",
  "tags":["scraping","crawl","MCP","runtime"],
  "endpoints":[…]
}

🗂 Metadata

Name: Gremlin Web Scraper MCP
Author: StatikFinTech LLC
License: MIT
Tags: #scraping, #crawl, #runtime, #gremlin

🐾 Future Add-ons

PDF / EPUB / Markdown parsing
Selective DOM element filtering
Scheduling/recurring crawl and scrap jobs
Direct Memory injection to GremlinGPT core

“Split. Streamlined. Sovereign.” StatikFinTech Systems • 2025

Caution

“Your qualifications are impressive...”

Coder Hiring Team (2025 Rejection Letter)

🔱 "This isn't rejection. It's proof they don't know how to build what comes next.

Still building what they can’t classify." 🔱 -StatikFinTech, LLC

This server cannot be installed

security - not tested

license - permissive license

quality - not tested

How are these scores calculated?

local-only server

The server can only run on the client's local machine because it depends on local resources.

A lightweight HTTP module that enables scraping visible text from any publicly accessible webpage, integrating directly with VS Code's MCP system.

Related MCP Servers

UseScraper MCP Server
tanevanwifferen
A
security
A
license
A
quality
A TypeScript-based MCP server utilizing the UseScraper API to provide web scraping capabilities, allowing users to extract content from webpages in various formats.
Last updated -
1
2
JavaScript
MIT License
MD Webcrawl MCP
jmh108
-
security
A
license
-
quality
A Python-based MCP server that crawls websites to extract and save content as markdown files, with features for mapping website structure and links.
Last updated -
3
Python
MIT License
Documentation Crawler & MCP Server
alizdavoodi
-
security
A
license
-
quality
Toolset that crawls websites, generates Markdown documentation, and makes that documentation searchable via a Model Context Protocol (MCP) server for integration with tools like Cursor.
Last updated -
23
Python
MIT License
Web-curl MCP Server
rayss868
A
security
A
license
A
quality
A powerful tool for fetching and extracting text content from web pages and APIs, supporting web scraping, REST API requests, and Google Custom Search integration.
Last updated -
4
2
JavaScript
MIT License

View all related MCP servers