web-scrapper-mcp
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| HTTPS_PROXY | No | Optional proxy URL for corporate proxy (e.g., http://proxy:8080) | |
| SCRAPER_OUTPUT_DIR | No | Directory where screenshots are saved | output |
| SCRAPER_TIMEOUT_MS | No | Page load timeout in milliseconds | 30000 |
Capabilities
Features and capabilities supported by this server
| Capability | Details |
|---|---|
| tools | {
"listChanged": false
} |
| prompts | {
"listChanged": false
} |
| resources | {
"subscribe": false,
"listChanged": false
} |
| experimental | {} |
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
| scrape_pageA | Scrape any SPA or JS-rendered webpage and return its content. Args: url: The page URL to scrape. wait_for: Playwright wait state — 'networkidle' | 'load' | 'domcontentloaded'. selector: Optional CSS selector to wait for before returning content. mode: Output format — 'markdown' | 'html' | 'text'. wait_ms: Extra settle delay in milliseconds after the page loads. Returns: {content, page_title, url, word_count, mode} |
| extract_api_endpointsA | Extract structured API endpoint data from an API documentation site. Automatically detects the site type (swagger, redoc, stoplight, fmp, generic). Override detection by passing site_type explicitly. Args: url: URL of the API documentation page. site_type: Force a specific extractor — 'swagger' | 'redoc' | 'stoplight' | 'fmp' | 'generic'. Returns: { endpoints: [{method, path, operation_id, summary, description, tags, parameters}], count: int, site_type: str, url: str, } |
| screenshot_pageA | Take a full-page screenshot of a URL for visual debugging. Returns the file path and the PNG encoded as base64 so the agent can display it inline. Args: url: URL to screenshot. full_page: Capture the full scrollable page (default True). Returns: {saved_path: str, base64: str} |
| scrape_and_seedA | Scrape API documentation and seed a finanal-style SQLite database directly. The target database must have an 'endpoints' table with columns: path, method, operation_id, summary, description, tags, parameters, source Args: url: URL of the API documentation page. db_path: Absolute path to the SQLite database file. source_name: Label for the 'source' column (e.g. 'fmp', 'tapetide'). site_type: Optional site type override for the extractor. Returns: {seeded: int, skipped: int, source: str, db_path: str} |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
Latest Blog Posts
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/Sekharz/web-scrapper-mcp'
If you have feedback or need assistance with the MCP directory API, please join our Discord server