Scraper Maintenance MCP
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@Scraper Maintenance MCP Inspect the 'Add to Cart' button on example.com"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
Scraper Maintenance MCP
A comprehensive Model Context Protocol (MCP) server for automating web scraper maintenance through intelligent browser inspection, selector generation, and code updates.
š Project Structure
mcp/
āāā src/ # TypeScript source files
ā āāā server.ts # Main MCP server implementation
ā āāā browser-manager.ts # Browser automation and management
ā āāā selector-generator.ts # Selector generation and scoring
ā āāā types.ts # Type definitions
āāā dist/ # Compiled JavaScript files
ā āāā server.js # Main MCP server (executable)
ā āāā browser-manager.js # Browser automation
ā āāā selector-generator.js # Selector intelligence
ā āāā types.js # Type definitions
āāā config/ # Configuration files
ā āāā test-config.json # Test configuration
ā āāā claude-desktop-config.json # Claude Desktop setup
ā āāā *.json # Various scraper configurations
āāā examples/ # Usage examples and documentation
āāā docs/ # Documentation files
āāā scripts/ # Build and utility scripts
āāā package.json # Project configuration
āāā tsconfig.json # TypeScript configurationRelated MCP server: Selenium MCP Server
š Quick Start
1. Install Dependencies
cd mcp
npm install2. Build the Project
npm run build3. Run the Server
npm startš ļø Available MCP Tools
Configuration Management
load_scraper_config- Load scraper configuration filesupdate_config- Update configurations with new selector mappings
Browser Operations
initialize_browser- Launch browser (headless/visible mode)navigate_to_page- Navigate to target URLstake_screenshot- Capture debugging screenshotsclose_browser- Cleanup browser resources
Element Inspection
inspect_field_manually- Interactive visual element selectionauto_detect_field- AI-powered automatic element detectionvalidate_selectors- Test selector reliability and performancegenerate_selectors- Create multiple selector variations with scoringtest_extraction- Test data extraction using current selectors
Maintenance & Code Generation
run_maintenance_check- Comprehensive scraper health analysisgenerate_extractor_code- Multi-language code generation
š Usage
For Claude Desktop
Add to your Claude Desktop configuration:
{
"mcpServers": {
"scraper-maintenance": {
"command": "node",
"args": ["/path/to/mcp/dist/server.js"],
"env": {
"NODE_ENV": "production"
}
}
}
}For Cursor
Add to your Cursor MCP configuration:
{
"mcpServers": {
"scraper-maintenance": {
"command": "node",
"args": ["/path/to/mcp/dist/server.js"],
"env": {
"NODE_ENV": "production"
}
}
}
}š§ Development
Build
npm run buildDevelopment Mode
npm run devTest
npm testš Documentation
Available Tools
13 toolsauto_detect_fieldC
Automatically detect elements for a field using AI-like heuristics
Inputs: fieldName (required), strategies.
close_browserA
Close the browser and cleanup resources
Inputs: no named parameters.
generate_extractor_codeC
Generate extractor code based on current configuration
Inputs: language, outputPath.
generate_selectorsC
Generate multiple selector variations for an element
Inputs: elementData (required).
initialize_browserC
Initialize browser for inspection with custom options
Inputs: timeout, headless, viewport, userAgent.
inspect_field_manuallyB
Start manual inspection for a specific field using visual element selection
Inputs: fieldName (required).
load_scraper_configC
Load a scraper configuration file
Inputs: configPath (required).
run_maintenance_checkC
Run comprehensive maintenance check on scraper configuration
Inputs: url (required), configPath.
take_screenshotC
Take a screenshot of the current page
Inputs: outputPath.
test_extractionC
Test data extraction using current selectors
Inputs: url (required), selectors.
update_configA
Update scraper configuration with new selector mappings
Inputs: mappings (required), outputPath.
validate_selectorsB
Validate existing selectors and check their reliability
Inputs: selectors (required), url.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelogā¦
TDQS
Scored across 13 tools
Each tool has a distinct purpose: browser lifecycle (initialize, navigate, close), config management (load, update), field inspection (manual vs. auto), selector operations (validate, generate), and testing/maintenance (test, audit, code generation). Even similar tools like inspect_field_manually and auto_detect_field are clearly differentiated by manual vs. automatic methodology.
All tool names follow a consistent verb_noun pattern (e.g., load_scraper_config, navigate_to_page, generate_selectors). No mixed conventions or vague verbs; each name clearly indicates its action and target.
With 13 tools, the server is well-scoped for scraper maintenance. Every tool supports the core workflow without redundancy, and the count falls comfortably within the ideal 3-15 range.
The tool set covers the full maintenance lifecycle: load configuration, inspect and detect fields, validate/generate selectors, test extraction, update config, run comprehensive checks, and generate final code. Minor features like exporting configs or handling pagination are absent, but the core workflow has no dead ends.
Maintenance
Related MCP Connectors
Web scraping MCP server ā scrape, extract structured data, screenshot any site with anti-bot bypass.
One MCP server for all web data. Scrape, search, crawl, and AI research in one install.
Web scraping, browser automation, screenshots and AI data extraction for AI agents via MCP.
Web scraping MCP server: any URL to Markdown or JSON, with JavaScript rendering and batch jobs.
Related MCP Servers
- AlicenseAqualityBmaintenanceMCP server for AI browser automation with tools for navigation, actions, data extraction, and scripting, supporting local and cloud execution.14496 npm3Apache 2.0
- FlicenseNot gradedqualityDmaintenanceMCP server for crawling and extracting data from web pages using Selenium with CSS/XPath selectors. Supports 17 tools including smart extraction, pagination, infinite scroll, and screenshots.3-
- AlicenseNot gradedqualityDmaintenanceMCP server for web scraping and browser automation, enabling AI agents to extract clean, token-efficient content from web pages.1MIT
- AlicenseCqualityCmaintenanceMCP server for browser automation that drives Chrome via an extension, preserving login state and offering 45 tools for navigation, interaction, scraping, and screenshots.535MIT