UseScraper MCP Server
UseScraper MCP 서버
UseScraper API를 사용하여 웹 스크래핑 기능을 제공하는 TypeScript 기반 MCP 서버입니다. 다양한 형식의 웹 페이지에서 콘텐츠를 추출할 수 있는 단일 도구인 '스크래핑'을 제공합니다.
특징
도구
scrape- 웹 페이지에서 콘텐츠 추출매개변수 :
url(필수): 스크래핑할 웹페이지의 URLformat(선택 사항): 콘텐츠를 저장할 형식(텍스트, HTML, 마크다운). 기본값: 마크다운advanced_proxy(선택 사항): 고급 프록시를 사용하여 봇 감지를 우회합니다. 기본값: falseextract_object(선택 사항): 추출할 데이터를 지정하는 객체
Related MCP server: MCP-Typescribe
설치
Smithery를 통해 설치
Smithery 를 통해 Claude Desktop용 UseScraper를 자동으로 설치하려면:
지엑스피1
수동 설치
저장소를 복제합니다.
git clone https://github.com/your-repo/usescraper-server.git cd usescraper-server종속성 설치:
npm install서버를 빌드하세요:
npm run build
구성
Claude Desktop과 함께 사용하려면 서버 구성을 추가하세요.
MacOS의 경우: ~/Library/Application Support/Claude/claude_desktop_config.json Windows의 경우: %APPDATA%/Claude/claude_desktop_config.json
{
"mcpServers": {
"usescraper-server": {
"command": "node",
"args": ["/path/to/usescraper-server/build/index.js"],
"env": {
"USESCRAPER_API_KEY": "your-api-key-here"
}
}
}
}/path/to/usescraper-server 실제 서버 경로로 바꾸고 your-api-key-here UseScraper API 키로 바꾸세요.
용법
구성이 완료되면 MCP 인터페이스를 통해 '스크래핑' 도구를 사용할 수 있습니다. 사용 예:
{
"name": "scrape",
"arguments": {
"url": "https://example.com",
"format": "markdown"
}
}개발
자동 재빌드를 사용한 개발의 경우:
npm run watch디버깅
MCP 서버는 stdio를 통해 통신하므로 디버깅이 어려울 수 있습니다. 패키지 스크립트로 제공되는 MCP Inspector를 사용하는 것이 좋습니다.
npm run inspector검사기는 브라우저에서 디버깅 도구에 액세스할 수 있는 URL을 제공합니다.
Available Tools
1 toolscrapeC
Scrape content from a webpage using UseScraper API
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | URL to scrape | |
| format | No | Format to save crawled page content. Strongly recommended to keep as markdown for optimal AI processing (default: markdown) | |
| advanced_proxy | No | Use advanced proxy to circumvent bot detection (default: false) | |
| extract_object | No | Optional object specifying data to extract |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description fails to disclose behavioral traits beyond the API name. It does not mention rate limits, authentication, potential failures, or what happens with the proxy option. The schema provides some param hints, but the description adds no behavioral context.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence, concise and front-loaded. It is appropriately sized for a simple tool, though it could include a bit more detail without becoming verbose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool has 4 parameters, nested objects, and no output schema, the description is too minimal. It does not explain what is returned or how the tool behaves in edge cases, leaving significant gaps for an agent.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with each parameter described, so the baseline is 3. The description adds minimal extra meaning beyond stating the API, so it meets the baseline without enhancing understanding.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description identifies the action (scrape) and resource (webpage), naming the API used (UseScraper). However, 'scrape' is broad and could be more specific about what types of content or how it extracts, but without siblings it's sufficiently clear.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives or any exclusions. The description only states what it does, leaving the agent to infer usage context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
1 tool update
v0.1.0- First observed
scrape
TDQS
Scored across 1 tool
Only one tool exists, so there is no possibility of confusion with other tools.
With a single tool, naming is trivially consistent.
A single tool for web scraping is borderline; it might suffice for basic use but feels thin for a full-featured scraper server.
The single scrape tool covers the core functionality, but lacks additional features like selecting specific elements or handling different output formats, which are common in web scraping APIs.
Maintenance
Related MCP Connectors
A TypeScript MCP server for Home Assistant, enabling programmatic management of entities, automati…
A simple Typescript MCP server built using the official MCP Typescript SDK and smithery/cli. This…
MCP server for 500+ pay-per-call web scraping, search, social, business, and financial data tools.
Programmatic web-scraping MCP server powered by x402 micro-transactions on Base.
Related MCP Servers
- AlicenseCqualityCmaintenanceMCP Server enabling integration with Scrapezy to retrieve structured data from websites.121 npm14MIT
- AlicenseNot gradedqualityDmaintenanceAn MCP server that enables LLMs to understand and work with TypeScript APIs they haven't been trained on by providing structured access to TypeScript type definitions and documentation.17 npm46MIT
- AlicenseAqualityDmaintenanceA TypeScript-based web scraping server built on the Model Context Protocol that offers multiple export formats, content extraction rules, and support for both static and dynamic (SPA) websites.712 npm1MIT
- AlicenseNot gradedqualityDmaintenanceA TypeScript-based MCP server that provides backend API handling and facilitates communication between microservices. Features an organized structure with controllers, routes, and models for easy extensibility and maintenance.284 npm1MIT