olostep-mcp
remote-capable server
The server can be hosted and run remotely because it primarily relies on remote services or has no dependency on the local environment.
Integrations
Provides structured data from Google search results through the google_search tool, including organic search results, knowledge graph data, and related questions
Supports waiting for JavaScript-heavy websites to render before scraping content, with configurable wait times
Retrieves webpage content in clean markdown format for easier consumption and formatting
Olostep MCP Server
A Model Context Protocol (MCP) server implementation that integrates with Olostep for web scraping, content extraction, and search capabilities.
Features
- Web page content extraction with clean markdown formatting
- Google search results with structured data extraction
- Website URL discovery and mapping
- Country-specific request routing for geo-targeted content
- Configurable wait times for JavaScript-heavy websites
- Comprehensive error handling and reporting
- Simple API key configuration
Installation
Running with npx
Manual Installation
Running on Claude Desktop
Add this to your claude_desktop_config.json
:
Running on Windsurf
Add this to your ./codeium/windsurf/model_config.json
:
Running on Cursor
To configure Olostep MCP in Cursor:
- Open Cursor Settings
- Go to Features > MCP Servers
- Click "+ Add New MCP Server"
- Enter the following:
- Name: "olostep-mcp" (or your preferred name)
- Type: "command"
- Command:
env OLOSTEP_API_KEY=your-api-key npx -y olostep-mcp
Replace your-api-key
with your Olostep API key.
Configuration
Environment Variables
OLOSTEP_API_KEY
: Your Olostep API key (required)
Available Tools
1. Get Webpage Content (get_webpage_content
)
Retrieves webpage content in clean markdown format with support for JavaScript rendering.
Parameters:
url_to_scrape
: The URL of the webpage to scrape (required)wait_before_scraping
: Time to wait in milliseconds before starting the scrape (default: 0)country
: Residential country to load the request from (e.g., US, CA, GB) (optional)
Response:
2. Get Website URLs (get_website_urls
)
Search and retrieve relevant URLs from a website, sorted by relevance to your query.
Parameters:
url
: The URL of the website to map (required)search_query
: The search query to sort URLs by (required)
Response:
3. Google Search (google_search
)
Retrieve structured data from Google search results.
Parameters:
query
: The search query to perform (required)country
: Country code for localized results (e.g., US, GB) (default: "US")
Response includes:
- Organic search results with titles, links, and snippets
- Knowledge graph data when available
- Related questions (People Also Ask)
- Related searches
- Rich snippets and other structured data
Error Handling
The server provides robust error handling:
- Detailed error messages for API issues
- Network error reporting
- Authentication failure handling
- Rate limit information
Example error response:
License
ISC License
This server cannot be installed
Searching google, individual websites and scraping their content. Fast and cost-effective. ⚡️