MCP Smart Searcher
The MCP Smart Searcher server enables AI agents to perform multi-engine web searches and extract clean content from URLs.
web_search: Search the web using one or more engines simultaneously — DuckDuckGo, Baidu, Juejin, GitHub, GitHub Code, Tavily, Brave, and Startpage. Control which engines to use, how many results to return per engine (1–50, default 10), and run multiple engines at once for broader coverage.fetch_web_content: Fetch and extract text content from any public URL. Supports multiple output formats (Markdown, reader-mode article, plain text, or outline), optional prompt-based filtering to prioritize relevant content, and a configurable character limit (default 30,000).Configuration & Control: Restrict available engines via an allowlist, configure per-engine or global proxy settings, set concurrency limits for parallel requests, and integrate API keys for Tavily and GitHub engines.
Provides web search capabilities via Baidu as part of a multi-engine search system.
Provides web search capabilities via DuckDuckGo as part of a multi-engine search system.
Provides search capabilities for GitHub repositories and code as part of a multi-engine search system.
Provides web search capabilities via Juejin as part of a multi-engine search system.
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@MCP Smart Searchersearch for 'MCP Smart Searcher' on DuckDuckGo"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
MCP Smart Searcher
A smart MCP (Model Context Protocol) server for multi-engine web search with AI-powered results.
Features
Multi-engine search — Search across 8 engines simultaneously: DuckDuckGo, Baidu, Juejin, GitHub, GitHub Code, Tavily, Brave, Startpage
Web content extraction — Fetch and extract clean content from any public URL in multiple formats:
markdown(default) — Structured Markdown with headings, lists, code blocks, tables, and links preservedarticle— Reader-mode extraction via Mozilla Readability, ideal for blogs/docs/newstext— Plain text, legacy behavioroutline— Page structure overview (headings, regions, interactive elements) without full contentPlus noise removal, hidden-element stripping, and prompt-guided filtering
Rate limiting — Built-in concurrency control via semaphore
Proxy support — Per-engine proxy configuration
Engine allowlist — Restrict which engines can be used
Related MCP server: evo-scry
Installation
# For users
pip install mcp-smart-searcher
# For development
pip install -e ".[dev]"Usage
Run the server
# Direct command (after pip install)
mcp-smart-searcher
# Or via Python module
python -m mcp_smart_searcher
# Or via uvx (no install required)
uvx mcp-smart-searcherMCP client configuration
Add to your MCP client config (e.g., Claude Desktop):
{
"mcpServers": {
"smart-searcher": {
"command": "mcp-smart-searcher"
}
}
}Or with uvx (no install required):
{
"mcpServers": {
"smart-searcher": {
"command": "uvx",
"args": ["mcp-smart-searcher"]
}
}
}Development
# Run with MCP inspector
mcp dev src/mcp_smart_searcher/server.py
# Run tests
PYTHONPATH=src pytest
# Build
python -m buildConfiguration
All settings are configured via environment variables:
Variable | Description | Default |
| Comma-separated default engines when none specified |
|
| Comma-separated allowlist; unset = all allowed | (all) |
| Tavily AI Search API key | (none) |
| GitHub API token (for github/github_code engines) | (none) |
| Enable proxy for engines that need it |
|
| Proxy address |
|
| Override: comma-separated engines that use proxy | (auto) |
| Max parallel search requests |
|
| Logging level ( |
|
Proxy behavior
By default, domestic engines (baidu, juejin) skip proxy, while all others use proxy. You can override this with PROXY_ENGINES:
# Only use proxy for DuckDuckGo and GitHub
PROXY_ENGINES=duckduckgo,github,github_code
# Disable proxy entirely
USE_PROXY=falseMCP client configuration with env vars
{
"mcpServers": {
"smart-searcher": {
"command": "mcp-smart-searcher",
"env": {
"TAVILY_API_KEY": "tvly-xxx",
"GITHUB_TOKEN": "ghp_xxx",
"PROXY_URL": "http://127.0.0.1:10809",
"LOG_LEVEL": "INFO"
}
}
}
}Or with uvx (no install required):
{
"mcpServers": {
"smart-searcher": {
"command": "uvx",
"args": ["mcp-smart-searcher"],
"env": {
"TAVILY_API_KEY": "tvly-xxx",
"GITHUB_TOKEN": "ghp_xxx"
}
}
}
}Quick Start
1. Install
pip install mcp-smart-searcher2. Configure (optional)
Create a .env file or set environment variables:
# .env
TAVILY_API_KEY=tvly-your-key-here
GITHUB_TOKEN=ghp_your-token-here
PROXY_URL=http://127.0.0.1:10809
LOG_LEVEL=INFO3. Add to your MCP client
{
"mcpServers": {
"smart-searcher": {
"command": "mcp-smart-searcher"
}
}
}4. Done!
Your AI agent can now search the web and fetch web pages.
License
Apache-2.0
Available Tools
2 toolsfetch_web_contentA
Fetch and extract text content from any public URL.
Args: url: Public HTTP/HTTPS URL to fetch prompt: Optional hint for what to extract. When provided, the content is filtered to prioritize paragraphs most relevant to the prompt keywords. Useful for AI agents to focus on specific content (e.g., "extract code examples only", "summarize the main argument"). max_chars: Maximum characters to return (default 30000)
Returns: Extracted text content from the webpage, optionally filtered by prompt
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| prompt | No | ||
| max_chars | No |
Output Schema
| Name | Required | Description |
|---|---|---|
| result | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must cover behavioral traits. It mentions 'any public URL' and optional filtering, but omits details on error handling, redirects, authentication, or rate limits. The transparency is basic.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is structured with a clear header, Args list, and Returns section. It is not overly long, though the prompt examples could be slightly trimmed. Overall, it is efficient.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description covers the basic inputs and output, but lacks details on error scenarios, maximum allowable characters, or non-HTTP content handling. With no annotations, more context would be beneficial for complete understanding.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 0%, requiring the description to add meaning. It does so by describing the URL as 'public HTTP/HTTPS URL,' the prompt as an optional filter with examples, and max_chars with its default. This adds significant value beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'Fetch and extract text content from any public URL,' providing a specific verb and resource. It distinguishes from the sibling 'web_search' by focusing on fetching a known URL rather than searching for URLs.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explains the prompt parameter and default max_chars, implying usage for targeted extraction. However, it does not explicitly contrast with the sibling 'web_search' or state when not to use this tool, leaving room for ambiguity.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
web_searchA
Search the web using one or more search engines simultaneously.
Args: query: Search query string (non-empty) engines: Search engines to use (duckduckgo, baidu, juejin, github, github_code, tavily) limit: Maximum number of results per engine (1-50, default 10)
Returns: Formatted search results from all specified engines
| Name | Required | Description | Default |
|---|---|---|---|
| query | Yes | ||
| engines | No | ||
| limit | No |
Output Schema
| Name | Required | Description |
|---|---|---|
| result | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description bears the full burden. It mentions simultaneous multi-engine searching and returns formatted results, but does not disclose rate limits, error handling for failed engines, or blocking behavior. Adequate but not comprehensive.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is brief and well-structured, starting with the main purpose and then listing parameters in a clear args format. Every sentence serves a purpose with no redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The tool has an output schema (not shown but indicated), so the description does not need to detail return values. With three parameters and a fairly broad search function, the description adequately covers the essentials, though more details on result format would be beneficial.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 0% description coverage, so the description must compensate. It clarifies that the query must be non-empty, lists the available engines (partially compensating for missing enums), and specifies the limit range (1-50). However, it does not explain the default behavior when 'engines' is null.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'search' and the resource 'web', and specifies the distinctive feature of using multiple search engines simultaneously. This differentiates it from the sibling tool 'fetch_web_content' which likely retrieves content from a single URL.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage for multi-engine web searches but does not explicitly state when to prefer this tool over the sibling or when not to use it. No exclusion criteria or alternative suggestions are provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections. Dates show when Glama detected each change.
2 tool updates
v0.2.1- First observed
fetch_web_content - First observed
web_search
TDQS
The two tools have clearly distinct purposes: one fetches content from a specific URL, the other performs web searches. There is no overlap or ambiguity.
Both tool names follow a consistent verb_noun pattern (fetch_web_content, web_search) using snake_case, making them predictable and easy to understand.
With only 2 tools, the server is minimal but covers the basic search-and-fetch workflow. It feels slightly thin for a server named 'Smart Searcher' as it lacks additional features like content summarization or multi-URL fetch.
The surface covers the core operations of searching and fetching web content, but there are notable gaps such as no tool to fetch search results directly or to handle multiple URLs. Agents may need to combine calls manually.
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Connectors
MCP server for Google search results via SERP API
Fast, intelligent web search and web crawling. New mcp tool: Exa-code is a context tool for coding
Scrape, crawl and search the web for AI agents via MCP.
Related MCP Servers
- AlicenseAqualityCmaintenanceMCP server for web crawling, searching, and AI-powered content extraction, supporting single-page, batch, and full-site crawling along with text, news, image, book, and video search.82MIT
- AlicenseNot gradedqualityDmaintenanceMCP server for internet search via direct Google and DuckDuckGo HTML scraping with AI-powered result normalization and optional summarization, requiring no API keys for search.MIT
- AlicenseAqualityBmaintenanceMCP server for web search with LLM-optimized results and anti-detection mechanisms.336MIT
- AlicenseNot gradedqualityAmaintenanceMulti-engine aggregated search MCP server that combines results from 7 search engines with deduplication, relevance ranking, and web page content extraction.1MIT
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/PXSR/mcp-smart-searcher'
If you have feedback or need assistance with the MCP directory API, please join our Discord server