mcpsurfr
This server provides local, keyless web search and page reading for LLMs over MCP, with on-device ranking and token-efficient passage extraction.
Search the web and return only the most relevant passages for a query, with optional keywords, domains, recency, region, and news filters.
Fetch full pages as clean text with
rag_search_ddgswhen whole-page context is needed.Read a specific URL and optionally extract only passages that answer a query; supports HTML and PDFs.
Run multi-term deep research across several search backends, merging results, de-duplicating pages, and fetching the best content.
Use keyless search backends including
auto, Brave, DuckDuckGo, Google, Wikipedia, Yahoo, and others.Get locally re-ranked results, duplicate removal, skipped-result reasons, warnings, titles, and publish dates when available.
Use built-in caching, domain include/exclude controls, news search, and a provided skill/research prompt for guided use.
Enables web search functionality using Google to retrieve up-to-date information that can be incorporated into Claude's responses
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@mcpsurfrsearch for the latest developments in quantum computing"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
flowchart LR
Q["query + keywords"] --> S["ddgs<br>several engines, no keys"]
S --> R["re-rank<br>on device"]
R --> F["fetch top pages<br>main text, PDFs"]
F -->|search| P["best passages<br>~1k tokens"]
F -->|rag_search_ddgs<br>deep_research| W["full pages<br>shared budget"]What's in it:
No API keys. Searches go through ddgs. Its
automode asks several engines at once and skips blocked ones.Ranked locally. A small MobileBERT model on plain numpy re-ranks results, so only the best pages get fetched.
Clean text. Pages are fetched with browser impersonation, and only the main content is kept: no menus, cookie banners or footers. Code blocks and tables keep their lines. PDFs are read too (text layer, first 50 pages), and docs sites that publish markdown copies of their pages (llms.txt) are read from those. The same page under two URLs comes back once.
Passages instead of pages.
searchreturns just the paragraphs that answer the question, about a tenth of the tokens, anddeep_researchcan do the same per search term. When nothing matches well,searchcan ask you whether you want the full pages instead.Reads the sites that block scrapers. Stack Overflow and the other Stack Exchange sites, Wikipedia, GitHub, Hacker News, PyPI, npm and crates.io go through their free APIs: questions with the accepted answer first, articles by section, READMEs and raw files, HN threads with their comments, and packages with their latest version, release date and README.
Titles and dates. Every page and passage carries its title, and its publish date when the page or news result has one.
Says what it left out. Results list skipped pages with a reason (blocked, JavaScript-only, duplicate...) and the search snippet for each, so a Reddit thread or an msn.com article still says something. Cut pages are marked
truncated, and fallbacks and engine failures show up aswarnings. Google blocks often, so it falls back toautoon its own.Quick on repeats. Searches and pages are kept for five minutes, so a follow-up call on the same pages doesn't fetch them again.
Brings its own guide. It serves a skill and a
researchprompt, so clients pick up how to use it without setup.
Tool | Use it for |
| Start here: returns only the relevant passages. Pass |
| Full pages as text (the original mode). Takes a |
| Several search terms across backends, merged and de-duplicated. |
| One page you already have the link for. Pass a |
The search tools also take recency (day, week, month, year), region (uk-en, de-de...), include_domains / exclude_domains, and news: true for dated news articles.
The old rag_search_google, deep_research_ddgs and deep_research_google presets are hidden by default. Options says why and how to turn them back on.
Backends: auto (default), brave, duckduckgo, google, grokipedia, mojeek, startpage, wikipedia, yahoo. auto and brave are the dependable ones. With news: true: auto, bing, duckduckgo, yahoo.
How it compares
Other keyless MCP servers (mcp-searxng, duckduckgo-mcp-server, open-webSearch, the official fetch server) hand the model snippets or whole pages. Hosted APIs like Tavily, Exa and Brave do cut pages down to the useful parts, but they need a key and do it on their servers. mcpsurfr does that part on your machine:
picks passages with BM25 on the query plus keywords the model supplies, and an on-device embedder for ties and paraphrases
drops near-duplicate pages and shares one text budget across the rest
tells the model what it skipped and why, and can ask you before falling back to full pages
What it doesn't do: JavaScript-only pages, OCR for scanned PDFs, image search.
Related MCP server: tavily-firecrawl-mcp
Install
From PyPI with uv:
{
"mcpServers": {
"mcpsurfr": {
"command": "uvx",
"args": ["mcpsurfr"]
}
}
}uvx keeps using the version it cached first. Use "mcpsurfr@latest" to pick up new releases on every start (about a second slower), or "mcpsurfr@<version>" to pin one. uv tool install mcpsurfr works too, with "command": "mcpsurfr".
Or with Docker (amd64 and arm64):
{
"mcpServers": {
"mcpsurfr": {
"command": "docker",
"args": ["run", "--rm", "-i", "--init", "ghcr.io/nkapila6/mcpsurfr:latest"]
}
}
}Options
All settings are optional. These configs set each one to its default, so change only what you need. With uvx they go in env:
{
"mcpServers": {
"mcpsurfr": {
"command": "uvx",
"args": ["mcpsurfr"],
"env": {
"MCPSURFR_MAX_CHARS": "40000",
"MCPSURFR_DEEP_RESEARCH_MODE": "pages",
"MCPSURFR_CACHE_TTL": "300",
"MCPSURFR_LEGACY_TOOLS": "0"
}
}
}
}Variable | Default | What it does |
|
| Text budget per call when returning full pages ( |
|
| What |
|
| Seconds searches and fetched pages are reused. |
|
|
|
Why the legacy tools are off: they're just rag_search_ddgs and deep_research with a fixed backend, which the search tools now take themselves. Each tool's name, description and parameters get sent to the model in every chat whether it's used or not, so three duplicates cost context for nothing and give the model more ways to pick the wrong one.
With Docker, env only reaches the docker command, not the container, so the settings go in args with -e, before the image name. The same defaults:
{
"mcpServers": {
"mcpsurfr": {
"command": "docker",
"args": [
"run", "--rm", "-i", "--init",
"-e", "MCPSURFR_MAX_CHARS=40000",
"-e", "MCPSURFR_DEEP_RESEARCH_MODE=pages",
"-e", "MCPSURFR_CACHE_TTL=300",
"-e", "MCPSURFR_LEGACY_TOOLS=0",
"ghcr.io/nkapila6/mcpsurfr:latest"
]
}
}
}Not sure where your config lives? See the MCP quickstart. Tested with Claude Desktop, Claude Code, Cursor and Goose.
Coming from mcp-local-rag? Your old config keeps working, since the old URL redirects and the mcp-local-rag command still exists. Switching to the config above gets you the new name and drops the --python=3.10 pin (3.10 is end of life as of October 2026). If your prompts call rag_search_google or deep_research_google by name, set MCPSURFR_LEGACY_TOOLS to 1 (see Options).
Skill and prompt
The mcpsurfr-search skill tells the model which tool and backend to pick and how to cite. The server serves it as skill://mcpsurfr-search/SKILL.md, so most clients need nothing extra. To add it to Claude Desktop by hand: Settings → Skills → Add from folder, then pick src/mcpsurfr/skills/mcpsurfr-search/.
The research(topic) prompt plans a few search terms, runs deep_research and writes a cited summary.
Example
Asking Claude Desktop about something newer than its training data:
Security audit by MseeP · Issues and PRs welcome · MIT licensed · Buy me a coffee if it helps you
Available Tools
4 toolsdeep_researchDeep researchARead-only
Research a topic across several search terms and engines. Each term is searched on each backend, results are re-ranked locally by relevance, duplicates are removed, and the best pages are fetched as text.
Backends: auto, brave, duckduckgo, google, grokipedia, mojeek, startpage, wikipedia, yahoo.
"auto" (default): ddgs metasearch over several engines, skipping blocked ones. Most reliable.
"brave": fast and usually available.
"wikipedia": exact article lookups, best with title-like terms.
"google", "startpage", "yahoo", "mojeek": often blocked. Empty engines are reported as warnings, and if every chosen engine is empty the terms are retried with "auto".
| Name | Required | Description | Default |
|---|---|---|---|
| news | No | Search news articles instead of the web. Results then carry their published "date". News backends: auto, bing, duckduckgo, yahoo. Pair with recency for current events. | |
| region | No | Region-language code like "us-en", "uk-en" or "de-de". Default: ddgs's own (us-en). | |
| recency | No | Applied to every term. Only results from the past "day", "week", "month" or "year". | |
| backends | No | Backends to use. Defaults to ["auto"]. Unknown names are skipped with a warning. | |
| passages | No | True returns only the passages that answer each term, about a tenth of the text of full pages: prefer it unless whole pages are needed. False returns full pages. Left out, the server's MCPSURFR_DEEP_RESEARCH_MODE decides (pages by default). | |
| include_urls | No | Whether to include each page's source URL. | |
| max_passages | No | Passages to return in passages mode, shared across terms. Default 12. | |
| search_terms | Yes | 2-5 specific, related search queries covering different angles. Example: ["postgres query planner", "postgres index types", "EXPLAIN ANALYZE tutorial"] | |
| top_k_per_term | No | Number of top-ranked results to keep per search term per backend. | |
| exclude_domains | No | Never results from these sites. Example: ["pinterest.com"] | |
| include_domains | No | Only results from these sites, subdomains included. Example: ["python.org", "stackoverflow.com"] | |
| num_results_per_term | No | Number of results to rank per search term per backend. |
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Beyond the readOnly and openWorld annotations, the description discloses the full pipeline: each term is searched on each backend, results are locally re-ranked by relevance, duplicates are removed, and best pages are fetched as text. It also explains blocked-engine behavior, warnings for empty engines, and automatic retry with auto when all chosen engines are empty.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is front-loaded with the core research workflow and then uses a compact backend list to convey selection guidance. Every section earns its place, and the structure makes the default and fallback behavior easy to scan.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the 12-parameter schema, full parameter descriptions, output schema, and read-only/open-world annotations, the description supplies the missing operational context: the multi-backend search pipeline, ranking, deduplication, page fetching, and engine fallback behavior. An agent has enough information to invoke this complex tool correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the schema already documents most parameters in detail. The description still adds meaningful semantics for the backends parameter by explaining the practical behavior of auto, brave, wikipedia, and commonly blocked engines, which goes beyond the schema's brief default/unknown-name note.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states a specific verb and resource: research a topic across multiple search terms and engines, then rank, deduplicate, and fetch pages. This is clearly distinguishable from a simple search or URL reader because it describes a multi-query, multi-backend research pipeline.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives clear contextual guidance for backend selection: auto is most reliable, brave is fast, wikipedia suits exact article lookups, and several engines are often blocked with fallback to auto. It does not explicitly compare against sibling tools like search or rag_search_ddgs, so it lacks named alternatives or when-not-to-use guidance.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
rag_search_ddgsWeb searchARead-only
Search the web and return the most relevant pages as text, for when whole pages are wanted (search returns only the relevant passages). Results are re-ranked locally by semantic similarity to the query before the top pages are fetched.
| Name | Required | Description | Default |
|---|---|---|---|
| news | No | Search news articles instead of the web. Results then carry their published "date". News backends: auto, bing, duckduckgo, yahoo. Pair with recency for current events. | |
| query | Yes | The search query. Use natural language questions or keywords. Example: "latest developments in quantum computing" | |
| top_k | No | Number of top-ranked pages to fetch and return. Default: 5 | |
| region | No | Region-language code like "us-en", "uk-en" or "de-de". Default: ddgs's own (us-en). | |
| backend | No | Search backend, same names as deep_research. Default "auto" (ddgs metasearch over several engines, skipping blocked ones). Non-auto backends that return nothing are retried with "auto". | auto |
| recency | No | Only results from the past "day", "week", "month" or "year". | |
| num_results | No | Number of initial search results to rank. More results provide better coverage but increase processing time. Default: 10 | |
| include_urls | No | Whether to include each page's source URL for citation. Default: True | |
| exclude_domains | No | Never results from these sites. Example: ["pinterest.com"] | |
| include_domains | No | Only results from these sites, subdomains included. Example: ["python.org", "stackoverflow.com"] |
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Goes beyond the readOnly/openWorld annotations by disclosing the internal pipeline — results are re-ranked locally by semantic similarity before the top pages are fetched. This explains why the tool is heavier than a plain search and clarifies the two-stage cost (num_results ranked, top_k fetched). It says nothing about fetch failures or latency, which keeps it from a 5.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two sentences, front-loaded with the action and output form, with the differentiator in a tight parenthetical. Slightly dense phrasing ('for when whole pages are wanted') costs it the top mark, but nothing is redundant.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Output schema exists, so return values need no explanation, and the description covers the key behavioral fact an agent needs: results are fetched pages, ranked locally. It omits guidance on backend/recency interaction, though the schema descriptions carry that.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so baseline is 3, and the description adds real value by explaining the two-stage relationship between ranking many results and fetching the top ones, which the schema documents only per-parameter. Numeric/format detail is left to the schema, which is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
States a specific verb and resource ('Search the web and return the most relevant pages as text') and immediately contrasts the output with the sibling 'search', which returns only passages. An agent can distinguish the two without opening either schema.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Gives a clear selection condition: use this when whole pages are wanted rather than relevant passages. It does not position the tool against the other siblings (deep_research, read_url), so the when-to-use story is incomplete but the core routing decision is explicit.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
read_urlRead a pageARead-only
Read one page whose URL you already have: a link the user pasted, or one from earlier results. HTML or PDF. With a query, returns only the passages that answer it, the same way search does; without one, the page's main text (cut to the shared budget).
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | A public http(s) URL. Localhost and private network addresses are refused. | |
| query | No | What you want from the page. Leave out to get the whole text. | |
| keywords | No | Terms a good answer would contain, as for search. | |
| max_passages | No | Passages to return when there's a query. Default 8. |
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already cover safety (readOnlyHint) and world reach (openWorldHint), and the description adds real behavior beyond them: two output modes depending on whether a query is supplied, and truncation to a shared budget in the no-query case. It doesn't discuss failure modes or rate limits, but the URL restriction is already carried by the schema.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Three short sentences, front-loaded with the precondition, then formats, then the two-mode behavior. No filler and nothing repeated from the schema verbatim.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With an output schema present, return values needn't be described, and the description covers formats, the two extraction modes, and the budget cap. The only thin spot is what happens on refused or unreachable URLs, which is left entirely to the schema's url field.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the baseline is 3; the description earns an extra point by explaining the conditional semantics of `query` — that supplying one yields answer-bearing passages "the same way search does" — and that omitting it returns main text clipped to a budget. That connects `query` and `max_passages` behaviorally in a way the per-field descriptions do not.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
States a specific verb and resource ("Read one page") and immediately scopes it to URLs the agent already possesses, which cleanly separates it from the search siblings. It also names the supported content types (HTML or PDF), so an agent knows what it can point this at without opening the schema.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The phrase "whose URL you already have: a link the user pasted, or one from earlier results" tells the agent the precondition for use and implicitly rules out discovery (that's what search/deep_research are for). It stops short of naming a sibling as the alternative for the discovery case, so it's clear context rather than an explicit when/when-not pair.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
searchSearch (passages)ARead-only
Search the web and return only the passages that answer the query, not whole pages: usually about a tenth of the text of rag_search_ddgs. Use this first.
Tiers, cheapest first:
Search, then keep the top_pages results whose title/snippet match best.
Fetch those pages, split them into ~600-char passages, keyword-match them (BM25) against the query plus
keywords.Only if that leaves too many candidates, or matches nothing (a paraphrase), the local embedder ranks them by meaning. If nothing matched the keywords and the client can show questions, the user is asked whether they want the full pages instead.
| Name | Required | Description | Default |
|---|---|---|---|
| news | No | Search news articles instead of the web. Results then carry their published "date". News backends: auto, bing, duckduckgo, yahoo. Pair with recency for current events. | |
| query | Yes | The question or topic, in natural language. | |
| region | No | Region-language code like "us-en", "uk-en" or "de-de". Default: ddgs's own (us-en). | |
| backend | No | Search backend, same names as deep_research. Default "auto". | auto |
| recency | No | Only results from the past "day", "week", "month" or "year". | |
| keywords | No | Terms a good answer would contain, including synonyms and exact phrases. Example for "how do I make postgres faster": ["index", "EXPLAIN ANALYZE", "query planner", "vacuum"]. Strongly improves results. | |
| top_pages | No | Pages to fetch and split. Default 5. | |
| num_results | No | Search results to consider. Default 10. | |
| max_passages | No | Passages to return. Default 8. | |
| exclude_domains | No | Never results from these sites. Example: ["pinterest.com"] | |
| include_domains | No | Only results from these sites, subdomains included. Example: ["python.org", "stackoverflow.com"] |
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations only declare readOnlyHint and openWorldHint; the description goes well beyond them by disclosing the internal pipeline — fetch top pages, split into ~600-char passages, BM25 keyword matching, local embedder as a meaning-based fallback. The "cheapest first" framing also signals relative cost, which annotations never convey.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Front-loaded with purpose and the routing cue, then a compact numbered pipeline. The tiered list is the right structure for a staged algorithm, and no sentence is filler — even the parenthetical about a tenth the text of rag_search_ddgs carries decision value.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
An output schema exists so return values need not be explained, and the description still covers cost, fallback behavior, and failure handling for an 11-parameter tool. Nothing an agent needs in order to call it correctly or decide against a sibling is missing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
With 100% schema coverage the baseline is 3, but the description earns more by explaining roles: `keywords` is described as the BM25 matching vocabulary in tier 2, and `top_pages` as the set of pages fetched and split. It does not clarify the interplay between num_results, top_pages, and max_passages, which is the one remaining ambiguity.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
States a specific verb and resource (search the web) plus the defining scope constraint: it returns passages, not whole pages. It explicitly contrasts with sibling rag_search_ddgs ("about a tenth of the text"), so an agent can choose between them without opening either schema.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
"Use this first" gives explicit precedence over siblings, and the numbered tiers state the conditions under which the cheap path is kept versus when the embedder fallback is invoked ("only if that leaves too many candidates, or matches nothing"). It even covers the escalation path to the user when nothing matches.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
1 tool update
v1.2.3- Changed
deep_research2 fields changed- added
Input schema / properties / max_passagesAdded value: +{ + "default": 12, + "description": "Passages to return in passages mode, shared across terms. Default 12.", + "type": "integer" +} - added
Input schema / properties / passagesAdded value: +{ + "anyOf": [ + { + "type": "boolean" + }, + { + "type": "null" + } + ], + "default": null, + "description": "True returns only the passages that answer each term, about a\ntenth of the text of full pages: prefer it unless whole pages are needed. False returns\nfull pages. Left out, the server's MCPSURFR_DEEP_RESEARCH_MODE decides (pages by default)." +}
7 tool updates
v1.2.0- Changed
deep_research5 fields changed- added
Input schema / properties / exclude_domainsAdded value: +{ + "anyOf": [ + { + "items": { + "type": "string" + }, + "type": "array" + }, + { + "type": "null" + } + ], + "default": null, + "description": "Never results from these sites. Example: [\"pinterest.com\"]" +} - added
Input schema / properties / include_domainsAdded value: +{ + "anyOf": [ + { + "items": { + "type": "string" + }, + "type": "array" + }, + { + "type": "null" + } + ], + "default": null, + "description": "Only results from these sites, subdomains included.\nExample: [\"python.org\", \"stackoverflow.com\"]" +} - added
Input schema / properties / newsAdded value: +{ + "default": false, + "description": "Search news articles instead of the web. Results then carry their published\n\"date\". News backends: auto, bing, duckduckgo, yahoo. Pair with recency for current events.", + "type": "boolean" +} - added
Input schema / properties / recencyAdded value: +{ + "anyOf": [ + { + "enum": [ + "day", + "week", + "month", + "year" + ], + "type": "string" + }, + { + "type": "null" + } + ], + "default": null, + "description": "Applied to every term. Only results from the past \"day\", \"week\", \"month\" or \"year\"." +} - added
Input schema / properties / regionAdded value: +{ + "anyOf": [ + { + "type": "string" + }, + { + "type": "null" + } + ], + "default": null, + "description": "Region-language code like \"us-en\", \"uk-en\" or \"de-de\". Default: ddgs's own (us-en)." +}
- Removed
deep_research_ddgs - Removed
deep_research_google - Changed
rag_search_ddgs6 fields changed- added
Input schema / properties / backendAdded value: +{ + "default": "auto", + "description": "Search backend, same names as deep_research. Default \"auto\" (ddgs\n metasearch over several engines, skipping blocked ones). Non-auto\n backends that return nothing are retried with \"auto\".", + "type": "string" +} - added
Input schema / properties / exclude_domainsAdded value: +{ + "anyOf": [ + { + "items": { + "type": "string" + }, + "type": "array" + }, + { + "type": "null" + } + ], + "default": null, + "description": "Never results from these sites. Example: [\"pinterest.com\"]" +} - added
Input schema / properties / include_domainsAdded value: +{ + "anyOf": [ + { + "items": { + "type": "string" + }, + "type": "array" + }, + { + "type": "null" + } + ], + "default": null, + "description": "Only results from these sites, subdomains included.\nExample: [\"python.org\", \"stackoverflow.com\"]" +} - added
Input schema / properties / newsAdded value: +{ + "default": false, + "description": "Search news articles instead of the web. Results then carry their published\n\"date\". News backends: auto, bing, duckduckgo, yahoo. Pair with recency for current events.", + "type": "boolean" +} - added
Input schema / properties / recencyAdded value: +{ + "anyOf": [ + { + "enum": [ + "day", + "week", + "month", + "year" + ], + "type": "string" + }, + { + "type": "null" + } + ], + "default": null, + "description": "Only results from the past \"day\", \"week\", \"month\" or \"year\"." +} - added
Input schema / properties / regionAdded value: +{ + "anyOf": [ + { + "type": "string" + }, + { + "type": "null" + } + ], + "default": null, + "description": "Region-language code like \"us-en\", \"uk-en\" or \"de-de\". Default: ddgs's own (us-en)." +}
- Removed
rag_search_google - Added
read_url - Changed
search5 fields changed- added
Input schema / properties / exclude_domainsAdded value: +{ + "anyOf": [ + { + "items": { + "type": "string" + }, + "type": "array" + }, + { + "type": "null" + } + ], + "default": null, + "description": "Never results from these sites. Example: [\"pinterest.com\"]" +} - added
Input schema / properties / include_domainsAdded value: +{ + "anyOf": [ + { + "items": { + "type": "string" + }, + "type": "array" + }, + { + "type": "null" + } + ], + "default": null, + "description": "Only results from these sites, subdomains included.\nExample: [\"python.org\", \"stackoverflow.com\"]" +} - added
Input schema / properties / newsAdded value: +{ + "default": false, + "description": "Search news articles instead of the web. Results then carry their published\n\"date\". News backends: auto, bing, duckduckgo, yahoo. Pair with recency for current events.", + "type": "boolean" +} - added
Input schema / properties / recencyAdded value: +{ + "anyOf": [ + { + "enum": [ + "day", + "week", + "month", + "year" + ], + "type": "string" + }, + { + "type": "null" + } + ], + "default": null, + "description": "Only results from the past \"day\", \"week\", \"month\" or \"year\"." +} - added
Input schema / properties / regionAdded value: +{ + "anyOf": [ + { + "type": "string" + }, + { + "type": "null" + } + ], + "default": null, + "description": "Region-language code like \"us-en\", \"uk-en\" or \"de-de\". Default: ddgs's own (us-en)." +}
6 tool updates
v1.1.1- Changed
deep_research5 fields changed- changed
Input schema / properties / backends / descriptionPrevious value: -"List of search backends to use. Defaults to [\"duckduckgo\", \"google\"].\n Can include: bing, brave, duckduckgo, google, grokipedia, \n mojeek, yandex, yahoo, wikipedia. If None, uses default."New value: +"Backends to use. Defaults to [\"auto\"]. Unknown names are skipped with a warning." - changed
Input schema / properties / include_urls / descriptionPrevious value: -"Whether to include URLs in the results."New value: +"Whether to include each page's source URL." - changed
Input schema / properties / num_results_per_term / descriptionPrevious value: -"Number of results to fetch per search term per backend."New value: +"Number of results to rank per search term per backend." - changed
Input schema / properties / search_terms / descriptionPrevious value: -"List of search terms to research. Provide multiple \n related search queries for comprehensive coverage.\n Example: [\"machine learning fundamentals\", \"neural networks\", \"deep learning best practices\"]"New value: +"2-5 specific, related search queries covering different angles.\n Example: [\"postgres query planner\", \"postgres index types\", \"EXPLAIN ANALYZE tutorial\"]" - changed
Input schema / properties / top_k_per_term / descriptionPrevious value: -"Number of top scored results to keep per search term per backend."New value: +"Number of top-ranked results to keep per search term per backend."
- Changed
deep_research_ddgs4 fields changed- changed
Input schema / properties / include_urls / descriptionPrevious value: -"Whether to include URLs in the results."New value: +"Whether to include each page's source URL." - changed
Input schema / properties / num_results_per_term / descriptionPrevious value: -"Number of results to fetch per search term."New value: +"Number of results to rank per search term." - changed
Input schema / properties / search_terms / descriptionPrevious value: -"List of search terms to research. The LLM should provide \n multiple related search queries for comprehensive coverage."New value: +"2-5 specific, related search queries." - changed
Input schema / properties / top_k_per_term / descriptionPrevious value: -"Number of top scored results to keep per search term."New value: +"Number of top-ranked results to keep per search term."
- Changed
deep_research_google4 fields changed- changed
Input schema / properties / include_urls / descriptionPrevious value: -"Whether to include URLs in the results."New value: +"Whether to include each page's source URL." - changed
Input schema / properties / num_results_per_term / descriptionPrevious value: -"Number of results to fetch per search term."New value: +"Number of results to rank per search term." - changed
Input schema / properties / search_terms / descriptionPrevious value: -"List of search terms to research. The LLM should provide \n multiple related search queries for comprehensive coverage."New value: +"2-5 specific, related search queries." - changed
Input schema / properties / top_k_per_term / descriptionPrevious value: -"Number of top scored results to keep per search term."New value: +"Number of top-ranked results to keep per search term."
- Changed
rag_search_ddgs3 fields changed- changed
Input schema / properties / include_urls / descriptionPrevious value: -"Whether to include source URLs in the results.\n If True, each result includes its URL for citation.\n Default: True"New value: +"Whether to include each page's source URL for citation.\n Default: True" - changed
Input schema / properties / num_results / descriptionPrevious value: -"Number of initial search results to fetch from DuckDuckGo.\n More results provide better coverage but increase processing time.\n Default: 10"New value: +"Number of initial search results to rank.\n More results provide better coverage but increase processing time.\n Default: 10" - changed
Input schema / properties / top_k / descriptionPrevious value: -"Number of top-scored results to include in the final output.\n These are the most semantically relevant results after scoring.\n Default: 5"New value: +"Number of top-ranked pages to fetch and return.\n Default: 5"
- Changed
rag_search_google3 fields changed- changed
Input schema / properties / include_urls / descriptionPrevious value: -"Whether to include URLs in the results."New value: +"Whether to include each page's source URL." - changed
Input schema / properties / num_results / descriptionPrevious value: -"Number of results to return."New value: +"Number of initial search results to rank." - changed
Input schema / properties / top_k / descriptionPrevious value: -"Use top \"k\" results for content."New value: +"Number of top-ranked pages to fetch and return."
- Added
search
5 tool updates
v1.0.4- Changed
deep_research5 fields changed- added
Input schema / properties / backends / descriptionAdded value: +"List of search backends to use. Defaults to [\"duckduckgo\", \"google\"].\n Can include: bing, brave, duckduckgo, google, grokipedia, \n mojeek, yandex, yahoo, wikipedia. If None, uses default." - added
Input schema / properties / include_urls / descriptionAdded value: +"Whether to include URLs in the results." - added
Input schema / properties / num_results_per_term / descriptionAdded value: +"Number of results to fetch per search term per backend." - added
Input schema / properties / search_terms / descriptionAdded value: +"List of search terms to research. Provide multiple \n related search queries for comprehensive coverage.\n Example: [\"machine learning fundamentals\", \"neural networks\", \"deep learning best practices\"]" - added
Input schema / properties / top_k_per_term / descriptionAdded value: +"Number of top scored results to keep per search term per backend."
- Changed
deep_research_ddgs4 fields changed- added
Input schema / properties / include_urls / descriptionAdded value: +"Whether to include URLs in the results." - added
Input schema / properties / num_results_per_term / descriptionAdded value: +"Number of results to fetch per search term." - added
Input schema / properties / search_terms / descriptionAdded value: +"List of search terms to research. The LLM should provide \n multiple related search queries for comprehensive coverage." - added
Input schema / properties / top_k_per_term / descriptionAdded value: +"Number of top scored results to keep per search term."
- Changed
deep_research_google4 fields changed- added
Input schema / properties / include_urls / descriptionAdded value: +"Whether to include URLs in the results." - added
Input schema / properties / num_results_per_term / descriptionAdded value: +"Number of results to fetch per search term." - added
Input schema / properties / search_terms / descriptionAdded value: +"List of search terms to research. The LLM should provide \n multiple related search queries for comprehensive coverage." - added
Input schema / properties / top_k_per_term / descriptionAdded value: +"Number of top scored results to keep per search term."
- Changed
rag_search_ddgs4 fields changed- added
Input schema / properties / include_urls / descriptionAdded value: +"Whether to include source URLs in the results.\n If True, each result includes its URL for citation.\n Default: True" - added
Input schema / properties / num_results / descriptionAdded value: +"Number of initial search results to fetch from DuckDuckGo.\n More results provide better coverage but increase processing time.\n Default: 10" - added
Input schema / properties / query / descriptionAdded value: +"The search query. Use natural language questions or keywords.\n Example: \"latest developments in quantum computing\"" - added
Input schema / properties / top_k / descriptionAdded value: +"Number of top-scored results to include in the final output.\n These are the most semantically relevant results after scoring.\n Default: 5"
- Changed
rag_search_google4 fields changed- added
Input schema / properties / include_urls / descriptionAdded value: +"Whether to include URLs in the results." - added
Input schema / properties / num_results / descriptionAdded value: +"Number of results to return." - added
Input schema / properties / query / descriptionAdded value: +"The query to search for." - added
Input schema / properties / top_k / descriptionAdded value: +"Use top \"k\" results for content."
6 tool updates
v1.0.1- Added
deep_research - Added
deep_research_ddgs - Added
deep_research_google - Removed
rag_search - Added
rag_search_ddgs - Added
rag_search_google
1 tool update
v1.0.0- Changed
rag_search1 field changed- added
Input schema / properties / include_urlsAdded value: +{ + "default": true, + "type": "boolean" +}
1 tool update
- First observed
rag_search
TDQS
Scored across 4 tools
read_url is clearly distinct, but search, rag_search_ddgs, and deep_research all perform web search with overlapping engines and ranking logic. The descriptions do distinguish them (passages vs. whole pages vs. multi-term multi-engine), but the boundary between search and rag_search_ddgs hinges on a subtle output-format difference that an agent could easily misselect.
All names use snake_case, but the conventions are mixed: bare verb (search), verb_noun (read_url, deep_research), and verb_noun with backend baked in (rag_search_ddgs). The backend name embedded in one tool name makes the set less predictable than a uniform pattern.
Four tools is slightly thin but reasonable for a focused web-research server; each tool covers a distinct retrieval mode. A fifth tool (e.g., a crawl/sitemap or batch URL reader) would round it out without bloat.
The surface covers the core research lifecycle: passage search, full-page search, multi-engine deep research, and direct URL reading (HTML and PDF). Minor gaps remain around batch reading, following links from a fetched page, or structured extraction, but the main workflows are covered.
Maintenance
Related MCP Connectors
Scrape, map, crawl, search and monitor the web. Runs locally with no API key, cites every source.
Scrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.
LLM-ready web search + instant answers + URL-to-clean-text fetch for agents and RAG.
Web search API and MCP server for developers building AI agents.
Related MCP Servers
- AlicenseBqualityCmaintenanceA Model Context Protocol server that enables LLM clients like VSCode, Copilot, and Claude Desktop to search the web using Google Programmable Search Engine API.172 npm12Apache 2.0
- AlicenseAqualityCmaintenanceA Model Context Protocol server for web scraping and searching, with automatic fallback from Tavily to Firecrawl for fetching web content.21MIT
- AlicenseAqualityFmaintenanceA Model Context Protocol server that exposes Google Search as a tool via scraping, requiring no API key.1MIT
- AlicenseNot gradedqualityFmaintenanceMCP server enabling local-first web search, fetch, extract, and caching with citeable excerpts, no API key required. Supports research workflows for agents and apps.65 npm1MIT