research-tools
Provides a web search tool using DuckDuckGo, allowing the agent to search the internet and retrieve content from web pages.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@research-tools search for MCP protocol vs LangChain tools"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
Autonomous Web Research Agent
A teaching project: one Python agent that plans, searches the web, stores notes in RAG, writes a report, then critiques itself and loops until the answer is good enough.
Stack: Python 3.11+ · LangChain · LangGraph · MCP · Chroma RAG · LangSmith
What you are building (classroom map)
Piece | File | Job |
Config |
| Reads |
LLM layer |
| One function, many providers |
Tools |
| Search + fetch pages |
MCP |
| Same tools over the MCP protocol |
RAG |
| Remember pages in Chroma |
State |
| The graph's notebook |
Nodes |
| One function per step |
Graph |
| Wires the loop |
CLI |
| Run from terminal |
API |
| FastAPI backend |
Read TEACHING.md for the full lesson.
Related MCP server: Local-MCP-server
Setup
cd ~/Projects/autonomous-web-research-agent
python3.11 -m venv .venv
source .venv/bin/activate
pip install -e ".[dev]"
cp .env.example .envPut at least one LLM key in .env (OPENAI_API_KEY is the default path). Search works with free DuckDuckGo. Add TAVILY_API_KEY later if you want higher-quality search. Add LANGCHAIN_API_KEY to watch traces in LangSmith.
Run a research job
python -m research_agent.cli "How does MCP differ from a normal LangChain tool?"Run the backend
python -m research_agent.api
# POST http://127.0.0.1:8001/research {"question": "..."}Run the MCP server (for Cursor / other hosts)
python -m research_agent.mcp_serverExample Cursor MCP config:
{
"mcpServers": {
"research-tools": {
"command": "/Users/YOU/Projects/autonomous-web-research-agent/.venv/bin/python",
"args": ["-m", "research_agent.mcp_server"]
}
}
}Tests (no API key needed)
pytestAvailable Tools
2 toolsfetch_pageB
Download a URL and return cleaned visible text.
Inputs: url (required). Returns: result
search_webC
Search the public web and return titles, URLs, and snippets.
Inputs: query (required). Returns: result
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
TDQS
Scored across 2 tools
search_web is for querying the web and returning snippets, while fetch_page retrieves full content from a specific URL. Their purposes are completely distinct and easily distinguishable.
Both tools follow a consistent verb_noun pattern (search_web, fetch_page), making the naming predictable and clear.
With only two tools, the server feels thin for a general research purpose. While each tool is essential, the minimal count borders on insufficient for complex workflows.
The two tools cover the basic research loop of searching and fetching content. Minor gaps exist (e.g., no ability to refine searches or manage results), but agents can work around them.
Maintenance
Related MCP Connectors
Web search API and MCP server for developers building AI agents.
Scrape, crawl and search the web for AI agents via MCP.
Free web search for AI agents. No API key required. Hosted MCP in active development.
Web scraping, extraction and search for AI agents. Hosted MCP with workspace API keys.
Related MCP Servers
- AlicenseNot gradedqualityDmaintenanceA Model Context Protocol server that exposes powerful web search and scraping tools to AI agents and MCP-compatible clients.Apache 2.0
- FlicenseNot gradedqualityDmaintenanceEnables tool-calling LLMs to search the internet, capture website images, extract webpage text, and more via a local MCP server.16-
- AlicenseNot gradedqualityCmaintenanceA minimal MCP server for agent-friendly web extraction and search. Offers two tools: fetching real pages with Playwright and Crawl4AI, and searching across 7 engines with automatic fallback.3AGPL 3.0
- AlicenseNot gradedqualityCmaintenanceA self-contained web-research MCP server that lets local LLM agents search, fetch, and synthesize web content using tools like web_search, web_fetch, and web_research.2MIT