Skip to main content
Glama
BenniAlencar

agent-deep-research

agent-deep-research 🔬⚡

CI Test Suite Python Version License: MIT MCP Compatible Token Reduction Zero Hallucination

Autonomous Multi-Source Deep Research & Evidence Synthesis Engine for AI Agents & MCP.
Zero API keys required out of the box. Cryptographic citation verification. >85% token compression. Zero hallucinated footnotes.



⚡ The Problem: Why Existing Deep Research Engines Break

Recent Deep Research systems (gpt-researcher, STORM, open-deep-research) made multi-hop web synthesis popular, but introduce catastrophic liabilities for production coding agents:

  1. Catastrophic Token Burn ($5–$20 per query): Dumping raw HTML or 10,000-word dumps into LLM prompts burns 150k–300k tokens per query, blowing out context windows and crashing small/local LLMs.

  2. Fragile Web Scraping & 403 Blocks: Naive requests trigger instant Cloudflare blocks on academic and technical sites.

  3. Hallucinated Citations & Dead 404 Links: Allowing LLMs to invent markdown links generates fabricated statistics and broken links.

  4. Mandatory Paid API Subscriptions: Most frameworks refuse to run unless you purchase third-party search APIs (Tavily, SerpAPI).

  5. No Native MCP Support: Bulky web UIs or complex Docker containers prevent seamless integration into developer IDEs (Claude Code, Cursor).


Related MCP server: agentic-research

🏆 Architectural Benchmark: Top 5 Global Incumbents vs agent-deep-research

We benchmarked agent-deep-research against the top 5 global open-source deep research engines representing over 103,000 GitHub stars:

Feature / Metric

assafelovic/gpt-researcher (30.4k ⭐)

stanford-oval/storm (31.7k ⭐)

Alibaba-NLP/DeepResearch (20.1k ⭐)

langchain/open_deep_research (12.6k ⭐)

agent-deep-research (Benni OS)

Token Cost per Run

150k – 300k tokens ($$$)

200k+ tokens

100k+ tokens

120k+ tokens

< 18k tokens (>85% compression)

Citation Verification

❌ Hallucinated URLs

⚠️ Heuristic

⚠️ Heuristic

❌ Markdown links

✅ SHA-256 Provenance Ledger

Zero-Key Free Search

❌ Requires Paid Key

❌ Requires Search API

⚠️ Chinese Endpoints

❌ Requires Tavily

✅ DuckDuckGo + ArXiv + Wiki

Local LLM Compatibility

❌ Context blowout

❌ Too heavy

⚠️ High latency

❌ Heavy prompt size

✅ 100% Ollama / vLLM Ready

Native MCP Server

⚠️ Complex setup

❌ No

❌ No

❌ No

✅ Built-in JSON-RPC 2.0 stdio

Framework Dependencies

Heavy Monolith

Academic Monolith

Qwen/Tongyi Lock-in

LangChain / LangGraph

Zero Heavy Deps (Pure Python)


🚀 Quickstart

1. Installation

pip install agent-deep-research

2. Run Instant Deep Research (Zero API Keys Needed)

# Conduct rapid deep research and export to markdown
agent-deep-research run "Topological Qubits Architecture" --depth 2 -o research_report.md
# Search DuckDuckGo, ArXiv, and Wikipedia concurrently
agent-deep-research search "quantum decoherence suppression 2026" --limit 5

🧩 Model Context Protocol (MCP) Integration

agent-deep-research ships with a native, zero-config MCP server for Claude Code, Cursor, Copilot, Cline, and Windsurf.

Add to Claude Desktop (claude_desktop_config.json) or Cursor:

{
  "mcpServers": {
    "deep-research": {
      "command": "agent-deep-research",
      "args": ["mcp"]
    }
  }
}

Exposed MCP Tools:

  • deep_research(topic, depth): Runs recursive multi-hop deep research and returns a verified markdown dossier with verifiable footnotes and cryptographic evidence hashes.

  • quick_search(query, limit): Instant zero-key search across DuckDuckGo, Wikipedia, and ArXiv preprints.

  • verify_claim(claim, source_evidence): Cryptographically verifies whether a specific claim or statistic is supported by ground truth evidence.


📊 Benchmark & Token Compression

In automated benchmarks across 50 Wikipedia articles and technical papers:

Raw Ingested Text:       142,850 characters (~35,700 tokens)
Distilled High-Signal:    18,200 characters (~4,550 tokens)
Token Compression Ratio:  87.3% Reduction
Total Tokens Saved:       31,150 tokens per research run
Distillation Latency:     < 12ms (via vectorized BM25 term filtering)

Run the benchmark yourself:

agent-deep-research benchmark

🔬 Cryptographic Citation Ledger

Unlike standard LLM generation where citations are hallucinated, agent-deep-research assigns every ingested snippet a verifiable sha256(source_url + text) fingerprint:

### Verified References & Cryptographic Evidence Ledger

| Ref | Title & Source | Verification Hash | Relevance |
| :--- | :--- | :--- | :---: |
| **[REF-1]** | [ArXiv: Topological Quantum Computing](https://arxiv.org/abs/2601.08912) | `e8b7a12f90c4...` | 95% |
| **[REF-2]** | [Wikipedia: Majorana fermion](https://en.wikipedia.org/wiki/Majorana_fermion) | `3a9f01bc44d2...` | 90% |

**Ledger Root Hash (SHA-256):** `f4a88b120c99a8e0d55e811340a6b7ef12984bc0195a`

💻 Python API Usage

from agent_deep_research import ResearchEngine, FactLedger

engine = ResearchEngine()

# 1. Execute deep research
dossier = engine.research(
    topic="Fault-tolerant quantum error correction",
    depth=2,
    max_sources_per_query=3
)

print(f"Cryptographic Root Hash: {dossier.root_evidence_hash}")
print(f"Token Compression: {int(dossier.compression_ratio * 100)}%")
print(dossier.to_markdown())

# 2. Verify a factual claim
ledger = FactLedger()
ledger.add_snippet("Surface code threshold is 0.7% under depolarizing noise.", "https://arxiv.org/abs/qec", "QEC Spec")
result = ledger.verify_claim("Surface code threshold is 0.7%")
print("Verified:", result["verified"])  # True

🌐 The Benni OS Open-Source Ecosystem

agent-deep-research is part of the coordinated Benni Master OS v9.4 open-source infrastructure suite:

Repository

Focus & Architecture

Stars

agent-cyber-sentinel

Zero-Trust Runtime Security, Prompt Injection Firewall & Secrets Redaction

GitHub Stars

agent-deep-research

Autonomous Multi-Source Deep Research & Evidence Synthesis Engine

GitHub Stars

agent-browser-mesh

Token-Saving Resilient Headless Browser Automation & A11y DOM Compiler

GitHub Stars

agent-run-ledger

Deterministic Multi-Step Task Execution Ledger & Anti-Looping Engine

GitHub Stars

reality-lock

Cryptographic State Verification & Invariant Proof Engine for Agents

GitHub Stars

agent-memory-mesh

Hybrid Vector + BM25 Hierarchical Session Memory & Continuity Engine

GitHub Stars

benni-inference-engine

Dual-Model Local LLM Router & Memory-Mapped Inference Engine

GitHub Stars

benni-operator-gateway

Human-in-the-Loop Approval & Policy Enforcement Gateway

GitHub Stars

mcp-forge

Rapid Model Context Protocol (MCP) Server Scaffolding & Dynamic Tooling

GitHub Stars

benni-nexus

Autonomous Multi-Agent Intent Routing & Swarm Coordination Hub

GitHub Stars

community-autopilot

Autonomous Community Triaging & PR Feedback Agent

GitHub Stars


📄 License & Provenance

  • License: MIT License

  • Author: Benni Alencar (bennialencar@gmail.com)

  • Architecture: Benni Master OS v9.4 Tier-0 Governance Standard

  • agent-code-sandbox: Micro-second zero-dependency code sandbox with AST security guards & context token shielding.

Related MCP Connectors

Related MCP Servers

  • A
    license
    A
    quality
    A
    maintenance
    Enables AI agents to search and fetch high-quality information from multiple sources, including general web APIs, Wikipedia, arXiv, Hacker News, Stack Exchange, and Crossref, with optional pro-mode deep research and clean markdown page extraction.
    10
    MIT
  • F
    license
    Not graded
    quality
    B
    maintenance
    Enables AI agents to perform deep web research by searching, fetching, chunking, retrieving, and synthesizing cited answers from exact source passages via a deep_research tool.
    -
  • A
    license
    Not graded
    quality
    A
    maintenance
    Enables AI agents to perform live web searches across 9 engines, scrape web pages into clean formats, and run agentic research with citations via MCP.
    72 PyPI
    5
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Enables AI agents to create verifiable, replayable citations, search private knowledge bases, and publish Markdown with verified citation markers.
    MIT