Skip to main content
Glama
mistakeknot

interdeep

by mistakeknot

interdeep

Deep research plugin for Claude Code. Extracts clean content from web pages and orchestrates multi-phase research sessions that produce structured markdown reports.

interdeep provides the content extraction backbone for research workflows. It pairs with companion plugins like interject (search) and interknow (knowledge storage) for a complete research pipeline, but works standalone for extraction and report compilation.

Installation

# Install from the Interverse marketplace
claude plugin install interdeep

# Install with browser extraction support (optional)
cd ~/.claude/plugins/interdeep && uv pip install -e ".[browser]" && playwright install chromium

Related MCP server: crawl-mcp-server

Usage

Slash Command

/interdeep:research what are the best practices for MCP server design
/interdeep:research quick trafilatura vs readability comparison
/interdeep:research deep autonomous agent architectures and failure modes

MCP Tools (programmatic)

The plugin exposes 4 MCP tools that any agent can call:

  • extract_content — Extract clean text from a single URL

  • extract_batch — Extract from multiple URLs concurrently

  • compile_report — Compile findings into a structured markdown report

  • research_status — Check extraction capabilities (trafilatura, Playwright availability)

Architecture

src/interdeep/
  server.py                # FastMCP server — 4 tools
  extraction/
    trafilatura_ext.py     # Fast extraction via trafilatura
    playwright_ext.py      # Browser fallback for JS pages
    hybrid.py              # Router: trafilatura-first strategy
  reports/
    markdown.py            # Structured report compiler

skills/deep-research/      # 5-phase research orchestration protocol
agents/                    # research-planner, source-evaluator, report-compiler
commands/research.md       # /research slash command

Design Decisions

  • Extraction + orchestration only — interdeep does not own search. Search providers come from companion plugins (interject, interflux/exa).

  • trafilatura-first — Fast path handles most pages. Playwright is an optional fallback for JavaScript-heavy sites, not a requirement.

  • Host-agent-as-brain — MCP tools are stateless utilities. Research intelligence lives in the skill definition and agent prompts, executed by Claude as the host agent.

  • Graceful degradation — Every component works standalone. Missing companion plugins reduce capability, they do not break the pipeline.

License

MIT

Available Tools

4 tools
compile_reportC

Compile research findings and sources into a structured markdown report with citations.

ParametersJSON Schema
NameRequiredDescriptionDefault
titleYesReport title.
queryNoThe original research query.
findingsYesList of findings, each with title, content, and optional confidence.
sourcesYesList of sources, each with url, title, and optional relevance.
metadataNoOptional metadata key-value pairs for the report frontmatter.

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries full burden but only states the output format ('structured markdown report with citations'). It misses behavioral details like whether the tool modifies data, requires specific permissions, handles errors, or has performance constraints (e.g., rate limits), which are critical for a tool with multiple parameters and nested objects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, efficient sentence that front-loads the core purpose without unnecessary details. Every word contributes to understanding the tool's function, making it appropriately sized and well-structured.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (5 parameters with nested objects) and lack of annotations or output schema, the description is insufficient. It doesn't cover behavioral aspects, output details, or error handling, leaving significant gaps for the agent to operate effectively in a research compilation context.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, providing baseline documentation for all parameters. The description adds minimal value by implying that 'findings' and 'sources' are compiled into the report, but doesn't elaborate on parameter interactions or usage beyond what the schema already describes.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('compile') and the output ('structured markdown report with citations'), specifying the resource as 'research findings and sources'. It distinguishes from siblings like 'extract_batch' or 'extract_content' by focusing on compilation rather than extraction, though it doesn't explicitly contrast them.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives like 'research_status' or other siblings. The description implies usage for compiling research, but lacks explicit context, prerequisites, or exclusions, leaving the agent to infer appropriate scenarios.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

extract_batchB

Extract content from multiple URLs concurrently. Returns a list of extraction results.

ParametersJSON Schema
NameRequiredDescriptionDefault
urlsYesList of URLs to extract content from.
max_concurrentNoMaximum concurrent extractions (default 5).

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden. It mentions concurrency and the return type ('list of extraction results'), but lacks details on permissions, rate limits, error handling, or what 'extract content' entails (e.g., text, metadata). For a batch operation with no annotations, this is insufficient behavioral disclosure.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise—two sentences with zero waste. It front-loads the core purpose and follows with the return value, making it easy to parse. Every sentence earns its place by adding essential information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's moderate complexity (batch extraction with concurrency control), no annotations, and no output schema, the description is minimally adequate. It covers the basic operation and return type but lacks details on output format, error cases, or integration with siblings. It meets the bare minimum for a read-like tool but leaves gaps.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema fully documents both parameters ('urls' and 'max_concurrent'). The description adds no additional meaning beyond what the schema provides—it doesn't explain parameter interactions, constraints, or usage examples. Baseline 3 is appropriate when schema does the heavy lifting.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose: 'Extract content from multiple URLs concurrently.' It specifies the verb ('extract'), resource ('content'), and scope ('multiple URLs concurrently'), but doesn't explicitly differentiate from sibling tools like 'extract_content' (which might handle single URLs). The description is specific but lacks sibling comparison.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives. It doesn't mention sibling tools like 'extract_content' (for single URLs) or 'compile_report' (for processing extracted data), nor does it specify prerequisites or exclusions. Usage context is implied but not articulated.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

extract_contentA

Extract clean text/markdown content from a URL using trafilatura (fast) with optional Playwright fallback (JS-rendered pages).

ParametersJSON Schema
NameRequiredDescriptionDefault
urlYesThe URL to extract content from.
timeoutNoFetch timeout in seconds (default 10).

TDQS

A3.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavioral disclosure. It mentions the dual extraction approach (trafilatura primary, Playwright fallback) and performance characteristics ('fast'), but doesn't disclose error handling, rate limits, authentication needs, or what constitutes 'clean' extraction. It adds some behavioral context but leaves significant gaps for a tool that performs web scraping.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise (one sentence) and front-loaded with all essential information. Every word earns its place by conveying the core functionality, implementation approach, and performance characteristics without any redundant or unnecessary information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given this is a web scraping tool with no annotations and no output schema, the description is somewhat incomplete. It explains what the tool does but doesn't describe return values, error conditions, or important behavioral constraints. For a tool that interacts with external websites and has potential complexity around JavaScript rendering, more context about limitations and outputs would be helpful.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already fully documents both parameters (url and timeout). The description doesn't add any parameter-specific semantics beyond what's in the schema - it mentions URL extraction generally but provides no additional details about URL formats, timeout implications, or extraction behavior differences based on parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the specific action ('extract clean text/markdown content'), target resource ('from a URL'), and implementation details ('using trafilatura with optional Playwright fallback'). It distinguishes itself from sibling tools like 'compile_report' and 'extract_batch' by focusing on single URL content extraction rather than batch processing or report generation.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides clear context about when to use this tool ('fast' extraction, JS-rendered pages via fallback), but doesn't explicitly state when NOT to use it or mention specific alternatives among the sibling tools. It implies usage for content extraction from URLs but lacks explicit exclusions or comparisons to 'extract_batch' for multiple URLs.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

research_statusC

Show extraction capabilities and companion plugin readiness.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

C2.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden of behavioral disclosure. It mentions 'show' and 'readiness', suggesting a read-only, non-destructive operation, but doesn't clarify what exactly is shown (e.g., status details, error states, or performance metrics), how it behaves (e.g., real-time vs. cached data), or any constraints like rate limits or authentication needs. This leaves significant gaps in understanding the tool's behavior.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence: 'Show extraction capabilities and companion plugin readiness.' It is front-loaded and wastes no words, though it could be more specific to improve clarity. For its brevity, it efficiently conveys the core idea without unnecessary elaboration.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the lack of annotations and output schema, the description is incomplete for a tool that likely provides status or diagnostic information. It doesn't explain what the output includes (e.g., capabilities list, readiness status, error messages), how to interpret results, or any dependencies. For a tool with no structured output documentation, the description should do more to guide the agent on what to expect.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 0 parameters with 100% coverage, meaning no parameters are documented because none exist. The description doesn't need to add parameter semantics, as there are no parameters to explain. It appropriately avoids redundant information, earning a baseline score of 4 for not introducing confusion or omission in this context.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose2/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'Show extraction capabilities and companion plugin readiness' states a general purpose but is vague and ambiguous. It doesn't specify what resource or system it refers to, nor does it clearly distinguish from sibling tools like 'extract_batch' or 'extract_content'. The phrase 'extraction capabilities' could overlap with those siblings, and 'companion plugin readiness' is unclear without context.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance is provided on when to use this tool versus alternatives like 'compile_report', 'extract_batch', or 'extract_content'. The description implies a diagnostic or status-checking function, but it doesn't specify prerequisites, exclusions, or comparative contexts, leaving the agent to guess based on tool names alone.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

  1. 4 tool updatesv0.1.6
    • First observedcompile_report
    • First observedextract_batch
    • First observedextract_content
    • First observedresearch_status

TDQS

B3.4/5.0

Scored across 4 tools

Disambiguation5/5

Each tool has a clearly distinct purpose with no ambiguity: compile_report creates reports from research, extract_batch handles multiple URLs concurrently, extract_content extracts from single URLs with fallback options, and research_status provides system status. The descriptions clearly differentiate their functions, making misselection unlikely.

Naming Consistency5/5

All tools follow a consistent verb_noun pattern (compile_report, extract_batch, extract_content, research_status) with clear, descriptive names. There are no deviations in naming conventions, making the set predictable and easy to understand.

Tool Count4/5

With 4 tools, the count is reasonable for a research/content extraction server, though slightly lean. Each tool earns its place by covering distinct aspects of the workflow, but the scope might benefit from additional tools for tasks like managing research sources or advanced report formatting.

Completeness4/5

The tool surface covers core research and extraction workflows well, including content extraction (single and batch), report compilation, and system status. Minor gaps exist, such as tools for editing reports, managing extracted data, or integrating with external research databases, but agents can work around these with the provided tools.

Maintenance

ActivitySlowing
ResponsivenessNo issues

Related MCP Connectors

Related MCP Servers

  • A
    license
    B
    quality
    F
    maintenance
    An MCP server that retrieves web page content using Playwright headless browser, capable of extracting main content and converting to Markdown format.
    3
    3,560 npm
    1,083
    MIT
  • F
    license
    Not graded
    quality
    Not graded
    maintenance
    An MCP server for web content extraction that converts HTML pages into clean, LLM-optimized Markdown using Mozilla's Readability. It supports batch processing, intelligent multi-page crawling, and configurable caching while respecting robots.txt standards.
    25 npm
    -
  • A
    license
    Not graded
    quality
    Not graded
    maintenance
    An MCP server that extracts clean, structured Markdown content from web page URLs using the WebforAI library. It simplifies feeding web content into AI models by removing HTML noise and intelligently processing tables and links.
    -
  • A
    license
    Not graded
    quality
    D
    maintenance
    An MCP server that scrapes content from web pages, including JavaScript-heavy sites, and converts it into high-quality Markdown. It leverages Playwright for headless browser automation and Pypandoc for clean content conversion.
    Apache 2.0