Skip to main content
Glama

Conclave MCP

一个 MCP(模型上下文协议)服务器,提供对 LLM 模型“秘密会议”的访问,使任何兼容 MCP 的客户端都能咨询多个前沿模型,以获取多样化的观点、同行评级评估和综合答案。

为什么存在这个项目

当你使用 AI 助手时,你得到的是一个模型的视角。有时这正是你所需要的。但对于重要决策——技术架构、商业策略、创意方向、复杂分析或任何涉及盲点的情况——多种意见的汇集能揭示你可能忽略的替代方案。

Conclave 为任何工作流程带来了民主化的 AI 共识。

无需手动查询多个 AI 服务,你可以通过 Claude Desktop、Claude Code 或任何 MCP 客户端咨询 Conclave。从多个前沿模型(GPT、Claude、Gemini、Grok、DeepSeek)获取排名意见,并获得代表集体 AI 智慧的综合答案。

使用场景包括:

  • 技术:架构决策、代码审查、调试、API 设计

  • 商业:策略分析、提案审查、市场研究综合

  • 创意:写作反馈、头脑风暴、编辑视角

  • 研究:文献综述、事实核查、多视角分析

  • 决策:优缺点分析、风险评估、选项评估

灵感来源于 Andrej Karpathy 的 llm-council 概念。本项目将核心思想重新实现为 MCP 服务器,以便与 AI 辅助工作流程无缝集成。

Related MCP server: AI Council MCP Server

工作原理

Conclave 最多在 3 个阶段运行:

┌─────────────────────────────────────────────────────────────────┐
│  Stage 1: OPINIONS                                              │
│  Query multiple LLMs in parallel for independent responses      │
│  (GPT, Claude, Gemini, Grok, DeepSeek, etc.)                   │
└─────────────────────────────────────────────────────────────────┘
                              ↓
┌─────────────────────────────────────────────────────────────────┐
│  Stage 2: PEER RANKING                                          │
│  Each model anonymously evaluates and ranks all responses       │
│  Aggregate scores reveal best performers (lower = better)       │
└─────────────────────────────────────────────────────────────────┘
                              ↓
┌─────────────────────────────────────────────────────────────────┐
│  Stage 3: SYNTHESIS                                             │
│  Chairman model synthesizes final answer from collective wisdom │
│  Consensus level reported (strong/moderate/weak/split)          │
│  Tiebreaker vote cast if conclave is split                      │
└─────────────────────────────────────────────────────────────────┘

功能特性

  • 分级查询:选择成本/深度权衡(快速 | 排名 | 全面)

  • 三个委员会层级:高级(前沿)、标准(平衡)、预算(快速/廉价)

  • 共识协议:检测一致性水平,在分歧时触发决胜局

  • 奇数规模会议:确保决胜投票可以打破僵局

  • 轮值主席:每周轮换防止单一模型偏见

  • 主席预设:上下文感知的主席选择(代码、创意、推理)

  • 成本估算:在查询前了解你的支出

  • 轻量级评估:用于随时间跟踪性能的独立基准测试运行器

安装

前置要求

  1. https://openrouter.ai/keys 获取 OpenRouter API 密钥

  2. 为你的 OpenRouter 账户充值(按需付费)

设置

# Clone the repository
git clone https://github.com/stephenpeters/conclave-mcp.git
cd conclave-mcp

# Install dependencies
uv sync

# Optional: Create .env file for running tests locally
# (Not required for MCP usage - API key is passed via client config)
echo "OPENROUTER_API_KEY=sk-or-v1-your-key-here" > .env

配置 Claude Desktop

选项 1:桌面扩展(推荐)

  1. 打开 Claude Desktop

  2. 前往 Settings > Extensions > Advanced settings > Install Extension...

  3. 导航到 conclave-mcp 目录

  4. 按照提示配置你的 OPENROUTER_API_KEY

  5. 重启 Claude Desktop

选项 2:手动配置

打开 Claude Desktop,前往 Settings > Developer > Edit Config,并将以下内容添加到 claude_desktop_config.json

{
  "mcpServers": {
    "conclave": {
      "command": "uv",
      "args": ["run", "--directory", "/path/to/conclave-mcp", "python", "server.py"],
      "env": {
        "OPENROUTER_API_KEY": "sk-or-v1-your-key-here"
      }
    }
  }
}

/path/to/conclave-mcp 替换为你的实际路径,保存并重启 Claude Desktop。

配置 Claude Code

使用 CLI 添加服务器:

claude mcp add --transport stdio conclave -- uv run --directory /path/to/conclave-mcp python server.py --env OPENROUTER_API_KEY=sk-or-v1-your-key-here

或者将 .mcp.json.example 复制为 .mcp.json 并更新路径:

cp .mcp.json.example .mcp.json
# Edit .mcp.json with your paths and API key

在 Claude Code 中使用 /mcp 或在终端中使用 claude mcp list 进行验证。

可用工具

conclave_quick

快速并行意见(仅限第 1 阶段)。查询所有 Conclave 模型并返回个人响应。

成本:每次查询约 $0.01-0.03

用途:快速头脑风暴,快速获取多样化视角

conclave_ranked

带有同行排名的意见(第 1 + 2 阶段)。显示哪个模型在此特定问题上表现最好。

成本:每次查询约 $0.05-0.10

用途:代码审查、比较方法、查看哪个模型“胜出”

conclave_full

完整的 Conclave 综合(所有 3 个阶段)。包括共识检测和主席决胜局。

成本:每次查询约 $0.10-0.20

选项

  • tier:模型层级 - "premium""standard"(默认)、"budget"

  • chairman:覆盖主席模型(例如 "anthropic/claude-sonnet-4"

  • chairman_preset:使用预设("code""creative""reasoning""concise""balanced"

用途:重要决策、架构选择、复杂调试

conclave_config

查看当前配置:Conclave 成员、主席轮换状态、共识阈值。

conclave_estimate

在运行查询前估算成本。

conclave_models

列出所有可用模型及选择编号。显示按层级分组的模型,具有稳定的编号:

  • 高级层级:1-10

  • 标准层级:11-20

  • 预算层级:21-30

  • 主席池:31-40

conclave_select

从模型编号创建自定义 Conclave。第一个模型成为主席。

conclave_select(models="31,1,11,21")

创建:

  • 主席:#31 (deepseek-r1)

  • 成员:#1 (claude-opus-4.5), #11 (claude-sonnet-4.5), #21 (gemini-2.5-flash)

自定义选择将持续到服务器重启或执行 conclave_reset

conclave_reset

清除自定义 Conclave 选择并返回基于层级的配置。

自定义模型选择

为了完全控制哪些模型参与 Conclave:

  1. 列出可用模型:使用 conclave_models 查看所有模型及其编号

  2. 选择你的阵容:使用 conclave_select(models="31,1,11,21") - 第一个数字是主席

  3. 查询:正常使用 conclave_quickconclave_rankedconclave_full

  4. 重置:使用 conclave_reset 返回基于层级的配置

示例工作流程

> conclave_models
## Available Models
### Premium Tier (1-10)
   1. anthropic/claude-opus-4.5
   2. google/gemini-3-pro-preview
   ...

> conclave_select(models="31,1,12,21")
## Custom Conclave Created
Chairman (#31): deepseek/deepseek-r1
Members:
  - #1: anthropic/claude-opus-4.5
  - #12: google/gemini-2.5-pro
  - #21: google/gemini-2.5-flash

> conclave_quick("What is the best approach for...")
[Uses your custom selection]

> conclave_reset
## Custom Conclave Cleared

配置

编辑 config.py 进行自定义:

Conclave 层级

每个层级都有独特的模型(无重叠),以实现适当的价格/性能差异化:

# Premium: 6 frontier models for complex questions (~$0.30-0.50/query)
COUNCIL_PREMIUM = [
    "anthropic/claude-opus-4.5",        # Claude Opus 4.5
    "google/gemini-3-pro-preview",      # Gemini 3 Pro
    "x-ai/grok-4",                      # Grok 4 (full reasoning)
    "openai/gpt-5.1",                   # GPT-5.1 (flagship)
    "deepseek/deepseek-v3.2-speciale",  # DeepSeek V3.2 Speciale
    "moonshotai/kimi-k2-thinking",      # Kimi K2 Thinking (1T MoE)
]

# Standard: 4 balanced models (default) (~$0.10-0.20/query)
COUNCIL_STANDARD = [
    "anthropic/claude-sonnet-4.5",      # Claude Sonnet 4.5
    "google/gemini-2.5-pro",            # Gemini 2.5 Pro
    "openai/o4-mini",                   # OpenAI o4-mini
    "deepseek/deepseek-chat-v3.1",      # DeepSeek Chat V3.1
]

# Budget: 4 cheap/fast models (~$0.02-0.05/query)
COUNCIL_BUDGET = [
    "google/gemini-2.5-flash",          # Gemini 2.5 Flash
    "qwen/qwen3-235b-a22b:free",        # Qwen 3 235B (free tier)
    "openai/gpt-4.1-mini",              # GPT-4.1 Mini
    "moonshotai/kimi-k2:free",          # Kimi K2 (free tier)
]

主席轮换

主席池仅使用推理模型(非聊天模型)以进行高质量的综合:

CHAIRMAN_ROTATION_ENABLED = True
CHAIRMAN_ROTATION_DAYS = 7  # Rotate weekly

CHAIRMAN_POOL = [
    "deepseek/deepseek-r1",          # DeepSeek R1 reasoning
    "openai/o3-mini",                # OpenAI o3-mini reasoning
    "anthropic/claude-sonnet-4",     # Claude Sonnet 4 (strong reasoning)
    "qwen/qwq-32b",                  # Qwen QWQ reasoning model
]

共识阈值

CONSENSUS_STRONG_THRESHOLD = 0.75   # 75%+ agreement
CONSENSUS_MODERATE_THRESHOLD = 0.50  # 50-75% agreement
CHAIRMAN_TIEBREAKER_ENABLED = True   # Chairman breaks ties

轻量级评估 (Eval-Light)

一个独立的基准测试运行器,用于测试和比较 Conclave 在不同层级和时间跨度下的性能。

测试套件概述

评估套件包括 9 个类别 中的 16 个任务,旨在测试不同的模型能力:

类别

任务

难度

测试内容

math

2

简单-中等

算术、应用题、逐步推理

code

2

简单-中等

错误检测、概念解释、代码示例

reasoning

2

中等-困难

三段论、多步逻辑谜题

analysis

2

中等

逻辑谬误、权衡分析

summarization

2

中等

技术文档、商业报告

writing_business

2

简单-中等

专业邮件、提案

writing_creative

2

简单-中等

故事开头、原创隐喻

creative

1

简单

带解释的类比

factual

1

简单

面向大众的科学解释

运行评估

# Run all 16 tests at standard tier (default)
python eval.py

# Run at different tiers
python eval.py --tier premium    # 6 frontier models (~$0.30-0.50/query)
python eval.py --tier standard   # 4 balanced models (~$0.10-0.20/query)
python eval.py --tier budget     # 4 cheap/fast models (~$0.02-0.05/query)

# Different modes
python eval.py --mode quick      # Stage 1 only (fastest, cheapest)
python eval.py --mode ranked     # Stage 1 + 2 (adds peer rankings)
python eval.py --mode full       # All 3 stages (default, includes synthesis)

# Filter by category
python eval.py --category math
python eval.py --category code
python eval.py --category reasoning

# Don't save results to disk
python eval.py --no-save

# Combine options
python eval.py --tier premium --mode full --category reasoning

输出格式

结果保存到 evals/eval_<tier>_<mode>_<timestamp>.json,包含:

  • metadata:时间戳、层级、模式、主席模型

  • summary:成功率、总时间、每个任务的平均时间

  • results:每个任务的详细信息,包括:

    • 个人模型响应

    • 同行排名(针对排名/全面模式)

    • 主席综合(针对全面模式)

    • 共识水平

输出示例

🏛️  Conclave Eval-Light
   Tier: standard | Mode: full | Tasks: 16
--------------------------------------------------

[1/16] Running: math_arithmetic (math)
   ✓ Completed in 12.34s

[2/16] Running: math_word_problem (math)
   ✓ Completed in 15.67s
...

==================================================
📊 EVAL SUMMARY
==================================================
Tier: standard | Mode: full
Chairman: deepseek/deepseek-r1
Tasks: 16/16 successful
Total time: 287.45s
Avg per task: 17.97s

📋 Results by Task:
  ✓ math_arithmetic (easy) - 12.34s
  ✓ math_word_problem (medium) - 15.67s
  ✓ code_debug (easy) - 11.23s
  ...

💾 Results saved to: evals/eval_standard_full_20251204_143052.json

比较层级

在所有层级运行相同的评估,以比较模型质量与成本:

python eval.py --tier budget --category reasoning
python eval.py --tier standard --category reasoning
python eval.py --tier premium --category reasoning

然后比较 JSON 输出,查看不同模型层级在相同任务上的表现。

使用场景

场景

推荐工具

原因

“审查此函数”

conclave_ranked

查看哪个模型捕获的问题最多

“Redis vs PostgreSQL 用于会话?”

conclave_full

重要决策,需要综合意见

“此功能的创意”

conclave_quick

快速多样化的头脑风暴

“调试此错误”

conclave_quick

快速并行诊断

“重写此段落”

conclave_full + chairman_preset="creative"

创意综合

“此架构是否合理?”

conclave_full + chairman_preset="code"

技术综合

工具输出示例

## Conclave Full Result

**Consensus: ✅ STRONG** (75% agreement)

---

### Chairman's Synthesis

_Chairman: deepseek/deepseek-r1_

[Synthesized answer incorporating best points from all models...]

---

### Model Rankings (lower is better)

1. **claude-sonnet-4.5**: 1.50
2. **o4-mini**: 2.00
3. **gemini-2.5-pro**: 2.75
4. **deepseek-v3.1**: 3.75

_First-place votes:_ claude-sonnet-4.5=3, o4-mini=1

项目结构

conclave-mcp/
├── server.py      # MCP server entry point (5 tools)
├── conclave.py    # Core 3-stage council logic
├── config.py      # Model tiers, chairman rotation, cost estimates
├── eval.py        # Standalone benchmark runner
└── evals/         # Saved evaluation results

添加模型

OpenRouter 支持 200 多种模型。在 https://openrouter.ai/models 查找模型 ID

# Add to COUNCIL_* lists in config.py
"x-ai/grok-4"                    # xAI Grok
"meta-llama/llama-4-maverick"    # Meta Llama
"mistralai/mistral-large-2"      # Mistral
"deepseek/deepseek-r1"           # DeepSeek reasoning

重要:保持每个层级的模型唯一(无重叠),以实现适当的差异化。

OpenRouter 的工作原理

OpenRouter 是一个统一的 API 网关——你不需要拥有 OpenAI、Google、Anthropic 等的独立账户。一个 API 密钥,一个信用余额,即可访问所有模型。

  • 注册:https://openrouter.ai

  • 充值(预付,或启用自动充值)

  • 对所有模型使用你的单一 API 密钥

许可证

MIT

归属

灵感来源于 Andrej Karpathy 的 llm-council。原版是一个用于交互式探索 LLM 比较的 Web 应用程序。本项目将委员会概念重新实现为 MCP 服务器,以便与 AI 辅助编辑器集成,并增加了共识协议和决胜机制。

Available Tools

8 tools
conclave_configA

View current conclave configuration.

Shows conclave member models, current chairman with rotation info, available chairman presets, consensus thresholds, and API key status.

Also shows custom conclave selection if active.

Returns: Current configuration as formatted JSON

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden. It discloses that this is a read-only operation ('View') and describes the return format ('formatted JSON'), but lacks details on permissions, rate limits, or error behavior. It adds some context about what data is included, which is helpful but not comprehensive.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is front-loaded with the core purpose, followed by specific details in bullet-like structure, and ends with return information. Every sentence adds value without redundancy, making it efficient and well-organized.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (configuration viewing with multiple data points), no annotations, and an output schema present, the description is mostly complete. It lists what data is shown and the return format, but could improve by mentioning sibling differentiation or behavioral constraints like authentication needs.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool has 0 parameters with 100% schema description coverage, so no parameter documentation is needed. The description correctly doesn't discuss parameters, earning a high baseline score for not adding unnecessary information.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the specific action ('View current conclave configuration') and lists the exact resources it shows (member models, chairman info, presets, thresholds, API key status, custom selection). It distinguishes from siblings like 'conclave_estimate' or 'conclave_reset' by focusing on configuration viewing rather than estimation or resetting.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives like 'conclave_models' (which might show models only) or 'conclave_full' (unclear purpose). It implies usage for viewing configuration but doesn't specify scenarios, prerequisites, or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

conclave_estimateA

Estimate cost for a conclave query before running it.

Provides approximate cost breakdown for quick/ranked/full query types.

Args: question: The question (used to estimate token count) tier: Which tier to estimate - "quick", "ranked", "full" (default: all)

Returns: Cost estimates for each query type

ParametersJSON Schema
NameRequiredDescriptionDefault
questionYes
tierNo

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.2/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden. It discloses that the tool provides 'approximate cost breakdown' and estimates based on token count, which adds useful behavioral context. However, it doesn't mention potential limitations like accuracy, rate limits, or authentication needs, leaving gaps for a tool with no annotation coverage.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is appropriately sized and front-loaded: the first sentence states the core purpose, followed by brief elaboration. Every sentence adds value without redundancy, and the structure with 'Args:' and 'Returns:' sections enhances readability without unnecessary verbosity.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 2 parameters with 0% schema coverage and an output schema present, the description is mostly complete. It explains parameters and return values ('Cost estimates for each query type'), but could benefit from more detail on behavioral aspects like error handling or prerequisites, especially since no annotations are provided.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It adds meaning beyond the schema by explaining that 'question' is 'used to estimate token count' and 'tier' specifies 'quick/ranked/full query types' with a default of 'all'. This clarifies parameter purposes, though it doesn't detail format constraints or examples.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose: 'Estimate cost for a conclave query before running it.' It specifies the verb ('estimate'), resource ('cost'), and scope ('before running it'), distinguishing it from sibling tools like conclave_quick or conclave_full that likely execute queries rather than estimate costs.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides clear context for when to use this tool: 'before running it' implies it's for pre-execution cost estimation. However, it doesn't explicitly state when not to use it or name alternatives among siblings, such as comparing to conclave_config or conclave_select, which might have overlapping or related purposes.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

conclave_fullA

Run the full conclave with synthesis (all 3 stages).

Most comprehensive - collects opinions, peer rankings, then has a Chairman model synthesize the best possible answer from the collective wisdom.

If a custom conclave is active (via conclave_select), it will be used instead of the tier-based config. The custom chairman overrides the chairman and chairman_preset parameters.

Args: question: The question to ask the conclave tier: Model tier - "premium" (complex), "standard" (default), "budget" (simple) Ignored if custom conclave is active. chairman: Override chairman model (e.g., 'anthropic/claude-sonnet-4') Ignored if custom conclave is active. chairman_preset: Use a context-based preset - "code", "creative", "reasoning", "concise", "balanced" Ignored if custom conclave is active.

Returns: Chairman's synthesis, consensus level, rankings, and individual responses

ParametersJSON Schema
NameRequiredDescriptionDefault
questionYes
tierNostandard
chairmanNo
chairman_presetNo

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.7/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden and does well by explaining the multi-stage process ('collects opinions, peer rankings, then has a Chairman model synthesize'), the override behavior with custom conclaves, and what the tool returns. It doesn't mention rate limits, auth needs, or error conditions, but provides substantial behavioral context beyond basic functionality.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is appropriately sized and front-loaded with the core purpose first. The Args and Returns sections are well-structured. Some sentences could be slightly more concise, but overall it's efficient with zero wasted text.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (multi-stage synthesis with overrides), no annotations, and 0% schema coverage, the description provides complete context. It explains the process, parameter semantics, conditional behavior, and return values. The output schema exists, so the description appropriately doesn't need to detail return structure.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters5/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 0% schema description coverage, the description fully compensates by explaining all 4 parameters in detail: what 'question' is for, the meaning of 'tier' values, what 'chairman' overrides, and the purpose of 'chairman_preset' options. It also clarifies conditional behavior ('Ignored if custom conclave is active') that isn't in the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose with specific verbs ('Run the full conclave with synthesis') and resources ('all 3 stages'), and distinguishes it from siblings by emphasizing it's the 'most comprehensive' option that includes synthesis. It explicitly mentions what makes it different from other conclave tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides explicit guidance on when to use this tool ('Most comprehensive') and when parameters are ignored ('Ignored if custom conclave is active'). It also implies alternatives through sibling tool names like conclave_quick and conclave_ranked, giving clear context for selection.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

conclave_modelsA

List all available models with selection numbers.

Shows all models from all tiers with unique numbers that can be used with conclave_select to create a custom conclave.

Numbers are stable:

  • Premium tier: 1-10

  • Standard tier: 11-20

  • Budget tier: 21-30

  • Chairman pool: 31-40

Returns: Numbered list of all available models grouped by tier

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.5/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden and does well by disclosing key behavioral traits: it lists models grouped by tier, specifies that numbers are stable with defined ranges per tier, and describes the return format as a numbered list. It doesn't mention aspects like rate limits or authentication needs, but covers essential behavior adequately for a read-only tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is front-loaded with the core purpose in the first sentence, followed by supporting details in bullet points and a returns section. Every sentence earns its place by adding specific information about tiers, number stability, and usage context without any redundant or vague statements.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (0 parameters, no annotations, but with an output schema), the description is complete. It explains the purpose, behavioral context (stable numbers per tier), usage with 'conclave_select', and return format. The output schema likely details the structure, so the description doesn't need to exhaustively list return values, making it well-rounded for this context.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 0 parameters with 100% coverage, so no parameter documentation is needed. The description appropriately focuses on output semantics, explaining the numbered list structure and tier groupings. This adds value beyond the schema by clarifying what the tool returns, which is helpful given the presence of an output schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List' and resource 'all available models with selection numbers', specifying it shows models from all tiers with unique numbers. It distinguishes from siblings by mentioning these numbers are used with 'conclave_select' to create custom conclaves, providing specific differentiation.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides clear context by explaining that the numbers are used with 'conclave_select' for custom conclave creation, giving a specific when-to-use scenario. However, it doesn't explicitly state when not to use this tool or compare it to alternatives like 'conclave_quick' or 'conclave_full', which could help further differentiate usage.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

conclave_quickA

Query the conclave for quick parallel opinions (Stage 1 only).

Fast and cheap - queries all conclave models in parallel and returns their individual responses. No peer ranking or synthesis. Good for getting diverse perspectives quickly.

If a custom conclave is active (via conclave_select), it will be used instead of the tier-based config.

Args: question: The question to ask the conclave tier: Model tier - "premium" (frontier), "standard" (default), "budget" (cheap/fast) Ignored if custom conclave is active.

Returns: Individual responses from each conclave model

ParametersJSON Schema
NameRequiredDescriptionDefault
questionYes
tierNostandard

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.6/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries full burden and does well by disclosing key behavioral traits: it's 'Fast and cheap', queries 'all conclave models in parallel', returns 'individual responses' without synthesis, and mentions the interaction with conclave_select for custom conclaves. It doesn't cover rate limits, authentication needs, or error handling, but provides substantial operational context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is perfectly structured and concise: purpose statement first, key characteristics next, behavioral notes, then parameter details in labeled sections. Every sentence earns its place with no redundancy or fluff. The use of sections (Args, Returns) enhances readability.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 2 parameters with 0% schema coverage and no annotations, the description does an excellent job explaining parameters and behavioral context. The existence of an output schema means it doesn't need to detail return values. It could mention more about error cases or prerequisites, but covers the essential context well for this query tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It adds meaningful semantics for both parameters: 'question' is described as 'The question to ask the conclave', and 'tier' gets detailed explanation of values ('premium', 'standard', 'budget') with defaults and the override rule when custom conclave is active. This goes well beyond the bare schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose with specific verbs ('Query the conclave for quick parallel opinions') and distinguishes it from siblings by specifying 'Stage 1 only', 'Fast and cheap', 'No peer ranking or synthesis', and 'Good for getting diverse perspectives quickly'. It explicitly differentiates from tools like conclave_full or conclave_ranked that likely involve synthesis or ranking.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides explicit guidance on when to use this tool ('Good for getting diverse perspectives quickly') and when not to use it ('Stage 1 only', 'No peer ranking or synthesis'). It also mentions the alternative of using a custom conclave via conclave_select, though it could be more explicit about other sibling alternatives like conclave_full or conclave_ranked.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

conclave_rankedA

Query the conclave with peer rankings (Stage 1 + 2).

Medium cost - gets individual opinions, then has each model anonymously evaluate and rank all responses. Returns aggregate "street cred" scores showing which models performed best on this specific question.

If a custom conclave is active (via conclave_select), it will be used instead of the tier-based config.

Args: question: The question to ask the conclave tier: Model tier - "premium" (frontier), "standard" (default), "budget" (cheap/fast) Ignored if custom conclave is active.

Returns: Individual responses plus aggregate rankings

ParametersJSON Schema
NameRequiredDescriptionDefault
questionYes
tierNostandard

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden. It discloses key behavioral traits: the two-stage process (individual opinions then anonymous ranking), cost level ('medium cost'), and the effect of 'conclave_select'. However, it doesn't cover important aspects like rate limits, authentication needs, error handling, or what 'street cred' scores entail, leaving gaps for a tool with no annotation support.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is appropriately sized and front-loaded, starting with the core purpose. The sentences are efficient, but the 'Args' and 'Returns' sections could be integrated more seamlessly, and some phrasing ('medium cost') is slightly vague, slightly reducing conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given complexity (multi-stage ranking process), no annotations, and an output schema present, the description is mostly complete. It covers the process, parameters, and return overview, but lacks details on output structure or error cases, which the output schema might handle, making it adequate but not fully comprehensive.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It explains 'question' as 'the question to ask the conclave' and 'tier' with values and default, adding meaning beyond the bare schema. However, it doesn't detail format constraints for 'question' or fully explain 'tier' implications beyond the list, resulting in partial compensation for the low coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool 'queries the conclave with peer rankings' and specifies it involves 'Stage 1 + 2' processing, which distinguishes it from simple query tools. However, it doesn't explicitly differentiate from siblings like 'conclave_full' or 'conclave_quick' in terms of ranking methodology, leaving some ambiguity about sibling differentiation.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides clear context for usage: it mentions 'medium cost' and explains when to use it (for getting individual opinions and aggregate rankings). It also notes that a custom conclave via 'conclave_select' overrides the tier parameter, offering some alternative guidance. However, it lacks explicit when-not-to-use scenarios or comparisons to specific siblings like 'conclave_estimate' or 'conclave_quick'.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

conclave_resetA

Clear custom conclave selection and return to tier-based config.

After reset, queries will use the tier parameter (premium/standard/budget) instead of the custom model selection.

Returns: Confirmation that custom selection was cleared

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries full burden and does well by disclosing the behavioral outcome ('clear custom selection', 'return to tier-based config', 'queries will use tier parameter') and return value ('Confirmation that custom selection was cleared'), though it lacks details on permissions or side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

It is front-loaded with the core action in the first sentence, followed by outcome and return details in clear, efficient sentences. Every sentence adds value without waste, making it highly concise and well-structured.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (0 parameters, no annotations, but has output schema), the description is nearly complete by explaining the reset action, post-reset behavior, and return value. It could slightly improve by mentioning any prerequisites or errors, but covers essentials well.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool has 0 parameters with 100% schema description coverage, so no parameter info is needed. The description appropriately focuses on behavior and output, earning a baseline 4 for not adding unnecessary details beyond the empty schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the specific action ('Clear custom conclave selection') and the resource affected ('tier-based config'), distinguishing it from siblings like conclave_config or conclave_select that likely configure or choose models rather than resetting to defaults.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It implicitly indicates usage context ('return to tier-based config') and the effect ('queries will use the tier parameter'), but does not explicitly state when to use this vs. alternatives like conclave_config or what triggers a reset need, missing explicit exclusions or prerequisites.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

conclave_selectA

Create a custom conclave from model numbers.

Select specific models by their numbers (from conclave_models). The first model in the list becomes the chairman.

This custom selection persists until server restart or conclave_reset.

Args: models: Comma-separated model numbers, e.g. "1,5,11,14" First number = chairman, rest = conclave members

Returns: Confirmation of the new conclave configuration

Example: conclave_select(models="31,1,11,21") creates: - Chairman: model #31 (deepseek-r1) - Members: models #1, #11, #21

ParametersJSON Schema
NameRequiredDescriptionDefault
modelsYes

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.6/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden and does so well. It discloses key behavioral traits: the custom selection persists until server restart or conclave_reset, the first model becomes chairman, and it references sibling tools (conclave_models, conclave_reset) for context. It doesn't mention permissions, rate limits, or error handling, but covers persistence and structure adequately.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is well-structured and front-loaded with the core purpose, followed by usage details, persistence, args, returns, and an example. Every sentence adds value without redundancy, and the example efficiently illustrates the tool's behavior.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (custom conclave creation with persistence), no annotations, and an output schema present, the description is complete. It covers purpose, usage, parameters, behavioral traits, and includes an example, making it sufficient for an AI agent to understand and invoke the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters5/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema description coverage is 0%, so the description must compensate, which it does excellently. It explains the 'models' parameter as comma-separated model numbers, specifies the first number is chairman and the rest are members, provides an example format, and clarifies the mapping to specific models (e.g., model #31 = deepseek-r1).

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose: 'Create a custom conclave from model numbers' with specific actions like selecting models and designating a chairman. It distinguishes from siblings by focusing on custom selection rather than configuration, estimation, or resetting.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides clear context for when to use this tool: to create a custom conclave from specific model numbers, with the first model as chairman. It mentions persistence until server restart or conclave_reset, but does not explicitly state when to use alternatives like conclave_quick or conclave_ranked.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

  1. 8 tool updatesv0.2.0
    • First observedconclave_config
    • First observedconclave_estimate
    • First observedconclave_full
    • First observedconclave_models
    • First observedconclave_quick
    • First observedconclave_ranked
    • First observedconclave_reset
    • First observedconclave_select

TDQS

A4.3/5.0

Scored across 8 tools

Disambiguation5/5

Each tool has a clearly distinct purpose with no ambiguity. For example, conclave_quick, conclave_ranked, and conclave_full represent distinct stages of query processing, while conclave_select and conclave_reset manage custom configurations, and conclave_models and conclave_config provide informational views. The descriptions clearly differentiate their roles.

Naming Consistency5/5

All tool names follow a consistent snake_case pattern with a 'conclave_' prefix and descriptive suffixes (e.g., conclave_config, conclave_estimate, conclave_full). This uniformity makes the tool set predictable and easy to understand, enhancing usability for agents.

Tool Count5/5

With 8 tools, the server is well-scoped for its purpose of managing and querying a conclave of models. Each tool serves a specific function, such as configuration, estimation, querying at different stages, and model selection, without redundancy or unnecessary complexity.

Completeness5/5

The tool set provides complete coverage for the conclave domain, including configuration viewing, cost estimation, querying at all stages (quick, ranked, full), model listing, custom selection, and resetting. There are no obvious gaps; agents can perform the full lifecycle from setup to querying and cleanup.

Maintenance

ActivityInactive
ResponsivenessNo issues

Related MCP Connectors

Related MCP Servers