feature-separate-batch-eval-mcp
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@feature-separate-batch-eval-mcpfind cross-patent batch issues in the saved patent evaluations"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
feature-separate-batch-eval-mcp
独立读取 feature-separate-eval-mcp 已落盘的单篇专利评测,发现单篇报告无法建立的跨专利问题。它不会修改现有 MCP、ledger 或单篇评测 JSON。
判定边界
只分析
input_kind=patent且包含完整专利号、claims、Judge 规则版本和claim_text_source=patsnap-clms-original的记录。旧版强制lang=cn生成的评测不参与聚合,避免把外国专利译文误当中文原文。同一 cohort、同一专利只计一次,默认保留最新有效评测。
每个候选问题至少需要 10 篇支持专利和 10 篇对照专利。
只发现语言差异、技术领域差异、输入结构敏感性和语言×结构交互。
“已有单篇错误出现很多次”不算新问题;候选必须增加跨样本条件、对照或交互关系。
不生成 Prompt 修改、后处理或其他修复建议。
Related MCP server: Patronus MCP Server
安装
需要 Python 3.10+:
python3.10 -m venv .venv
.venv/bin/pip install -e ".[test]"
cp .env.example .env让 CC_EVAL_DATA_DIR 指向单篇评测使用的同一目录。批量产物默认写入其 batch_analysis/ 子目录,也可用 FEATURE_SEPARATE_BATCH_DATA_DIR 指定独立路径。
连接 Claude Code:
claude mcp add --scope local --transport stdio feature-separate-batch-eval -- \
/absolute/path/.feature-separate-batch-eval-mcp/.venv/bin/feature-separate-batch-eval-mcpTools
feature_separate_batch_eval_status:扫描专利评测与 cohort,零网络调用。feature_separate_batch_eval_tag:写独立 sidecar,为记录登记 cohort、服务版本和实验标签,零网络调用。feature_separate_batch_eval_check:检查样本门槛、对照组与规则版本,零网络调用。feature_separate_batch_eval_run:补充 IPC/CPC,生成确定性统计候选并让 Judge 做语义新颖性审查。feature_separate_batch_eval_insights:读取已确认的新问题,零网络调用。
run 的 allow_network 默认为 false。开启前必须告知用户:PatSnap 只接收未缓存记录的专利号并仅请求 IPC/CPC;IPC/CPC 不可用时 Judge 接收 claim 摘要用于领域分类;Judge 还接收确定性候选统计和单篇问题池用于语义去重。
Judge HTTP 请求默认超时为 300 秒;.env.example 显式设置
CLAIM_DECOMPOSITION_JUDGE_TIMEOUT=300。真实 token 只保存在未跟踪的本地 .env
或进程环境中,不进入模型输入、日志或批量产物。
测试
.venv/bin/pytestAvailable Tools
5 toolsfeature_separate_batch_eval_checkC
Validate one cohort and show comparison readiness; never uses network.
| Name | Required | Description | Default |
|---|---|---|---|
| cohort_id | Yes | ||
| minimum_support | No |
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden, and it does disclose one behavioral trait: 'never uses network,' which tells the agent this is a local/safe read-style operation. That is genuinely useful. However, it says nothing about read-only status, error behavior, what 'comparison readiness' means if the cohort fails validation, or any side effects, leaving significant behavioral gaps for a tool with zero annotation coverage.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single compact sentence with no filler and front-loads the action. It is efficient, though the brevity comes at the cost of completeness rather than being a model of useful concision.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with two parameters (one required, zero schema descriptions), no annotations, and four similar siblings, the description is too thin. It omits all parameter meaning, provides no routing guidance versus siblings, and only hints at the validation outcome despite an output schema existing. The one behavioral disclosure ('never uses network') is the sole substantive addition.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%: neither 'cohort_id' nor 'minimum_support' has a description in the schema. The tool description mentions neither parameter, so it does not compensate at all. The agent has no idea what format cohort_id takes, what minimum_support controls, or how the default of 10 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states a verb ('Validate') and resource ('one cohort') and adds the deliverable ('show comparison readiness'), which is clearer than a bare name. However, it does not distinguish this tool from its four siblings (status, tag, run, insights), all of which share the eval-batch prefix. An agent gets partial understanding of the purpose but cannot confidently route between the siblings based on the description.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
There is no explicit guidance on when to use this versus the sibling tools. The phrase 'show comparison readiness' implies a preparatory check step, but neither alternatives nor exclusions are named. The agent must infer usage from context alone.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
feature_separate_batch_eval_insightsB
List persisted batch-only insights; never uses network.
| Name | Required | Description | Default |
|---|---|---|---|
| cohort_id | No |
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden, and it does disclose one meaningful trait: 'never uses network', implying a local, safe read. However it says nothing about permissions, whether results are cached/stale, or idempotency, so it only partially covers the behavioral burden.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
A single front-loaded sentence with zero filler; the key resource comes first and the offline trait follows. It is efficient, though the extreme terseness leaves little room for the missing usage and parameter context.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
An output schema exists, so return values need not be explained. But for a tool with an undocumented optional filter and several closely related siblings, the description omits both usage routing and parameter meaning, leaving the definition only minimally viable.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0% and the single parameter (cohort_id) is not mentioned in the description at all. Since coverage is low, the description was expected to compensate but adds no meaning about what cohort_id filters or that it is optional/nullable.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description names a specific verb (List) and resource (persisted batch-only insights), which distinguishes it reasonably from a status/check/tag/run sibling. It does not explicitly say how it differs from those siblings, but 'insights' vs 'status'/'run' is a fairly clear resource distinction.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
There is no guidance on when to call this tool versus its siblings (_status, _check, _run) or what state must exist first (e.g. whether a batch eval must have run). The only contextual note is that it is offline, which is a behavioral trait rather than a when-to-use rule.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
feature_separate_batch_eval_runC
Discover batch-only issues after explicit network-scope confirmation.
| Name | Required | Description | Default |
|---|---|---|---|
| cohort_id | Yes | ||
| allow_network | No | ||
| minimum_support | No |
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full behavioral burden. It implies network access ('explicit network-scope confirmation'), but says nothing about whether the run mutates state, how long it takes, whether it can be repeated, or what permissions are needed — significant gaps for a tool that triggers an evaluation run.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
A single eight-word sentence is compact and front-loads the outcome, but the brevity comes at the cost of missing information rather than being efficient. It is short, not pointed.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With three parameters at 0% description coverage, no annotations, and no parameter guidance in the description, an agent cannot reliably construct a call. The output schema is present so return values need not be described, but the input side is left almost entirely undocumented.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must compensate and does not. 'Network-scope confirmation' loosely gestures at allow_network, but cohort_id (required) and minimum_support (default 10) receive no explanation of format, meaning, or impact anywhere.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The phrase 'Discover batch-only issues' names an outcome but not a concrete verb+resource pairing, and 'batch-only' is not defined. With four sibling tools (status, tag, check, insights) that all operate on the same batch-eval feature, the description does nothing to distinguish this 'run' tool from the others.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
'After explicit network-scope confirmation' implies a precondition and hints at ordering, but it never states when to choose this tool over check, insights, or status. No exclusions or alternatives are given, so the agent must guess the sequencing.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
feature_separate_batch_eval_statusB
List cohorts and sample readiness; never uses network.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full behavioral burden, and it does disclose one non-obvious trait: "never uses network" (i.e., a safe, offline/local read). However, it never explicitly states read-only safety, permissions, or what the operation returns, so it only partially compensates for the absent annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two short clauses, front-loaded with the action ("List cohorts...") and followed by the most decision-relevant constraint ("never uses network"). It is efficient, though arguably under-specified rather than genuinely concise.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
An output schema exists, so return values need not be described. But for a status tool among four near-neighbor siblings, the description is too thin to let an agent confidently choose it over check or insights, leaving a real ambiguity gap.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool takes zero parameters, so the baseline is 4; there is nothing for the description to clarify beyond what the empty schema already conveys.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states a verb+resource ("List cohorts and sample readiness"), but the domain terms are opaque and it does not distinguish this status tool from siblings like feature_separate_batch_eval_check or feature_separate_batch_eval_insights, which plausibly overlap in reporting readiness or evaluation state.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
There is no guidance on when to use this tool versus the four sibling eval tools, nor any preconditions or exclusions. The agent is left to infer that this is a status/inspection call from the verb "List" alone.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
feature_separate_batch_eval_tagC
Assign patent evaluation records to a comparable cohort; never uses network.
| Name | Required | Description | Default |
|---|---|---|---|
| cohort_id | Yes | ||
| record_ids | Yes | ||
| experiment_tag | Yes | ||
| service_version | Yes |
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It adds one behavioral fact ('never uses network'), but for an assignment/mutation tool it omits permissions, idempotency, reversibility, and what happens to records not assigned. This is a significant gap.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
One short sentence with no filler, but the semicolon appends an isolated behavioral note and the overall structure is too terse for a four-parameter mutation. It is concise but lacks useful front-loading for the operation's complexity.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Although an output schema exists to cover return values, the description is inadequate for a 4-parameter required mutation with no annotations. It leaves parameter meanings, mutation effects, and selection criteria unexplained, so an agent cannot invoke it correctly without guessing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0% across four required parameters. The description adds no meaning to record_ids, cohort_id, service_version, or experiment_tag. It does not compensate for the missing schema descriptions at all.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
States a specific verb 'Assign' and resource 'patent evaluation records' with a target 'comparable cohort'. However, it does not distinguish this from sibling tools like status, check, run, or insights, so it falls short of a 5.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Provides no when-to-use or when-not-to-use guidance. The phrase 'never uses network' is a behavioral trait, not usage direction, and no alternative sibling is mentioned. An agent has no basis for choosing this tool over the others.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
5 tool updates
v0.1.0- First observed
feature_separate_batch_eval_check - First observed
feature_separate_batch_eval_insights - First observed
feature_separate_batch_eval_run - First observed
feature_separate_batch_eval_status - First observed
feature_separate_batch_eval_tag
TDQS
Scored across 5 tools
Each tool targets a distinct action: status (list cohorts), tag (assign records), check (validate one cohort), run (execute network eval), insights (list persisted results). Status and check both touch 'readiness' and status/insights both list things, which introduces mild overlap, but descriptions keep them separable.
Every tool shares the consistent 'feature_separate_batch_eval_' prefix followed by a short suffix, forming a predictable pattern. Minor deviation in that tag/check/run are verbs while status/insights are nouns, but overall highly consistent.
Five tools is a reasonable, well-scoped set for a batch-evaluation workflow (readiness, tagging, validation, execution, insights). Slightly lean but each tool has a clear role without redundancy.
The core lifecycle (list readiness, assign cohorts, validate, run, retrieve insights) is covered, but there is no way to modify/remove cohort assignments or clear/export persisted insights, leaving some dead ends.
Maintenance
Related MCP Connectors
Semantic patent search & analysis: find, compare, and analyze patents by meaning.
Prompt evals over MCP: run a prompt on your dataset, score each output 1-5 with an LLM judge.
Remote MCP for Gemini upgrade evals, prompt regressions, output diffs, and eval receipts.
Find novel, statistically validated patterns in tabular data — hypothesis-free.
Related MCP Servers
- AlicenseAqualityDmaintenanceEnables analysis of clinical trial protocols using MCP tools for document listing, entity extraction, adverse event clustering, and summarization.41MIT

Patronus MCP Serverofficial
AlicenseNot gradedqualityDmaintenanceEnables running LLM evaluations, experiments, and custom evaluators through a standardized MCP interface.16Apache 2.0- AlicenseNot gradedqualityAmaintenanceEnables conversational patent data analysis through a set of tools for trend analysis, clustering, word cloud generation, and more. Allows natural language queries to explore patent datasets with structured results and visualizations.1AGPL 3.0
- AlicenseNot gradedqualityBmaintenanceEnables evidence-first game operations incident investigation through read-only MCP tools, including metric queries, cohort comparisons, anomaly detection, and reproducible incident report drafting with citations.76MIT