Skip to main content
Glama

evaluate_diff

Analyze only modified lines in a code diff by running all 45 judges on the full file and filtering findings to the specified line changes. Supports PR reviews and incremental analysis.

Instructions

Evaluate only the changed lines in a code diff. Runs all 45 judges on the full file but filters findings to only those affecting the specified changed lines. Ideal for PR reviews and incremental analysis.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
codeYesThe full file content (post-change)
configNoOptional inline configuration (same format as .judgesrc)
contextNoOptional context about the change
languageYesThe programming language
changedLinesYesArray of 1-based line numbers that were changed (added or modified)
minConfidenceNoMinimum finding confidence to include (0-1, default: 0)
includeAstFindingsNoInclude AST/code-structure findings (default: true)
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description discloses that all 45 judges run on the full file but findings are filtered to changed lines, explaining the underlying behavior. No annotations are provided, so this is valuable context. It does not mention performance implications, but the core pipeline is transparent.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two concise sentences with zero waste. It is front-loaded with the key purpose and immediately provides the unique filtering behavior.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Despite 7 parameters and a nested config object, the description explains the core mechanism (full analysis + filter) and mentions 45 judges. No output schema exists, but the description is still informative. A complete outline of the return value is missing but not critical.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the schema already describes all parameters. The description adds no additional meaning beyond briefly referencing changed lines. Baseline 3 is appropriate as the description does not enhance parameter understanding.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'evaluate' and the resource 'changed lines in a code diff', distinguishing it from sibling tools like evaluate_code (which evaluates entire file) and evaluate_git_diff. It specifies the unique filtering behavior.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly recommends the tool for 'PR reviews and incremental analysis,' providing clear context for use. It does not mention when not to use it or list alternative tools, but the context is sufficient.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/KevinRabun/judges'

If you have feedback or need assistance with the MCP directory API, please join our Discord server