Skip to main content
Glama

delimit_test_smoke

Automatically detect test framework from project config, run smoke tests, and output pass/fail/error counts.

Instructions

Run smoke tests for a project.

Detects the test framework (pytest/jest/vitest/mocha) from project config, runs the test suite, and parses pass/fail/error counts.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
project_pathYesProject path.
test_suiteNoSpecific test suite to run.

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault

No arguments

Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description carries full burden. While it describes detection and parsing, it does not disclose whether running tests modifies project state, required permissions, or potential side effects. Only basic behavior is revealed.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences, no redundant information. First sentence states purpose, second elaborates on process. Highly concise and well-structured.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple tool with 2 parameters and output schema existing, description covers the core behavior. However, missing details about preconditions or permission requirements, but overall adequate.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema covers both parameters with descriptions (100% coverage). Description adds context about framework detection but does not substantially enhance parameter understanding beyond schema. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states it runs smoke tests for a project, detects test framework, and parses results. Specific verb+resource distinguishes from sibling test tools like delimit_test_coverage and delimit_test_generate.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Implies usage for smoke testing but lacks explicit when/not to use or alternatives. Context is clear from name and description, but no mention of prerequisites or cases where other tools are preferred.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/delimit-ai/delimit-mcp-server'

If you have feedback or need assistance with the MCP directory API, please join our Discord server