@lamatic/mcp
OfficialEnables browsing, searching, and validating AgentKit contributions on GitHub, including revalidating pull requests with an optional GitHub token.
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@@lamatic/mcpfind documentation for setting up a new project"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
@lamatic/mcp
The unified Model Context Protocol server for Lamatic.ai — manage your org, execute deployed flows, query the docs, and explore AgentKit, all from any MCP-compatible AI agent (Claude, Cursor, Claude Code, and more).
@lamatic/mcp merges four capabilities into a single server so your AI assistant can operate Lamatic end to end:
Prefix | What it does | Package it replaces |
| Manage orgs, projects, flows, contexts & credentials |
|
| Execute deployed Lamatic flows |
|
| Query Lamatic.ai documentation via RAG | hosted Docs MCP |
| Browse, search & validate AgentKit contributions | — |
Each namespace degrades independently — missing credentials for one prefix never break the others.
Requirements
Node.js ≥ 18
Related MCP server: mcp-canon
Install
No install needed — run it on demand with npx:
npx @lamatic/mcpOr install globally to expose the lamatic-mcp binary:
npm install -g @lamatic/mcp
lamatic-mcpSetup
Claude Desktop / Cursor / Claude Code
Add the server to your MCP config:
{
"mcpServers": {
"lamatic": {
"command": "npx",
"args": ["-y", "@lamatic/mcp"]
}
}
}Execution-only mode (single flow)
For GraphMCP's execution-only mode (no org key, single flow — e.g. the Studio "Connect with AI" snippet), pass env vars instead:
{
"mcpServers": {
"lamatic": {
"command": "npx",
"args": ["-y", "@lamatic/mcp"],
"env": {
"PROJECT_API_KEY": "<projectApiKey>",
"PROJECT_ID": "<projectId>",
"ENDPOINT": "<endpoint>",
"FLOW_ID": "<flowId>"
}
}
}
}GitHub token (optional, for AgentKit PR writes)
kit_revalidate_pr posts /validate comments to GitHub. Add a token to raise GitHub's API rate limit and enable comment writes:
{
"mcpServers": {
"lamatic": {
"command": "npx",
"args": ["-y", "@lamatic/mcp"],
"env": {
"GITHUB_TOKEN": "<github-personal-access-token>"
}
}
}
}Authentication
Prefix | How to authenticate |
|
|
|
|
| None — proxies to the public hosted endpoint |
| None for read/validate tools; GitHub token ( |
All credentials live in one namespaced file at ~/.lamatic/config.json:
{
"dev": { "apiKey": "...", "orgId": "...", "userId": "..." },
"graph": { "orgApiKey": "...", "projectApiKey": "...", "orgId": "..." },
"kit": { "githubToken": "..." }
}Available tools
dev_* — org, project, flow & credential management
Auth & projects
dev_auth_login— Authenticate with Lamatic DevMCPdev_list_projects— List all projects in your organizationdev_create_project— Create a new projectdev_get_project— Get details of a projectdev_update_project— Rename a projectdev_delete_project— Delete a projectdev_deploy_project— Deploy a project
Flows
dev_create_flow— Create a new flow in a projectdev_get_flows— List all flows in a projectdev_list_all_flows— List all flows for a projectdev_update_flow— Update a flow with new nodes and edgesdev_rename_flow— Rename a flowdev_update_flow_status— Change a flow's statusdev_delete_flow— Delete a flow
Contexts (vector / memory)
dev_create_context— Create a new vector or memory contextdev_get_context— Get details of a specific contextdev_get_all_contexts— List all contexts in a projectdev_delete_context— Delete a context
Deployments
dev_list_all_deployments— List all deployments for a projectdev_get_deployment— Get details of a specific deployment
Models
dev_list_model_providers— List available model providers (optionally their models)dev_list_model_creds— List model credentials for a projectdev_create_model_creds— Create model credentials for a providerdev_check_model_status— Check the availability status of a model
Integrations & credentials
dev_list_supported_integrations— List all supported integrationsdev_list_integration_creds— List integration credentials for a projectdev_create_integration_creds— Create integration credentialsdev_get_cred_info— Get details of a specific credentialdev_update_credential— Update an existing credentialdev_delete_credential— Delete a credentialdev_get_oauth_url— Get an OAuth authorization URL for an integration
graph_* — execute deployed flows
graph_auth_login— Authenticate with GraphMCP (only if not configured via env vars)graph_load_project_flows— Load all active flows with their input schemas (org-level access)graph_refresh_flows— Refresh and list all active flows for a project (org-level access)graph_execute_flow— Execute a deployed flow (flowIdoptional in single-flow mode)
docs_* — documentation Q&A
docs_query_docs— Ask any question about Lamatic.ai docs; RAG-powered, no auth required
kit_* — AgentKit browse, search & validation
kit_list— List all kits, bundles, and templates in the AgentKit repokit_get— Get full details for a kit (config, README, flows)kit_search— Search kits by type and/or tag/keywordkit_get_flow— Get the raw.tssource of a flow inside a kitkit_validate_structure— Run CI's Phase 1 structural checks against a local kit before opening a PRkit_check_pr_status— Check Phase 1/Phase 2 validation status and labels on an open PRkit_revalidate_pr— Trigger Phase 2 Studio re-validation by posting the/validatecomment (needs GitHub token)kit_auth_login— Store a GitHub token forkit_check_pr_statusandkit_revalidate_pr
Architecture notes
docs_*does not duplicate the RAG-calling logic from the Lamatic-MCP-Docs repo. It runs a thin MCP client (utils/docsProxy.js) that connects to the hosted endpoint (https://docmcp.lamatic.ai/api/mcp) and forwards the call. The standalone hosted endpoint keeps working unchanged for zero-install users.kit_*reads directly from the publicLamatic/AgentKitGitHub repo viautils/kitProxy.js— there is no hosted Kit API today. If one is ever stood up (the waydocs_*proxies to a hosted endpoint), the fetch calls inkitProxy.jsare the only thing that needs to change; tool signatures intools/kit.jsstay the same.kit_validate_structuremirrors the Phase 1 checks invalidate-pr.ymlby hand. There is no CI link between the two files today — if Phase 1's bash logic changes, this needs a matching manual update or the two will silently disagree on what counts as a valid kit.
Local development
git clone https://github.com/Lamatic/Lamatic-MCP.git
cd lamatic-mcp
npm install
node server.jsWindows setup
npx -y @lamatic/mcp won't work on Windows because npx can't determine the executable. Use the local path approach instead:
Clone the repo:
git clone https://github.com/Lamatic/Lamatic-MCP.git
cd Lamatic-MCP
npm installAdd to your
claude.jsonorclaude_desktop_config.json:
"lamatic": {
"type": "stdio",
"command": "node",
"args": ["C:/path/to/Lamatic-MCP/server.js"],
"env": {}
}Mac/Linux users can use npx directly:
"lamatic": {
"type": "stdio",
"command": "npx",
"args": ["-y", "@lamatic/mcp"],
"env": {}
}Available Tools
44 toolsdev_auth_loginC
Authenticate with Lamatic DevMCP
| Name | Required | Description | Default |
|---|---|---|---|
| orgId | Yes | ||
| apiKey | Yes | ||
| userId | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, and the description does not disclose what happens after authentication (e.g., token generation, session creation) or any side effects. The minimal information leaves the agent without understanding the behavioral implications.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence that is concise and front-loaded. However, it is too brief and sacrifices necessary details, making it only moderately effective.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given three required parameters, no output schema, and no annotations, the description is severely incomplete. It does not explain what the parameters do, what the authentication process returns, or any behavioral context, leaving the agent unable to use the tool effectively.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
With 0% schema description coverage, the description does not add any meaning to the three required parameters (apiKey, orgId, userId). It fails to explain their roles or how they should be used, leaving the agent with insufficient information to correctly invoke the tool.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states the verb 'Authenticate' and the resource 'Lamatic DevMCP', giving a basic understanding of the tool's function. However, it does not differentiate it from sibling tools like graph_auth_login or kit_auth_login, which also perform authentication for different environments.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
There is no guidance on when to use this tool versus the other auth tools, nor any prerequisites or context for authentication. The description simply states the action without any usage conditions.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_check_model_statusC
Check the availability status of a specific model
| Name | Required | Description | Default |
|---|---|---|---|
| modelName | Yes | The model name to check (e.g. command-r7b-12-2024) | |
| projectId | Yes | The project ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description bears full burden. It indicates a read operation ('check availability status') but does not disclose side effects, authentication requirements, or other behavioral traits beyond the basic action.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single short sentence with no filler. It is concise but could benefit from additional context without becoming verbose. It is minimally adequate.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (two parameters, no output schema), the description is minimally complete. It states the purpose but lacks additional context like possible status values or error conditions. It is acceptable but not thorough.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100% (both parameters have descriptions). The tool description does not add any additional meaning beyond what the schema provides. Baseline 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'Check' and the resource 'availability status of a specific model'. It specifies what the tool does, though it does not differentiate from sibling tools. However, no sibling tool has an identical purpose, so the description is sufficiently clear.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives, nor does it specify prerequisites or exclusions. It simply states the action without context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_create_contextB
Create a new context (vector or memory) in a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| name | Yes | Name of the context | |
| type | Yes | Type of context | |
| projectId | Yes | The project ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, and the description is too brief. It does not disclose behavioral traits such as idempotency, side effects, permission requirements, or what happens if a context with the same name already exists. For a mutation tool, this is insufficient.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, concise sentence that immediately communicates the action and resource. Every word is meaningful and front-loaded.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description lacks details about return values, constraints (e.g., name uniqueness, type implications), or error conditions. Given no output schema, more context is needed for a complete understanding.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100% with clear parameter descriptions in the schema. The tool description adds no extra meaning beyond the schema, meeting the baseline of 3.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action 'Create', the resource 'context', and specifies two types (vector or memory) and the project context. This distinguishes it from sibling tools like dev_get_all_contexts, dev_get_context, and dev_delete_context.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description does not explicitly provide when or when-not to use this tool versus alternatives. It is implied by the name and action, but lacks explicit guidance or exclusions.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_create_flowC
Create a new flow in a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| name | Yes | ||
| projectId | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided; description only says 'Create a new flow' without disclosing side effects, required permissions, or whether it is a mutation. Little behavioral context.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, clear and to the point. No wasted words, but could benefit from a bit more detail without losing conciseness.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With 2 parameters, no output schema, and no annotations, the description is too minimal. It omits what a 'flow' is, any constraints, or post-creation behavior.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0% and the description does not elaborate on the parameters (name, projectId). No added meaning beyond the parameter names.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description states specific verb 'Create' and resource 'flow in a Lamatic project', clearly distinguishing from sibling creation tools for contexts, credentials, projects, etc.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives like dev_create_context or dev_create_project. Agent must infer from tool name alone.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_create_integration_credsB
Create new integration credentials for a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| name | Yes | Display name for the integration credential | |
| projectId | Yes | The project ID | |
| credentials | Yes | Key-value pairs of credentials required by the integration | |
| integration | Yes | Integration type (e.g. s3, slack, postgres, gmail, googleDrive) |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries full burden, but it discloses no behavioral traits beyond the basic create action. No mention of side effects, idempotency, permissions, or whether it overwrites existing credentials.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence that is front-loaded with the key purpose. While very concise, the brevity is acceptable given the schema covers details. No wasted words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With 4 required parameters, nested objects, no output schema, and no annotations, the description is insufficient. It does not explain return values, error cases, or behavior when credentials already exist.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the schema already documents each parameter. The description adds no additional meaning beyond what the schema provides, thus baseline 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('Create new integration credentials') and the target resource ('for a Lamatic project'), using a specific verb+resource pair that distinguishes it from sibling tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives like dev_create_model_creds or other credential tools. No mention of prerequisites, when-not-to-use, or context for invocation.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_create_model_credsB
Create new model credentials for a provider in a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| name | Yes | Display name for the credential | |
| provider | Yes | Provider name (e.g. openai, anthropic, mistral) | |
| projectId | Yes | The project ID | |
| credentials | Yes | Key-value pairs of credentials required by the provider |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It does not disclose behavioral traits such as whether duplicate names are handled, if credentials are validated, or any side effects. The description merely states the action without elaboration.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence with no filler. It is front-loaded and efficiently communicates the core action.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the lack of output schema and annotations, the description is insufficient. It does not mention return values (e.g., created credential ID) or error scenarios. For a tool with 4 required parameters and no behavioral cues, more context is needed to be fully usable.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so baseline is 3. The description adds no additional meaning beyond the schema; it does not explain the structure of the 'credentials' object or acceptable values for 'provider'. It merely reiterates the tool's purpose without enriching parameter understanding.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool creates model credentials for a provider in a Lamatic project. It uses a specific verb and resource, and distinguishes from sibling tools like dev_list_model_creds (list) and dev_create_integration_creds (different credential type).
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives, such as when to use dev_create_integration_creds instead. There is no mention of prerequisites or when not to use this tool.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_create_projectC
Create a new Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| name | Yes | ||
| region | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided. The description only says 'Create', implying mutation, but does not disclose side effects, idempotency, duplicate handling, or permission requirements. With no annotations, the description must carry behavioral context; it fails to do so.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence, which is concise. However, it is too minimal given the lack of annotations and schema descriptions. Could be restructured to include key details without adding much length.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
No output schema; description does not hint at return value (e.g., project object). Sibling tools like dev_get_project suggest retrieval after creation, but no guidance on output. The description is incomplete for an agent to know what to expect.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%. The description does not explain what 'name' and 'region' mean beyond their types. For 'region', enum values are listed but no context (e.g., 'aws region'). The description adds no value to the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action (Create) and the resource (a new Lamatic project). It is specific enough to distinguish from unrelated tools, though it does not differentiate from sibling tools like dev_create_flow or dev_create_context.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives (e.g., dev_update_project for updates). No mention of prerequisites or context like authentication. The agent has no help deciding when to invoke this tool.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_delete_contextC
Delete a context from a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| contextId | Yes | The context ID to delete | |
| projectId | Yes | The project ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries full burden. It only states 'Delete', implying a destructive action, but fails to disclose irreversibility, side effects, or required permissions (e.g., authentication scope).
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise—one sentence of 10 words—and directly states the action and resource. However, it could be slightly more informative without becoming verbose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple delete tool, the description lacks crucial context such as return value, error conditions, or any confirmation of success. The absence of an output schema makes this gap more significant, leaving the agent uninformed about what happens after invocation.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema covers both parameters with descriptions (contextId and projectId), achieving 100% coverage. The tool description adds no extra semantic value beyond what the schema already provides, meeting the baseline.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'Delete' and the resource 'context from a Lamatic project', making the purpose unambiguous. However, it does not explicitly distinguish from sibling delete tools like dev_delete_credential or dev_delete_flow, which have similar descriptions.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives (e.g., dev_get_context for reading, or other delete operations). Prerequisites, such as the context must exist, are not mentioned.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_delete_credentialB
Delete a credential from a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| projectId | Yes | The project ID | |
| credentialId | Yes | The credential ID to delete |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, so description must disclose behavior. It states 'delete' indicating a destructive operation, but does not mention irreversibility, side effects, or required permissions.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, no redundancy. Could benefit from slightly more detail, but remains appropriately concise for a simple delete operation.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
No output schema; missing information on return values, error handling, or whether deletion is reversible. For a destructive tool, more context is needed.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Input schema provides 100% coverage with clear descriptions for both parameters. The description adds no additional meaning beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'Delete', the resource 'credential', and the scope 'from a Lamatic project'. It distinguishes itself from sibling tools like dev_update_credential and dev_get_cred_info.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool vs alternatives, but the action (delete) is straightforward. No prerequisites or when-not-to-use mentioned.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_delete_flowB
Delete a flow from a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| flowId | Yes | The flow ID to delete | |
| projectId | Yes | The project ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden of behavioral disclosure. The description only states 'Delete' but does not mention that this action is destructive and irreversible, or whether special permissions or confirmation steps are needed. Such transparency is critical for a deletion tool.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence of 6 words, which is concise but overly minimal. It lacks front-loaded context like the project or Lamatic. While there is no fluff, the terseness undermines usefulness.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given that this is a destructive action with no output schema, the description should include details like irreversibility, success/failure indicators, or error conditions. It fails to provide enough context for an agent to understand the full impact of calling this tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with descriptions for both parameters ('The flow ID to delete' and 'The project ID'). The description does not add any additional meaning beyond these schema descriptions, so the baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses the specific verb 'Delete' and clearly identifies the resource as 'a flow from a Lamatic project'. This clearly indicates the tool's action and distinguishes it from sibling tools like dev_delete_context or dev_rename_flow.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description lacks any guidance on when to use this tool versus alternatives (e.g., dev_update_flow for changes, dev_list_all_flows to find flow IDs). No prerequisites, restrictions, or when-not-to-use information is provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_delete_projectC
Delete a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| projectId | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description merely states the operation without disclosing behavioral implications like irreversibility, cascading deletions, or authorization requirements. Since no annotations are provided, this is a significant gap.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise (one sentence). While efficient, it sacrifices necessary detail for a tool with no annotations and a bare schema.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple tool with one parameter, the description is incomplete. It lacks essential context about the parameter, return values, side effects, and usage context.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The single parameter 'projectId' is not explained at all. The description adds no meaning beyond the schema's type definition. With 0% schema coverage, this is critically inadequate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states the action ('Delete') and resource ('Lamatic project'), making the purpose clear. However, it does not differentiate from other delete tools for different resources or provide any additional context about what 'delete' entails.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives like dev_create_project or dev_update_project. The description lacks any contextual hints about prerequisites or typical scenarios.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_deploy_projectC
Deploy a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| name | No | ||
| projectId | Yes | ||
| description | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description bears full responsibility for behavioral disclosure. It merely states the action without mentioning side effects (e.g., whether the deployment is immediate or asynchronous), required permissions, or return behavior. This is insufficient for safe tool selection.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence, which is concise but overly minimal. It is front-loaded, but the brevity sacrifices necessary detail, making it acceptable but not well-structured for comprehensive understanding.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the absence of annotations and output schema, and with three parameters including a required projectId, the description is far from complete. It does not explain prerequisites, success criteria, or what the tool returns, leaving significant gaps for an agent.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, yet the description does not explain any of the three parameters (name, projectId, description). The agent must guess their meaning and required format, which is a critical gap.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Deploy a Lamatic project' uses a specific verb and resource, clearly indicating the action and object. It distinguishes from sibling tools like dev_create_project (create) and dev_delete_project (delete). However, it could be slightly more precise about what deployment entails.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives such as dev_create_project or dev_list_all_deployments. The description lacks context on prerequisites or scenarios, leaving the agent to infer usage from the name alone.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_get_all_contextsA
List all contexts in a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| projectId | Yes | The project ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, so description carries the burden. It indicates a read operation ('List'), but lacks details on permissions, rate limits, or other behavioral traits. Adequate for a simple list.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, front-loaded, and efficiently communicates the tool's purpose without unnecessary words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple tool with one required parameter and no output schema, the description is complete enough to select and invoke the tool correctly. Could mention return type but not necessary.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% (one parameter fully described). Description adds no extra meaning beyond the schema, so baseline score of 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses a specific verb 'List' and resource 'all contexts', clearly distinguishing it from siblings like 'dev_get_context' (singular) and create/delete tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives, no when-not-to-use instructions, and no context provided for prerequisites or limitations.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_get_contextB
Get details of a specific context in a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| contextId | Yes | The context ID | |
| projectId | Yes | The project ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are present, and the description only states 'Get details' without elaborating on what details are returned, whether the operation is safe/read-only, permissions needed, or response structure. The description does not carry the burden of behavioral disclosure well.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Description is a single sentence that is front-loaded with the key action and target. No extraneous words; it is maximally concise while being clear.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The tool is simple (get by two required IDs), but no output schema is provided and the description does not explain what 'details' are returned. For a retrieval tool, providing a hint about the return value would improve completeness. Adequate but with a gap.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% (both contextId and projectId have descriptions in the input schema). The tool description adds no additional meaning beyond what the schema already provides, so a baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states 'Get details of a specific context', which is a specific verb+resource that distinguishes it from sibling tools like dev_get_all_contexts (which gets all contexts) or dev_create_context (which creates).
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool vs alternatives, such as when a single context lookup is needed versus a bulk query. No prerequisites or exclusions are mentioned.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_get_cred_infoA
Get details of a specific credential in a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| projectId | Yes | The project ID | |
| credentialId | Yes | The credential ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided; description only says 'get details' which implies read-only. No disclosure of auth needs, error handling, or other behavioral traits beyond what the schema indicates.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence that is front-loaded with the verb and resource. No unnecessary words or repetition.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
No output schema, so the agent doesn't know what details are returned. For a 'get details' tool, additional info about typical response fields would improve completeness.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with descriptions for both parameters. The tool description adds no additional meaning beyond the schema, so baseline 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'get', the resource 'credential', and the scope 'in a Lamatic project'. It distinguishes from sibling tools that list or modify credentials.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool vs alternatives like dev_list_integration_creds or dev_update_credential. Usage is implied but not stated.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_get_deploymentA
Get details of a specific deployment in a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| projectId | Yes | The project ID | |
| deploymentId | Yes | The deployment ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description states 'Get details' implying a read-only operation, but without annotations, it lacks explicit statements about idempotency, permissions, or side effects. Acceptable but minimal.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, clear, no unnecessary words. Efficient communication of purpose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple get operation with 2 parameters and no output schema, the description is mostly adequate. Minor gap: does not specify what 'details' includes, which could be clarified.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with parameter descriptions already in the schema. The description adds no new information beyond the schema, so baseline score applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses a specific verb 'Get' and resource 'details of a specific deployment', clearly distinguishing it from sibling tool 'dev_list_all_deployments' which lists all deployments.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool vs alternatives like 'dev_list_all_deployments'. Usage is implied but not clearly stated.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_get_flowsC
List all flows in a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| projectId | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Without annotations, the description carries the full burden for behavioral disclosure. It only says 'list', implying read-only, but omits details like pagination, sorting, or response format. Minimal added value.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence, appropriate in length for a simple list tool, but it lacks crucial details that could be included without much verbosity.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the similarity to 'dev_list_all_flows' and the absence of an output schema, the description is insufficient. It does not explain return values or how it differs from the sibling, leaving the agent uncertain.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 0% description coverage for the single required parameter 'projectId'. The description adds no explanation or constraint beyond the parameter name, failing to compensate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'list' and resource 'flows in a Lamatic project', but it does not distinguish from the sibling 'dev_list_all_flows', which has an identical purpose.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives, especially the very similar 'dev_list_all_flows'. No usage context or exclusion criteria are given.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_get_oauth_urlC
Get an OAuth authorization URL for an integration in a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| nodeName | Yes | The integration node name (e.g. googleDrive, gmail, slack) | |
| projectId | Yes | The project ID | |
| redirectUri | Yes | The redirect URI after OAuth authorization | |
| credentialName | Yes | Display name for the credential being created |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description fully bears the burden of disclosing behavioral traits. It does not mention any side effects, authentication requirements, rate limits, or what the returned URL entails. This is a significant gap for a tool that triggers an external OAuth flow.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single concise sentence that conveys the core purpose without extraneous words. It could be slightly more structured, but it is efficient and front-loaded.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The tool has 4 required parameters, no output schema, and no annotations. The description does not mention the return value, required scopes, or error scenarios, leaving the agent with incomplete information to use the tool effectively.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the baseline is 3. The description adds no extra meaning beyond the schema; it does not clarify parameter formats, constraints, or relationships.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool retrieves an OAuth authorization URL for an integration in a Lamatic project, using a specific verb and resource. However, it does not explicitly differentiate from sibling tools like dev_auth_login or dev_create_integration_creds, which may have overlapping functionality.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives, nor are there any prerequisites or when-not-to-use instructions. The agent must infer usage from context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_get_projectB
Get details of a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| projectId | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries full burden for behavioral disclosure, but it does not mention any behavioral traits such as authentication needs, rate limits, side effects, or whether the operation is read-only. The description only restates the basic purpose.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence, which is concise and front-loaded. However, it could be slightly expanded to include parameter clarification or usage hints without losing conciseness.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the low complexity (one required string parameter, no output schema), the description covers the basic purpose but lacks detail on what 'details' means or what the output will contain. It is minimally viable but leaves gaps for the agent.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema has 0% description coverage for the single parameter 'projectId'. The description does not explain what 'projectId' is, how to obtain it, or any constraints. The schema provides the type 'string' but no further context, placing the burden on the description which fails to add value beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('Get details') and the resource ('a Lamatic project'), using a specific verb and resource that distinguishes it from sibling tools like dev_list_projects (list all projects) and dev_create_project (create a new project). The purpose is immediately clear.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives. There are no explicit contexts, exclusions, or comparisons to sibling tools like dev_list_projects or dev_get_deployment. The implied usage is minimal.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_list_all_deploymentsA
List all deployments for a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| projectId | Yes | The project ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, and the description lacks any behavioral details such as auth requirements, pagination, or effects. For a read operation, it minimally conveys safety but no depth.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, no unnecessary words, efficient and front-loaded.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's low complexity (one parameter, no output schema), the description is mostly sufficient. However, it would benefit from briefly noting the response format (e.g., list of deployment IDs).
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% for the single parameter, which already describes itself. The description adds no additional meaning beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool lists all deployments for a Lamatic project, using a specific verb and resource. It distinguishes from siblings like `dev_get_deployment` which retrieves a single deployment.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool versus alternatives like `dev_get_deployment`. Usage is implied but not directly stated.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_list_all_flowsC
List all flows for a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| projectId | Yes | The project ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations exist, so the description must carry the burden of behavioral disclosure. It only states a list operation with no mention of read-only nature, authentication needs, or any side effects. The description is insufficient for a list tool with no annotation support.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single short sentence with no wasted words. It is appropriately concise for a simple tool.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the simple parameter set (1 required) and no output schema, the description is too minimal. It fails to convey return format, pagination, or what constitutes a 'flow'. This leaves significant gaps for an agent to use the tool effectively.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100% (projectId is described as 'The project ID'). The description adds no additional meaning beyond the schema, resulting in baseline score.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states the action (list) and resource (flows) and scope (for a Lamatic project). However, it does not distinguish itself from sibling tools like dev_get_flows, which may have overlapping functionality.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives or prerequisites. The description simply states what it does without providing context for agent decision-making.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_list_integration_credsC
List all integration credentials for a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| projectId | Yes | The project ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It only states it lists credentials, but fails to disclose any behavioral traits such as authentication requirements, pagination, or potential side effects. A list operation is generally safe, but more detail would improve transparency.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, concise sentence that front-loads the action. It is efficient but could include more details without being verbose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool has only one parameter and no output schema, the description is minimal. It lacks details about return format or what constitutes 'integration credentials'. However, for a simple list operation, it is somewhat adequate.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Input schema covers the single parameter with a description 'The project ID'. The description adds no additional meaning beyond the schema. With 100% schema coverage, baseline 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool lists integration credentials for a Lamatic project. The verb 'list' and resource 'integration credentials' are specific. It distinguishes from sibling tools like dev_list_model_creds by resource type, but does not explicitly differentiate.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives like dev_list_model_creds or dev_get_cred_info. It lacks context on prerequisites or scenarios where this tool is appropriate.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_list_model_credsB
List all model credentials for a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| projectId | Yes | The project ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, and the description does not disclose behavioral aspects such as side effects, permissions, or error scenarios. For a listing tool, read-only nature is inferred but not stated.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single concise sentence that gets the point across without unnecessary words, though it could be expanded slightly for more clarity.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the simplicity of the tool (one parameter, no output schema, no annotations), the description is minimally adequate but lacks usage context and behavioral details that would help an AI agent fully understand when and how to use it.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with one parameter 'projectId' having a description. The description adds no extra meaning beyond the schema, so baseline of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'List' and the resource 'model credentials for a Lamatic project', distinguishing it from siblings like 'dev_list_integration_creds' and 'dev_list_projects'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description does not provide any guidance on when to use this tool versus alternatives, nor does it mention any prerequisites or context. No explicit usage guidelines are given.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_list_model_providersB
List all available model providers, optionally including their models
| Name | Required | Description | Default |
|---|---|---|---|
| projectId | Yes | The project ID | |
| includeModels | No | Include available models for each provider |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden. It does not disclose side effects (likely none), authentication needs, rate limits, or the meaning of 'including models' in terms of performance or response size.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence of 10 words, front-loading the core functionality with zero waste.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple list tool with two parameters and no output schema, the description is minimally adequate but lacks context about response format, project scope, and what 'available' means.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% and description adds minimal value beyond what parameter descriptions already provide. The 'includeModels' option is mentioned but not elaborated. Baseline 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action (list) and resource (model providers), with an optional inclusions of models. It distinguishes from sibling tools that list other resources, but misses clarifying 'available' in the context of a project.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives like dev_list_model_creds or other list tools, nor any conditions or prerequisites.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_list_projectsA
List all projects in your Lamatic organization
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden. It states 'list all projects' which implies a read operation, but does not disclose potential limitations like pagination, rate limits, or authentication requirements. Adequate but lacks depth.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, focused sentence with no extraneous words. Perfectly concise and front-loaded.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (no parameters, no output schema), the description adequately covers its purpose. Could mention the return format, but not essential for a basic list operation.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
No parameters exist (schema coverage 100%), so the description needs no parameter details. Baseline 4 for zero-parameter tools is justified.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses the specific verb 'List' and resource 'projects', clearly stating the tool's purpose. It effectively distinguishes from siblings like 'dev_get_project' or 'dev_create_project' which operate on individual projects.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool versus alternatives like 'dev_get_project' for a specific project. While the intent is clear from the name, the description misses the opportunity to provide context on when a list is appropriate.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_list_supported_integrationsB
List all supported integrations available for a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| projectId | Yes | The project ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must disclose behavioral traits. It only says 'list all supported integrations', implying a read operation, but doesn't disclose any side effects, permissions, or rate limits. This is insufficient given no annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence of 9 words, front-loading the core action and resource. Every word is necessary; no fluff.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Tool is simple with one required parameter, no output schema, and low complexity. The description adequately covers the basic functionality. Could mention return format, but overall complete for the context.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with one parameter 'projectId' described as 'The project ID'. The description adds no additional meaning beyond the schema. Baseline of 3 is appropriate because the schema already handles semantics.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('List all supported integrations') and the resource ('available for a Lamatic project'). It distinguishes from sibling tools like dev_list_integration_creds which lists credentials, not integrations.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives. No when-to-use, when-not-to-use, or prerequisites are mentioned. The agent must infer from context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_rename_flowB
Rename a flow in a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| name | Yes | The new name for the flow | |
| flowId | Yes | The flow ID to rename | |
| projectId | Yes | The project ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description bears full burden for behavioral disclosure. It only says 'Rename', a mutation verb, but does not describe side effects, success conditions, error cases, or return values. The agent is left guessing about the tool's behavior.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Extremely concise: a single sentence that captures the core purpose. It is front-loaded without wasted words. However, it could benefit from slightly more detail without being verbose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The tool has no output schema and the description does not explain return values. As a mutation operation, it should indicate if it returns the renamed flow or a confirmation. The simplicity of parameters doesn't compensate for the missing behavioral context.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema covers all parameters with descriptions (100% coverage). The tool description adds no additional meaning beyond what the schema provides. Baseline score of 3 is appropriate because the description does not enhance parameter understanding.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('Rename') and the resource ('a flow in a Lamatic project'). It distinguishes the tool from siblings like dev_create_flow, dev_delete_flow, and dev_update_flow by focusing solely on renaming.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool versus alternatives such as dev_update_flow. The usage is implied from the name, but lacking context for an AI agent to decide between rename and update.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_update_credentialB
Update an existing credential in a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| projectId | Yes | The project ID | |
| credentials | Yes | Key-value pairs of updated credentials | |
| credentialId | Yes | The credential ID to update |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It only states 'Update' but does not disclose side effects, whether it's a partial or full replacement, permission requirements, or reversibility.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
A single, clear sentence with no unnecessary words. It's appropriately concise, though it could benefit from more structure.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a mutation tool with no output schema and no annotations, the description lacks important context (e.g., update behavior, return value). It only covers basic purpose.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the baseline is 3. The description adds no additional meaning beyond the schema's property descriptions; it merely restates the purpose.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses a specific verb ('Update') and identifies the resource ('credential') clearly. It distinguishes from siblings like dev_delete_credential and dev_get_cred_info by focusing on modification.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives like dev_create_integration_creds or dev_create_model_creds. No prerequisites or exclusions are mentioned.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_update_flowC
Update an existing Lamatic flow with new nodes and edges
| Name | Required | Description | Default |
|---|---|---|---|
| edges | Yes | Array of edge objects | |
| nodes | Yes | Array of node objects | |
| flowId | Yes | The flow ID to update | |
| status | No | Flow status | active |
| projectId | Yes | The project ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided. Description does not disclose whether nodes/edges are replaced or merged, authentication requirements, idempotency, or side effects. For a mutation tool, this is insufficient.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, no fluff. However, it is too brief and could benefit from a second sentence to cover status or behavior.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
No output schema, no annotations. Description does not explain return value, prerequisites (flow must exist), or behavioral details. Incomplete for a 5-parameter mutation tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so baseline is 3. Description adds 'new nodes and edges' implying replacement, but does not clarify semantics for other parameters like status. Marginal value beyond schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states it updates a Lamatic flow with new nodes and edges, distinguishing from create, delete, rename, and status-only update siblings. However, it omits mention of the status parameter, which can also be updated.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool vs. alternatives like dev_create_flow, dev_rename_flow, or dev_update_flow_status. Missing explicit context for when to use each sibling.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_update_flow_statusB
Update the status of a flow in a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| flowId | Yes | The flow ID | |
| status | Yes | The new status for the flow | |
| projectId | Yes | The project ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must carry the full burden. It only states 'update', implying mutation, but lacks details on side effects, idempotency, or required permissions.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single concise sentence that front-loads the key action and resource. It could be slightly more efficient but is well-structured.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a mutation tool with 3 required parameters and no output schema or annotations, the description lacking details about return values, error handling, or preconditions makes it incomplete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Parameter schema coverage is 100% with descriptions for each parameter. The tool description adds the context 'in a Lamatic project' but does not enhance parameter semantics beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'Update', the resource 'status of a flow', and the scope 'in a Lamatic project'. It distinguishes from sibling tools like dev_rename_flow or dev_update_flow which handle other properties.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage for changing flow status but does not provide explicit guidance on when to use this tool versus alternatives, nor when not to use it.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
dev_update_projectC
Rename a Lamatic project
| Name | Required | Description | Default |
|---|---|---|---|
| name | Yes | ||
| projectId | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description bears full responsibility for behavioral disclosure. It only states 'rename' (a mutation) but does not mention permissions, reversibility, side effects, or response behavior. The description lacks critical details about what this tool does beyond the basic action.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise at one sentence. It is front-loaded with the core action. However, it may be too brief, sacrificing clarity for brevity. The structure is acceptable but lacks detail.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (2 required params, no output schema, no annotations), the description is incomplete. It does not mention expected outcomes, return values, or any constraints. The agent lacks context on what happens after a rename (e.g., ID changes? references updated?).
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must compensate. It does not explain the two parameters 'projectId' and 'name' beyond the generic rename action. The intended use of 'name' (new name) and 'projectId' (ID of project to rename) is implied but not explicitly clarified.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action 'Rename a Lamatic project', which is a specific verb+resource combination. It distinguishes from sibling tools like dev_create_project or dev_delete_project, though the tool name 'dev_update_project' might imply broader update functionality beyond just renaming.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives. It does not mention prerequisites, exclusions, or compare to sibling tools like dev_rename_flow for flows. The usage context is entirely implicit.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
docs_query_docsA
Ask any question about Lamatic.ai documentation. Uses RAG to search across all indexed docs and return a precise answer. No authentication required.
| Name | Required | Description | Default |
|---|---|---|---|
| text | Yes | The question to ask about Lamatic.ai documentation |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It mentions using RAG and returning a 'precise answer', but does not detail output format, handling of ambiguous queries, or any limitations. It is not misleading but lacks depth.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Three sentences: purpose, mechanism, authentication. No wasted words, front-loaded with the main action. Very concise.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple one-parameter tool with no output schema, the description covers the essentials. It could mention answer format (e.g., textual response with citations) but is otherwise complete enough given the simplicity.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% and the parameter 'text' is well-described in the schema. The description adds no additional semantics beyond what the schema already provides, so baseline 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'ask', the resource 'Lamatic.ai documentation', and the mechanism 'RAG'. It distinguishes itself from sibling tools by focusing on documentation queries, which are not covered by other tools like dev_* or kit_*.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description says 'Ask any question' and notes 'No authentication required', which gives context. However, it does not explicitly compare to sibling tools like 'kit_search' or 'kit_get' to clarify when to use this tool instead.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
graph_auth_loginA
Authenticate with Lamatic GraphMCP (only needed if not already configured via environment variables)
| Name | Required | Description | Default |
|---|---|---|---|
| orgId | No | Your organization ID — required for flow discovery | |
| orgApiKey | No | Your org-level API key (lt-org-...) — required for flow discovery | |
| projectApiKey | Yes | Your project-level API key (lt-mmup-...) |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It states authentication but does not disclose side effects, safety, or what happens on repeated calls. The phrase 'only needed if not already configured' hints at idempotency but lacks detail.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is one sentence, front-loaded with purpose and usage context. It is concise and waste-free, though it could be slightly expanded with parameter hints.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no annotations, no output schema, and 3 parameters, the description lacks details on authentication outcome, success/failure indicators, or prerequisites. It is minimally complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with parameter descriptions, so the agent can infer meaning. However, the description adds no extra context about the parameters (e.g., which are required for flow discovery). Baseline of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'Authenticate' and the resource 'Lamatic GraphMCP', and it distinguishes from sibling tools like dev_auth_login and kit_auth_login by specifying GraphMCP context. Purpose is specific and unambiguous.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explains when to use the tool: 'only needed if not already configured via environment variables'. This provides clear context but does not explicitly mention when not to use it or alternatives among sibling auth tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
graph_execute_flowB
Execute a deployed Lamatic flow. If connected via a single-flow integration, flowId can be omitted.
| Name | Required | Description | Default |
|---|---|---|---|
| flowId | No | The flow ID to execute (optional if pre-configured for a single flow) | |
| payload | Yes | Input payload matching the flow input schema (e.g. { "prompt": "Hello" }) | |
| projectId | No | The project ID (optional if already configured) |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description must disclose behavioral traits, but it only covers parameter optionality. It does not mention side effects, authentication requirements, rate limits, or what the tool returns upon execution (e.g., run ID or result). This leaves the agent uninformed about operational consequences.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence that immediately conveys the primary action. It is free of unnecessary words, front-loaded with the key action, and efficiently adds one conditional note. Every word earns its place.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the lack of annotations and output schema, the description is insufficient. It does not explain what happens after execution, how to retrieve results, whether the operation is asynchronous, or any required prerequisites. The agent is left with significant gaps in understanding the tool's full behavior.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so parameters are already well-documented. The description adds only a brief clarification about flowId optionality, which is already implied by the schema. No additional meaning is provided beyond what the schema offers, resulting in a baseline score of 3.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'Execute' and the resource 'a deployed Lamatic flow', making the tool's purpose immediately obvious. It also adds a helpful note about flowId being optional in single-flow integrations, which distinguishes it from similar tools like dev_create_flow.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description mentions a specific condition (single-flow integration) where flowId can be omitted, but it does not provide explicit guidance on when to use this tool versus alternatives. There's no discussion of prerequisites, failure modes, or comparison to sibling tools like graph_load_project_flows.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
graph_load_project_flowsB
Load all active flows for a project with their input schemas (requires org-level access)
| Name | Required | Description | Default |
|---|---|---|---|
| projectId | Yes | The project ID to load flows from |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It adds the access requirement, but lacks explicit mention of read-only nature or other behavioral traits like rate limits or what constitutes 'active'.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence with no wasted words; it efficiently conveys action, output, and constraint.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple load tool with one parameter and no output schema, the description is mostly complete. However, it misses comparisons to sibling flow tools.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% for the single parameter, and the description does not add extra meaning beyond the schema's description of projectId.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool loads active flows with input schemas, using a specific verb and resource. However, it does not differentiate from sibling tools like dev_get_flows or dev_list_all_flows.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description mentions 'requires org-level access' as a prerequisite, but provides no guidance on when to use this tool versus alternatives or any exclusions.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
graph_refresh_flowsB
Refresh and list all active flows for a project (requires org-level access)
| Name | Required | Description | Default |
|---|---|---|---|
| projectId | Yes | The project ID |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the burden. It mentions the action of refreshing and requires org-level access, but does not disclose side effects (e.g., cache clearing, asynchronous behavior) or return value structure. The meaning of 'refresh' is ambiguous.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, concise sentence (10 words) that front-loads the action. No unnecessary words or repetition.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple tool with one parameter and no output schema, the description is minimally adequate. However, it fails to clarify the output format (e.g., list of flow details) or the nature of the refresh action, leaving some ambiguity.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The only parameter, projectId, is described in the schema as 'The project ID' with 100% schema coverage. The tool description adds no additional semantic information, so it meets the baseline for adequate schema coverage.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's action: 'Refresh and list all active flows for a project'. It specifies the resource (active flows) and the scope (per project). The requirement for 'org-level access' adds useful context. This distinguishes it from sibling tools like 'dev_get_flows' which may not have a refresh action.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description does not provide guidance on when to use this tool versus alternatives. While it specifies a prerequisite (org-level access), it lacks explicit exclusions or comparisons to similar tools like 'graph_load_project_flows' or 'dev_get_flows'.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
kit_auth_loginA
Store a GitHub personal access token for kit_check_pr_status and kit_revalidate_pr. Token needs public_repo scope (or repo scope for private orgs).
| Name | Required | Description | Default |
|---|---|---|---|
| githubToken | Yes | A GitHub personal access token |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must carry the behavioral disclosure burden. It discloses that the tool stores a token and requires specific scopes, but does not mention whether it overwrites existing tokens, how persistent the storage is, or any side effects. The description adds some value beyond the schema but lacks depth.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description consists of two concise sentences that immediately state the tool's purpose and provide essential scope information. Every sentence adds value, and there is no wasted text.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given a simple tool with one parameter and no output schema or annotations, the description covers the key aspects: what it does, which tools use it, and token scope requirements. It might be improved by mentioning whether the token is stored permanently or per-session, but overall it is sufficient for an agent to understand usage.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 100% coverage with one parameter described as 'A GitHub personal access token'. The description adds the scope requirement, which is not present in the schema, enhancing the parameter's meaning. This additional context helps the agent select and use the parameter correctly.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool stores a GitHub personal access token for specific tools (kit_check_pr_status, kit_revalidate_pr). The verb 'Store' and resource 'GitHub personal access token' are specific, and it distinguishes from siblings like dev_auth_login by specifying its use for kit tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides context on when to use the token (for kit_check_pr_status and kit_revalidate_pr) and specifies required scopes (public_repo or repo). It does not explicitly state when not to use this tool or mention alternatives like dev_auth_login, but the context is clear.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
kit_check_pr_statusA
Check the Phase 1 (structural) and Phase 2 (Studio runtime) validation status and labels on an open AgentKit PR. Requires a GitHub token (kit_auth_login or GITHUB_TOKEN env var) for higher rate limits, but works without one for public PRs at GitHub's unauthenticated rate limit.
| Name | Required | Description | Default |
|---|---|---|---|
| prNumber | Yes | The AgentKit PR number, e.g. 160 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, so the description must carry the burden. It discloses token dependency, rate limits, and the two phases, but does not mention what happens for closed or non-existent PRs, nor the exact return format.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two concise sentences, front-loaded with the core purpose, followed by token requirements. No unnecessary words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple tool with one parameter and no output schema, the description is quite complete. It covers purpose, token usage, and rate limits. Slight lack of detail on return values but acceptable.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with a clear description of prNumber. The tool description adds no additional meaning beyond the schema, meeting the baseline of 3.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it checks Phase 1 and Phase 2 validation status and labels on an open AgentKit PR. This specific verb+resource combination distinguishes it from siblings like kit_revalidate_pr and kit_validate_structure.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explains when to use it (to check PR status) and provides guidance on token usage for rate limits. However, it does not explicitly state when not to use it or mention alternatives.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
kit_getA
Get full details for a single kit — its lamatic.config.ts, README, and list of flows. No authentication required.
| Name | Required | Description | Default |
|---|---|---|---|
| name | Yes | The kit folder name, e.g. "content-generation" |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations exist, so the description must convey behavior. It states 'No authentication required,' which is helpful, but does not mention that the operation is read-only, has no side effects, or any potential errors. More transparency about safety and limitations would improve the score.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two concise sentences that front-load the action and resource. Every word adds value, with no redundancy or unnecessary detail.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema, the description adequately explains the return content. It covers the single required parameter and explicit return fields. Minor omission: it does not mention error handling or what happens if the kit does not exist, but for a simple GET tool this is sufficient.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has one parameter with a clear description, so schema coverage is 100%. The description adds value by explaining what the tool returns (lamatic.config.ts, README, flows), which helps the agent understand the parameter's purpose beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('Get'), the resource ('single kit'), and the specific details returned (lamatic.config.ts, README, list of flows). It distinguishes itself from sibling tools like 'kit_get_flow' (which gets a single flow) and 'kit_list' (list of kits).
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage for obtaining full details of a kit, but does not explicitly guide when to use this tool versus alternatives like 'kit_search' or 'kit_list'. No when-not-to-use or exclusion criteria are provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
kit_get_flowA
Get the raw .ts source of a specific flow inside a kit. No authentication required.
| Name | Required | Description | Default |
|---|---|---|---|
| kitName | Yes | The kit folder name, e.g. "content-generation" | |
| flowName | Yes | The flow file name without .ts, e.g. "generate-week" |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries full burden. It states 'No authentication required' but does not disclose potential error cases, rate limits, or whether the returned source is exactly the raw file. The behavior is straightforward but could be more transparent.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, direct sentence followed by a standalone note about authentication. Every word is necessary, with no filler or redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (2 parameters, no output schema), the description is fairly complete. It could mention what the tool returns (raw .ts source) and any limitations, but it covers the essential purpose and parameters.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema provides 100% coverage with descriptions that include examples (e.g., 'kit folder name, e.g. "content-generation"'), adding clarity beyond the schema's property definitions. This helps the agent understand the expected values.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states 'Get the raw .ts source of a specific flow inside a kit', using a specific verb and resource. It distinguishes itself from sibling tools like 'kit_get' (which likely gets kit metadata) and 'dev_get_flows' (which lists flows).
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
While the description notes 'No authentication required', it provides no guidance on when to use this tool versus alternatives such as 'dev_get_flows', 'dev_list_all_flows', or 'graph_load_project_flows'. There is no mention of prerequisites or context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
kit_listA
List all kits, bundles, and templates available in the Lamatic AgentKit repository. No authentication required.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries full burden. It accurately describes a read-only list operation and adds the important detail of no authentication required. No contradictions.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, front-loaded with action, no filler. Every word adds value.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple list-without-filters tool, the description is complete. It doesn't specify return format, but given no output schema, it's acceptable.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
No parameters exist (0 params, 100% schema coverage). Per guidelines, 0 params warrants baseline 4. Description adds nothing beyond schema, but that's appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states 'List all kits, bundles, and templates' with specific verb and resource, distinguishing from siblings like kit_get (single item) and kit_search (filtered search).
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
States 'No authentication required,' which is helpful context. While it doesn't explicitly exclude alternatives, the purpose implies using this when you need the full list rather than specific items.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
kit_revalidate_prA
Trigger a Phase 2 Studio re-validation on an open AgentKit PR by posting the /validate comment. Requires a GitHub token with comment-write access (kit_auth_login or GITHUB_TOKEN env var).
| Name | Required | Description | Default |
|---|---|---|---|
| prNumber | Yes | The AgentKit PR number, e.g. 160 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden. It discloses that the tool posts a comment, triggers re-validation, and requires specific authentication. It does not mention potential side effects like rate limits or errors, but the core behavior is transparent.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence that is front-loaded with the main action and includes all necessary details (prerequisite) without any fluff. Every word earns its place.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool has one parameter, no output schema, and no annotations, the description provides sufficient information for an agent to decide when to use this tool. It covers the action, trigger mechanism, and auth requirement. Minor gaps like post-trigger behavior are acceptable for a simple trigger tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The single parameter prNumber is documented in the schema with its type and an example. The description does not add additional semantics beyond what is already in the schema. With 100% schema coverage, baseline 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool triggers a Phase 2 Studio re-validation on an open AgentKit PR by posting a /validate comment. It specifies the verb ('Trigger'), resource ('open AgentKit PR'), and mechanism ('posting the /validate comment'), making it distinct from siblings like kit_check_pr_status and kit_validate_structure.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly states when to use (open AgentKit PR requiring re-validation) and provides prerequisites (GitHub token with comment-write access). It does not explicitly list alternatives, but the context of sibling tools and the specific action make usage clear.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
kit_searchA
Search kits by type (kit/bundle/template) and/or tag/keyword. No authentication required.
| Name | Required | Description | Default |
|---|---|---|---|
| type | No | Filter by contribution type | |
| query | No | Free-text keyword to match against name, description, and tags |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the burden. It discloses no authentication needed, but omits behavioral details such as return format, pagination, or search behavior (exact vs fuzzy match). This is adequate but not thorough for a search tool.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
A single sentence that immediately conveys the tool's purpose and key constraint. No filler, perfectly front-loaded.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple search tool with no output schema, the description does not explain what the response contains (e.g., list of matching kit objects). It covers search criteria but lacks return structure context. Complete enough for minimal use but has gaps.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, with both parameters having descriptions. The description restates the type enum and query as filter, adding no new meaning beyond the schema. Baseline 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool searches kits by type (kit/bundle/template) and/or keyword. This verb+resource+scope is specific and distinguishes from sibling tools like kit_get (get a specific kit) and kit_list (list all).
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly mentions 'No authentication required,' guiding the agent when to use this tool. However, it lacks guidance on when to prefer this over alternatives like kit_list or docs_query_docs.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
kit_validate_structureA
Run the same Phase 1 structural checks used in CI (validate-pr.yml) against a local kit folder, before opening a PR. No authentication required.
| Name | Required | Description | Default |
|---|---|---|---|
| kitPath | Yes | Absolute or relative local filesystem path to the kit folder, e.g. "./kits/my-kit" |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided; description states 'No authentication required' and that it runs CI checks locally. Does not mention return format or side effects, but for a validation tool this is adequate.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence, no filler, front-loaded with action and context. Every word adds value.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
No output schema exists, so description should hint at return values. It does not, leaving a gap. However, the tool's simplicity partially mitigates this.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Parameter kitPath has 100% schema description coverage. Description adds no new info beyond the schema, earning the baseline score of 3.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states the tool runs Phase 1 structural checks from CI on a local kit folder, distinguishing it from siblings like kit_check_pr_status and kit_revalidate_pr.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Explicitly says 'before opening a PR', providing context for when to use. Does not list when-not or alternative tools, but the context is clear.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
TDQS
Most tools have clearly distinct purposes, but there is direct overlap between dev_get_flows and dev_list_all_flows, which both list flows. The three auth_login tools are also similar in name though they authenticate different contexts.
Tools consistently use prefix_category + verb_noun in snake_case. However, the duplicate dev_get_flows and dev_list_all_flows break the naming pattern, and some verbs are inconsistent (e.g., 'get' vs 'list' for similar operations).
44 tools is excessive for a single MCP server, covering too many subdomains (dev, docs, graph, kit). This high count suggests the server could be split into smaller, more focused servers.
The tool surface covers most CRUD operations for projects, flows, contexts, credentials, and deployments. Minor gaps exist, such as missing update for contexts and delete for deployments, but overall it is fairly complete for the domain.
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Connectors
Nifty's MCP server — exposes tasks, projects, messages, and files as tools for AI agents.
Remote MCP server for supportsheep: run AI interviews and manage support content for your blog.
MCP server for secureFlows: token-free URL builders and integration-linting tools for AI agents.
Hosted AgentLux MCP server for marketplace, identity, creator, services, and social flows.
Related MCP Servers
- AlicenseNot gradedqualityCmaintenanceMCP server that equips AI agents with dev workflow tools including GitHub project management, conventional commits, visual regression testing, Jira/Confluence integration, and a persistent memory knowledge graph.21MIT
- AlicenseAqualityCmaintenanceUniversal MCP knowledge server for LLM agents, powered by local RAG, providing domain-specific best practices and playbooks across software engineering, marketing, video editing, and other knowledge areas.3MIT
- AlicenseBqualityBmaintenanceMCP server wrapping Backstage — query service catalog, fetch TechDocs, and scaffold services via AI agents.7Apache 2.0
- AlicenseNot gradedqualityDmaintenanceMCP Server for interacting with the Langflow API via a natural language interface. It exposes Langflow functionalities as tools for LLMs.MIT
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/Lamatic/Lamatic-MCP'
If you have feedback or need assistance with the MCP directory API, please join our Discord server