Skip to main content
Glama

chat_with_local_model

Send messages to a local AI model and receive replies. Use it to run chat sessions against locally hosted models through Msty Admin MCP.

Instructions

Chat with a Local AI model.

Input Schema

NameRequiredDescriptionDefault
modelYes
messagesYes

Output Schema

NameRequiredDescriptionDefault
resultYes

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv5.0.0

TDQS

C2.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full behavioral burden, and it delivers almost nothing: no statement about statefulness, streaming, latency, cost, or permissions. 'Local' is the only faint signal (local inference), which is minimal for an interactive chat tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

It is a single front-loaded sentence with no waste, which is structurally clean. The brevity, however, tips into under-specification rather than genuine conciseness for a two-parameter tool with no other documentation.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

An output schema exists so return values need not be described, but with zero annotation coverage, zero parameter documentation, and no differentiation from sibling chat tools, the definition is insufficient for reliable invocation. A minimal line on backend/locality and message format would close the gap.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Both required parameters ('model' and 'messages') have 0% schema description coverage, and the description adds no meaning beyond the generic word 'Chat'. It neither explains the accepted model identifiers nor the expected shape/content of the messages array, leaving the schema gap entirely uncompensated.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose3/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description names a clear verb and resource ('Chat with a Local AI model'), so an agent knows the general action. However, it does nothing to distinguish this from sibling chat tools such as chat_with_llamacpp_model, chat_with_mlx_model, or ask_frontier, which is the critical selection question here.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no guidance on when to use this tool versus the many near-identical chat/query siblings. The word 'Local' implies a backend constraint but never states what qualifies as local or when a caller should prefer this over the llamacpp/MLX variants.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.