Skip to main content
Glama
jgt87

local-llm-mcp

by jgt87

Ask the local model

local_ask

Send a prompt to a local Ollama model for immediate private answers. Use it for summarising text, drafting boilerplate, or extracting fields without sending data off-machine.

Instructions

Send a prompt to a local model via Ollama and get the answer back immediately. Runs on this machine, so nothing leaves it and there is no API cost. Use it for work where checking the answer is cheaper than producing it: summarising long output, drafting boilerplate or commit messages, extracting fields from text. It is a small model on CPU (~16 tok/s for a 7B), so keep outputs short — maxTokens is the main latency lever. It has no file access and cannot run anything. For work needing judgement, repo context, or edits on disk, do it yourself or use codex_start.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
modelNoModel tag. Defaults to qwen2.5-coder:7b.
promptYesThe full question or instruction. No conversation context is carried over.
systemNoOptional system prompt to set role or output format.
maxTokensNoCap on generated tokens. Roughly 16 tokens per second, so 160 is ~10s.
temperatureNoDefaults to 0 for repeatable output.
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden and does an excellent job: it discloses the local/offline nature (nothing leaves the machine), no API cost, no file access, cannot run anything, roughly 16 tok/s for a 7B model, and that no conversation context is carried over. This is rich behavioral context that goes well beyond any schema.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is dense but efficiently structured: it opens with the core action, then capability boundaries, then usage examples, then constraints, then alternatives. Every sentence earns its place and there is zero filler or repetition.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given there is no output schema and no annotations, this description is remarkably complete: it covers purpose, constraints, performance characteristics, safety boundaries, and alternatives. For a parameter-rich tool (5 params) it fully compensates for the missing structured metadata.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The description adds value by naming maxTokens as the main latency lever and relating it to the tok/s speed, which connects the parameter to a concrete performance behavior beyond mere syntax. It doesn't cover every parameter explicitly but the schema already handles most of that burden.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states exactly what the tool does: sends a prompt to a local model via Ollama and returns the answer immediately. It clearly identifies the resource (local model) and verb (send prompt / get answer), and differentiates it from siblings by noting it is the local-model option distinct from local_classify and local_models.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Provides explicit when-to-use guidance ('summarising long output, drafting boilerplate or commit messages, extracting fields from text') and explicit when-not-to-use with named alternatives ('For work needing judgement, repo context, or edits on disk, do it yourself or use codex_start'). Also gives practical guidance on keeping outputs short and mentions the CPU speed constraint.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/jgt87/local-llm-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server