complete
Delegate text or chat completion to a local LLM to save costs and keep data private. Supports streaming via progress notifications.
Instructions
DELEGATED INFERENCE: Offload a text/chat completion to a local model runtime for cost savings and privacy (data never leaves the machine). This is NOT a chat feature for the user; it delegates work to a local LLM. Provide either prompt or messages. Streams tokens via MCP progress notifications when the client supplies a progressToken (stream defaults to true). Without a provider arg, uses the first detected provider.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| stop | No | Stop sequences | |
| model | Yes | Model id/name to run the completion on | |
| prompt | No | Plain prompt text (alternative to messages) | |
| stream | No | Stream tokens from the provider (default true). Progress notifications are sent when the client provides a progressToken. | |
| messages | No | Chat-style messages (alternative to prompt) | |
| provider | No | Optional provider id | |
| maxTokens | No | Maximum tokens to generate | |
| temperature | No | Sampling temperature |