chat
Offload small, mechanical tasks to a cheap local or OpenAI-compatible model via one-shot prompts or full multi-turn conversations, keeping bulky intermediate output out of your own context.
Instructions
Chat-completion passthrough to the cheap/local model — cheapest way to offload a small mechanical task. Pass prompt (+ optional system) for one-shot completions, or messages for a full OpenAI-style conversation (few-shot examples, multi-turn).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| seed | No | Fixed seed for reproducible output. | |
| stop | No | Stop sequences. | |
| model | No | Model to use (default: provider/config default). Use list_models to see options. | |
| think | No | Chain-of-thought control (ollama `think`; best-effort on openai-compatible servers). think:false keeps the whole max_tokens budget for the answer. | |
| top_p | No | Nucleus sampling threshold. | |
| prompt | No | One-shot prompt (use this OR messages) | |
| system | No | System prompt prepended when using prompt | |
| num_ctx | No | Context window size (ollama providers only; bounded for VRAM). | |
| options | No | Provider-native overrides merged into the request (ollama `options` keys like top_k/repeat_penalty; openai-compatible body fields). Wins over named params. | |
| messages | No | OpenAI-style message list (use this OR prompt) | |
| provider | No | Provider name from server config (default: default_provider). | |
| max_tokens | No | Max tokens to generate. On thinking models, thinking consumes this budget — pass think:false for short mechanical answers. | |
| temperature | No | Sampling temperature (default ~0.2). | |
| response_format | No | "json" for JSON mode, or a JSON schema for structured output |