chat
Send chat completion requests to local language models via OpenAI-compatible API, with automatic model loading.
Instructions
Send a chat completion request to a model (OpenAI-compatible /v1/chat/completions).
The model is auto-loaded if not already in memory (JIT loading enabled by default in LM Studio). Set stream=True only when the MCP client supports streamed responses; most do not.
Examples: chat(model="qwen/qwen3-4b-2507", messages=[{"role":"user","content":"Hello"}]) chat(model="qwen/qwen3-4b-2507", messages=[{"role":"system","content":"Be terse."},{"role":"user","content":"Hi"}], temperature=0.2, max_tokens=64)
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| stop | No | ||
| model | Yes | ||
| tools | No | ||
| top_k | No | ||
| top_p | No | ||
| stream | No | ||
| messages | Yes | ||
| max_tokens | No | ||
| temperature | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||