lmstudio_chat
Send prompts to a local LM Studio model and retrieve generated completions; if local instances are offline, returns fallback guidance to use remote LLMs.
Instructions
Send a prompt or instruction to the local LM Studio model and get the generated completion. If all local instances are offline, returns a directive instructing the agent to fallback to remote LLMs.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | No | Optional model identifier (defaults to currently loaded model in LM Studio) | |
| prompt | Yes | The prompt or instruction to send to the local model | |
| max_tokens | No | Maximum tokens to generate in response (default: 2048) | |
| temperature | No | Sampling temperature between 0.0 and 2.0 (default: 0.7) | |
| system_prompt | No | Optional system instructions guiding the model behavior |