chat
Delegate prompts to a local llama.cpp model and return generated replies, with optional system, model, token limit, and temperature settings.
Instructions
Send a prompt to the local model through its chat template and return the reply.
Leave `temperature` unset to use llama-server's own sampling settings.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | No | ||
| prompt | Yes | ||
| system | No | ||
| max_tokens | No | ||
| temperature | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |