query_local_llm
Start new conversations or one-off tasks with local language models, supporting vision, JSON schema, and reasoning.
Instructions
Standard: Use this for STARTING a new conversation or one-off tasks. Supports Vision, JSON Schema, and Reasoning. Do not use this for follow-ups if you have a response ID.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| seed | No | ||
| stop | No | ||
| model | No | Optional: Load or use specific model ID. | |
| top_k | No | ||
| top_p | No | ||
| prompt | Yes | ||
| json_mode | No | ||
| image_path | No | Optional: Path to local image for Vision models. | |
| max_tokens | No | ||
| json_schema | No | ||
| temperature | No | ||
| systemPrompt | No | You are a helpful assistant. | |
| repeat_penalty | No | ||
| presence_penalty | No | ||
| frequency_penalty | No |