Ask local model
llm_ask_llmSend a short prompt to the local model for quick decisions or classification in a pipeline. Reuse the already loaded model by default to avoid model swaps, or specify a model to override.
Instructions
Short query to the local model — for quick, simple decisions/ classification inside a pipeline. Use with for_each after build_prompts to ask about many items at once. model defaults to None, meaning: ask the server what's already loaded (/v1/models) and use that, instead of requesting a specific model by name — avoids forcing a model swap or a second model loading into RAM when something else (e.g. LM Studio Bionic) is already serving a different model on the same port. Pass an explicit model to override this.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | No | ||
| prompt | Yes | ||
| timeout | No | ||
| base_url | No | http://localhost:1234/v1 |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||