chat_completion
Send multi-turn conversations to NVIDIA NIM language models and receive completions across Llama, Mistral, Gemma, Qwen, and more.
Instructions
Send a multi-turn conversation to a NVIDIA NIM language model and receive a completion. Supports all major open-source LLMs including Llama 3.1, Mistral, Gemma, Qwen, and more.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| seed | No | ||
| stop | No | ||
| model | No | NIM model ID (optional, uses default if not set) | |
| top_p | No | ||
| messages | Yes | ||
| max_tokens | No | ||
| temperature | No | ||
| system_prompt | No | System prompt to prepend |