togetherai_chat_completion
Complete chat interactions using Together AI models including Llama, Mistral, and Qwen. Supports 100+ open-source models for flexible conversation generation.
Instructions
Run a chat completion with any Together AI model. Supports Llama, Mistral, Qwen, and 100+ open-source models.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| api_key | Yes | Together AI API key | |
| model | Yes | Model ID (e.g. meta-llama/Llama-3-8b-chat-hf). Use togetherai_list_models to browse. | |
| messages | Yes | Array of {role, content} message objects | |
| max_tokens | No | Maximum tokens to generate | |
| temperature | No | Sampling temperature 0-2 (default 0.7) | |
| top_p | No | Top-p nucleus sampling | |
| top_k | No | Top-k sampling | |
| stop | No | Stop sequences |