togetherai_completion
Generate text completions by providing a prompt and API key to any Together AI model. Customize output with parameters like temperature, top-p, and stop sequences.
Instructions
Run a text completion with any Together AI model.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| stop | No | Stop sequences | |
| model | No | Model ID (e.g. mistralai/Mistral-7B-v0.1) | |
| top_k | No | Top-k sampling | |
| top_p | No | Top-p nucleus sampling | |
| prompt | Yes | Text prompt to complete | |
| api_key | Yes | Together AI API key | |
| max_tokens | No | Maximum tokens to generate | |
| temperature | No | Sampling temperature 0-2 |