| Property | Description | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Model ID | llama-3.1-8b-instruct | |||||||||||
| Alias | - | |||||||||||
| Creator | Meta | |||||||||||
| License | - | |||||||||||
| Supported data types | InputsText OutputsText | |||||||||||
| Token limits | Input token limit128,000 Output token limit4,096 | |||||||||||
| Capabilities | Tuning | |||||||||||
| Release date | - | |||||||||||
| Latest update | - | |||||||||||
| Knowledge cut-off | ||||||||||||
| Reference URL | - | |||||||||||
| Hugging Face URL | https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct | |||||||||||
Providers
| ||||||||||||
GatewayGlama gateway allows you to interact with leading AI models using OpenAI compatible API. Copy import { OpenAI } from 'openai'
const openai = new OpenAI({
// OpenAI compatible API
baseURL: 'https://glama.ai/api/gateway/openai/v1',
// Your Glama Gateway API key
// https://glama.ai/settings
apiKey: GLAMA_API_KEY,
});
await openai.chat.completions.create({
messages: [
{
role: 'user',
content: 'Hello!'
}
],
// Let Glama choose the best provider
model: 'llama-3.1-8b-instruct',
// or specify a specific provider...
// model: 'deepinfra/llama-3.1-8b-instruct'
}); | ||||||||||||