Property | Description |
---|---|
Model ID | llama-3.1-8b-instruct |
Alias | - |
Creator | Meta |
License | - |
Supported data types | InputsText OutputsText |
Token limits | Input token limit128,000 Output token limit4,096 |
Capabilities | Function calling Tuning |
Release date | - |
Latest update | - |
Knowledge cut-off | |
Reference URL | - |
Hugging Face URL | https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct |
Providers | |
GatewayGlama gateway allows you to interact with leading AI models using OpenAI compatible API. import { OpenAI } from 'openai'
const openai = new OpenAI({
// OpenAI compatible API
baseURL: 'https://glama.ai/api/gateway/openai/v1',
// Your Glama Gateway API key
// https://glama.ai/settings
apiKey: GLAMA_API_KEY,
});
await openai.chat.completions.create({
messages: [
{
role: 'user',
content: 'Hello!'
}
],
// Let Glama choose the best provider
model: 'llama-3.1-8b-instruct',
// or specify a specific provider...
// model: 'deepinfra/llama-3.1-8b-instruct'
// model: 'avian/llama-3.1-8b-instruct'
}); |