llama-3.1-8b-instruct

Property Description

Model ID llama-3.1-8b-instruct

Alias -

Creator

Inputs

Text

Outputs

Text

Token limits

Input token limit

128,000

Output token limit

4,096

Capabilities

Function calling

Tuning

Release date -

Latest update -

Knowledge cut-off December 2023

Reference URL -

Hugging Face URL https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct

Providers

	Price
	Input	Output	Blended	Cache Read	Cache Write
Deepinfra	$0.02	$0.05	$0.028	$-	$-
Avian	$0.1	$0.1	$0.1	$-	$-

Gateway

Glama gateway allows you to interact with leading AI models using OpenAI compatible API.

import { OpenAI } from 'openai'

const openai = new OpenAI({
  // OpenAI compatible API
  baseURL: 'https://glama.ai/api/gateway/openai/v1',
  // Your Glama Gateway API key
  // https://glama.ai/settings
  apiKey: GLAMA_API_KEY,
});

await openai.chat.completions.create({
  messages: [
    {
      role: 'user',
      content: 'Hello!'
    }
  ],
  // Let Glama choose the best provider
  model: 'llama-3.1-8b-instruct',
  // or specify a specific provider...
  // model: 'deepinfra/llama-3.1-8b-instruct'
  // model: 'avian/llama-3.1-8b-instruct'
});

Other LLM Models from the same Author

llama-3.1-405b-instruct llama-3.3-70b-instruct llama-3.2-1b-instruct llama-3.2-11b-vision-instruct llama-3.1-70b-instruct llama-3-8b-instruct