Skip to main content
Glama

What is Gateway?

Gateway lets you access AI models from top providers like OpenAI and Anthropic with one API key, unified billing, and zero rate limits.

PropertyDescription
Model ID
deepseek-r1-distill-llama-70b
Alias-
Creator
DeepSeek
License-
Supported data types

Inputs

Text

Outputs

Text

Token limits

Input token limit

128,000

Output token limit

8,000

Capabilities
Release date
Latest update
Knowledge cut-off
Reference URL-
Hugging Face URL-

Providers

Name
Price
InputOutputCache ReadCache Write
$0.55
$2.2
$-
$-

Success Rate (%)

Latency (ms)

Gateway Code Examples

import { OpenAI } from 'openai' const openai = new OpenAI({ // OpenAI compatible API baseURL: 'https://glama.ai/api/gateway/openai/v1', // Your Glama Gateway API key // https://glama.ai/settings/gateway/api-keys apiKey: GLAMA_API_KEY, }); await openai.chat.completions.create({ messages: [ { role: 'user', content: 'Hello!' } ], // Let Glama choose the best provider model: 'deepseek-r1-distill-llama-70b', // If there are multiple model providers, then we will pick // the provider with the best availability, price, and latency. // or specify a specific provider... // model: 'groq/deepseek-r1-distill-llama-70b' });

FAQ

Other LLM Models from the same Author