What is Gateway?

Gateway lets you access AI models from top providers like OpenAI and Anthropic with one API key, unified billing, and zero rate limits.

PropertyDescription
Model ID
claude-3-5-haiku-20241022
Creator
Anthropic
License-
Supported data types

Inputs

Text

Outputs

Text

Token limits

Input token limit

200,000

Output token limit

8,192

Capabilities

Caching

Native tool use

Structured outputs

Assistant response prefilling

Release date
Latest update-
Knowledge cut-off
Reference URL-
Hugging Face URL-

Providers

Name
Price
InputOutputCache ReadCache Write
$0.8
$4
$0.03
$0.3

Gateway Code Examples

import { OpenAI } from 'openai' const openai = new OpenAI({ // OpenAI compatible API baseURL: 'https://glama.ai/api/gateway/openai/v1', // Your Glama Gateway API key // https://glama.ai/settings/gateway/api-keys apiKey: GLAMA_API_KEY, }); await openai.chat.completions.create({ messages: [ { role: 'user', content: 'Hello!' } ], // Let Glama choose the best provider model: 'claude-3-5-haiku-20241022', // or specify a specific provider... // model: 'anthropic/claude-3-5-haiku-20241022' });