Skip to main content
Glama

Llama API

llm_llama
Read-only

Llama API - pay per call, no API key. OpenAI-format chat completions on meta-llama/llama-4-maverick, pinned to DeepInfra for reliability. You sign a fixed price computed from your max_tokens; unused tokens are not refunded. 20s server-side timeout - never charged if it fires; set your client timeout to 30s. Try GET /llm/llama/sample.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
messagesYesOpenAI-format chat messages: [{role, content}, ...].
max_tokensNoMax completion tokens, capped at 4096 - also bounds the price ceiling.

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault
idNo
modelNo
usageYes
choicesYes
x402_receiptNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. Added

TDQS

A3.9/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Goes well past the annotations: pay-per-call with no API key, price computed from max_tokens, unused tokens not refunded, 20s server timeout with no charge if it fires, and a recommended 30s client timeout. An agent learns the cost and failure model before calling, which the readOnly/openWorld/idempotent hints do not convey.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Front-loads what the tool is and its pricing model in the first sentence, then stacks operational constraints and the sample pointer. Every sentence carries distinct, actionable information with no filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

An output schema exists, so return format needn't be described, and pricing/timeout/auth are covered thoroughly. The gap is that, in a family of ~10 llm_* siblings, the description never states when this model is the right choice, leaving the agent to infer selection criteria.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the baseline is 3. The description adds real semantics beyond the schema by explaining that max_tokens drives the signed price and that unused tokens are not refunded, giving the agent a reason to tune that parameter. It says nothing additional about messages formatting beyond the schema's OpenAI-format note.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific capability: OpenAI-format chat completions on meta-llama/llama-4-maverick pinned to DeepInfra. The model/provider pinning helps separate it from the many llm_* siblings. It stops short of an explicit verb-resource framing like 'run a chat completion', leaning on the title 'Llama API' for the noun.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to pick this tool over siblings such as llm_gpt_mini or llm_gemini_flash, and no mention of when it is unsuitable. The only 'guidance' is operational (set client timeout to 30s; try the sample endpoint), which is useful but is not tool-selection guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.