Skip to main content
Glama

Flat-rate LLM

llm_completion

LLM inference at a flat $0.001 per call - no token metering, no surge. POST a prompt, get the completion. Same price for 10 tokens or 4000, while metered gateways scale with usage. Automatic failover across several large models; typical response under 1s. Flat $0.001 per call, paid over x402 (USDC).

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
promptYesThe request for the model. Up to 24000 characters.
sistemaNoOptional system instruction.
maxTokensNoOutput token cap, up to 4000. Does not change the price.

Schema Changelog

Changes observed during successful MCP inspections. Dates show when Glama detected each change.

  1. First observed

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden. It discloses automatic failover, typical response time under 1s, and the flat pricing mechanism. However, it omits details like error handling, rate limits, or side effects (though it's a non-destructive POST). It adds some behavioral context but not comprehensive coverage.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is somewhat repetitive, mentioning 'flat $0.001 per call' twice and the pricing theme multiple times. It is not tightly front-loaded, leading with pricing rather than the core function. It could be trimmed without losing information, making it only adequately concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool is simple with three parameters, but since there is no output schema, the description should clarify the return format. It only says 'get the completion' without specifying structure. It does mention payment via x402 (USDC), which is useful context. Overall, it is moderately complete but leaves the response format ambiguous.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the parameters are fully documented. The description mentions that maxTokens doesn't change the price, but this is already stated in the schema's description for that parameter. No additional semantic value is added beyond what the schema provides, so the baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool is an LLM inference endpoint that takes a prompt and returns a completion, with a flat pricing model. It is distinct from all sibling tools, which are EVM/utility functions, so an agent can unambiguously identify this as the LLM completion tool.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

While the description does not explicitly name an alternative, the sibling set is entirely EVM/utility, making this the obvious choice for LLM needs. It does mention a differentiator ('flat $0.001 per call' vs. 'metered gateways'), which gives context for when this is preferable, though it stops short of an explicit when/when-not statement.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources