Skip to main content
Glama

LLM inference, large model: Llama 3.3 70B or gpt-oss-120b

ai_chat_large
Read-only

Send a prompt, get an answer from a larger open model: Llama 3.3 70B Instruct (default) or OpenAI gpt-oss-120b, with an optional system prompt, up to 1,024 output tokens and adjustable temperature. Same call as /ai/chat with a stronger model. Use when the 8B model is not enough: reasoning, drafting and Q&A. Example: prompt=Explain x402 in one sentence.. Price $0.01/call via x402 USDC or a card key (/credits); failed calls free. Reads or computes only and changes nothing; each call is charged, so repeats are not free.

Input Schema

NameRequiredDescriptionDefault
modelNollama-3.3-70b (default) or gpt-oss-120b
promptYesUser prompt, up to 8,000 characters
systemNoOptional system prompt, up to 2,000 characters
maxTokensNoMaximum output tokens, 1-1024 (default 400)
temperatureNo0-1.5 (default 0.6)

Schema Changelog

Changes observed during successful MCP inspections.

  1. Added

TDQS

A4.5/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already cover safety (readOnly, non-destructive, openWorld, non-idempotent), and the description adds the economically critical context they cannot: $0.01 per call via x402 USDC or card key, failed calls free, and that repeated identical calls are still billed. That cost-on-repeat disclosure is exactly the kind of behavioral fact that changes agent strategy.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Model choice, cost and usage guidance are front-loaded in a compact block, and almost every clause earns its place. Minor bloat from the redundant 'Same call as /ai/chat with a stronger model' repetition and a stray double period in the example.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, the description covers models, limits, price and the read-only nature of the operation, which is what an agent needs before calling. It stops short of describing the response shape (e.g. whether raw text or a JSON envelope with usage/cost is returned), a small gap for a text-generation endpoint.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so all five parameters are already documented in structured fields. The description restates the optional system prompt, the 1,024 output-token ceiling and adjustable temperature, and adds only the useful nugget that llama-3.3-70b is the default model. That meets the baseline but does not meaningfully exceed the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with a concrete verb and resource (send a prompt, get an answer) and names the exact backing models including the default. It explicitly positions itself against the sibling ai_chat as the same call with a stronger model, so an agent can distinguish the two without opening either schema.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It states the selection condition clearly: use when the 8B model is not enough, for reasoning, drafting and Q&A, and names ai_chat as the alternative for lighter work. A worked example (prompt=Explain x402 in one sentence) anchors the expected input shape.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.