LLM inference API, large model: Llama 3.3 70B or gpt-oss-120b
llm_inferenceLLM inference with a large open model: send a prompt (optional system prompt, up to 1,024 output tokens) and get an answer from Llama 3.3 70B Instruct or OpenAI gpt-oss-120b in one call, with no provider account; OpenAI-compatible at /v1/chat/completions by model name. Use when a small model is not enough: reasoning, drafting, analysis and Q&A inside an agent workflow. Example: prompt=Explain x402 in one sentence.. Price $0.01/call via x402 USDC or a card key (/credits); failed calls free. Reads or computes only and changes nothing; each call is charged, so repeats are not free.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"prompt": "<prompt>"
},
"name": "llm_inference"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | No | llama-3.3-70b (default) or gpt-oss-120b | |
| prompt | Yes | User prompt, up to 8,000 characters | |
| system | No | Optional system prompt, up to 2,000 characters | |
| maxTokens | No | Maximum output tokens, 1-1024 (default 400) | |
| temperature | No | 0-1.5 (default 0.6) |