Actually run a small model, right now
try_a_modelEverything else here tells you what a model would do. This one runs one. A 0.8B model on ordinary server CPU answers your prompt live, and the reply carries its own measured tokens/sec for that exact call - not an average someone remembered. It is a weak model and it is often wrong; that is the point, because you get to see what this size actually does instead of reading an adjective for it. One caller at a time: if it is busy you get a number of seconds rather than a queue, because two callers on one CPU brain roughly halve each other's speed. Needs no identity, costs no credits. Read-only in the sense that it changes nothing here: it runs a small model and gives you the text back. It costs us real compute, so it is rate limited, and when the box is busy it says so instead of queueing you.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| prompt | Yes | What to ask it. Keep it short - a long prompt costs more CPU to read than the answer costs to write. |