Plan a model deploy (free)
plan_deployWhat serving a Hugging Face model takes, before anything is rented: the GPU memory it needs and the machines it fits on right now, best value first, each with its hourly price and a rough speed. Free; rents and changes nothing. Call it first whenever the person wants a model running (to chat with, call from code, generate images, video or speech, or run evals against), tell them the price, then deploy_model with the option's node_id and gpu_count.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"model": "<model>"
},
"name": "plan_deploy"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | Yes | A Hugging Face model id or link, for example Qwen/Qwen3-8B; for llama.cpp, owner/repo:QUANT. | |
| engine | No | Default vllm. omni = vLLM-Omni (image, video, speech, audio). | |
| hf_token | No | A Hugging Face token, for a gated or private model. | |
| extra_args | No | The person's own engine options, to check them before renting. |