Skip to main content
Glama

Arrakis

Deploy a Hugging Face model

deploy_model
Idempotent

Serve any model from Hugging Face on a machine of the person's, like a hosted inference API but on their own GPU: vLLM or SGLang for text models, vLLM-Omni or SGLang for image and video models (FLUX, Qwen-Image, Wan), vLLM-Omni for speech and music, llama.cpp for a GGUF file (owner/repo:Q4_K_M). extra_args takes the person's own engine options as they'd paste them. COSTS MONEY like rent_gpu: the machine's hourly price, paid an hour at a time from when it runs until terminate_instance or termination_hours; worst_case_usd is the most it can cost. The model's size is read from Hugging Face and, without node_id, the best-ranked clean machine that holds it is rented on as few GPUs as it allows. A gated or private model needs hf_token (read access is enough; it goes to the machine only and Arrakis keeps none). Returns the instance, the endpoint (an OpenAI-compatible base URL once RUNNING, and its api_key) and ssh_command: the person also gets root SSH. The engine downloads the model first, so it answers a few minutes after RUNNING: get_instance shows endpoint_ready. Same idempotency_key returns the same machine.

Input Schema

NameRequiredDescriptionDefault
nameNoA name you will recognise.
modelYesA Hugging Face model id or link, for example Qwen/Qwen3-8B; for llama.cpp, owner/repo:QUANT picks one GGUF file.
engineNoDefault vllm. omni = vLLM-Omni (image, video, speech, audio).
node_idNoA machine from search_gpus. Default: the one sized for the model.
hf_tokenNoA Hugging Face token, for a gated or private model.
gpu_countNoGPUs of it to rent. Default: the fewest that hold the model.
extra_argsNoThe person's own engine options, as they'd paste them: flags, the whole command, or a docker run line (--max-model-len 32768). Read without a shell; the address, key and model stay Arrakis's.
ssh_public_keyNoYour SSH public key. Default: the account's first saved key.
idempotency_keyNoReuse when retrying.
termination_hoursYesHours until the machine is removed automatically.
max_price_per_gpu_hourNoThe most to pay per GPU-hour (USD).

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

A4.5/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Goes well beyond the annotations: it discloses that the call spends money hourly until terminate_instance or termination_hours, explains worst_case_usd, notes the engine downloads the model so the endpoint answers only minutes after RUNNING, points at get_instance/endpoint_ready, and states hf_token is never retained. The idempotency contract (same key returns the same machine) reinforces idempotentHint=true with concrete semantics. No contradiction with readOnlyHint=false/destructiveHint=false.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Front-loaded with the core purpose and every clause carries information, but it is delivered as one dense run-on block with heavy punctuation, making the billing, token-handling and readiness facts hard to scan. Splitting the cost and return-value details into their own sentences would cost nothing and gain legibility.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Eleven parameters, no output schema — yet the description covers returns (instance, OpenAI-compatible endpoint plus api_key, ssh_command), the cost model, failure/readiness timing, and idempotency. An agent has everything needed to call it correctly and to know what it will be billed and given back.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the baseline is 3; the description still adds meaning the schema lacks — the engine-to-modality mapping across sglang/omni/llamacpp, the default node sizing logic when node_id is omitted, that gpu_count defaults to the fewest that hold the model, and how extra_args is parsed (flags, whole command, or docker run line, read without a shell, address/key/model withheld). Some items like the GGUF quant syntax merely repeat the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb+resource (serve a Hugging Face model on the person's own GPU) and immediately scopes the variants by modality (vLLM/SGLang for text, vLLM-Omni for image/video/speech, llama.cpp for GGUF). It also differentiates itself from the sibling rent_gpu by explicitly saying it costs money 'like rent_gpu', so the agent can tell the two apart without opening schemas.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Gives clear conditions: gated/private models need hf_token, GGUF needs the owner/repo:Q4_K_M form, without node_id the best-ranked clean machine is auto-picked. It references rent_gpu for the cost model and get_instance for readiness, but never states plainly when to choose this over plain rent_gpu (i.e. when you want a model served rather than a bare box).

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources