pull_late_infer
Compile a Hugging Face model for late-infer by detecting the idle local GPU and building for that vendor. Extra calls wait for approval.
Instructions
Pull a Hugging Face model snapshot and compile it for late-infer on this computer. Detects the idle GPU first (NVIDIA / AMD / Intel) and compiles for that vendor — Intel is never treated as NVIDIA. Requires a Hub org/model id. Extra calls wait for Late Approve. The destination is fixed by late-infer; this tool accepts no cwd, allowlist, write directory, or filesystem path.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | Yes | Hugging Face Hub model id, for example Qwen/Qwen2.5-0.5B-Instruct |