whisper_server
Manage a persistent whisper model server that holds the model in VRAM, eliminating per-file load overhead for repeated transcriptions. Start for batch work, stop to free GPU memory.
Instructions
Start, stop, or check the persistent whisper model server. When running, the active model stays resident in VRAM and every transcribe_audio / transcribe_batch call is served over localhost without reloading it — eliminating the per-file model-load cost (a large speedup for many short files). ⚠️ The resident model holds GPU VRAM for the server's entire lifetime, so start it deliberately, do your work, then stop it to hand the GPU back to other applications. While it is running, background jobs, start_batch, generate_subtitles, and lrc/csv or advanced per-call options are refused (they need the one-shot CLI and would contend for the GPU) — stop the server to use those. Bound to localhost only.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| action | Yes | start = launch the server with the active model resident; stop = shut it down and free VRAM; status = report whether it is running, the resident model, port, and uptime. |