server_metrics
Retrieve live inference telemetry from a llama.cpp server, including phase, token rates, and slot counts. Returns a degraded envelope when the server is unavailable.
Instructions
Live in-server inference telemetry for a running server (ADR-LLNCH-019): phase (idle/prompt/generating), gen_tok_s, prompt_tok_s, slot counts, started_at. Safe tier — no prompt text. Local-node only. Returns a degraded envelope ({'available': false, 'reason': 'loading'|'no-metrics-flag'|'unreachable'}) rather than erroring when the target server can't be read.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| port | Yes | Port number of the server |