Return current capability inventory and usage instructions.

Call this first whenever you connect.

List models matching the filters.

Args: capability: capability tags the model must support (e.g. ["vision"]). min_context_length: minimum context window in tokens. endpoint: limit to a single endpoint name. include_unprobed: include models whose capabilities have not been probed yet (default True).

Forward a request to the selected (endpoint, model).

Args: endpoint: endpoint name registered via the CLI. model: model_id as returned by list_models. operation: one of chat / embedding / image_gen / tts / stt / rerank. payload: upstream-compatible body (OpenAI shape for openai-compat endpoints). The model field is set automatically. The response is passed through verbatim; errors are returned inside error.

Return近3天 aggregated call metrics per model (background-updated).

Args: endpoint: limit to a single endpoint name. sort_by: one of call_count / success_count / avg_first_byte_ms / avg_prompt_tokens / avg_output_tokens. limit: max rows to return.

Each row includes call_count, success_count, success_rate, avg_first_byte_ms, avg_prompt_tokens, avg_output_tokens, window_days.

Enqueue probe jobs. Server-internal worker will drain them.

Args: endpoint: endpoint name; if None, refresh every endpoint. capabilities: list of capability tags; if None, choose probes per model using known metadata. refresh_model_list: re-fetch /v1/models first (default True).

Manually register models or user-confirmed model features.

Args: endpoint: endpoint name. model_ids: one or more model_id to register. context_length: optional context window in tokens. capabilities: optional capability tags to mark as supported (override source). Aliases tts/stt/asr are accepted. feature_overrides: optional key/value overrides. Keys may be capability tags or context_length; capability values must be booleans. Example: {"audio_tts": true, "context_length": 32000}.