kobold_perf_info
Retrieve performance metrics from KoboldAI's text generation API to monitor system status and optimize resource usage.
Instructions
Get performance information
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| apiUrl | No | http://localhost:5001 |
Implementation Reference
- src/index.ts:307-323 (handler)Maps 'kobold_perf_info' tool calls to the KoboldAI '/api/extra/perf' endpoint and proxies the GET request using makeRequest, returning the JSON response.
const getEndpoints: Record<string, string> = { kobold_max_context_length: '/api/v1/config/max_context_length', kobold_max_length: '/api/v1/config/max_length', kobold_generate_check: '/api/extra/generate/check', kobold_model_info: '/api/v1/model', kobold_version: '/api/v1/info/version', kobold_perf_info: '/api/extra/perf', kobold_sd_models: '/sdapi/v1/sd-models', kobold_sd_samplers: '/sdapi/v1/samplers', }; if (getEndpoints[name]) { const result = await makeRequest(`${apiUrl}${getEndpoints[name]}`); return { content: [{ type: "text", text: JSON.stringify(result, null, 2) }], isError: false, }; - src/index.ts:70-70 (schema)Defines the input schema for 'kobold_perf_info' tool as PerfInfoSchema, which aliases BaseConfigSchema (optional 'apiUrl' string for overriding the default KoboldAI API URL).
const PerfInfoSchema = BaseConfigSchema; - src/index.ts:194-197 (registration)Registers the 'kobold_perf_info' tool in the ListTools response, providing name, description, and input schema.
name: "kobold_perf_info", description: "Get performance information", inputSchema: zodToJsonSchema(PerfInfoSchema), }, - src/index.ts:146-162 (helper)Universal HTTP request helper function used to proxy all tool calls, including 'kobold_perf_info', to the KoboldAI server.
async function makeRequest(url: string, method = 'GET', body: Record<string, unknown> | null = null) { const options: RequestInit = { method, headers: body ? { 'Content-Type': 'application/json' } : undefined, }; if (body && method !== 'GET') { options.body = JSON.stringify(body); } const response = await fetch(url, options); if (!response.ok) { throw new Error(`KoboldAI API error: ${response.statusText}`); } return response.json(); }