Hardware for a local AI assistant for Directum RX
size_aiHow many CPU servers and how much memory a local LLM assistant for Directum RX needs (the model works with RX through MCP tools), from drxinfra measurements: llama.cpp on CPU, load tests with 1, 2 and 4 concurrent users and an answer quality check. Same model and numbers as drxinfra.ru/ai-sizing.html. Returns servers, memory, typical and p95 answer time, answers per hour, the quality score, and a comparison of all measured models on the chosen server.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| hw | No | Measured server: icelake16 = Intel Xeon Ice Lake, 16 vCPU, 32 ГБ; m1pro = Apple M1 Pro, 8 ядер CPU | icelake16 |
| kv | No | KV cache type of the model server | f16 |
| qph | No | Questions per hour from each of them | |
| model | No | Model: qwen3-4b = Qwen3 4B; qwen3-8b = Qwen3 8B; gigachat31 = GigaChat 3.1 10B-A1.8B; qwen3-30b-a3b = Qwen3 30B-A3B Instruct 2507 | qwen3-8b |
| share | No | Percent of them asking in the peak hour, usually 10-30 | |
| users | No | Employees with the assistant | |
| target | No | Acceptable typical answer time, seconds | |
| toolset | No | RX tools given to the model: all = Все 27; pilot = 16 для пилота | all |