A
licenseA
qualityA
maintenanceReal-time cluster health monitoring, pre-request NLMS latency prediction, and intelligent prompt routing across multi-instance LLM backends (vLLM, Ollama, SGLang, TGI).
4
4
3
Apache 2.0
Matching MCP tools:
Matching MCP Connectors:
io.github.sadri-dridi
io.github.sadri-dridi
io.github.sadri-dridi
io.github.sadri-dridi