A
licenseA
qualityA
maintenanceReal-time cluster health monitoring, pre-request NLMS latency prediction, and intelligent prompt routing across multi-instance LLM backends (vLLM, Ollama, SGLang, TGI).
4
3
Apache 2.0
115,036 servers. Updated
Search Relevance ↓
Recent Usage ↓
Date Added ↓
Date Updated ↓
Weekly npm Downloads ↓
Weekly PyPI Downloads ↓
GitHub Stars ↓
Recent GitHub Stars ↓