A
licenseNot graded
qualityB
maintenanceEnables edge AI agents to optimize inference memory and latency by mapping logical blocks to non-contiguous physical pages, tracking fragmentation, and exposing related MCP tools.
7
MIT
genpark-kv-cache-paged-attention-allocator-skill
Officialby alphaparkinc
Related Servers
Alternatives to genpark-kv-cache-paged-attention-allocator-skill
No user-submitted related servers found.
Related Servers
- AlicenseNot gradedqualityBmaintenanceEnables profiling and optimizing edge and on-device LLM inference by measuring TTFT, TPOT, tokens/second throughput, and P50/P90/P99 jitter while providing standard-library primitives for quantization, paged attention, speculative decoding, and prefix caching.7MIT
- AlicenseNot gradedqualityBmaintenanceEnables zero-dependency INT8 symmetric quantization of LLM weights and activations on a per-tensor or per-channel basis, reporting SNR and MSE reconstruction telemetry along with TTFT/TPOT latency and jitter metrics. Also exposes edge inference primitives such as PagedAttention block allocation, radix prefix caching, and speculative decoding verification through the Model Context Protocol.7MIT
- AlicenseNot gradedqualityBmaintenanceEnables verification of draft-target speculative decoding with rejection sampling, acceptance-rate telemetry, and dynamic speedup estimation, alongside edge inference primitives such as INT8 quantization, paged KV allocation, and radix prefix caching.7MIT
- AlicenseNot gradedqualityBmaintenanceEnables LLM clients to manage hierarchical working, dialogue, and episodic memories with decay-aware consolidation, hybrid lexical/vector retrieval, knowledge-graph expansion, and semantic caching over MCP.7MIT
Local AI MCPofficial
AlicenseAqualityAmaintenanceUnified MCP server for managing local model runtimes (Ollama, LM Studio, etc.), enabling provider-agnostic discovery, lifecycle management, hardware-fit checks, and delegated inference.1646 npmCreative Commons Attribution Non Commercial No Derivatives 4.0 International
This server cannot be deployed
Maintenance
ActivityMaintained
ResponsivenessNo issues