A
licenseNot graded
qualityC
maintenanceEnables benchmarking of local LLM models (performance and quality) and sharing results to a public leaderboard via MCP tools.
6 npm
8
Apache 2.0
MCP vLLM Benchmarking Tool
by Eliovp-BV
Related Servers
Alternatives to MCP vLLM Benchmarking Tool
No user-submitted related servers found.
Related Servers
- AlicenseNot gradedqualityNot gradedmaintenanceEnables benchmarking of Large Language Model APIs by measuring performance metrics such as generation throughput, prompt throughput, and Time To First Token (TTFT) with configurable concurrency levels and parameters.1MIT
- AlicenseBqualityNot gradedmaintenanceEnables building and running custom LLM benchmarks with multi-judge evaluation, supporting GUI, MCP client, and CLI usage for ranked, auditable results.3MIT
- AlicenseNot gradedqualityAmaintenanceVendor-neutral local LLM inference benchmark and hardware-config advisor for mlx and llama.cpp. Exposes an MCP tool that measures real tokens/second on your own hardware.15 npmApache 2.0
- AlicenseNot gradedqualityBmaintenanceProvides an MCP-compatible profiler for measuring edge and on-device LLM inference latency, including TTFT, TPOT, tokens-per-second throughput, and P50/P90/P99 jitter distributions. It enables agents and developers to run these telemetry benchmarks from MCP clients such as Claude Desktop, Cursor, and Windsurf.7MIT
- AlicenseAqualityCmaintenanceEnables users to benchmark AI models across English, Urdu, and Roman Urdu by running question sets, grading answers, measuring confidently wrong and hedged responses, and producing reports, comparisons, and CSV exports through an MCP client or CLI.8MIT
This server cannot be deployed
Maintenance
ActivityInactive
ResponsivenessNo issues