A
securityA
licenseA
qualityAn MCP server that provides LLMs access to other LLMs
Last updated -
50
63
MIT License
MCP vLLM Benchmarking Tool
This is proof of concept on how to use MCP to interactively benchmark vLLM.
We are not new to benchmarking, read our blog:
This is just an exploration of possibilities with MCP.
Usage
- Clone the repository
- Add it to your MCP servers:
Then you can prompt for example like this:
Todo:
- Due to some random outputs by vllm it may show that it found some invalid json. I have not really looked into it yet.
This server cannot be installed
remote-capable server
The server can be hosted and run remotely because it primarily relies on remote services or has no dependency on the local environment.
사용자가 MCP를 통해 vLLM 엔드포인트를 벤치마킹하고 사용자 정의 가능한 매개변수를 사용하여 LLM 모델의 성능 테스트를 수행할 수 있는 대화형 도구입니다.
Related MCP Servers
- -securityAlicense-qualityAn MCP server that allows agents to test and compare LLM prompts across OpenAI and Anthropic models, supporting single tests, side-by-side comparisons, and multi-turn conversations.Last updated -MIT License
- -securityFlicense-qualityAn MCP server that integrates various penetration testing tools, enabling security professionals to perform reconnaissance, vulnerability scanning, and API testing through natural language commands in compatible LLM clients like Claude Desktop.Last updated -4
- -securityAlicense-qualityConnects local LLMs to external tools (calculator, knowledge base) via MCP protocol, enabling automatic tool detection and execution to enhance query responses.Last updated -MIT License