Patronus MCP Serverofficial
A
licenseNot graded
qualityD
maintenanceEnables running LLM evaluations, experiments, and custom evaluators through a standardized MCP interface.
16
Apache 2.0
NM Hard Tools
Officialby neuralmagic
NM Hard Tools
Servicios MCP desplegables y sin estado para una evaluación rigurosa de inferencia y benchmarking. Este repositorio contiene las implementaciones de los servicios, las imágenes de contenedor y los gráficos de Helm.
Servicios incluidos:
un controlador y trabajador de
lm-evaluation-harnessperfilado;un adaptador MCP acotado para el servicio de benchmark de forward-pass de vLLM;
gráficos de despliegue para lm-eval, forward-pass, Nyann y AgentX.
Desarrollo
uv run --extra test pytest
uv run --extra test ruff format --check src tests
uv run --extra test ruff check src testsLa gobernanza del repositorio se almacena en gov/ y se valida con govctl:
cargo install govctl --version 0.19.1 --locked
govctl status
govctl checkLa imagen de lm-eval debe construirse con una imagen base de Python explícita:
podman build -f Dockerfile.lm-eval-service \
--build-arg BASE_IMAGE=python:3.12-slim -t inference-hard-lm-eval:dev .Related MCP server: ArmBench MCP Server
Licencia
Licenciado bajo la Licencia Apache, versión 2.0. Consulte LICENSE.
This server cannot be installed
Maintenance
–Maintainers
–Response time
–Release cycle
–Releases (12mo)
Commit activity
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Servers
- AlicenseNot gradedqualityBmaintenanceEnables benchmarking and inference of LLMs on Arm64 cloud instances with KleidiAI optimizations, providing an MCP-compatible API for serving results.1MIT
Local AI MCPofficial
AlicenseAqualityAmaintenanceUnified MCP server for managing local model runtimes (Ollama, LM Studio, etc.), enabling provider-agnostic discovery, lifecycle management, hardware-fit checks, and delegated inference.16224Creative Commons Attribution Non Commercial No Derivatives 4.0 International- FlicenseNot gradedqualityCmaintenanceMCP-based code evaluation harness — sandboxed execution + LLM quality scoring.
Related MCP Connectors
MCP server providing access to the Scorecard API to evaluate and optimize LLM systems.
Hosted MCP server for LLM cost estimation, model comparison, and budget-aware routing.
Benchmark-first release surface with a read-only MCP endpoint and operator CLI.
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/neuralmagic/nm-hard-tools'
If you have feedback or need assistance with the MCP directory API, please join our Discord server