Patronus MCP Serverofficial
A
licenseNot graded
qualityD
maintenanceEnables running LLM evaluations, experiments, and custom evaluators through a standardized MCP interface.
16
Apache 2.0
NM Hard Tools
Officialby neuralmagic
NM Hard Tools
Bereitstellbare, zustandslose MCP-Dienste für rigorose Inferenzbewertung und Benchmarking. Dieses Repository enthält die Dienstimplementierungen, Container-Images und Helm-Charts.
Enthaltene Dienste:
ein profilierter
lm-evaluation-harness-Controller und -Worker;ein begrenzter MCP-Adapter für den vLLM-Forward-Pass-Benchmark-Dienst;
Bereitstellungs-Charts für lm-eval, forward-pass, Nyann und AgentX.
Entwicklung
uv run --extra test pytest
uv run --extra test ruff format --check src tests
uv run --extra test ruff check src testsDie Repository-Governance ist in gov/ gespeichert und wird mit govctl validiert:
cargo install govctl --version 0.19.1 --locked
govctl status
govctl checkDas lm-eval-Image muss mit einem expliziten Python-Basis-Image erstellt werden:
podman build -f Dockerfile.lm-eval-service \
--build-arg BASE_IMAGE=python:3.12-slim -t inference-hard-lm-eval:dev .Related MCP server: ArmBench MCP Server
Lizenz
Lizenziert unter der Apache License, Version 2.0. Siehe LICENSE.
This server cannot be installed
Maintenance
–Maintainers
–Response time
–Release cycle
–Releases (12mo)
Commit activity
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Servers
- AlicenseNot gradedqualityBmaintenanceEnables benchmarking and inference of LLMs on Arm64 cloud instances with KleidiAI optimizations, providing an MCP-compatible API for serving results.1MIT
Local AI MCPofficial
AlicenseAqualityAmaintenanceUnified MCP server for managing local model runtimes (Ollama, LM Studio, etc.), enabling provider-agnostic discovery, lifecycle management, hardware-fit checks, and delegated inference.16224Creative Commons Attribution Non Commercial No Derivatives 4.0 International- FlicenseNot gradedqualityCmaintenanceMCP-based code evaluation harness — sandboxed execution + LLM quality scoring.
Related MCP Connectors
MCP server providing access to the Scorecard API to evaluate and optimize LLM systems.
Hosted MCP server for LLM cost estimation, model comparison, and budget-aware routing.
Benchmark-first release surface with a read-only MCP endpoint and operator CLI.
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/neuralmagic/nm-hard-tools'
If you have feedback or need assistance with the MCP directory API, please join our Discord server