Scorecard MCP Server
This server does not currently have a deployable release on Glama. Follow the repository's setup instructions to install and configure it for your MCP client, including any required credentials and local dependencies.
Scorecard MCP Server on Cloudflare
This repository allows you to deploy a remote MCP server on Cloudflare Workers that enables Claude and other MCP clients to access Scorecard's evaluation tools.
Get started:
This will deploy your Scorecard MCP server to a URL like: scorecard-mcp.<your-account>.workers.dev/sse
Alternatively, you can clone this repository and deploy it using Wrangler:
git clone https://github.com/scorecard-ai/scorecard-mcp.git
cd scorecard-mcp
npm install
npm run deployRelated MCP server: Remote MCP Server
About This MCP Server
This MCP server provides access to Scorecard's evaluation tools directly from Claude and other MCP-compatible clients. It uses Clerk for authentication and is built on Cloudflare Workers for reliable, global deployment.
The server implements the MCP specification (2025-03-26) and provides secure access to Scorecard's API for running experiments, generating synthetic data, configuring metrics, and analyzing model performance.
Connect to MCP Clients
This MCP server works with various MCP-compatible clients:
Connect to claude.ai, Cursor, and Windsurf
Once deployed, you can connect to your MCP server from Claude and other MCP-compatible clients by providing your server URL:
https://scorecard-mcp.<your-account>.workers.dev/sseConnect via Cloudflare AI Playground
You can also connect through the Cloudflare AI Playground:
Enter your deployed MCP server URL (
scorecard-mcp.<your-account>.workers.dev/sse)You can now use Scorecard's evaluation tools directly from the playground!
Connect via Claude Desktop
For local testing, you can connect to your MCP server from Claude Desktop by using the mcp-remote proxy.
Follow Anthropic's Quickstart and within Claude Desktop go to Settings > Developer > Edit Config.
Update with this configuration:
{
"mcpServers": {
"scorecard": {
"command": "npx",
"args": [
"mcp-remote",
"https://scorecard-mcp.<your-account>.workers.dev/sse" // or http://localhost:8787/sse for local testing
]
}
}
}Restart Claude and you should see the tools become available.
Local Development
For local development, create a ".dev.vars" file with your Clerk credentials:
cp .dev.vars.example .dev.varsConfigure the following variables in your .dev.vars file:
Variable | Source | Notes |
CLERK_CLIENT_ID | Clerk Dashboard -> Configure -> OAuth Applications | |
CLERK_CLIENT_SECRET | Clerk Dashboard -> Configure -> OAuth Applications | Cannot be viewed after initial generation |
CLERK_DOMAIN | Clerk Dashboard -> Configure -> API Keys -> Frontend API URL | Override this with the Clerk development URL if using with local Scorecard server |
CLERK_PUBLISHABLE_KEY | Clerk Dashboard -> Configure -> API Keys -> Publishable Key | Override this with the pk_test_* one if using with local Scorecard server |
Then run the development server:
npm install
npm run devRemember to run npx wrangler types to generate types for the environment variables.
Contributors
Special thanks to Dustin Moore for his engineering leadership in developing this MCP implementation.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
Related MCP Connectors
MCP server providing access to the Scorecard API to evaluate and optimize LLM systems.
Pay-per-call AI evaluation MCP server. Score LLM outputs against benchmark rubrics via Workers AI.
Cloudflare Workers MCP server: claude-skill-validator
Zero-dependency Cloudflare Worker gateway turning websites and REST APIs into MCP tools.
Related MCP Servers
- FlicenseNot gradedqualityCmaintenanceA Cloudflare Workers-based implementation of the Model Context Protocol server with OAuth login, allowing Claude and other MCP clients to connect to remote tools.1-
- FlicenseNot gradedqualityNot gradedmaintenanceA Cloudflare Workers-based implementation of Model Context Protocol (MCP) server that enables AI assistants like Claude to access external tools and capabilities through a standardized interface with OAuth authentication.-
- FlicenseNot gradedqualityCmaintenanceA Cloudflare Workers-based implementation of the Model Context Protocol (MCP) server that enables tool usage in Claude through OAuth authentication.-
- FlicenseNot gradedqualityDmaintenanceA Cloudflare Workers-based implementation of Model Context Protocol (MCP) server with OAuth login that allows tools like Claude to access external capabilities.-