Skip to main content
Glama

Server Configuration

Describes the environment variables required to run the server.

NameRequiredDescriptionDefault
OPENROUTER_API_KEYYesAPI key for OpenRouter. Required for all roles by default.
TOURNAMENT_RESULTS_DIRNoDirectory for results output. Defaults to './results'.
TOURNAMENT_MODEL_JUDGE_RULESNoModel override for the rules judge role (e.g., 'openai/gpt-5.4-mini').
TOURNAMENT_MODEL_PARTICIPANTNoModel override for the participant agent role (e.g., 'deepseek/deepseek-v3.2').
TOURNAMENT_MODEL_SYNTHESIZERNoModel override for the synthesizer role (e.g., 'moonshotai/kimi-k2.5').

Instructions

Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.

This server publishes no instructions, or was last inspected before Glama recorded them.

Capabilities

Features and capabilities supported by this server

Protocol revision2025-11-25

CapabilityDetails
tools
{
  "listChanged": true
}

Tools

Functions exposed to the LLM to take actions

NameDescription
tournament.evaluateB

Evaluate one to four candidate models with a judge panel.

tournament.quick_testC

Run one scenario with one judge and no synthesis model call.

tournament.leaderboardC

Read the best cached score per model from result files.

Prompts

Interactive templates invoked by user choice

NameDescription

No prompts

Resources

Contextual data attached and managed by the client

NameDescription

No resources

TDQS

B3/5.0

Scored across 3 tools

Disambiguation5/5

Each tool has a distinct purpose: quick test runs a minimal scenario, leaderboard reads cached scores, and evaluate runs a full evaluation. No overlap or ambiguity.

Naming Consistency2/5

Naming is inconsistent: 'quick_test' uses underscore and adjective+noun, 'leaderboard' is a single noun without underscore, and 'evaluate' is a bare verb. No consistent pattern in structure or part of speech.

Tool Count4/5

With 3 tools, the server is at the low end of the typical 3-15 range but still reasonable for a focused evaluation service. The scope is narrow enough that each tool earns its place.

Completeness4/5

The tools cover the core workflow: quick test, full evaluation, and reading results. Minor gaps exist, such as no tool for configuring judges or scenarios, but these are likely predefined or managed externally.

Maintenance

ActivityMaintained
ResponsivenessNo issues