A
licenseA
qualityB
maintenanceLets assistants send the same test prompts to as many as four text models across OpenRouter, Amazon Bedrock, Google Vertex AI and Microsoft Foundry, then automatically grade each answer with a judge model, rule checks and a policy gate. Returns scored leaderboards with letter grades, per-response strengths and weaknesses, latency, throughput and estimated cost, plus downloadable PDF and CSV reports.
9
MIT