Skip to main content
Glama
tr4m0ryp

EvalKit MCP Server

by tr4m0ryp
OverviewSchemaSourceRelated ServersDiscussionsAdmin
Python
Remote

Related Servers

Alternatives to EvalKit MCP Server

No user-submitted related servers found.

    Related Servers

    • Trustwise MCP Server by trustwiseai

      Trustwise MCP Serverofficial

      trustwiseai
      A
      license
      Not graded
      quality
      C
      maintenance
      Provides advanced evaluation tools for assessing AI safety, alignment, and performance of LLM outputs. Enables programmatic evaluation of quality, safety metrics like toxicity and PII detection, and operational metrics including carbon footprint and cost estimation.
      4
      Apache 2.0

    • AI Red Teaming MCP Server

      manteclaw
      A
      license
      Not graded
      quality
      C
      maintenance
      AI red teaming toolkit exposed as a Model Context Protocol (MCP) server. Connect any MCP client and test AI systems for safety vulnerabilities.
      MIT

    • TrustHarness

      ofirtro
      A
      license
      B
      quality
      C
      maintenance
      Enables deterministic security testing of AI agents that use tools by serving synthetic MCP environments with poisoned data, fake secrets, and privileged actions. Records agent tool calls and evaluates security invariants (e.g., canary leaks, forbidden access, approval binding) without an LLM judge or real systems.
      8
      MIT
    Deploy Server
    One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd

    TDQS

    B3.2/5.0

    Scored across 4 tools

    Disambiguation5/5

    Each tool targets a distinct evaluation function: robustness classification, query decomposition, obfuscation analysis, and server status. No overlap in purpose.

    Naming Consistency4/5

    All tools share the 'eval_' prefix, but the suffixes vary in pattern (noun_noun for classifier_robustness, verb_noun for decompose_query, noun_noun for obfuscation_evasion, and single noun for status). Mostly consistent with minor deviation.

    Tool Count5/5

    Four tools is well-scoped for an evaluation kit, covering multiple evaluation stages without excess or deficiency.

    Completeness4/5

    The set covers core evaluation operations and status checking, though a tool for retrieving historical results or configuring evaluations would round it out. Minor gap, not severe.

    Maintenance

    ActivityInactive
    ResponsivenessNo issues

    Resources