Skip to main content
Glama
EvalKit MCP Server
by tr4m0ryp

Related Servers

Alternatives to EvalKit MCP Server

No user-submitted related servers found.

    Related Servers

    • A
      license
      Not graded
      quality
      B
      maintenance
      Enables red-team testing of AI agents against indirect prompt injection by fuzzing payloads with delimiter evasion and Unicode homoglyphs, detecting exfiltration canaries, enforcing least-privilege tool boundaries, and producing cryptographic audit proofs.
      7
      MIT
    • A
      license
      A
      quality
      C
      maintenance
      Enables LLM agents to drive a data-poisoning detection research pipeline through 28 typed tools: generate poisoned datasets with published attacks, configure and launch detection experiments, follow logs, compare runs, inspect flagged samples, and export sanitized datasets.
      24
      MIT
    • A
      license
      Not graded
      quality
      D
      maintenance
      Provides advanced evaluation tools for assessing AI safety, alignment, and performance of LLM outputs. Enables programmatic evaluation of quality, safety metrics like toxicity and PII detection, and operational metrics including carbon footprint and cost estimation.
      4
      Apache 2.0
    • A
      license
      Not graded
      quality
      D
      maintenance
      AI red teaming toolkit exposed as a Model Context Protocol (MCP) server. Connect any MCP client and test AI systems for safety vulnerabilities.
      MIT

    TDQS

    B3.2/5.0

    Scored across 4 tools

    Disambiguation5/5

    Each tool targets a distinct evaluation function: robustness classification, query decomposition, obfuscation analysis, and server status. No overlap in purpose.

    Naming Consistency4/5

    All tools share the 'eval_' prefix, but the suffixes vary in pattern (noun_noun for classifier_robustness, verb_noun for decompose_query, noun_noun for obfuscation_evasion, and single noun for status). Mostly consistent with minor deviation.

    Tool Count5/5

    Four tools is well-scoped for an evaluation kit, covering multiple evaluation stages without excess or deficiency.

    Completeness4/5

    The set covers core evaluation operations and status checking, though a tool for retrieving historical results or configuring evaluations would round it out. Minor gap, not severe.

    Maintenance

    ActivityInactive
    ResponsivenessOutdated data