Skip to main content
Glama
Sign In
BYK

jev-eval-mcp

by BYK
OverviewSchemaSourceRelated ServersDiscussionsAdmin
TypeScript
Remote

Related Servers

Alternatives to jev-eval-mcp

No user-submitted related servers found.

    Related Servers

    • jev-mcp

      rajasekharponakala
      A
      license
      B
      quality
      C
      maintenance
      Enables AI agents to obtain typed judgments from TypeSafe's Jev System One models, including yes/no probabilities, multiple-choice selections with distributions, and rubric-based scores, directly usable in code.
      5
      2
      AGPL 3.0

    • jev-judge-mcp

      gecm0
      A
      license
      Not graded
      quality
      B
      maintenance
      Enables MCP clients to consult TypeSafe's Jev through a judge tool, answering narrow typed questions with calibrated probabilities instead of prose.
      32 npm
      1
      MIT

    • use-jev

      silkyland
      A
      license
      Not graded
      quality
      C
      maintenance
      Enables MCP-capable agents to run TypeSafe's Jev judgment model as typed yes/no, choice, and score tools, with calibrated probabilities, confidence thresholds, escalation for uncertain or non-judgment tasks, and an optional action gate that fails open.
      1
      MIT

    • Jev MCP

      resumocast
      A
      license
      Not graded
      quality
      A
      maintenance
      Enables MCP clients to submit bounded semantic-uncertainty judgments to the pinned TypeSafe Jev API, with tools for yes/no, choice, and score evaluations plus optional evidence or context selection.
      MIT

    • jev-mcp

      arunav25
      A
      license
      A
      quality
      C
      maintenance
      Enables MCP clients to call TypeSafe's JEV classifier and receive structured, typed judgments with probabilities for binary, choice, and scoring questions.
      1
      8
      MIT

    • typesafe-mcp

      devbux
      A
      license
      A
      quality
      A
      maintenance
      Enables agents to ask TypeSafe AI's Jev decision model typed questions — choices, scores, true/false propositions, and image bounding boxes — about a text or JSON state, returning structured answers with calibrated probabilities and confidence instead of free-form prose. Supports images, multi-question batch calls, and long-context requests over stdio.
      6
      0
      MIT
    Deploy Server
    One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd

    TDQS

    A4.1/5.0

    Scored across 3 tools

    Disambiguation5/5

    Each tool has a clearly distinct purpose: jev_map judges items in a list, jev_eval evaluates question wordings against labeled data, and jev_ask runs questions to see answers. There is no overlap or ambiguity in their intended use cases.

    Naming Consistency5/5

    All tools share the 'jev_' prefix and use a consistent verb_noun pattern: map, eval, ask. The naming is predictable and clearly indicates the action each tool performs.

    Tool Count4/5

    With only 3 tools, the server is on the low end of the appropriate range, but each tool covers a distinct phase of the evaluation workflow (prototype, evaluate, triage). The count is reasonable for the narrow domain and does not feel artificially padded.

    Completeness4/5

    The tools cover the core lifecycle for question evaluation: jev_ask for prototyping, jev_eval for validating wording, and jev_map for applying judgments at scale. Minor gaps exist (e.g., no tool for managing question sets or exporting results), but these are not blocking for the primary workflow.

    Maintenance

    ActivitySlowing
    ResponsivenessUnresponsive

    Resources