Skip to main content
Glama

Jev Kit

English | 繁體中文

Batch judgments for coding agents and experimental Ego Lite browser automation, powered by TypeSafe Jev.

Features

Batch judgments

Built on jev-use and jev-mcp patterns, with local source/quote validation. Pass existing text or tool output directly; no extra LLM summary is needed.

Tool

Capability

Example use

jev_evidence

Check up to 256 claim/source pairs per input. Verify exact quotes locally; return support, contradiction, insufficient evidence or review

Check report citations, release claims or answers against logs and documents

jev_classify

Classify up to 64 records against 2–32 custom classes, with an explicit manual-review option

Triage issues, group feedback or label tool outputs

jev_extract

Use regex to find candidates, then select exact source values for up to 8 fields

Find the current version, date or identifier among several mentions

jev_decide

Compare 2–6 supplied alternatives against priorities and up to 3 requirements; flag missing or conflicting evidence

Choose an implementation or processing route using known tradeoffs

jev_rerank

Reorder up to 30 supplied search results; select an inspection prefix while retaining all remaining IDs

Prioritize code snippets or document passages from existing search results

These are advisory judgments. Sources and alternatives come from the caller; the tools do not search for missing evidence or execute the selected decision. Input schemas and examples.

Ego Lite browser automation — experimental

Run a browser job with a goal, starting URL and expected outcome. The pinned jev-ultrafast policy chooses actions; Ego Lite executes them.

  • Click controls, fill fields, select options and navigate pages for searches, forms and article lookup. Generated field text uses a configured text model or Claude CLI helper.

  • Check target identity, visibility and page state before acting. Re-observe supported stale-target failures instead of replaying the old action.

  • Verify the expected URL and/or page text independently of Jev's completion signal.

  • Set allowed origins, a step limit and a time budget; stop for caller handoff on observed popups or dialogs. Record actions and outcomes in a private receipt.

~/.local/share/jev-kit/jev browser --input job.json

Requires separate Ego Lite/upstream setup. Time limits are checked between operations; login, transaction approvals, frames, shadow DOM and popup continuation are outside the tested scope. Setup and job example.

Agent integration and lifecycle

  • Native integration, MCP and Skill: expose the same five judgment tools across supported hosts; the included Skill explains when to use them and how to handle uncertain results.

  • CLI batch processing: read JSON from a file or stdin, return structured JSON, and validate inputs offline with --validate-only.

  • Shared installation manager: detect hosts, select integrations, update managed hosts together, check configuration drift and remove individual integrations while preserving unrelated settings.

Installation makes tools available for the agent to call. It does not add automatic permission hooks, context compaction or model routing.

Review and result tracking

Low-confidence, incomplete or invalid judgments remain marked for review. Reranking failures retain the original candidate order. Local quote checks, empty extraction candidates and single-candidate reranking can skip model calls.

Results include review flags, timing, resolved model and usage when a call returns them; source-based tools also retain IDs/references and hashes for comparison with the original input. CLI output can be saved as a new private receipt without overwriting an existing file.

Related MCP server: jev-agent-mcp

Install

Requires Git, Node.js 22+, Python 3.11+ and a POSIX shell. Host installation tested on macOS; Windows unsupported.

curl -fsSL https://raw.githubusercontent.com/WaynezProg/jev-kit/main/install.sh | sh

The installer detects configured hosts: Codex, Claude Code, OpenCode, Muse, Grok, Gemini CLI, Cursor, VS Code and Pi. It prefers native integration, with MCP + Skill fallback where supported.

Save your TypeSafe API key to ~/.config/jev-benchmark/typesafe-api-key with file permission 0600, or configure TYPESAFE_API_KEY / TYPESAFE_API_KEY_FILE in the host environment. Restart the host after installation; start a new Codex task.

# Status, update, remove
~/.local/share/jev-kit/jev status
~/.local/share/jev-kit/jev update
~/.local/share/jev-kit/jev uninstall

Host configuration and verification details. Cursor/VS Code editor UI discovery remains unverified; OpenCode V2 has contract tests only.

Test results

Measured workflow results; browser timings compare Jev against Fable 5.1 low with up to five actions per response. Times are medians.

Workload

Observed result

Ego Lite: 3 form tasks × 2 runs

Both passed 6/6; Jev 6.35 s vs Fable 7.30 s (13.0% less time)

Ego Lite: 2 Wikipedia tasks × 2 runs, after fix

Both passed 4/4; Jev 5.42 s vs Fable 7.23 s (25.1% less time)

Code search: 64 queries

Paired target ranked first: BM25 46.9%, Jev 70.3%, Fable 93.8%. In the separate repair test, Jev was slower than BM25: 5.25 s vs 4.42 s

Model assistance

Haiku accuracy did not improve; Fable routing was faster but less accurate. No demonstrated reduction in required thinking level

The browser sample is small and uses familiar tasks; Wikipedia initially passed only 3/4 before the fix. These results support further browser trials, not a general coding speedup or cost-saving claim.

Browser measurements · Search and repair measurements · Model comparisons — links pin the tested historical revision.

Engineering checks: 47 JavaScript + 36 Python tests passed, with macOS/Linux CI passing on 2026-09-21. These check implementation behavior, separately from the task results above.

Related MCP Connectors

Related MCP Servers

  • A
    license
    A
    quality
    B
    maintenance
    Enables frontier coding agents to delegate routine probabilistic judgments to TypeSafe Jev, providing calibrated triage signals for failures, attempts, completion, context ranking, findings, risk, and generic evidence-grounded questions.
    7
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables coding or reasoning agents to request structured judgments from TypeSafe's Jev model at decision points, including choices, scores, claim verification, and code reviews, with probabilities and confidence returned as data.
    5
    173 npm
    MIT
  • A
    license
    B
    quality
    C
    maintenance
    Enables AI agents to obtain typed judgments from TypeSafe's Jev System One models, including yes/no probabilities, multiple-choice selections with distributions, and rubric-based scores, directly usable in code.
    5
    2
    AGPL 3.0
  • F
    license
    Not graded
    quality
    B
    maintenance
    Enables Claude Code agents to perform structured decision-making through TypeSafe Jev, supporting yes/no checks, route selection, scoring, and batched multi-question judgments with confidence values.
    1
    -