localagents
localagents
Claude Code의 잡일을 직접 보유한 하드웨어에서 실행되는 모델에 넘기세요.
localagents는 Claude Code에 run_agent 도구를 제공하는 MCP 서버입니다. 호출할 때마다 전체 헤드리스 Claude Code 세션이 시작됩니다. 동일한 도구, 동일한 CLAUDE.md, 동일한 작업 트리 — 단, API 트래픽은 Anthropic 대신 직접 실행하는 llama.cpp 또는 vLLM 서버로 전송됩니다. Claude가 지시문을 작성하고, 로컬 모델이 작업을 수행하며, Claude가 결과를 검토합니다. Anthropic 토큰 예산은 필요한 부분에만 사용됩니다.
단일 GPU의 27B Qwen은 "이 모듈에 CLI를 추가하고 그에 맞는 테스트를 작성"하는 작업을 충분히 처리할 수 있습니다. Opus는 pytest가 실행되는 것을 지켜보는 것보다 설계 대화에 사용하는 것이 더 낫습니다. 두 개의 로컬 에이전트를 병렬로 실행하면 고정된 인터페이스를 기준으로 패키지의 두 부분을 각각 구축할 수 있습니다.
상태: 초기 단계. 작동하며, 매일 사용 중이고, 인터페이스는 변경될 것입니다. llama.cpp와 vLLM을 구체적으로 대상으로 합니다. Ollama는 목표가 아닙니다.
작동 방식
Claude Code (your session)
│ MCP: run_agent(task, model=...)
▼
localagents ── spawns ──▶ headless `claude` (Agent SDK)
│ │ ANTHROPIC_BASE_URL
│ ▼
└──── in-process shim ◀────┘ normalises requests, logs them,
│ translates backend errors
▼
llama-server / vllm (/v1/messages, on your machine or your LAN)이것을 단순한 환경 변수 이상으로 만드는 세 가지 요소:
실시간으로 프로브되는 레지스트리.
models.yaml은 서버 위치와 모델 이름 메뉴를 나열합니다. 각 서버가 현재 실제로 제공하는 것, 실제 컨텍스트 창, 사용 중인 슬롯 수는 호출할 때마다 발견됩니다. 모델을 수동으로 올리고 내립니다 — 서버는 아무것도 시작하지 않습니다 — 그리고 Claude가 실행 중이 아닌 모델이 필요하면 이름으로 요청합니다.Claude Code와 백엔드 사이의 심(shim). Claude Code는 로컬 채팅 템플릿이 거부하는 것을 보내고, 로컬 서버는 Claude Code가 인식하지 못하는 방식으로 실패합니다. 심은 양방향을 수정하고(자세한 내용은 아래) 작업별로
requests.jsonl을 기록하여 네트워크를 통해 정확히 무엇이 전송되었는지 확인할 수 있게 합니다.Claude 자체 서브에이전트와 동일한 격리 모델. 기본적으로 작업은 Agent 도구처럼 트리에서 실행됩니다.
isolation: worktree는local-agent/<job>브랜치에 새 git worktree를 제공하며, 변경 사항이 있을 때만 유지되고 작업 기록에 diffstat이 포함되어 Claude가 diff로 검토할 수 있습니다.
Related MCP server: lmstudio-mcp
요구 사항
Python 3.12+ 및 uv
Claude Code. Agent SDK는 자체
claude바이너리를 번들하므로 추가로 설치할 것이 없습니다.Anthropic의
/v1/messages를 지원하는 서버:llama.cpp
llama-server—--jinja로 시작하고,--slots --metrics를 추가하면 도구 출력에서 점유율과 캐시 통계를 얻을 수 있습니다.vLLM
--enable-auto-tool-choice --tool-call-parser <parser>와 함께.
실제로 Claude Code를 구동할 수 있는 모델: 견고한 네이티브 도구 호출과 요청당 128k 이상의 컨텍스트 창. Qwen3.8-27B가 잘 작동합니다. 더 작은 창도 작동하지만 지속적으로 압축됩니다. 컨텍스트 창을 참조하세요.
설치
git clone https://github.com/ccebelenski/localagents.git && cd localagents
uv tool install -e . # `localagents` on PATH; editable, so repo edits apply
cp models.example.yaml models.yaml # edit for your servers (gitignored)
claude mcp add --scope user local -- localagents --config "$PWD/models.yaml"사용자 범위는 모든 프로젝트가 local 서버를 얻는다는 것을 의미합니다. 이 서버는 실행한 Claude Code 세션의 cwd를 상속하므로 run_agent는 해당 프로젝트의 트리를 기본값으로 사용합니다. 프로젝트는 자체 ./models.yaml을 보유하여 레지스트리를 재정의할 수 있습니다.
단일 프로젝트로 제한하려면 해당 프로젝트의 .mcp.json에 다음을 넣으세요:
{"mcpServers": {"local": {"command": "localagents", "args": ["--config", "/path/to/models.yaml"]}}}추가한 후 Claude Code를 다시 시작하세요(또는 /mcp → 재연결). MCP 서버는 시작 시 로드됩니다.
사용 방법
Claude는 다른 도구처럼 이를 인식합니다. 이름으로 요청하면 올바른 작업을 수행합니다:
로컬 에이전트를 사용하여 CLI에
--json플래그를 추가하고 테스트에서 다루세요.
Claude가 그 뒤에 수행하는 작업: list_models로 상황을 확인하고, run_agent(task=…)로 작업 ID를 얻은 다음, wait_job / job_status / job_log로 완료될 때까지 기다린 후, files_touched(또는 worktree diff)를 읽고 작업을 확인합니다. Claude Code의 2분 도구 시간 제한을 초과하는 작업은 백그라운드로 전환되어 나중에 처리됩니다. 아무것도 할 필요가 없습니다.
적합한 것이 실행 중이 아니면 시작하라는 요청을 받게 됩니다:
qwen3.8-27b가 어디에서도 실행 중이 아닙니다. 사용자에게 시작하도록 요청하세요. 참고: llama.cpp의 기본 중간 크기 코더; --reasoning on으로 실행
평소처럼 시작하고 "실행 중"이라고 말하면 Claude가 재시도합니다.
도구
도구 | 기능 |
| 실시간 상태, 제공 ID, 컨텍스트 창, 슬롯 점유율을 가진 엔드포인트; |
| 작업 시작: |
| 작업 추적 및 제어 |
| 풀 모델을 시작하도록 사용자에게 알릴 내용 |
| 세션 내에서 풀에 추가( |
| 도구 없는 일회성 생성 — 요약, 초안, 분류 |
작업 기록은 ~/.local/state/localagents/jobs/<job>/에 저장됩니다: transcript.txt(에이전트가 말하고 행한 것), events.jsonl(모든 SDK 메시지), requests.jsonl(타이밍, 크기, 사용량을 포함한 모든 백엔드 요청), 그리고 요청 덤프를 켜면 requests_full.jsonl도 있습니다.
구성: models.yaml
models.example.yaml에서 시작하세요. 호출할 때마다 다시 읽히므로 편집 내용이 즉시 적용되며, 서버는 이를 다시 쓰지 않습니다 — register_*는 위에 병합되는 사이드카 models.local.yaml에 기록합니다.
endpoints:
llamacpp:
base_url: http://127.0.0.1:8080
backend: llama.cpp
gpu-server:
base_url: http://gpu-server.lan:8000
backend: vllm
host: gpu-server
models:
qwen3.8-27b:
notes: default mid-size coder on llama.cpp; run with --reasoning on
deepseek-v4-flash:
host: gpu-server
notes: vllm needs --enable-auto-tool-choice --tool-call-parser deepseek_v3endpoints는
/v1/messages를 제공하는 위치입니다. 제공되는 내용은 프로브됩니다.models는 단지 이름입니다. 이름은 제공 ID와 퍼지 매칭됩니다(
qwen3.8-27b는unsloth/Qwen3.8-27B-GGUF:UD-Q4_K_XL을 찾음). 따라서 항목에는notes와 시작을 요청할 때 전달할host만 있으면 됩니다.served_name(정확한 ID 또는 glob),endpoint,context(대체 창),bring_up(시작 명령)은 원하는 경우 재정의로 존재합니다. 시작 명령은 빨리 낡습니다. 이름과 메모가 일반적으로 더 오래갑니다.defaults는 기본 모델,
permission_mode(acceptEdits), 허용 및 금지 도구(서브에이전트는 서브에이전트를 생성할 수 없음), 로드할 Claude 설정,max_turns,timeout_s, 그리고 에이전트에게 위임자임과 보고 방법을 알려주는 시스템 프롬프트 접미사를 다룹니다.
심이 하는 일
llama.cpp와 vLLM 모두 /v1/messages를 기본적으로 지원하므로 ANTHROPIC_BASE_URL을 그쪽으로 지정하면 거의 작동합니다. 심이 간극을 메웁니다:
대화 중 시스템 메시지. Claude Code는 messages 안에 role: system 항목을 넣습니다 — 스킬 목록, 토큰 예산 표시, 그리고 턴마다 하나 더. Qwen의 채팅 템플릿은 거부합니다: "System message must be at the beginning". 심은 각각을 인접한 사용자 메시지에 <system>…</system> 텍스트 블록으로 제자리에 접습니다. 대신 최상위 system 필드로 올리면 매 턴 프롬프트 시작이 변경되어 서버의 KV-캐시 접두사가 무효화되고 전체 ~35k 토큰 프롬프트가 매번 재평가됩니다(27B에서 턴당 21–47초). 제자리에 접으면 프롬프트가 추가 전용으로 유지됩니다: llama-server 로그에서 f_sim_best 0.88–0.99, 턴당 2.5–14초.
컨텍스트 오버플로. Claude Code는 인식하지 못하는 모델에 대해 200k 창을 가정합니다. 더 작은 슬롯에서는 llama.cpp의 exceed_context_size_error가 발생하고, 이를 이해하지 못해 작업이 중단됩니다. 다음 섹션을 참조하세요.
심이 하는 모든 것은 필요하지 않을 때 no-op이며, 모든 요청은 타이밍, 메시지 수, 바이트 크기, 보고된 사용량과 함께 기록됩니다.
컨텍스트 창
두 계층이 세션을 실제 창 안에 유지합니다:
프로브가 읽습니다 — llama.cpp
/propsn_ctx(슬롯별: 통합 KV가 꺼져 있을 때-c를--parallel로 나눈 값), vLLMmax_model_len— 그리고 세션은CLAUDE_CODE_MAX_CONTEXT_TOKENS를 받습니다. 그러면 Claude Code 자체 자동 압축이 올바른 시점에 실행됩니다. 128k 미만에서는 출력 예산도n_ctx/8로 축소됩니다. 압축 임계값이window − max_output이므로 그렇지 않으면 0이 되기 때문입니다.요청이 여전히 오버플로되면 심은 백엔드 오류를 Anthropic의
prompt is too long: N tokens > M maximum으로 다시 작성하며, Claude Code는 압축하고 재시도하여 응답합니다.
64k에서는 작동하지만 심하게 반복됩니다: Claude Code의 ~20k 고정 프롬프트 및 도구 스키마, ~7k 토큰 압축 요약(27B에서 ~55초), 그리고 다시 첨부하는 파일들이 몇 턴 안에 창을 다시 채우고, 스래시 가드가 작업을 종료합니다. 각 슬롯에 128k 이상을 제공하세요.
백엔드 참고 사항
llama.cpp:
llama-server -hf <gguf> --jinja -fa on --slots --metrics, 그리고 사고 모델용--reasoning on, 동시 작업용--parallel N./slots가 켜져 있으면list_models는{total, busy, free}를 표시하여 Claude가 두 번째 에이전트가 지금 실행될지 대기할지 알 수 있습니다./metrics가 켜져 있으면 각 작업은 처리된 프롬프트 토큰 대 캐시, 캐시 적중률, 프롬프트 및 생성 tok/s, 추측 디코딩 수용을 기록합니다 — 카운터는 서버 전체이므로 겹치는 작업이 델타를 공유합니다.vLLM:
vllm serve <model> --served-model-name <alias> --enable-auto-tool-choice --tool-call-parser <parser>. 세션은CLAUDE_CODE_ATTRIBUTION_HEADER=0으로 시작됩니다. 요청별 속성 해시가 접두사 캐싱을 무효화하기 때문입니다.작업의 첫 턴은 콜드 슬롯에서 약 20k 토큰의 프롬프트 비용이 듭니다(시스템 프롬프트 + 도구 스키마), 27B에서 ~10초. 그 이후는 캐시 적중과 델타입니다.
개발
uv sync --dev
uv run pytest -q레이아웃과 실제 서버에 대한 변경 사항 테스트 방법은 CONTRIBUTING.md를 참조하세요.
라이선스
MIT. LICENSE를 참조하세요.
Copyright © 2026 Chris Cebelenski
Available Tools
11 toolscancel_jobB
Cancel a running job (kills the headless Claude session).
| Name | Required | Description | Default |
|---|---|---|---|
| job_id | Yes |
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden. It does disclose a key behavioral trait—that cancellation kills the headless session—but does not elaborate on reversibility, side effects on job output, or whether the cancellation is asynchronous. This is partial disclosure but not comprehensive.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence with no unnecessary words. The core action ('Cancel a running job') is front-loaded, and the parenthetical adds essential behavioral detail. It is highly concise and well-structured.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple one-parameter cancellation tool, the description covers the essential action and primary side effect. However, it lacks details about error handling (e.g., what happens if the job is already finished), whether cancellation is synchronous, or any prerequisites. The presence of an output schema reduces the need to describe return values, but overall the description is adequate yet not rich.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must compensate. The only parameter, job_id, is never explained; its meaning is only implied by the tool's purpose. The description does not clarify how to obtain a valid job_id or that it must reference a running job.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses a specific verb ('Cancel') and a clear resource ('a running job'), and adds the clarifying detail that it 'kills the headless Claude session.' This clearly distinguishes it from related tools like job_status, wait_job, and list_jobs without needing to inspect their schemas.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description states only what the tool does, not when to use it relative to alternatives. It does not mention conditions for use (e.g., only when a job is running) or contrast with siblings like job_status or wait_job. No guidance on when to avoid this tool is provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
job_logB
Tail of a job's human-readable transcript (assistant text, tool calls, results).
| Name | Required | Description | Default |
|---|---|---|---|
| job_id | Yes | ||
| tail_lines | No |
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the behavioral burden. It does disclose that the tool returns the tail of a transcript and what content categories are included, but it does not describe behavior for missing jobs, incomplete jobs, or error conditions. This is adequate but not rich.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
One concise sentence with no filler. 'Tail of a job's human-readable transcript' is front-loaded and the parenthetical content list adds useful scope without bloating the text.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The tool is simple and has an output schema, so return values need not be re-described. However, with no annotations and no parameter-level details, the description leaves some context implicit, such as the unit for tail_lines and whether the tool is safe for active jobs. An agent can still call it, but the context is minimally sufficient.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must compensate, but it does not explicitly explain job_id or tail_lines. The word 'Tail' loosely implies tail_lines controls how much is returned, and job_id is inferable from 'a job's transcript', but the meaning of the default and the line-count semantics are left to the schema titles only.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states a specific resource and action: retrieving the tail of a job's human-readable transcript. It also clarifies content type (assistant text, tool calls, results), which distinguishes it from status-oriented siblings like job_status or list_jobs, though it does not name them.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
There is no explicit guidance about when to use this tool versus alternatives such as job_status, wait_job, or list_jobs. The phrase 'tail of a job's transcript' weakly implies a read-after-run scenario, but no exclusions or selection criteria are stated.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
job_statusB
Current status, last activity, files touched, and result (if finished) of a job.
| Name | Required | Description | Default |
|---|---|---|---|
| job_id | Yes |
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description must bear the transparency burden. It does disclose what the tool reports and notes the conditional result field for finished jobs, but it does not explicitly state that the call is non-mutating, non-blocking, or what happens for unknown jobs.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is compact and efficiently lists the key return categories without filler. Minor structural issue: it is a noun phrase rather than a complete verb-led sentence.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Because an output schema exists, the lack of return-value detail is acceptable, and the essentials for invoking with job_id are present. However, the tool lacks usage context and behavioral caveats, leaving an agent to infer how this relates to wait_job and job_log.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description needs to compensate, but it only implies job_id through 'of a job'. It does not explain the expected format, where to find the ID, or any constraints beyond the schema's generic string type.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description identifies a specific resource (a job) and lists the exact information returned: current status, last activity, files touched, and result when finished. It is clear enough to separate from list_jobs or wait_job, though it lacks an explicit verb like 'Gets' or 'Returns'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is given about when to call this instead of siblings such as wait_job or job_log. The 'if finished' caveat is the only hint about polling behavior; there is no explicit context for choosing this tool over alternatives.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_jobsA
List jobs from this server session (newest last).
| Name | Required | Description | Default |
|---|---|---|---|
| include_finished | No |
Output Schema
| Name | Required | Description |
|---|---|---|
| result | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the behavioral burden. It usefully discloses ordering and session scoping, but it does not mention side-effect guarantees, pagination, or how include_finished affects results.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
A single concise sentence with no filler. The action is front-loaded, and the scope and ordering details are included efficiently.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple list operation with one self-explanatory optional boolean and an output schema, the description is mostly sufficient. The main gap is the lack of connection to sibling tools and explicit include_finished behavior.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, and the description never mentions the include_finished parameter. The parameter name and default value imply its meaning, but the description adds no semantic value for it.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states a concrete action and object ('List jobs'), scopes them to 'this server session', and adds ordering ('newest last'). This clearly distinguishes it from siblings like job_status, job_log, and cancel_job.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives no guidance on when to use list_jobs versus job_status, job_log, or wait_job. It implies a session scope but does not state exclusions or alternatives.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_modelsA
List configured endpoints (with live health + what they're serving now) and the model pool.
Pool entries that are currently reachable are marked `available: true` with the endpoint name
and the served id. Unavailable ones are the menu to ask the user for (by name, on `host`).
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the burden and does well: it discloses live health semantics, the meaning of 'available: true', and how unavailable entries should be treated. Read-only behavior is only implicit via the verb 'List', but that is reasonable for this tool.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Three terse sentences front-load the primary purpose and each subsequent sentence adds useful semantic or behavioral detail. No filler or redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a zero-parameter listing tool with an output schema, the description is complete: it explains what is listed, what availability means, and how to interpret unavailable entries. Nothing needed for correct invocation is missing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, so there is no parameter documentation burden. The description appropriately focuses on behavior and output meaning instead.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
States a specific verb ('List') and distinct resources: configured endpoints with live health and the model pool. It also clarifies what availability means, differentiating this from list-style siblings like list_jobs.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies when to use it: to inspect live endpoint availability and decide which unavailable models to ask the user about. It does not explicitly name alternatives or exclusion conditions, but the context is clear enough.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
local_completeA
One-shot completion on a local model, no tools, no agent loop. Cheap offload for summaries, drafts, classification, translation, boilerplate. Returns the text.
| Name | Required | Description | Default |
|---|---|---|---|
| model | No | ||
| prompt | Yes | ||
| system | No | ||
| endpoint | No | ||
| max_tokens | No | ||
| temperature | No |
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the burden. It discloses the core behavior (one-shot, no tools, returns text) and notes it's 'cheap' (low cost), but omits potential failure modes, authorization requirements, or network behavior (despite an endpoint parameter). It adds some value but not full transparency.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is 3 succinct sentences, front-loading the primary action and immediately differentiating from siblings. Every sentence contributes: purpose, use cases, and return value. No filler or redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with 6 parameters and sibling tools for registering models/endpoints, the description doesn't mention prerequisites or how to choose a model. It assumes the agent knows it can just pass prompt and rely on defaults, but lacks guidance on when to specify model/endpoint. Given the output schema exists, return format is covered, but operational context is incomplete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema parameter description coverage is 0%, and the tool description offers no parameter-specific explanation. It doesn't clarify how 'model', 'endpoint', or 'system' interact, nor does it mention defaults or dependencies. The parameter names are self-explanatory, but the description adds no semantic value beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool performs one-shot completion on a local model, explicitly contrasting with agent loops and tools. It lists concrete use cases (summaries, drafts, classification, translation) and specifies the output, leaving no ambiguity about what the tool does.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
It explicitly identifies when to use it ('cheap offload' for simple tasks) and when not to ('no tools, no agent loop'), implicitly routing to sibling tools like run_agent for agentic needs. While it doesn't name the alternative directly, the exclusion is clear enough for an agent to decide.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
register_endpointC
Add or update an inference endpoint (persisted to models.yaml) and probe it.
`base_url` is the server root that exposes `/v1/messages`, e.g. `http://127.0.0.1:8080`.
`backend` is one of llama.cpp | vllm | ollama | other (informational).
| Name | Required | Description | Default |
|---|---|---|---|
| host | No | local | |
| name | Yes | ||
| notes | No | ||
| backend | No | other | |
| base_url | Yes |
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden. It discloses that the tool persists to models.yaml and probes the endpoint, which is useful, but it omits critical behavioral details such as whether the operation is idempotent, what happens on probe failure, error handling, or potential side effects like network timeouts. For a tool that mutates state and performs network calls, this is insufficient.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is brief at two sentences plus a code block, which is concise. However, it lacks a clear structure: the parameter explanations are dropped inline rather than presented as a list, and key scoping info is not front-loaded. It's not bloated, but it could be more organized.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool has five parameters, no annotations, no output schema (schema is present but no output schema referenced), and 0% schema description coverage, the description is incomplete. It does not explain the return value of probing, error conditions, or how the endpoint is validated. An agent cannot fully predict the tool's behavior from the description alone.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must explain parameters. It explicitly covers base_url (server root exposing /v1/messages) and backend (enum of llama.cpp, vllm, ollama, other), but fails to describe the other three parameters: name, host, and notes. Two of five parameters are explained, leaving the rest undocumented.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's purpose: 'Add or update an inference endpoint (persisted to models.yaml) and probe it.' The verb 'add or update' combined with the resource 'inference endpoint' is specific, and the persistence detail distinguishes it from related tools like register_model or list_models.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no explicit guidance on when to use this tool versus alternatives. It mentions the tool registers endpoints but doesn't indicate when to prefer it over other registry-related tools, nor does it list any prerequisites or exclusions. The context about base_url and backend is informative but not usage-routing guidance.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
register_modelA
Add or update a model in the pool (persisted to models.yaml).
Only `name` is required: it is fuzzy-matched against served ids (alphanumerics, case-folded,
substring), so `qwen3.8-27b` finds `unsloth/Qwen3.8-27B-GGUF:UD-Q4_K_XL`. `host` and `notes`
are what gets relayed when asking the user to bring it up. The rest are overrides:
`served_name` (exact id or glob) when fuzzy matching is ambiguous, `endpoint` to prefer one,
`context` as a fallback window when the backend doesn't report one, `bring_up` a start command
(goes stale quickly; usually leave empty).
| Name | Required | Description | Default |
|---|---|---|---|
| host | No | ||
| name | Yes | ||
| tags | No | ||
| notes | No | ||
| context | No | ||
| bring_up | No | ||
| endpoint | No | ||
| served_name | No |
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Despite having no annotations, the description discloses key behaviors: upsert semantics, persistence to a YAML file, the fuzzy-matching algorithm, and the caveat that bring_up goes stale. It clearly indicates mutation and side effects. It omits auth/permission requirements and error scenarios, but the disclosed details are substantial.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is front-loaded with the core purpose, then breaks down parameters with clear rationale. Each sentence adds value, though it is somewhat long. The structure is logical and efficient, with no wasted words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's complexity (8 params, matching algorithm, overrides) and lack of annotations, the description covers most operational aspects: required field, matching behavior, param purposes, and a caveat. The omission of tags and lack of error/edge-case discussion are gaps, but the output schema presumably covers return values. Overall, it is largely complete for an agent to invoke correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
With 0% schema description coverage, the description explains most parameters (name matching, host/notes relay, served_name, endpoint, context, bring_up) with usage context. However, the 'tags' parameter is completely ignored, leaving one of eight parameters undocumented. The detail given for the others is strong and compensates for the schema gap.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Clearly states a specific action ('Add or update a model in the pool') with a concrete resource and persistence detail ('persisted to models.yaml'). The verb+object is unambiguous and distinct from sibling tools like register_endpoint.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies when to use the tool (to add or update a model) but does not explicitly contrast it with alternatives such as register_endpoint or request_model. No when-not-to-use guidance, prerequisites, or conditions that select this tool over siblings are provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
request_modelA
What to relay to the user to bring up a model that is not currently running.
Returns the pool entry's `host`/`notes` (and a start command only if one is on file). If the
model is already up, says so instead.
| Name | Required | Description | Default |
|---|---|---|---|
| model | Yes |
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden of explaining behavior, and it does so well. It discloses the return payload (host/notes, plus a start command only if one is on file) and the conditional behavior when the model is already up. It implies a read-only, informational operation by saying it relays content to the user, though it does not explicitly state that no start action is triggered.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is compact: a one-sentence purpose, a one-sentence return summary, and a one-sentence conditional behavior note. Every sentence adds distinct information, and the key purpose is front-loaded. No redundant phrasing or unnecessary detail.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple one-parameter tool, the description is largely complete: it explains what to pass, what to expect in return, and the main conditional case. It does not address what happens if the model is unknown or not registered in the pool, but the presence of an output schema and the clear conditional wording make this a minor gap rather than a blocking one.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema has only a 'model' string parameter and no parameter description, so schema coverage is 0%. The description adds some context by framing 'model' as the identifier of a model that is not currently running, but it does not specify expected values, naming conventions, or where the model identifier comes from. This is partially compensated by the self-explanatory parameter name and the surrounding context.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's purpose: relay to the user what is needed to bring up a model that is not currently running. It identifies the resource (model) and a specific action (request/relay), and the conditional 'if the model is already up, says so instead' further clarifies scope. It does not explicitly name a sibling tool, but the unique purpose is recognizable.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives a clear usage condition: use this when a model is not currently running and you need instructions to give the user. It also handles the alternative case by noting that if the model is already up, the tool says so. It does not name alternative tools like list_models or register_model, but the intended context is reasonably explicit.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
run_agentA
Delegate a task to an agent on a local model. Returns a job id immediately.
The agent is a headless Claude Code session (Read/Edit/Write/Glob/Grep/Bash, project
CLAUDE.md, same working tree) whose API calls go to the local endpoint. Write the task like a
brief for a capable but junior engineer: what to do, where, how to verify, and what to report.
Args:
task: The brief. Be explicit; local models follow less implicit context than Claude.
model: Pool name (see list_models) or a served model id/glob. Default from models.yaml.
endpoint: Force a specific endpoint; with no `model`, uses whatever it is serving.
cwd: Working directory (default: this server's cwd, i.e. the current project).
isolation: "none" (work in cwd, like a normal subagent) or "worktree" (fresh git worktree
on branch local-agent/<job>; kept only if the agent changed something, reported in
job.worktree with a diffstat). Use worktree for risky/large edits you want to review as a diff.
wait_s: If > 0, block up to this many seconds and return the result when done (else job id).
permission_mode: acceptEdits (default) | bypassPermissions | default | plan.
max_turns: Cap on agent turns (default from models.yaml).
allowed_tools: Override auto-approved tools.
system_prompt_append: Extra instructions appended to the Claude Code system prompt.
resume_job: Continue a previous job's session (same model) with `task` as the next message.
timeout_s: Wall-clock cap for the job.
| Name | Required | Description | Default |
|---|---|---|---|
| cwd | No | ||
| task | Yes | ||
| model | No | ||
| wait_s | No | ||
| endpoint | No | ||
| isolation | No | none | |
| max_turns | No | ||
| timeout_s | No | ||
| resume_job | No | ||
| allowed_tools | No | ||
| permission_mode | No | ||
| system_prompt_append | No |
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden, and it delivers: it discloses the agent's toolset (Read/Edit/Write/Glob/Grep/Bash, project CLAUDE.md, same working tree), immediate-return behavior, isolation details including worktree retention and diffstat reporting, permission modes, resume semantics, and blocking behavior via wait_s. This goes well beyond what the name and schema reveal.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is appropriately sized for a 12-parameter tool. Each sentence earns its place: the opening sentence states purpose and return behavior, the second gives task-writing guidance, and the arg list is dense but scannable. No redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given 12 parameters, no annotations, and an output schema to cover return values, the description is complete. It covers all parameters, defaults, the immediate-return/blocking distinction, worktree behavior, permission modes, and resume capability. Nothing an agent needs to invoke this tool correctly is missing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must fully compensate, and it does. Every one of the 12 parameters gets a meaningful explanation with defaults, allowed values, and behavioral effects (e.g., isolation explains 'none' vs 'worktree', permission_mode lists all options, resume_job explains continued sessions).
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with 'Delegate a task to an agent on a local model,' which is a specific verb and resource, and immediately states the key behavioral distinction: 'Returns a job id immediately.' This clearly differentiates run_agent from the job-management siblings (job_log, cancel_job, job_status, wait_job).
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives strong usage context: how to write the task brief, when to use isolation='worktree' ('Use worktree for risky/large edits you want to review as a diff'), when wait_s should be used, and points to a sibling tool via 'Pool name (see list_models)'. It doesn't explicitly name alternatives for follow-up status checks (e.g., job_status/wait_job), but the immediate-return semantics make that implication clear.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
wait_jobA
Block up to timeout_s seconds for a job to finish; returns its status/result either way.
| Name | Required | Description | Default |
|---|---|---|---|
| job_id | Yes | ||
| timeout_s | No |
Output Schema
| Name | Required | Description |
|---|---|---|
No output parameters | ||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the behavioral burden. It discloses the blocking behavior, the timeout bound, and the fact that it returns a status/result even when the job has not finished. This is meaningful transparency, though it does not mention error cases like invalid job_id.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The entire description is one sentence with no filler. It front-loads the blocking behavior, states the timeout parameter, and conveys the return guarantee efficiently.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple two-parameter wait tool, the description covers the core behavior and return guarantee, and an output schema exists to document the result shape. It could add a note about already-finished jobs or invalid IDs, but nothing essential is missing for correct usage.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description needed to compensate. It clarifies that timeout_s is measured in seconds and controls the blocking duration, but it does not explain job_id beyond the implicit 'a job'. The parameter names are largely self-explanatory, so this is adequate but not exceptional.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
States a specific verb ('Block'), the resource ('a job'), and the outcome ('returns its status/result either way'). This clearly distinguishes wait_job from siblings like job_status or list_jobs, which check or list rather than block.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description conveys a clear usage context: call this when you are willing to block up to a timeout for a job to finish, and you will get the result whether or not it completed. It does not explicitly name alternatives or state when not to use it, such as 'use job_status for non-blocking checks', so it stops short of a 5.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
11 tool updates
v0.1.0- First observed
cancel_job - First observed
job_log - First observed
job_status - First observed
list_jobs - First observed
list_models - First observed
local_complete - First observed
register_endpoint - First observed
register_model - First observed
request_model - First observed
run_agent - First observed
wait_job
TDQS
Scored across 11 tools
Most tools target distinct resources and actions: job lifecycle (run_agent, job_status, job_log, wait_job, cancel_job, list_jobs) and model/endpoint management (list_models, request_model, register_model, register_endpoint) are clearly separated. The main overlap risk is between wait_job and job_status, both returning status/result, but blocking vs non-blocking behavior distinguishes them.
The naming mostly follows a clear verb_noun pattern (cancel_job, list_models, register_model, run_agent, wait_job, list_jobs). Minor deviations exist with job_log, job_status, and local_complete, which use noun-first or adjective-verb constructions but are still readable and predictable.
11 tools is well-scoped for a local agent orchestration server. Each tool covers a distinct operational concern, and none feel redundant or superfluous.
The core domain is well covered: job creation, waiting, status, logs, cancellation, listing, plus model pool and endpoint registration and a one-shot completion fallback. Minor gaps include no explicit unregister/delete tool for models or endpoints, but these are not major blockers for typical workflows.
Maintenance
Related MCP Connectors
Work on your own computers from Claude or ChatGPT: run commands, edit and search files.
Connect ChatGPT, Claude, Cursor or VS Code to your Windows PC: files, terminal, browser, apps.
No-data MCP handoff for local Claude Code to Codex harness moves. $49 lifetime.
Agent personas for Claude. 16 tools, 13 personas, 3 workflows. Zero extra API cost. Free.
Related MCP Servers
- AlicenseNot gradedqualityDmaintenanceEnables Claude to delegate coding tasks to local Ollama models, reducing API token usage by up to 98.75% while leveraging local compute resources. Supports code generation, review, refactoring, and file analysis with Claude providing oversight and quality assurance.247 npm25AGPL 3.0
- AlicenseNot gradedqualityDmaintenanceEnables Claude Code to delegate mechanical tasks (summaries, boilerplate, reformatting) to local models running in LM Studio.1MIT
- AlicenseAqualityCmaintenanceEnables Claude Code to offload routine code generation and text processing tasks to a local Ollama LLM, saving Cloud API tokens and costs with automatic model selection and security features.11281 npm3Apache 2.0
- AlicenseNot gradedqualityAmaintenanceEnables Claude Code to hand off bulk, mechanical, read-heavy tasks to a local model, including agentic loops that can read, write, and run commands sandboxed at zero cloud token cost.MIT