Skip to main content
Glama
local-model-suitability-mcp

local-model-suitability-mcp

by OjasKord

Local Model Suitability MCP

ToolRank

Cloud inference is expensive. Everything that can run locally should.

This MCP server tells your agent — before every cloud API call — whether the task can be handled by a local model instead. Route to Ollama, LM Studio, or llama.cpp when you can. Only pay for cloud when you must.

The Tool

check_local_viability

Call this BEFORE every cloud inference call. If verdict is LOCAL, skip the cloud call entirely and route to your local model. Only use cloud when this tool returns CLOUD.

Inputs:

Field

Required

Description

task

✅

The exact task you are about to send to a cloud model

quality_threshold

Optional

PRODUCTION (default) / PROTOTYPE / BEST_EFFORT

data_sensitivity

Optional

PUBLIC (default) / INTERNAL / CONFIDENTIAL

CONFIDENTIAL forces LOCAL regardless of task complexity — data never leaves the machine.

Response:

{
  "verdict": "LOCAL",
  "confidence": "HIGH",
  "reason": "Simple text summarisation — no reasoning depth required. Any 7B+ local model handles this well.",
  "estimated_cost_saving": "$0.002-0.008 saved per call at claude-sonnet pricing",
  "recommended_local_models": ["llama3.2:8b", "mistral-7b", "phi3:medium"],
  "cloud_justified_reason": null,
  "analysis_type": "AI-powered cost routing — NOT a simple lookup"
}

Related MCP server: ai-workers-mcp

Data Sources

  • AI reasoning: Anthropic Claude (claude-sonnet) — cost routing analysis

  • No external data sources — pure AI reasoning

Pricing

Plan

Calls

Price

Free

20/month

$0

Starter

500-call bundle

$20

Pro

2,000-call bundle

$70

Subscribe at kordagencies.com

Setup

{
  "mcpServers": {
    "local-model-suitability": {
      "command": "npx",
      "args": ["-y", "local-model-suitability-mcp"],
      "env": {
        "ANTHROPIC_API_KEY": "your-key",
        "API_KEY": "your-lms-api-key-for-paid-tier"
      }
    }
  }
}

Free tier requires no API key — tracked by IP.

Harness Integration

Claude Code / Claude Desktop (.mcp.json)

{
  "mcpServers": {
    "local-model-suitability": {
      "type": "http",
      "url": "https://local-model-suitability-mcp-production.up.railway.app"
    }
  }
}

LangChain (Python)

from langchain_mcp_adapters.client import MultiServerMCPClient
client = MultiServerMCPClient({
    "local-model-suitability": {
        "url": "https://local-model-suitability-mcp-production.up.railway.app",
        "transport": "http"
    }
})
tools = await client.get_tools()

OpenAI Agents SDK (Python)

from agents import Agent, HostedMCPTool
agent = Agent(
    name="Assistant",
    tools=[HostedMCPTool(tool_config={
        "type": "mcp",
        "server_label": "local-model-suitability",
        "server_url": "https://local-model-suitability-mcp-production.up.railway.app",
        "require_approval": "never"
    })]
)

LangGraph

Same as LangChain above — langchain-mcp-adapters works with LangGraph natively.

Results are for cost-optimisation guidance only and do not constitute technical advice. Full terms: kordagencies.com/terms.html

Available Tools

1 tool
check_local_viabilityAInspect

Checks whether a task can be handled by a local model instead of a cloud API. Call this BEFORE your agent routes any task to a cloud model — at the moment a task is ready to be sent and the model has not yet been selected. Use this when your agent is about to make a cloud inference call and wants to determine whether a local model could handle it at lower cost. Returns LOCAL/CLOUD/EITHER verdict with recommended model. If verdict is LOCAL, skip the cloud call entirely — saves cost on every routable inference call. Pass data_sensitivity=CONFIDENTIAL to force LOCAL verdict for tasks that must not leave the machine. Do not route to cloud without checking local viability first.

Inputs: task (required), data_sensitivity, quality_threshold. Returns: reason, verdict, checked_at, confidence, +8 more

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

Loading tool schema changelog…

    TDQS

    A4.5/5.0

    Scored across 1 tool

    Disambiguation5/5

    With only one tool, there is no possibility of confusion between tools.

    Naming Consistency5/5

    The single tool follows a clear verb_noun pattern (check_local_viability), which is consistent and readable.

    Tool Count2/5

    A single tool is too few for a server with the stated purpose; users would expect additional tools for managing local model configurations or listing available models.

    Completeness2/5

    The server only provides a viability check, lacking tools for model listing, configuration, or feedback, which are natural extensions of the domain.

    Maintenance

    ActivityStale
    ResponsivenessNo recent community issues

    Related MCP Connectors

    Related MCP Servers