local-model-suitability-mcp
Provides integration with LangChain through the MultiServerMCPClient to access the local model suitability tool.
Allows integration with LangGraph (via LangChain MCP adapters) to use the local model suitability tool.
Enables integration with the OpenAI Agents SDK using HostedMCPTool to access the local model suitability tool.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@local-model-suitability-mcp Can I run this summarization locally?"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
Local Model Suitability MCP
Cloud inference is expensive. Everything that can run locally should.
This MCP server tells your agent — before every cloud API call — whether the task can be handled by a local model instead. Route to Ollama, LM Studio, or llama.cpp when you can. Only pay for cloud when you must.
The Tool
check_local_viability
Call this BEFORE every cloud inference call. If verdict is LOCAL, skip the cloud call entirely and route to your local model. Only use cloud when this tool returns CLOUD.
Inputs:
Field | Required | Description |
| ✅ | The exact task you are about to send to a cloud model |
| Optional |
|
| Optional |
|
CONFIDENTIAL forces LOCAL regardless of task complexity — data never leaves the machine.
Response:
{
"verdict": "LOCAL",
"confidence": "HIGH",
"reason": "Simple text summarisation — no reasoning depth required. Any 7B+ local model handles this well.",
"estimated_cost_saving": "$0.002-0.008 saved per call at claude-sonnet pricing",
"recommended_local_models": ["llama3.2:8b", "mistral-7b", "phi3:medium"],
"cloud_justified_reason": null,
"analysis_type": "AI-powered cost routing — NOT a simple lookup"
}Related MCP server: ai-workers-mcp
Data Sources
AI reasoning: Anthropic Claude (claude-sonnet) — cost routing analysis
No external data sources — pure AI reasoning
Pricing
Plan | Calls | Price |
Free | 20/month | $0 |
Starter | 500-call bundle | $20 |
Pro | 2,000-call bundle | $70 |
Setup
{
"mcpServers": {
"local-model-suitability": {
"command": "npx",
"args": ["-y", "local-model-suitability-mcp"],
"env": {
"ANTHROPIC_API_KEY": "your-key",
"API_KEY": "your-lms-api-key-for-paid-tier"
}
}
}
}Free tier requires no API key — tracked by IP.
Harness Integration
Claude Code / Claude Desktop (.mcp.json)
{
"mcpServers": {
"local-model-suitability": {
"type": "http",
"url": "https://local-model-suitability-mcp-production.up.railway.app"
}
}
}LangChain (Python)
from langchain_mcp_adapters.client import MultiServerMCPClient
client = MultiServerMCPClient({
"local-model-suitability": {
"url": "https://local-model-suitability-mcp-production.up.railway.app",
"transport": "http"
}
})
tools = await client.get_tools()OpenAI Agents SDK (Python)
from agents import Agent, HostedMCPTool
agent = Agent(
name="Assistant",
tools=[HostedMCPTool(tool_config={
"type": "mcp",
"server_label": "local-model-suitability",
"server_url": "https://local-model-suitability-mcp-production.up.railway.app",
"require_approval": "never"
})]
)LangGraph
Same as LangChain above — langchain-mcp-adapters works with LangGraph natively.
Legal
Results are for cost-optimisation guidance only and do not constitute technical advice. Full terms: kordagencies.com/terms.html
Available Tools
1 toolcheck_local_viabilityAInspect
Checks whether a task can be handled by a local model instead of a cloud API. Call this BEFORE your agent routes any task to a cloud model — at the moment a task is ready to be sent and the model has not yet been selected. Use this when your agent is about to make a cloud inference call and wants to determine whether a local model could handle it at lower cost. Returns LOCAL/CLOUD/EITHER verdict with recommended model. If verdict is LOCAL, skip the cloud call entirely — saves cost on every routable inference call. Pass data_sensitivity=CONFIDENTIAL to force LOCAL verdict for tasks that must not leave the machine. Do not route to cloud without checking local viability first.
Inputs: task (required), data_sensitivity, quality_threshold. Returns: reason, verdict, checked_at, confidence, +8 more
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
TDQS
Scored across 1 tool
With only one tool, there is no possibility of confusion between tools.
The single tool follows a clear verb_noun pattern (check_local_viability), which is consistent and readable.
A single tool is too few for a server with the stated purpose; users would expect additional tools for managing local model configurations or listing available models.
The server only provides a viability check, lacking tools for model listing, configuration, or feedback, which are natural extensions of the domain.
Maintenance
Related MCP Connectors
Cost-optimized LLM model routing recommendations for autonomous AI agents
Decision-only prompt routing and firewall checks for local/cloud routing, PII and jailbreak risk.
BYOK AI router & FinOps control plane: audit token waste, check tool safety, and rank models.
LLM cost optimization gateway, repo token-waste auditor & model arbitrage MCP server.
Related MCP Servers
- AlicenseAqualityDmaintenanceOptimizes token costs by intelligently delegating low-complexity tasks to local LLMs via LiteLLM, enabling cost-effective development workflows.31MIT
- FlicenseAqualityDmaintenanceRoutes commodity NLP tasks like summarization and translation to free-tier LLMs, saving Claude tokens for complex work.12-
- AlicenseAqualityBmaintenanceOffloads cheap work from cloud LLM agents to a local Ollama model, reducing costs and keeping frontier models focused on complex tasks.894 PyPI3MIT
- FlicenseNot gradedqualityDmaintenanceRoutes code generation tasks between local models and Claude Cloud, optimizing cost by handling simple tasks locally and reserving cloud thinking for complex tasks.-