Skip to main content
Glama

omlx-mcp-server

Local stdio MCP server for oMLX.

Tools

  • omlx_status: return the local oMLX model list and current power status in one call.

  • omlx_run: unified execution tool for either chat or agent mode.

Related MCP server: local-mcp

Battery Guard

omlx_run checks power status before using a model.

  • On AC power: execute normally.

  • On battery power: return status="needs_confirmation" unless allow_on_battery=true.

This is meant to force an explicit user decision before running heavy local inference on battery.

Compact Interface

The server is intentionally compressed to two tools to keep MCP schema overhead down.

  • Use omlx_status() to fetch models + power_status.

  • Use omlx_run(mode="chat" | "agent", prompt=...) for execution.

omlx_run picks a default model automatically:

  • chat mode defaults to MLX-Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-4bit

  • agent mode defaults to MLX-Qwen3.5-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-8bit

Defaults

  • Default chat model: MLX-Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-4bit

  • Default agent model: MLX-Qwen3.5-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-8bit

  • Default base URL: http://127.0.0.1:8000/v1

Local Run

UV_CACHE_DIR=.uv-cache UV_PROJECT_ENVIRONMENT=.venv uv sync --dev
UV_CACHE_DIR=.uv-cache UV_PROJECT_ENVIRONMENT=.venv uv run omlx-mcp-server

Codex Config Snippet

Add this to your Codex config if you want future sessions to discover it automatically. Replace /path/to/omlx-mcp-server with your clone path and set your local oMLX key:

[mcp_servers.omlx]
command = "uv"
args = [
  "run",
  "--directory", "/path/to/omlx-mcp-server",
  "omlx-mcp-server",
]

[mcp_servers.omlx.env]
UV_CACHE_DIR = "/path/to/omlx-mcp-server/.uv-cache"
UV_PROJECT_ENVIRONMENT = "/path/to/omlx-mcp-server/.venv"
OMLX_BASE_URL = "http://127.0.0.1:8000/v1"
OMLX_API_KEY = "your-local-omlx-key"
OMLX_DEFAULT_MODEL = "MLX-Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-4bit"
OMLX_AGENT_MODEL = "MLX-Qwen3.5-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-8bit"

Available Tools

2 tools
omlx_runB

Run either a chat or agent-style local oMLX request. Blocks on battery unless allow_on_battery is true.

Inputs: mode (required), prompt (required), model, context, +4 more. Returns: object

omlx_statusA

Return local oMLX model list and current Mac power status.

Inputs: no named parameters. Returns: object

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

Loading tool schema changelog…

    TDQS

    A3.7/5.0

    Scored across 2 tools

    Disambiguation5/5

    The two tools have completely distinct purposes: one for querying status/model list, the other for running requests. There is no overlap or ambiguity.

    Naming Consistency5/5

    Both tools follow a consistent 'omlx_' prefix plus a verb (status, run). This is a clear and predictable pattern.

    Tool Count3/5

    With only 2 tools, the set feels thin for a model-running server. While each tool is justified, the count is on the borderline of being too minimal.

    Completeness4/5

    The core functionality is covered: status provides information needed before running, and run executes the request. Minor gaps exist (e.g., no explicit model management or request cancellation), but for the stated purpose the surface is largely complete.

    Maintenance

    ActivityInactive
    ResponsivenessNo recent community issues

    Related MCP Connectors

    Related MCP Servers

    • A
      license
      Not graded
      quality
      B
      maintenance
      A Python MCP server that exposes local Ollama models as tools for AI assistants, enabling chat, generation, embeddings, and model management without cloud APIs.
      83 PyPI
      5
      MIT
    • F
      license
      Not graded
      quality
      D
      maintenance
      Enables running MCP tools against local MLX models on your Mac, with hardware-aware configuration, CLI streaming, and a dashboard for routing and monitoring.
      5,198 npm
      -
    • A
      license
      Not graded
      quality
      D
      maintenance
      MCP server that enables local Apple on-device Foundation Model access via any MCP client, supporting text generation, structured output, and multi-turn chat on macOS.
      2
      MIT
    • F
      license
      A
      quality
      D
      maintenance
      MCP server that connects LLM agents to a local LM Studio instance, enabling model management, OpenAI-compatible chat completions, text completions, and embeddings through a set of tools.
      9
      1
      -