Skip to main content
Glama

What LLMs fit on this hardware

what_fits_on_hardware
Read-onlyIdempotent

Rank which popular local LLMs fit on a given GPU or Apple Silicon Mac (at ~4-bit quantization, 8K context) — models that fit come first, biggest first, with max context each. Use when a user asks "what can I run on my <GPU/Mac/N GB>?", "best local model for my machine?", or gives hardware without naming a model.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
gpuNoGPU name, fuzzy. Multi-GPU rigs: join with + (e.g. "RTX 5090 + RTX 3090"). Provide gpu OR mac_ram_gb.
gpu_countNoNumber of identical copies of the gpu. Default 1.
mac_ram_gbNoApple Silicon unified memory GB. Provide gpu OR mac_ram_gb.

Schema Changelog

Changes observed during successful MCP inspections. Dates show when Glama detected each change.

  1. First observed

TDQS

A4.2/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare the operation read-only, idempotent, and non-destructive. The description adds valuable behavioral context beyond that: it assumes ~4-bit quantization and 8K context, ranks fitting models first and largest first, and reports max context per model. This meaningfully informs the agent about how results are produced.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences, front-loaded with the core purpose, and contains no filler. Every clause contributes either the behavior, the assumptions, or the trigger conditions for use.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple read-only tool with a fully documented schema, the description covers what the tool does, when to use it, and the shape of the output (ordered list with max context). It does not specify the exact return format, but the absence of an output schema is mitigated by the description's clarity about ranking and included fields.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the parameters are already fully documented. The description adds high-level context by mentioning GPU/Apple Silicon and 'N GB', which maps to gpu and mac_ram_gb, but it does not add detail beyond the schema. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb ('Rank') and a clear resource ('popular local LLMs fit on a given GPU or Apple Silicon Mac'), and it states the ranking criteria. It is clearly differentiated from the likely sibling tools by focusing on hardware-to-model matching rather than checking a specific fit or listing all supported models.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly says when to use the tool ('Use when a user asks...') and includes concrete example queries. It does not explicitly mention when not to use it or name sibling alternatives, so it stops short of full exclusion guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.