MakerPortal compute

Decide whether one LLM fits one accelerator, at every quantization.

llmVramFit

Decide whether one LLM fits one accelerator, at every quantization.

The identical function behind the /lab/llm-vram instrument. Returns one row per quantization (FP16 through Q3_K_M) with weight bytes and their basis, headroom, the largest context that fits, and the bandwidth-limited decode ceiling; plus the chosen best-fitting quant, the full-precision row, and a five-state verdict. Model geometry comes from each repo’s own config.json and tensor-shape index; accelerator capacity and bandwidth come from the site’s device table.

Every result carries provenance.canonicalUrl — the published page for these exact inputs, or the lane hub when they are off the published grid.

Input Schema

TableJSON Schema

Name	Required	Description
`gpu`	Yes	Accelerator slug.
`batch`	No	Concurrent sequences sharing the cache. Omit it for the published page's 1.
`model`	Yes	Model slug.
`context`	No	Context length in tokens used for the headline verdict. Omit it and the solver takes its own default of 8192, which is what the published page states.
`kvBytes`	No	Bytes per KV cache element: 2 for FP16/BF16 cache, 1 for an 8-bit cache. Omit it for the published page's 2.

Output Schema

TableJSON Schema

Name	Required	Description
`inputs`	Yes	The parsed inputs, echoed back with defaults filled in.
`result`	Yes	The solved analysis. Shape is per-tool.
`license`	Yes
`provenance`	Yes

Schema Changelog

Changes observed during successful MCP inspections.

Changed1 schema field changedSep 22, 2026

changedInput schema / properties / model / enum

Previous value: -[
-  "deepseek-r1-distill-llama-70b",
-  "deepseek-r1-distill-llama-8b",
-  "deepseek-r1-distill-qwen-1-5b",
-  "deepseek-r1-distill-qwen-14b",
-  "deepseek-r1-distill-qwen-32b",
-  "deepseek-r1-distill-qwen-7b",
-  "dolphin-mistral-24b-venice-edition",
-  "falcon3-7b-instruct",
-  "gemma-2-27b-it",
-  "gemma-2-9b-it",
-  "gemma-3-12b-it",
-  "gemma-3-1b-it",
-  "gemma-3-27b-it",
-  "gemma-3-4b-it",
-  "gpt-oss-120b",
-  "gpt-oss-20b",
-  "granite-3-3-8b-instruct",
-  "hermes-4-3-36b",
-  "hy3",
-  "kat-coder-v2-5-dev",
-  "laguna-s-2-1",
-  "laguna-xs-2-1",
-  "llama-3-1-70b-instruct",
-  "llama-3-1-8b-instruct",
-  "llama-3-1-nemotron-70b-instruct",
-  "llama-3-2-1b-instruct",
-  "llama-3-2-3b-instruct",
-  "llama-3-3-70b-instruct",
-  "minicpm5-1b",
-  "mistral-7b-instruct-v0-3",
-  "mistral-nemo-instruct-2407",
-  "mistral-small-24b-instruct-2501",
-  "mixtral-8x7b-instruct-v0-1",
-  "nanbeige4-2-3b",
-  "olmo-2-1124-13b-instruct",
-  "phi-3-5-mini-instruct",
-  "phi-4",
-  "phi-4-mini-instruct",
-  "qwen-agentworld-35b-a3b",
-  "qwen2-5-0-5b-instruct",
-  "qwen2-5-1-5b-instruct",
-  "qwen2-5-14b-instruct",
-  "qwen2-5-32b-instruct",
-  "qwen2-5-3b-instruct",
-  "qwen2-5-72b-instruct",
-  "qwen2-5-7b-instruct",
-  "qwen2-5-coder-32b-instruct",
-  "qwen2-5-coder-7b-instruct",
-  "qwen3-0-6b",
-  "qwen3-1-7b",
-  "qwen3-14b",
-  "qwen3-30b-a3b",
-  "qwen3-32b",
-  "qwen3-4b",
-  "qwen3-8b",
-  "qwq-32b",
-  "qwythos-9b-claude-mythos-5-1m",
-  "smollm2-1-7b-instruct",
-  "smollm2-135m-instruct",
-  "smollm2-360m-instruct",
-  "tinyllama-1-1b-chat-v1-0",
-  "yi-1-5-34b-chat"
-]New value: +[
+  "deepseek-r1-distill-llama-70b",
+  "deepseek-r1-distill-llama-8b",
+  "deepseek-r1-distill-qwen-1-5b",
+  "deepseek-r1-distill-qwen-14b",
+  "deepseek-r1-distill-qwen-32b",
+  "deepseek-r1-distill-qwen-7b",
+  "dolphin-mistral-24b-venice-edition",
+  "falcon3-7b-instruct",
+  "gemma-2-27b-it",
+  "gemma-2-9b-it",
+  "gemma-3-12b-it",
+  "gemma-3-1b-it",
+  "gemma-3-27b-it",
+  "gemma-3-4b-it",
+  "gpt-oss-120b",
+  "gpt-oss-20b",
+  "granite-3-3-8b-instruct",
+  "hermes-4-3-36b",
+  "hy3",
+  "k2-horizon-7b",
+  "kat-coder-v2-5-dev",
+  "laguna-s-2-1",
+  "laguna-xs-2-1",
+  "llama-3-1-70b-instruct",
+  "llama-3-1-8b-instruct",
+  "llama-3-1-nemotron-70b-instruct",
+  "llama-3-2-1b-instruct",
+  "llama-3-2-3b-instruct",
+  "llama-3-3-70b-instruct",
+  "minicpm5-1b",
+  "minicpm5-2b",
+  "mistral-7b-instruct-v0-3",
+  "mistral-nemo-instruct-2407",
+  "mistral-small-24b-instruct-2501",
+  "mixtral-8x7b-instruct-v0-1",
+  "nanbeige4-2-3b",
+  "nex-n2-5-pro",
+  "olmo-2-1124-13b-instruct",
+  "ornith-1-5-35b-a3b",
+  "ornith-1-5-9b",
+  "phi-3-5-mini-instruct",
+  "phi-4",
+  "phi-4-mini-instruct",
+  "qwen-agentworld-35b-a3b",
+  "qwen2-5-0-5b-instruct",
+  "qwen2-5-1-5b-instruct",
+  "qwen2-5-14b-instruct",
+  "qwen2-5-32b-instruct",
+  "qwen2-5-3b-instruct",
+  "qwen2-5-72b-instruct",
+  "qwen2-5-7b-instruct",
+  "qwen2-5-coder-32b-instruct",
+  "qwen2-5-coder-7b-instruct",
+  "qwen3-0-6b",
+  "qwen3-1-7b",
+  "qwen3-14b",
+  "qwen3-30b-a3b",
+  "qwen3-32b",
+  "qwen3-4b",
+  "qwen3-8b",
+  "qwq-32b",
+  "qwythos-9b-claude-mythos-5-1m",
+  "smollm2-1-7b-instruct",
+  "smollm2-135m-instruct",
+  "smollm2-360m-instruct",
+  "spark-x2-5-4b",
+  "tinyllama-1-1b-chat-v1-0",
+  "yi-1-5-34b-chat"
+]

First observedSep 6, 2026

TDQS

Score is being calculated.

All MakerPortal compute tools Inspect

Try in Browser

One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources

Need Help?