vram-mcp

by sushiHex

Overview Schema Source Related Servers Discussions Admin

Python

Local

warm

Load or refresh an Ollama model's keep-alive to keep it resident in GPU VRAM; pin indefinitely with -1.

Instructions

Load a model or refresh its keep-alive (e.g. "5m"; "-1" pins indefinitely).

An already resident model requires zero additional capacity. New loads account for reservations using an approximate model size; size_verified describes that estimate, while outcome describes verified residency. Returns succeeded|refused|failed|unknown. On unknown, inspect residency and pending_until before retrying. force=True bypasses admission checks but cannot override a pending operation. Zero durations must use unload().

Input Schema

Name	Required	Default
`by`	No	unknown
`force`	No
`model`	Yes
`keep_alive`	No	5m

Output Schema

Name	Required	Description	Default
`ok`	Yes
`busy`	Yes
`model`	Yes
`scope`	Yes
`claims`	Yes
`detail`	Yes
`reason`	Yes
`free_mb`	Yes
`outcome`	Yes
`refused`	Yes
`summary`	Yes
`resident`	Yes
`protected`	Yes
`keep_alive`	Yes
`operations`	Yes
`headroom_mb`	Yes
`reserved_mb`	Yes
`retry_after`	Yes
`retry_count`	Yes
`observations`	Yes
`operation_id`	Yes
`reservations`	Yes
`additional_mb`	Yes
`model_size_mb`	Yes
`pending_until`	Yes
`size_verified`	Yes
`coordination_warning`	Yes

Schema Changelog

Changes observed during successful MCP inspections.

Changed1 schema field changedv0.3.1Oct 18, 2026

changedOutput schema / (root)

Previous value: -nullNew value: +{
+  "$defs": {
+    "ClaimEntry": {
+      "properties": {
+        "claim_id": {
+          "anyOf": [
+            {
+              "type": "string"
+            },
+            {
+              "type": "null"
+            }
+          ],
+          "title": "Claim Id"
+        },
+        "claimed_at": {
+          "anyOf": [
+            {
+              "type": "string"
+            },
+            {
+              "type": "null"
+            }
+          ],
+          "title": "Claimed At"
+        },
+        "expires_at": {
+          "anyOf": [
+            {
+              "type": "string"
+            },
+            {
+              "type": "null"
+            }
+          ],
+          "title": "Expires At"
+        },
+        "gb": {
+          "anyOf": [
+            {
+              "type": "number"
+            },
+            {
+              "type": "null"
+            }
+          ],
+          "title": "Gb"
+        },
+        "kind": {
+          "enum": [
+            "model",
+            "reservation"
+          ],
+          "title": "Kind",
+          "type": "string"
+        },
+        "model": {
+          "anyOf": [
+            {
+              "type": "string"
+            },
+            {
+              "type": "null"
+            }
+          ],
+          "title": "Model"
+        },
+        "owner": {
+          "anyOf": [
+            {
+              "type": "string"
+            },
+            {
+              "type": "null"
+            }
+          ],
+          "title": "Owner"
+        },
+        "pid": {
+          "anyOf": [
+            {
+              "type": "integer"
+            },
+            {
+              "type": "null"
+            }
+          ],
+          "title": "Pid"
+        },
+        "purpose": {
+          "anyOf": [
+            {
+              "type": "string"
+            },
+            {
+              "type": "null"
+            }
+          ],
+          "title": "Purpose"
+        },
+        "renewed_at": {
+          "anyOf": [
+            {
+              "type": "string"
+            },
+            {
+              "type": "null"
+            }
+          ],
+          "title": "Renewed At"
+        },
+        "ttl_seconds": {
+          "anyOf": [
+            {
+              "type": "integer"
+            },
+            {
+              "type": "null"
+            }
+          ],
+          "title": "Ttl Seconds"
+        }
+      },
+      "required": [
+        "claim_id",
+        "kind",
+        "model",
+        "gb",
+        "pid",
+        "owner",
+        "purpose",
+        "claimed_at",
+        "renewed_at",
+        "ttl_seconds",
+        "expires_at"
+      ],
+      "title": "ClaimEntry",
+      "type": "object"
+    },
+    "OperationEntry": {
+      "properties": {
+        "expires_at": {
+          "title": "Expires At",
+          "type": "string"
+        },
+        "kind": {
+          "title": "Kind",
+          "type": "string"
+        },
+        "lease_expired": {
+          "title": "Lease Expired",
+          "type": "boolean"
+        },
+        "lifecycle": {
+          "enum": [
+            "in_flight",
+            "unknown",
+            "unrecognized"
+          ],
+          "title": "Lifecycle",
+          "type": "string"
+        },
+        "model": {
+          "title": "Model",
+          "type": "string"
+        },
+        "operation_id": {
+          "title": "Operation Id",
+          "type": "string"
+        },
+        "outcome": {
+          "anyOf": [
+            {
+              "const": "unknown",
+              "type": "string"
+            },
+            {
+              "type": "null"
+            }
+          ],
+          "title": "Outcome"
+        },
+        "owner_live": {
+          "title": "Owner Live",
+          "type": "boolean"
+        },
+        "pending_until": {
+          "title": "Pending Until",
+          "type": "string"
+        },
+        "reason": {
+          "anyOf": [
+            {
+              "type": "string"
+            },
+            {
+              "type": "null"
+            }
+          ],
+          "title": "Reason"
+        },
+        "retry_after": {
+          "anyOf": [
+            {
+              "type": "string"
+            },
+            {
+              "type": "null"
+            }
+          ],
+          "title": "Retry After"
+        },
+        "retry_count": {
+          "title": "Retry Count",
+          "type": "integer"
+        },
+        "scope": {
+          "title": "Scope",
+          "type": "string"
+        },
+        "started_at": {
+          "title": "Started At",
+          "type": "string"
+        }
+      },
+      "required": [
+        "operation_id",
+        "model",
+        "kind",
+        "scope",
+        "started_at",
+        "expires_at",
+        "pending_until",
+        "lifecycle",
+        "owner_live",
+        "lease_expired",
+        "outcome",
+        "reason",
+        "retry_count",
+        "retry_after"
+      ],
+      "title": "OperationEntry",
+      "type": "object"
+    }
+  },
+  "properties": {
+    "additional_mb": {
+      "anyOf": [
+        {
+          "type": "integer"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Additional Mb"
+    },
+    "busy": {
+      "anyOf": [
+        {
+          "type": "boolean"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Busy"
+    },
+    "claims": {
+      "anyOf": [
+        {
+          "items": {
+            "$ref": "#/$defs/ClaimEntry"
+          },
+          "type": "array"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Claims"
+    },
+    "coordination_warning": {
+      "anyOf": [
+        {
+          "type": "string"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Coordination Warning"
+    },
+    "detail": {
+      "anyOf": [
+        {
+          "type": "string"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Detail"
+    },
+    "free_mb": {
+      "anyOf": [
+        {
+          "type": "integer"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Free Mb"
+    },
+    "headroom_mb": {
+      "anyOf": [
+        {
+          "type": "integer"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Headroom Mb"
+    },
+    "keep_alive": {
+      "anyOf": [
+        {
+          "type": "string"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Keep Alive"
+    },
+    "model": {
+      "anyOf": [
+        {
+          "type": "string"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Model"
+    },
+    "model_size_mb": {
+      "anyOf": [
+        {
+          "type": "integer"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Model Size Mb"
+    },
+    "observations": {
+      "anyOf": [
+        {
+          "additionalProperties": true,
+          "type": "object"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Observations"
+    },
+    "ok": {
+      "title": "Ok",
+      "type": "boolean"
+    },
+    "operation_id": {
+      "anyOf": [
+        {
+          "type": "string"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Operation Id"
+    },
+    "operations": {
+      "anyOf": [
+        {
+          "items": {
+            "$ref": "#/$defs/OperationEntry"
+          },
+          "type": "array"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Operations"
+    },
+    "outcome": {
+      "enum": [
+        "succeeded",
+        "refused",
+        "failed",
+        "unknown"
+      ],
+      "title": "Outcome",
+      "type": "string"
+    },
+    "pending_until": {
+      "anyOf": [
+        {
+          "type": "string"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Pending Until"
+    },
+    "protected": {
+      "anyOf": [
+        {
+          "type": "boolean"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Protected"
+    },
+    "reason": {
+      "anyOf": [
+        {
+          "type": "string"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Reason"
+    },
+    "refused": {
+      "anyOf": [
+        {
+          "type": "boolean"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Refused"
+    },
+    "reservations": {
+      "anyOf": [
+        {
+          "items": {
+            "$ref": "#/$defs/ClaimEntry"
+          },
+          "type": "array"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Reservations"
+    },
+    "reserved_mb": {
+      "anyOf": [
+        {
+          "type": "integer"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Reserved Mb"
+    },
+    "resident": {
+      "anyOf": [
+        {
+          "type": "boolean"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Resident"
+    },
+    "retry_after": {
+      "anyOf": [
+        {
+          "type": "string"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Retry After"
+    },
+    "retry_count": {
+      "title": "Retry Count",
+      "type": "integer"
+    },
+    "scope": {
+      "anyOf": [
+        {
+          "type": "string"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Scope"
+    },
+    "size_verified": {
+      "anyOf": [
+        {
+          "type": "boolean"
+        },
+        {
+          "type": "null"
+        }
+      ],
+      "title": "Size Verified"
+    },
+    "summary": {
+      "title": "Summary",
+      "type": "string"
+    }
+  },
+  "required": [
+    "ok",
+    "outcome",
+    "model",
+    "reason",
+    "detail",
+    "summary",
+    "operation_id",
+    "pending_until",
+    "retry_after",
+    "retry_count",
+    "keep_alive",
+    "resident",
+    "protected",
+    "busy",
+    "claims",
+    "operations",
+    "observations",
+    "reservations",
+    "refused",
+    "size_verified",
+    "model_size_mb",
+    "headroom_mb",
+    "reserved_mb",
+    "additional_mb",
+    "scope",
+    "free_mb",
+    "coordination_warning"
+  ],
+  "title": "ResidencyResult",
+  "type": "object"
+}

First observedv0.2.0Sep 16, 2026

TDQS

A4.1/5.0

Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden and does so well: it discloses that resident models cost zero capacity, that new loads account for reservations via an approximate size, the meaning of size_verified vs outcome, the four possible outcomes, retry guidance on 'unknown', and force semantics. It omits auth/permission requirements and any concurrency or rate-limit behavior.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Front-loads the core action, then layers behavioral detail in a logical order. Dense but every sentence contributes; the outcome/retry guidance is the only section that could be tightened.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

An output schema exists, so return values need not be explained, yet the description still usefully enumerates outcomes and retry logic. For a zero-annotation tool with complex capacity semantics it is largely complete, with the undocumented 'by' parameter the main gap.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0%, so the description must compensate. It explains keep_alive semantics ('5m', '-1' pins indefinitely) and force behavior, and implies model, but the 'by' parameter is never described in either schema or description. Partial compensation for a 4-param tool with zero schema documentation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description gives a specific verb+resource ('Load a model or refresh its keep-alive') and disambiguates the closest sibling by routing zero durations to unload(). An agent can distinguish this from unload() without opening either schema.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Clear context for when to use it (load or refresh keep-alive), plus explicit guidance on force=True (bypasses admission checks, cannot override pending) and on handling the 'unknown' outcome before retrying. It stops short of naming alternatives like reserve/claim/ensure_free for capacity cases, so it lacks full when-not coverage.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Deploy Server