Skip to main content
Glama

Search inference offerings

search_offerings
Read-onlyIdempotent

Search AI inference offerings in the OpenNodes registry — registered nodes AND imported catalogs (OpenRouter, Hugging Face Inference Providers, models.dev, local nodes). All filters are optional and combine with AND. Returns { offerings, total, counts }: each offering has node_id, offering_id, model, pricing (USD per MTok), trust tier, serving capabilities, measured probe results, and a rank explanation. Use get_offering for one offering's full card, recommend to let the advisor choose.

Input Schema

NameRequiredDescriptionDefault
qNoFree-text match against the model metadata, offering id, and node id, e.g. "bielik" or "coder".
langNoLanguage with minimum grade, "<iso-code>[:basic|strong|native]", e.g. "pl:strong" or "de".
sortNorank = registry ranking (price, trust, reliability); price = cheapest input first; ttft = fastest first token; tps = highest throughput.rank
tierNoMinimum trust tier. unverified < community (passed automated checks) < verified (identity and context verified) < attested.
limitNoMaximum offerings to return; `total` still counts every match.
localNotrue: only models that run on the user's own machine (the Ollama library: no server, free, ranked by Ollama pulls, with local.sizes_memory per size). false: only hosted offerings. Omit for both (hosted listed first). The result's counts give { hosted, local }.
familyNoModel family or exact artifact, e.g. "llama-3.3" or "qwen3". Matches model.family or model.artifact exactly.
regionNoData residency: every pinned region and every live serving site must lie inside this ISO 3166 code, e.g. "CA" (also matches "CA-QC") or "EU" (also matches member states such as "DE"; "EEA" adds IS, LI, NO).
schemeNoPayment scheme the offering must accept. "free" finds no-cost offerings.
modalityNoWhat the model consumes/produces. Use "text" for chat and completion models.
supportsNoComma-separated features the offering must all support: tool_calls, json_mode, vision, streaming. Example: "tool_calls,json_mode".
memory_gbNoRAM/VRAM the user can give a local model, in GB: keeps local models with a size that fits (4-bit estimate). Hosted offerings are unaffected.
min_contextNoMinimum context window in tokens, e.g. 32768.
jurisdictionNoOnly operators that declare a country inside it: "eea" (EU + Iceland, Liechtenstein, Norway) or comma-separated ISO country codes, e.g. "DE,FI". Registered nodes declare their country; imported listings of known providers carry an inferred one (jurisdiction.basis = "inferred"); listings without a country are excluded.
location_basisNoMinimum evidence for the serving locations: claimed < documented (the provider's own dated page) < measured (registry probes) < attested. Offerings without known locations are excluded.
exclude_lineageNoComma-separated ISO country codes; drops offerings whose declared model lineage includes any of them, e.g. "CN". Offerings that declare no lineage are kept.
max_input_priceNoMaximum input price in USD per million tokens.

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed1 schema field changed
    • changedInput schema / properties / region / description
      Previous value: -"Data residency: every pinned region and every live serving site must lie inside this ISO 3166 code, e.g. \"CA\" (also matches \"CA-QC\") or \"EU\"."New value: +"Data residency: every pinned region and every live serving site must lie inside this ISO 3166 code, e.g. \"CA\" (also matches \"CA-QC\") or \"EU\" (also matches member states such as \"DE\"; \"EEA\" adds IS, LI, NO)."
  2. Changed3 schema fields changed
    • addedInput schema / properties / exclude_lineage
      Added value: +{
      +  "description": "Comma-separated ISO country codes; drops offerings whose declared model lineage includes any of them, e.g. \"CN\". Offerings that declare no lineage are kept.",
      +  "type": "string"
      +}
    • addedInput schema / properties / location_basis
      Added value: +{
      +  "description": "Minimum evidence for the serving locations: claimed < documented (the provider's own dated page) < measured (registry probes) < attested. Offerings without known locations are excluded.",
      +  "enum": [
      +    "claimed",
      +    "documented",
      +    "measured",
      +    "attested"
      +  ],
      +  "type": "string"
      +}
    • addedInput schema / properties / region
      Added value: +{
      +  "description": "Data residency: every pinned region and every live serving site must lie inside this ISO 3166 code, e.g. \"CA\" (also matches \"CA-QC\") or \"EU\".",
      +  "type": "string"
      +}
  3. Changed2 schema fields changed
    • addedInput schema / properties / local
      Added value: +{
      +  "description": "true: only models that run on the user's own machine (the Ollama library: no server, free, ranked by Ollama pulls, with local.sizes_memory per size). false: only hosted offerings. Omit for both (hosted listed first). The result's counts give { hosted, local }.",
      +  "type": "boolean"
      +}
    • addedInput schema / properties / memory_gb
      Added value: +{
      +  "description": "RAM/VRAM the user can give a local model, in GB: keeps local models with a size that fits (4-bit estimate). Hosted offerings are unaffected.",
      +  "minimum": 1,
      +  "type": "number"
      +}
  4. Changed1 schema field changed
    • changedInput schema / properties / jurisdiction / description
      Previous value: -"Only operators that declare a country inside it: \"eea\" (EU + Iceland, Liechtenstein, Norway) or comma-separated ISO country codes, e.g. \"DE,FI\". Imported listings declare no country and are excluded."New value: +"Only operators that declare a country inside it: \"eea\" (EU + Iceland, Liechtenstein, Norway) or comma-separated ISO country codes, e.g. \"DE,FI\". Registered nodes declare their country; imported listings of known providers carry an inferred one (jurisdiction.basis = \"inferred\"); listings without a country are excluded."
  5. Changed1 schema field changed
    • addedInput schema / properties / jurisdiction
      Added value: +{
      +  "description": "Only operators that declare a country inside it: \"eea\" (EU + Iceland, Liechtenstein, Norway) or comma-separated ISO country codes, e.g. \"DE,FI\". Imported listings declare no country and are excluded.",
      +  "type": "string"
      +}
  6. First observed

TDQS

A4.3/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnly/idempotent/openWorld, so the safety profile is covered; the description adds genuinely new context: the multi-source registry scope, AND semantics for filters, and the exact return envelope { offerings, total, counts }. It stops short of stating pagination or rate-limit behavior, which is why it is not a 5.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Front-loaded with purpose and source scope, then the return shape, then sibling routing — a sensible priority order. It is dense but nearly every clause earns its place; the parenthetical source list and the return-field enumeration are the only slightly heavy stretches.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a 17-parameter, zero-required-parameter tool with no output schema, the description does the important compensating work: it enumerates the return fields (pricing, trust tier, capabilities, probe results, rank explanation) and states totals/counts. Per-parameter meanings are left entirely to a very thorough schema, which is acceptable here but keeps it short of a 5.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the schema carries parameter detail and 3 is the baseline. The description still adds meaning beyond it by declaring that optional filters combine with AND and by explaining that `limit` truncates results while `total` still reflects every match — a cross-parameter behavior the schema cannot express.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Opens with a specific verb and resource ("Search AI inference offerings") and immediately scopes it to two source classes: registered nodes AND imported catalogs (OpenRouter, Hugging Face, models.dev, local nodes). It also names the two sibling tools that serve different intents, so an agent can tell search from get_offering and recommend without opening a schema.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Gives explicit routing ("Use get_offering for one offering's full card, recommend to let the advisor choose") and states the filter combinatorics ("All filters are optional and combine with AND"). It lacks an explicit when-not statement such as how it relates to find_locations/find_residency for pure geography questions, but the core selection guidance is clear.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.