Cheapest LLM API

Server Details

Compare LLM API prices, search models and providers, and access reviewed benchmark results.

If you are the author of this connector, you can claim ownership by verifying the domain or GitHub account it belongs to. Claimed connector authors can inspect health checks, view analytics, and manage their listing.

Status: Healthy
Last Tested: 2026-10-05 17:59
Transport: Streamable HTTP · MCP 2025-11-25
URL

TDQS

A4.3/5.0

Scored 2026-10-05 01:40 across 7 tools

Disambiguation4/5

benchmark_list vs benchmark_results and provider_list vs catalog_search target distinct resources. However, catalog_search, model_detail, and offer_compare all surface pricing/offer information with overlapping purposes, and the descriptions are elaborate enough to clarify which to use. Mostly distinct with a bit of price-tool overlap.

Naming Consistency4/5

All tools use snake_case with a predictable noun_action pattern (catalog_search, offer_compare, benchmark_list, provider_list) plus noun_noun (model_detail, benchmark_results) and the bare verb execute. Consistent and readable, with only the standalone execute being a minor deviation.

Tool Count5/5

Seven tools is well-scoped for a model catalog, offer comparison, and benchmark lookup service. Each tool has a clear, non-redundant role and the count avoids both thinness and bloat.

Completeness4/5

The surface covers discovery (catalog_search, provider_list, benchmark_list), detail (model_detail), comparison (offer_compare), scoring (benchmark_results), and composition (execute). Core workflows are covered; only a few conveniences like a direct 'cheapest for workload' shortcut are absent.

Available Tools

7 tools

benchmark_listDiscover reviewed benchmarksA

Read-onlyIdempotent

Inspect

Discover exact benchmark IDs, editions, score units, configurations, provenance, and reviewed result counts before calling benchmark_results. Empty benchmarks are retained with resultCount 0.

ParametersJSON Schema

Name	Required	Description	Default
No parameters

Output Schema

ParametersJSON Schema

Name	Required	Description
`data`	Yes
`meta`	Yes

TDQS

A4.5/5.0

Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint, idempotentHint and destructiveHint=false, so the safety profile is covered. The description adds genuine behavioral context beyond that: empty benchmarks are retained with resultCount 0, which preempts a likely agent misreading of absent results.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences, zero waste. The discovery purpose is front-loaded and the edge-case caveat about resultCount 0 is placed last, after the main point.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

An output schema exists, so return values need not be spelled out, yet the description still names the key fields an agent needs to chain into benchmark_results. With no inputs and annotations covering safety, nothing required for correct invocation is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool takes zero parameters, so the baseline is 4. There is no parameter surface for the description to clarify, and it correctly spends no space on nonexistent inputs.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb (Discover) and enumerates the exact resources returned: benchmark IDs, editions, score units, configurations, provenance, and reviewed result counts. It also names the sibling it precedes (benchmark_results), so an agent can distinguish it from benchmark_results without opening either schema.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly tells the agent when to use it: 'before calling benchmark_results', which is clear sequencing guidance. It does not, however, state when not to use it or name any alternative discovery path (e.g. catalog_search), so it falls short of the full when/when-not/alternatives bar.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

benchmark_resultsGet benchmark resultsA

Read-onlyIdempotent

Inspect

Get reviewed scores for an exact benchmark_id from benchmark_list. Join result.modelId to catalog_search model.id. Compare scores only within the same benchmark edition and configuration. Includes source provenance and reported coding-agent usage when published. Follow pagination.hasMore.

ParametersJSON Schema

Name	Required	Description	Default
`limit`	No
`offset`	No
`benchmark_id`	Yes

Output Schema

ParametersJSON Schema

Name	Required	Description
`data`	Yes
`meta`	Yes
`pagination`	Yes

TDQS

A4.1/5.0

Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnly, idempotent, and closed-world behavior, so the bar is lower. The description adds real context beyond them: provenance and coding-agent usage are included only when published, and pagination must be driven by pagination.hasMore.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Front-loaded with the core action and identity constraint, then layered caveats. The prose is telegraphic but every clause (join, comparison scope, provenance, pagination) carries distinct information; nothing is redundant.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

An output schema exists, so return-value detail is not required, yet the description still flags provenance/usage fields and pagination handling. Combined with the join and comparison caveats, an agent has enough to call it correctly; only the limit/offset range semantics are left implicit.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must carry parameter meaning. It clarifies that benchmark_id must be an exact value from benchmark_list, which is genuinely useful, but limit and offset are never explained beyond the indirect pagination.hasMore hint.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource ("Get reviewed scores") and pins the scope to an exact benchmark_id sourced from benchmark_list. It explicitly differentiates itself from siblings benchmark_list and catalog_search by naming them and describing the join.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Implies an ordering (obtain the id from benchmark_list) and gives a comparison rule ("only within the same benchmark edition and configuration"), plus a downstream routing hint to catalog_search. It stops short of explicit when-not-to-use exclusions, so it lands just below the top tier.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

catalog_searchSearch LLM catalogA

Read-onlyIdempotent

Inspect

Find canonical model slugs, context limits, and provider prices. Optional provider_slug filters availability, not the provider in bestOffer. bestOffer is selected for 10M input + 2M output tokens; use offer_compare for your workload. Follow pagination.hasMore.

ParametersJSON Schema

Name	Required	Description	Default
`page`	No
`query`	No
`page_size`	No
`category_slug`	No
`provider_slug`	No

Output Schema

ParametersJSON Schema

Name	Required	Description
`data`	Yes
`meta`	Yes
`pagination`	Yes

TDQS

A4.4/5.0

Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations cover the safety profile (readOnly, idempotent, non-destructive), and the description adds non-obvious behavior: the exact token mix (10M input + 2M output) underlying bestOffer selection and the availability-vs-provider semantics of provider_slug. It also points at pagination.hasMore for continuation, which is behavior the annotations do not convey.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three dense sentences, no filler, front-loaded with the primary purpose and followed by the two constraints an agent most needs (bestOffer basis and pagination). Every sentence carries information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

An output schema exists, so return values need not be explained, and the description covers the key selection rule and pagination signal. It is slightly thin on the four undocumented query/pagination parameters, which an agent must infer from defaults alone.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the schema documents nothing about page, page_size, query, and category_slug. The description compensates only for provider_slug, explaining its filtering semantics, leaving the other four parameters without meaning beyond their names and defaults.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource plus the concrete outputs (canonical model slugs, context limits, provider prices), which immediately distinguishes it from siblings like provider_list or model_detail. An agent can tell what this returns without opening the schema.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Routes the agent to a sibling ('use offer_compare for your workload') and clarifies that provider_slug filters availability rather than the bestOffer provider. It lacks an explicit statement of when not to use it or of prerequisites, but the alternative routing is concrete.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

executeRun catalog codeA

Read-onlyIdempotent

Inspect

Run a JavaScript async function in an isolated sandbox, composing catalog_search, model_detail, offer_compare, benchmark_results, provider_list, and benchmark_list as catalog.* methods. Return a small JSON value. Example: async () => { const page = await catalog.catalog_search({query: 'claude', page_size: 5}); return page.data.models.map(m => ({slug: m.slug, prices: m.bestOffer?.prices})); }. No network, secrets, or database binding is exposed. Shared worldwide execution budgets: 100 per UTC minute and 5000 per UTC day. Limits: 30 executions per client per minute (IPv6 /64), 20 catalog calls and read units (offer_compare uses 5), at most two concurrent calls, 5 seconds wall time, 50ms sandbox CPU, 32KiB code, 64KiB JSON output. JavaScript only; no imports or TypeScript syntax. Use /mcp?mode=code for only search + execute.

ParametersJSON Schema

Name	Required	Description	Default
`code`	Yes

Output Schema

ParametersJSON Schema

Name	Required	Description
`logs`	Yes
`calls`	Yes
`result`	Yes

TDQS

A4.7/5.0

Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Goes far beyond the annotations: discloses sandbox isolation ('no network, secrets, or database binding'), worldwide and per-client rate budgets, per-execution resource caps (20 catalog calls, read units, 2 concurrent, 5s wall, 50ms CPU, 32KiB code, 64KiB output), and language restrictions. The readOnly/idempotent hints are reinforced rather than contradicted by the 'no network/secrets' claim.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Purpose and example are front-loaded well, and each sentence carries information. The final limits sentence is a dense run-on of numeric caps, which is informative but harder to scan than a structured list.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a code-execution tool with an existing output schema, this covers execution semantics, environment, limits, and language constraints, so nothing an agent needs to invoke it correctly is missing. Return shape is left to the output schema, which is appropriate.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters5/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0% and the single 'code' param has no schema description, but the description fully compensates: it specifies an async function returning small JSON, supplies a concrete example, and lists syntax constraints (JS only, no imports or TypeScript, size cap). That is more than enough to construct a valid value.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource: run a JavaScript async function in an isolated sandbox, and names the exact catalog.* methods it composes. This distinguishes it cleanly from the sibling tools it wraps and makes the tool's role unmistakable.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Frames the use case clearly (compose multiple catalog methods in one call) and adds a routing hint ('Use /mcp?mode=code for only search + execute'). It never explicitly says when NOT to use it, e.g. that a simple single-field lookup should go straight to catalog_search, so alternatives are only implicitly addressed.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

model_detailGet model detailsA

Read-onlyIdempotent

Inspect

Get capabilities, context/output limits, and current sourced provider offers by model_slug from catalog_search. Prices are base-context rates; long-context tiers, cache writes, batch discounts, and free-tier quotas can change actual cost.

ParametersJSON Schema

Name	Required	Description	Default
`model_slug`	Yes

Output Schema

ParametersJSON Schema

Name	Required	Description
`data`	Yes
`meta`	Yes

TDQS

A4.5/5.0

Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnly, idempotent, non-destructive, closed-world behavior, so the safety profile is covered. The description adds non-obvious context the annotations cannot: that prices are base-context rates and that long-context tiers, cache writes, batch discounts, and free-tier quotas can change real cost — an important caveat for interpreting results.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences, front-loaded with the capability statement and followed by the pricing caveat. No filler, and both sentences carry distinct information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

An output schema exists, so return-shape explanation is unnecessary, and rich annotations cover the safety profile. Given a single required parameter, the description supplies purpose, input provenance, and a cost-interpretation caveat — everything needed to call and read the result correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With one parameter and 0% schema description coverage, the schema supplies only a pattern and length bound. The description compensates by disclosing provenance ('by model_slug from catalog_search'), which is the meaning an agent most needs beyond the raw format constraints, though it adds no further syntax detail.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description names a specific verb (Get) and enumerates exactly what the resource returns: capabilities, context/output limits, and current sourced provider offers. It also ties the lookup key back to catalog_search, which separates it from that sibling and from offer_compare, so an agent can route without opening a schema.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It gives a clear prerequisite — model_slug comes from catalog_search — which tells the agent when this tool is callable. It does not state explicit exclusions or contrast with siblings like offer_compare/provider_list, so it falls short of a full when/when-not statement.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

offer_compareCompare provider offersA

Read-onlyIdempotent

Inspect

Rank current provider offers for up to five canonical model slugs by the USD cost of your input/output token workload. Input tokens are uncached. Estimates use base-context rates and exclude long-context tiers, cache writes, batch discounts, and free-tier quotas. provider_slugs restricts the ranked offers.

ParametersJSON Schema

Name	Required	Description	Default
`model_slugs`	Yes
`input_tokens`	No
`output_tokens`	No
`provider_slugs`	No

Output Schema

ParametersJSON Schema

Name	Required	Description
`data`	Yes
`meta`	Yes
`workload`	Yes

TDQS

A4.1/5.0

Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Beyond the read-only/idempotent annotations, the description discloses the estimation model's limits: uncached input tokens, base-context rates, and exclusion of long-context tiers, cache writes, batch discounts, and free-tier quotas. This is exactly the kind of caveat an agent needs to interpret results correctly.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Four sentences, front-loaded with the core action and cost basis before the caveats. Little waste, though the trailing provider_slugs sentence is thin and could be merged or dropped.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

An output schema exists, so return values need not be described, and the estimation caveats are well covered. The remaining gap is that default token values and their effect on estimates are never mentioned.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It clarifies model_slugs (up to five canonical slugs) and provider_slugs (restricts the ranked offers), but says nothing about input_tokens/output_tokens beyond 'workload', leaving their large defaults (10M/2M) unexplained.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description names a specific verb (rank) and resource (provider offers) plus the ranking dimension (USD cost of the input/output token workload). It is clearly distinguishable from siblings like model_detail or provider_list, which do not rank by cost.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage is implied by the cost-ranking framing and the input/output token workload, but there is no explicit statement of when to prefer this over siblings such as model_detail or provider_list, and no exclusions or prerequisites are given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

provider_listList inference providersA

Read-onlyIdempotent

Inspect

Discover accepted provider slugs, roles, and current comparable model/offer counts. Provider minimum input and output prices are independent minima and may belong to different models; use offer_compare for an actual quote.

ParametersJSON Schema

Name	Required	Description	Default
No parameters

Output Schema

ParametersJSON Schema

Name	Required	Description
`data`	Yes
`meta`	Yes

TDQS

A4.4/5.0

Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnly, idempotent, non-destructive, closed-world behavior, so the safety profile is covered. The description adds genuinely non-obvious data semantics: provider min input/output prices are independent minima that may come from different models. That is real context beyond structured fields, though nothing is said about freshness or pagination.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two tight sentences, zero filler. The payload contents are front-loaded and the pricing caveat with its alternative follows immediately, so the agent reads the most important routing information first.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

An output schema exists, so return values need no explanation, and the description still flags the key interpretation pitfall about independent minima. It is complete enough to call safely; only minor gaps remain (e.g., what 'roles' denote, staleness of counts).

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool takes zero parameters, so there is nothing to disambiguate and the baseline is 4. The description correctly spends its budget describing output content instead of parameter syntax.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb (discover/list) and resource (providers), and enumerates the payload contents: accepted provider slugs, roles, and comparable model/offer counts. It also differentiates itself from offer_compare by name, so an agent can distinguish it from siblings without opening schemas.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Gives a clear conditional redirect: use offer_compare for an actual quote, implying provider_list is for discovery/comparison rather than pricing decisions. It doesn't cover when to prefer it over benchmark_list or catalog_search, so it falls short of full alternative coverage.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

7 tool updatesOct 5, 2026

Addedbenchmark_list

Changedbenchmark_results6 fields changed

addedInput schema / $schema

Added value: +"https://json-schema.org/draft/2020-12/schema"

removedInput schema / properties / benchmark_id / enum

Removed value: -[
-  "livebench",
-  "aa-intelligence",
-  "aa-coding",
-  "aa-agentic",
-  "swe-bench-verified-epoch-2-0-2",
-  "terminal-bench-2-1-terminus-2",
-  "terminal-bench-2-1-claude-code",
-  "terminal-bench-2-1-codex",
-  "gpqa-diamond",
-  "otis-mock-aime-2024-2025",
-  "livebench-coding",
-  "livebench-agentic-coding",
-  "livebench-reasoning",
-  "livebench-math"
-]

addedInput schema / properties / benchmark_id / maxLength
```
Added value: +120
```
addedInput schema / properties / benchmark_id / minLength
```
Added value: +1
```
addedInput schema / properties / benchmark_id / pattern
```
Added value: +"^[a-z0-9-]+$"
```

changedOutput schema / (root)

Previous value: -nullNew value: +{
+  "properties": {
+    "data": {
+      "properties": {
+        "benchmark": {
+          "properties": {
+            "cohort": {
+              "enum": [
+                "frontier",
+                "measured"
+              ],
+              "type": "string"
+            },
+            "cohortLabel": {
+              "type": "string"
+            },
+            "configurationNote": {
+              "type": "string"
+            },
+            "date": {
+              "description": "Source date, or an empty string when the upstream source supplies none.",
+              "type": "string"
+            },
+            "description": {
+              "type": "string"
+            },
+            "evaluator": {
+              "type": "string"
+            },
+            "id": {
+              "type": "string"
+            },
+            "label": {
+              "type": "string"
+            },
+            "provenance": {
+              "properties": {
+                "sourceLabel": {
+                  "type": "string"
+                },
+                "sourceUrl": {
+                  "format": "uri",
+                  "type": "string"
+                }
+              },
+              "required": [
+                "sourceUrl",
+                "sourceLabel"
+              ],
+              "type": "object"
+            },
+            "scoreUnit": {
+              "enum": [
+                "points",
+                "percent"
+              ],
+              "type": "string"
+            },
+            "version": {
+              "type": "string"
+            }
+          },
+          "required": [
+            "id",
+            "label",
+            "description",
+            "version",
+            "date",
+            "scoreUnit",
+            "evaluator",
+            "configurationNote",
+            "cohort",
+            "cohortLabel",
+            "provenance"
+          ],
+          "type": "object"
+        },
+        "results": {
+          "items": {
+            "properties": {
+              "configuration": {
+                "type": "string"
+              },
+              "date": {
+                "format": "date",
+                "type": "string"
+              },
+              "dateKind": {
+                "enum": [
+                  "source-update",
+                  "run"
+                ],
+                "type": "string"
+              },
+              "evaluator": {
+                "type": "string"
+              },
+              "harness": {
+                "type": "string"
+              },
+              "modelId": {
+                "type": "string"
+              },
+              "provenance": {
+                "properties": {
+                  "sourceDataUrl": {
+                    "format": "uri",
+                    "type": "string"
+                  },
+                  "sourceRecordId": {
+                    "type": "string"
+                  },
+                  "sourceUrl": {
+                    "format": "uri",
+                    "type": "string"
+                  }
+                },
+                "required": [
+                  "sourceUrl",
+                  "sourceDataUrl",
+                  "sourceRecordId"
+                ],
+                "type": "object"
+              },
+              "reportedAgentUsage": {
+                "anyOf": [
+                  {
+                    "properties": {
+                      "agent": {
+                        "type": "string"
+                      },
+                      "agentVersion": {
+                        "type": "string"
+                      },
+                      "averageTrialDurationSeconds": {
+                        "minimum": 0,
+                        "type": "number"
+                      },
+                      "derived": {
+                        "description": "Values derived from the published run totals and rounded benchmark score.",
+                        "properties": {
+                          "costPerSuccessfulTrialUsd": {
+                            "minimum": 0,
+                            "type": "number"
+                          },
+                          "costPerTrialUsd": {
+                            "minimum": 0,
+                            "type": "number"
+                          },
+                          "inputCacheShare": {
+                            "maximum": 1,
+                            "minimum": 0,
+                            "type": "number"
+                          },
+                          "tokensPerSuccessfulTrial": {
+                            "minimum": 0,
+                            "type": "number"
+                          }
+                        },
+                        "required": [
+                          "costPerTrialUsd",
+                          "costPerSuccessfulTrialUsd",
+                          "inputCacheShare",
+                          "tokensPerSuccessfulTrial"
+                        ],
+                        "type": "object"
+                      },
+                      "reportedCostUsd": {
+                        "minimum": 0,
+                        "type": "number"
+                      },
+                      "tokens": {
+                        "properties": {
+                          "cachedInput": {
+                            "minimum": 0,
+                            "type": "integer"
+                          },
+                          "output": {
+                            "minimum": 0,
+                            "type": "integer"
+                          },
+                          "total": {
+                            "minimum": 0,
+                            "type": "integer"
+                          },
+                          "uncachedInput": {
+                            "minimum": 0,
+                            "type": "integer"
+                          }
+                        },
+                        "required": [
+                          "uncachedInput",
+                          "cachedInput",
+                          "output",
+                          "total"
+                        ],
+                        "type": "object"
+                      },
+                      "trialCount": {
+                        "minimum": 1,
+                        "type": "integer"
+                      }
+                    },
+                    "required": [
+                      "agent",
+                      "agentVersion",
+                      "trialCount",
+                      "tokens",
+                      "reportedCostUsd",
+                      "averageTrialDurationSeconds",
+                      "derived"
+                    ],
+                    "type": "object"
+                  },
+                  {
+                    "type": "null"
+                  }
+                ]
+              },
+              "runStartedAt": {
+                "anyOf": [
+                  {
+                    "format": "date-time",
+                    "type": "string"
+                  },
+                  {
+                    "type": "null"
+                  }
+                ]
+              },
+              "sampleCount": {
+                "anyOf": [
+                  {
+                    "minimum": 1,
+                    "type": "integer"
+                  },
+                  {
+                    "type": "null"
+                  }
+                ]
+              },
+              "score": {
+                "maximum": 100,
+                "minimum": 0,
+                "type": "number"
+              },
+              "scoreUnit": {
+                "enum": [
+                  "points",
+                  "percent"
+                ],
+                "type": "string"
+              },
+              "sourceModel": {
+                "type": "string"
+              },
+              "standardError": {
+                "anyOf": [
+                  {
+                    "minimum": 0,
+                    "type": "number"
+                  },
+                  {
+                    "type": "null"
+                  }
+                ]
+              },
+              "version": {
+                "type": "string"
+              }
+            },
+            "required": [
+              "modelId",
+              "sourceModel",
+              "configuration",
+              "score",
+              "scoreUnit",
+              "evaluator",
+              "harness",
+              "version",
+              "date",
+              "dateKind",
+              "runStartedAt",
+              "sampleCount",
+              "standardError",
+              "reportedAgentUsage",
+              "provenance"
+            ],
+            "type": "object"
+          },
+          "type": "array"
+        }
+      },
+      "required": [
+        "benchmark",
+        "results"
+      ],
+      "type": "object"
+    },
+    "meta": {
+      "properties": {
+        "apiVersion": {
+          "const": "v1"
+        },
+        "currency": {
+          "const": "USD"
+        },
+        "tokenPriceUnit": {
+          "const": "per_million_tokens"
+        }
+      },
+      "required": [
+        "apiVersion",
+        "currency",
+        "tokenPriceUnit"
+      ],
+      "type": "object"
+    },
+    "pagination": {
+      "properties": {
+        "hasMore": {
+          "type": "boolean"
+        },
+        "limit": {
+          "minimum": 1,
+          "type": "integer"
+        },
+        "offset": {
+          "minimum": 0,
+          "type": "integer"
+        },
+        "page": {
+          "minimum": 1,
+          "type": "integer"
+        },
+        "pageCount": {
+          "minimum": 0,
+          "type": "integer"
+        },
+        "pageSize": {
+          "minimum": 1,
+          "type": "integer"
+        },
+        "total": {
+          "minimum": 0,
+          "type": "integer"
+        }
+      },
+      "type": "object"
+    }
+  },
+  "required": [
+    "meta",
+    "data",
+    "pagination"
+  ],
+  "type": "object"
+}

Changedcatalog_search5 fields changed

addedInput schema / $schema

Added value: +"https://json-schema.org/draft/2020-12/schema"

addedInput schema / properties / category_slug / default
```
Added value: +""
```
addedInput schema / properties / provider_slug / default
```
Added value: +""
```
addedInput schema / properties / query / default
```
Added value: +""
```

changedOutput schema / (root)

Previous value: -nullNew value: +{
+  "properties": {
+    "data": {
+      "properties": {
+        "models": {
+          "items": {
+            "properties": {
+              "author": {
+                "properties": {
+                  "name": {
+                    "type": "string"
+                  },
+                  "slug": {
+                    "type": "string"
+                  }
+                },
+                "required": [
+                  "slug",
+                  "name"
+                ],
+                "type": "object"
+              },
+              "bestOffer": {
+                "anyOf": [
+                  {
+                    "properties": {
+                      "prices": {
+                        "properties": {
+                          "inputPerMillionTokens": {
+                            "minimum": 0,
+                            "type": "number"
+                          },
+                          "outputPerMillionTokens": {
+                            "minimum": 0,
+                            "type": "number"
+                          }
+                        },
+                        "required": [
+                          "inputPerMillionTokens",
+                          "outputPerMillionTokens"
+                        ],
+                        "type": "object"
+                      },
+                      "provider": {
+                        "properties": {
+                          "name": {
+                            "type": "string"
+                          },
+                          "slug": {
+                            "type": "string"
+                          }
+                        },
+                        "required": [
+                          "slug",
+                          "name"
+                        ],
+                        "type": "object"
+                      }
+                    },
+                    "required": [
+                      "provider",
+                      "prices"
+                    ],
+                    "type": "object"
+                  },
+                  {
+                    "type": "null"
+                  }
+                ],
+                "description": "Provider selected using 10 million input and 2 million output tokens; not independent minima or a quote for every workload."
+              },
+              "contextTokens": {
+                "anyOf": [
+                  {
+                    "minimum": 1,
+                    "type": "integer"
+                  },
+                  {
+                    "type": "null"
+                  }
+                ]
+              },
+              "family": {
+                "anyOf": [
+                  {
+                    "type": "string"
+                  },
+                  {
+                    "type": "null"
+                  }
+                ]
+              },
+              "id": {
+                "type": "string"
+              },
+              "maxOutputTokens": {
+                "anyOf": [
+                  {
+                    "minimum": 1,
+                    "type": "integer"
+                  },
+                  {
+                    "type": "null"
+                  }
+                ]
+              },
+              "name": {
+                "type": "string"
+              },
+              "offerCount": {
+                "minimum": 0,
+                "type": "integer"
+              },
+              "releasedAt": {
+                "anyOf": [
+                  {
+                    "format": "date",
+                    "type": "string"
+                  },
+                  {
+                    "type": "null"
+                  }
+                ]
+              },
+              "slug": {
+                "type": "string"
+              },
+              "weightAvailability": {
+                "enum": [
+                  "closed",
+                  "open",
+                  "unknown"
+                ],
+                "type": "string"
+              }
+            },
+            "required": [
+              "id",
+              "slug",
+              "name",
+              "author",
+              "family",
+              "releasedAt",
+              "contextTokens",
+              "maxOutputTokens",
+              "weightAvailability",
+              "offerCount",
+              "bestOffer"
+            ],
+            "type": "object"
+          },
+          "type": "array"
+        }
+      },
+      "required": [
+        "models"
+      ],
+      "type": "object"
+    },
+    "meta": {
+      "properties": {
+        "apiVersion": {
+          "const": "v1"
+        },
+        "currency": {
+          "const": "USD"
+        },
+        "tokenPriceUnit": {
+          "const": "per_million_tokens"
+        }
+      },
+      "required": [
+        "apiVersion",
+        "currency",
+        "tokenPriceUnit"
+      ],
+      "type": "object"
+    },
+    "pagination": {
+      "properties": {
+        "hasMore": {
+          "type": "boolean"
+        },
+        "limit": {
+          "minimum": 1,
+          "type": "integer"
+        },
+        "offset": {
+          "minimum": 0,
+          "type": "integer"
+        },
+        "page": {
+          "minimum": 1,
+          "type": "integer"
+        },
+        "pageCount": {
+          "minimum": 0,
+          "type": "integer"
+        },
+        "pageSize": {
+          "minimum": 1,
+          "type": "integer"
+        },
+        "total": {
+          "minimum": 0,
+          "type": "integer"
+        }
+      },
+      "type": "object"
+    }
+  },
+  "required": [
+    "meta",
+    "data",
+    "pagination"
+  ],
+  "type": "object"
+}

Addedexecute

Changedmodel_detail3 fields changed

addedInput schema / $schema

Added value: +"https://json-schema.org/draft/2020-12/schema"

addedInput schema / properties / model_slug / pattern
```
Added value: +"^[a-zA-Z0-9._:-]+$"
```

changedOutput schema / (root)

Previous value: -nullNew value: +{
+  "properties": {
+    "data": {
+      "properties": {
+        "model": {
+          "properties": {
+            "author": {
+              "properties": {
+                "name": {
+                  "type": "string"
+                },
+                "slug": {
+                  "type": "string"
+                }
+              },
+              "required": [
+                "slug",
+                "name"
+              ],
+              "type": "object"
+            },
+            "capabilities": {
+              "items": {
+                "type": "string"
+              },
+              "type": "array"
+            },
+            "categories": {
+              "items": {
+                "properties": {
+                  "name": {
+                    "type": "string"
+                  },
+                  "slug": {
+                    "type": "string"
+                  }
+                },
+                "required": [
+                  "slug",
+                  "name"
+                ],
+                "type": "object"
+              },
+              "type": "array"
+            },
+            "contextTokens": {
+              "anyOf": [
+                {
+                  "minimum": 1,
+                  "type": "integer"
+                },
+                {
+                  "type": "null"
+                }
+              ]
+            },
+            "description": {
+              "type": "string"
+            },
+            "family": {
+              "anyOf": [
+                {
+                  "type": "string"
+                },
+                {
+                  "type": "null"
+                }
+              ]
+            },
+            "id": {
+              "type": "string"
+            },
+            "knowledgeCutoffAt": {
+              "anyOf": [
+                {
+                  "format": "date",
+                  "type": "string"
+                },
+                {
+                  "type": "null"
+                }
+              ]
+            },
+            "maxOutputTokens": {
+              "anyOf": [
+                {
+                  "minimum": 1,
+                  "type": "integer"
+                },
+                {
+                  "type": "null"
+                }
+              ]
+            },
+            "name": {
+              "type": "string"
+            },
+            "offers": {
+              "items": {
+                "properties": {
+                  "id": {
+                    "type": "string"
+                  },
+                  "limits": {
+                    "properties": {
+                      "contextTokens": {
+                        "anyOf": [
+                          {
+                            "minimum": 1,
+                            "type": "integer"
+                          },
+                          {
+                            "type": "null"
+                          }
+                        ]
+                      },
+                      "maxOutputTokens": {
+                        "anyOf": [
+                          {
+                            "minimum": 1,
+                            "type": "integer"
+                          },
+                          {
+                            "type": "null"
+                          }
+                        ]
+                      }
+                    },
+                    "required": [
+                      "contextTokens",
+                      "maxOutputTokens"
+                    ],
+                    "type": "object"
+                  },
+                  "model": {
+                    "properties": {
+                      "name": {
+                        "type": "string"
+                      },
+                      "slug": {
+                        "type": "string"
+                      }
+                    },
+                    "required": [
+                      "slug",
+                      "name"
+                    ],
+                    "type": "object"
+                  },
+                  "prices": {
+                    "properties": {
+                      "cachedInputPerMillionTokens": {
+                        "anyOf": [
+                          {
+                            "minimum": 0,
+                            "type": "number"
+                          },
+                          {
+                            "type": "null"
+                          }
+                        ]
+                      },
+                      "inputPerMillionTokens": {
+                        "minimum": 0,
+                        "type": "number"
+                      },
+                      "outputPerMillionTokens": {
+                        "minimum": 0,
+                        "type": "number"
+                      }
+                    },
+                    "required": [
+                      "inputPerMillionTokens",
+                      "outputPerMillionTokens",
+                      "cachedInputPerMillionTokens"
+                    ],
+                    "type": "object"
+                  },
+                  "provenance": {
+                    "properties": {
+                      "checkedAt": {
+                        "format": "date",
+                        "type": "string"
+                      },
+                      "sourceUrl": {
+                        "format": "uri",
+                        "type": "string"
+                      }
+                    },
+                    "required": [
+                      "sourceUrl",
+                      "checkedAt"
+                    ],
+                    "type": "object"
+                  },
+                  "provider": {
+                    "properties": {
+                      "name": {
+                        "type": "string"
+                      },
+                      "slug": {
+                        "type": "string"
+                      }
+                    },
+                    "required": [
+                      "slug",
+                      "name"
+                    ],
+                    "type": "object"
+                  },
+                  "routeType": {
+                    "enum": [
+                      "official",
+                      "cloud",
+                      "gateway",
+                      "unverified"
+                    ],
+                    "type": "string"
+                  }
+                },
+                "required": [
+                  "id",
+                  "model",
+                  "provider",
+                  "routeType",
+                  "prices",
+                  "limits",
+                  "provenance"
+                ],
+                "type": "object"
+              },
+              "type": "array"
+            },
+            "releaseChannel": {
+              "type": "string"
+            },
+            "releasedAt": {
+              "anyOf": [
+                {
+                  "format": "date",
+                  "type": "string"
+                },
+                {
+                  "type": "null"
+                }
+              ]
+            },
+            "slug": {
+              "type": "string"
+            },
+            "status": {
+              "type": "string"
+            },
+            "weightAvailability": {
+              "type": "string"
+            }
+          },
+          "required": [
+            "id",
+            "slug",
+            "name",
+            "description",
+            "author",
+            "family",
+            "status",
+            "releaseChannel",
+            "releasedAt",
+            "knowledgeCutoffAt",
+            "contextTokens",
+            "maxOutputTokens",
+            "weightAvailability",
+            "capabilities",
+            "categories",
+            "offers"
+          ],
+          "type": "object"
+        }
+      },
+      "required": [
+        "model"
+      ],
+      "type": "object"
+    },
+    "meta": {
+      "properties": {
+        "apiVersion": {
+          "const": "v1"
+        },
+        "currency": {
+          "const": "USD"
+        },
+        "tokenPriceUnit": {
+          "const": "per_million_tokens"
+        }
+      },
+      "required": [
+        "apiVersion",
+        "currency",
+        "tokenPriceUnit"
+      ],
+      "type": "object"
+    }
+  },
+  "required": [
+    "meta",
+    "data"
+  ],
+  "type": "object"
+}

Changedoffer_compare3 fields changed

addedInput schema / $schema

Added value: +"https://json-schema.org/draft/2020-12/schema"

addedInput schema / properties / model_slugs / items / pattern
```
Added value: +"^[a-zA-Z0-9._:-]+$"
```

changedOutput schema / (root)

Previous value: -nullNew value: +{
+  "properties": {
+    "data": {
+      "properties": {
+        "offers": {
+          "items": {
+            "properties": {
+              "offer": {
+                "properties": {
+                  "id": {
+                    "type": "string"
+                  },
+                  "limits": {
+                    "properties": {
+                      "contextTokens": {
+                        "anyOf": [
+                          {
+                            "minimum": 1,
+                            "type": "integer"
+                          },
+                          {
+                            "type": "null"
+                          }
+                        ]
+                      },
+                      "maxOutputTokens": {
+                        "anyOf": [
+                          {
+                            "minimum": 1,
+                            "type": "integer"
+                          },
+                          {
+                            "type": "null"
+                          }
+                        ]
+                      }
+                    },
+                    "required": [
+                      "contextTokens",
+                      "maxOutputTokens"
+                    ],
+                    "type": "object"
+                  },
+                  "model": {
+                    "properties": {
+                      "name": {
+                        "type": "string"
+                      },
+                      "slug": {
+                        "type": "string"
+                      }
+                    },
+                    "required": [
+                      "slug",
+                      "name"
+                    ],
+                    "type": "object"
+                  },
+                  "prices": {
+                    "properties": {
+                      "cachedInputPerMillionTokens": {
+                        "anyOf": [
+                          {
+                            "minimum": 0,
+                            "type": "number"
+                          },
+                          {
+                            "type": "null"
+                          }
+                        ]
+                      },
+                      "inputPerMillionTokens": {
+                        "minimum": 0,
+                        "type": "number"
+                      },
+                      "outputPerMillionTokens": {
+                        "minimum": 0,
+                        "type": "number"
+                      }
+                    },
+                    "required": [
+                      "inputPerMillionTokens",
+                      "outputPerMillionTokens",
+                      "cachedInputPerMillionTokens"
+                    ],
+                    "type": "object"
+                  },
+                  "provenance": {
+                    "properties": {
+                      "checkedAt": {
+                        "format": "date",
+                        "type": "string"
+                      },
+                      "sourceUrl": {
+                        "format": "uri",
+                        "type": "string"
+                      }
+                    },
+                    "required": [
+                      "sourceUrl",
+                      "checkedAt"
+                    ],
+                    "type": "object"
+                  },
+                  "provider": {
+                    "properties": {
+                      "name": {
+                        "type": "string"
+                      },
+                      "slug": {
+                        "type": "string"
+                      }
+                    },
+                    "required": [
+                      "slug",
+                      "name"
+                    ],
+                    "type": "object"
+                  },
+                  "routeType": {
+                    "enum": [
+                      "official",
+                      "cloud",
+                      "gateway",
+                      "unverified"
+                    ],
+                    "type": "string"
+                  }
+                },
+                "required": [
+                  "id",
+                  "model",
+                  "provider",
+                  "routeType",
+                  "prices",
+                  "limits",
+                  "provenance"
+                ],
+                "type": "object"
+              },
+              "workloadCostUsd": {
+                "minimum": 0,
+                "type": "number"
+              }
+            },
+            "required": [
+              "offer",
+              "workloadCostUsd"
+            ],
+            "type": "object"
+          },
+          "type": "array"
+        }
+      },
+      "required": [
+        "offers"
+      ],
+      "type": "object"
+    },
+    "meta": {
+      "properties": {
+        "apiVersion": {
+          "const": "v1"
+        },
+        "currency": {
+          "const": "USD"
+        },
+        "tokenPriceUnit": {
+          "const": "per_million_tokens"
+        }
+      },
+      "required": [
+        "apiVersion",
+        "currency",
+        "tokenPriceUnit"
+      ],
+      "type": "object"
+    },
+    "workload": {
+      "properties": {
+        "inputTokens": {
+          "minimum": 0,
+          "type": "integer"
+        },
+        "outputTokens": {
+          "minimum": 0,
+          "type": "integer"
+        }
+      },
+      "required": [
+        "inputTokens",
+        "outputTokens"
+      ],
+      "type": "object"
+    }
+  },
+  "required": [
+    "meta",
+    "workload",
+    "data"
+  ],
+  "type": "object"
+}

Addedprovider_list

4 tool updatesOct 4, 2026
- First observedbenchmark_results
- First observedcatalog_search
- First observedmodel_detail
- First observedoffer_compare

Related MCP Connectors

OptimToken A
io.github.OptimNow
Compare LLM API pricing, estimate workload costs, and benchmark cloud compute. By OptimNow.
AI & Machine Learning Cloud Platforms Finance
51
mcp A
com.modelpricewatch
Live LLM API pricing: token prices, comparisons, cheapest-model lookups. No key required.
AI & Machine Learning Research & Data
42
ModelCostComparison A
io.github.Lazige
Find AI model pricing, estimate token costs and compare offers. No API key required.
AI & Machine Learning Developer Tools
61
InferIndex A
io.github.InferIndex
LLM API prices across 70+ providers: cheapest offer, comparisons, history and cost estimates.
AI & Machine Learning Finance
51

Related MCP Servers

LLM Benchmark MCP Server
AI & Machine Learning Research & Data
AiAgentKarl
A
license
Not graded
quality
D
maintenance
Enables AI agents to compare LLM benchmarks, get pricing, and receive model recommendations for tasks and budgets.
Updated 6 months ago (2026-04-03 16:05 UTC)
1
MIT
Model Price Watch
AI & Machine Learning Developer Tools
romanshumy
A
license
A
quality
A
maintenance
Live LLM API pricing: current token prices, model comparisons, cheapest-model lookups, and The LLM Price Index for 150+ models across 20+ providers, re-verified daily. No API key required.
Updated 4 hours ago (2026-10-05 14:33 UTC)
4
1
MIT
Artificial Analysis MCP Server
Search Developer Tools Monitoring
davidhariri
A
license
A
quality
D
maintenance
Provides access to real-time LLM pricing, speed metrics, and performance benchmarks for over 300 models from Artificial Analysis. It enables users to list, filter, and compare models based on costs, tokens per second, and intelligence indices.
Updated 9 months ago (2026-01-13 01:17 UTC)
2
35 npm
9
MIT
Modelglassofficial
AI & Machine Learning Developer Tools
Modelglass
A
license
Not graded
quality
A
maintenance
Live, sourced pricing and benchmark data across image, language, video, and audio AI models, seven tools for comparison, competitor lookups, and cost-aware routing. Also powers the free Modelglass VS Code extension.
Updated 5 days ago (2026-10-01 02:21 UTC)
1
MIT