Skip to main content
Glama

Temsor API — Turkey & EU business data

LLM Endpoint Drift

model_drift

Independent daily record of what changed behind a provider endpoint: which alias resolved to which model, and when behaviour shifted.

Providers update models behind stable endpoint names. This endpoint publishes an independent measurement: a fixed probe suite is sent daily at temperature 0, three repeats per probe, and the identity a provider declares in its own response (modelVersion, system_fingerprint, region) is recorded alongside. A change is only reported as drift when the repeats agree with each other and disagree with the previous run — same-day disagreement is noise, not drift. aliases answers "what was actually behind gemini-flash-latest on that day"; a question that cannot be answered retroactively.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
daysNoHistory window in days (only `events`).
viewNo`aliases`: alias → the real model behind it · `events`: drift events · `probes`: probe status from the last run.aliases
limitNo
providerNoFilter by provider (gemini, groq, cerebras, mistral).
severityNoOnly for the `events` view.

TDQS

A4.4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden of behavioral disclosure. It explains the probe methodology (daily, temperature 0, three repeats), the condition for reporting drift (agreement among repeats and disagreement with previous run, same-day disagreement is noise), and the limitation that the alias-to-model mapping cannot be answered retroactively without this record. This is rich behavioral context covering how the tool operates and its constraints, though it does not specify output format or error behavior.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise at ~150 words but dense with essential information. It is well-structured: first a one-sentence summary, then methodology, then the drift detection rule, then view explanations. Every sentence adds value: no fluff, no repetition of schema content. The first sentence clearly states purpose, and the rest provides necessary behavioral context.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (5 optional parameters, 3 views, no output schema, no annotations), the description is quite complete. It explains the core methodology, the drift definition, the purpose of views, and the key constraint (no retroactive aliases). It lacks specification of return structure or error cases, but with no output schema, the agent might need more information about response format. However, for a data retrieval tool, this level of detail is strong and likely sufficient.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 80% (4 of 5 params described: days, view, provider, severity; limit lacks description). The description adds meaning beyond the schema by explaining the 'aliases' view answers a question that cannot be answered retroactively, and that severity is only for events. It clarifies the purpose of each view in the context of drift detection, which adds value beyond the schema's simple labels. The one undocumented parameter (limit) is self-explanatory due to naming.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool records what changed behind a provider endpoint (alias resolution and behavior shifts) with specific details on methodology (daily fixed probe suite, temperature 0, three repeats). It distinguishes from siblings like model_archive and series_history by focusing on endpoint drift measurement, not just archival or historical series.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explains why this tool is needed (providers update models behind stable names) and when it is appropriate (to answer 'what was actually behind an alias on that day'). It implies usage for drift detection but does not explicitly state when not to use it or mention alternatives. The context of independent measurement suggests it complements rather than replaces other tools, but no direct exclusions or alternative names are given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

TDQS

A4/5.0
Disambiguation4/5

Most tools have clearly distinct purposes (e.g., bic_validate vs vin_validate), but there is notable overlap: tr_validate bundles Turkish validations that are also covered individually by iban_validate and tin_validate. Also, lei_validate and lei_lookup are closely related but distinct enough. Overall, agents can usually pick the right tool, but a few pairs could confuse.

Naming Consistency4/5

Tool names are consistently snake_case with predominately verb_noun patterns (e.g., validate, lookup, screen, parse, build). Some nouns like mcp_index, model_archive, and series_history break the verb pattern but are still predictable. Minor deviations from the noun_verb form (tr_invoice_build, shipping_identify) don't cause confusion. Very readable and consistent overall.

Tool Count3/5

With 27 tools, the set is heavy, exceeding the typical 3–15 well-scoped range. However, the server covers a broad domain: international standards validation, Turkey-specific business data (fuel, labor, invoices, addresses), and even MCP/LLM model archives. The count is justifiable given the scope, but it stretches coherence and may overwhelm agents.

Completeness4/5

The tool surface is remarkably comprehensive for the stated Turkey & EU business data purpose: validators for most ID types, VAT, IBAN, phone, VIN, sanctions; plus Turkey-specific operations like invoice build/parse, labor calculations, fuel prices, business days, and address parsing. Minor gaps exist (e.g., no general exchange-rate conversion, no credit-note-specific builder), but agents can accomplish core workflows without dead ends.

Resources