Skip to main content
Glama

scrutica_estimate_flops

Read-only

Compute peak BF16 FLOP estimates for a hardware configuration. Returns point estimate + bounds. Methodology matches the Interactive Methodology Explorer at /methodology#flop-estimation. Do NOT present outputs as exact measurements — always relay the bounds and the is_estimated flag.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
sparsityNoStructured-sparsity mode. NOTE: both values currently apply a 1.0x multiplier — the theoretical 2x speedup of 2:4 sparsity rarely materializes in wall-clock training throughput, so this estimator deliberately does not credit it (see the response note and /methodology#flop-estimation). The parameter is accepted and echoed for forward compatibility only.dense
precisionNobf16
unit_countYesNumber of accelerators
utilizationNoSustained utilization (MFU) fraction (default 0.40; documented range 0.20–0.50, calibrated to PaLM 540B 0.462 and LLaMA 3 405B 0.384)
hardware_typeYesGPU / accelerator model

TDQS

A4.2/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Beyond the readOnlyHint annotation, the description discloses that the result is an estimate with bounds and an is_estimated flag, and that it matches the Interactive Methodology Explorer. This adds meaningful behavioral context about uncertainty and output interpretation. It does not over-explain side effects, but for a read-only estimation tool this is adequate.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is three concise, front-loaded sentences. The first sentence states the primary action, the second names the return structure and methodology link, and the third gives a critical usage caution. Every sentence earns its place with no redundancy or filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, the description compensates by stating the return format (point estimate + bounds) and the is_estimated flag. It also references the methodology URL for deeper context. It could mention units or clarify how the precision parameter interacts with 'BF16,' but overall it provides enough context for an agent to invoke the tool and interpret results.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema already documents 4 of 5 parameters with descriptions (80% coverage), so the baseline is 3. The tool description itself does not add detailed parameter-level semantics beyond noting 'BF16' and 'hardware configuration,' which maps loosely to the precision and hardware_type/unit_count parameters. This is sufficient but not exceptional.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with a specific verb and resource: 'Compute peak BF16 FLOP estimates for a hardware configuration.' This clearly distinguishes the tool from its siblings, which all concern entity lookups or searches. It also immediately conveys the tool's core purpose and precision focus.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides clear usage context by stating the tool returns a point estimate plus bounds and points to a methodology reference. It also gives an explicit 'do not' instruction: 'Do NOT present outputs as exact measurements — always relay the bounds and the is_estimated flag.' It does not name alternative tools, but the context is sufficient given the sibling set.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

TDQS

A4.4/5.0
Disambiguation5/5

Each tool targets a clearly distinct resource or action: canonical entity/facility/program lookups, free-text search, supply-chain traversal, BIS query versus BIS change-log, FLOP estimation, and methodology docs. Cross-references explicitly redirect likely-confused intents, such as using scrutica_query_export_controls for entity designations and scrutica_entity_list_changes for changes, so misselection is unlikely.

Naming Consistency4/5

The naming is mostly consistent: scrutica_get_* for canonical lookups, plus clear action-style names like scrutica_search, scrutica_query_export_controls, and scrutica_estimate_flops. The main deviation is scrutica_entity_list_changes, which reads as a noun phrase rather than a verb-first tool name, so the pattern is coherent but not perfectly uniform.

Tool Count5/5

Ten tools is well calibrated for this server's broad but focused domain coverage. Each meaningful data area gets one or two dedicated tools—companies, facilities, sovereign programs, supply chain, export controls, scenarios, methodology, and FLOP estimation—with no count-inflating duplicates.

Completeness4/5

The read-side surface is largely complete: search, get-by-ID, change-tracking, relationship traversal, scenario retrieval, and methodology lookup all exist. The main gap is that some methodology topics describe metrics or indices—such as cost-index and compute-visibility index—without an obvious dedicated tool for retrieving those metric values directly.

Resources