estimate_quantization_energy
Estimate the task-level energy change (ΔE% vs FP16) of weight-only quantization (NF4 or INT8) for a model of a given size on a GPU architecture class, from measured-anchored curves. The answer carries basis (measured/interpolated/estimated), confidence and evidence boundaries.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| q | No | alternative: plain-English query, e.g. '13B on A100 int8 batch 32' | |
| ctx | No | context length (default 2048) | |
| arch | No | GPU architecture class | |
| batch | No | batch size (default 1; >1 shrinks savings — modelled, not measured) | |
| params_b | No | model size in billions of parameters, e.g. 7 | |
| precision | No | quantization format (default NF4) |