predict_performance
Predict throughput, memory, and power for a given model, hardware, and inference configuration. Uses benchmark evidence to report confidence, missing metrics, and caveats.
Instructions
$0.05 USDC: predict configuration throughput, memory, and power from bounded StackBench evidence with confidence, missing metrics, and caveats.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | Yes | ||
| engine | No | ||
| batch_size | No | ||
| concurrency | No | ||
| ubatch_size | No | ||
| max_evidence | No | ||
| quantization | No | ||
| prompt_tokens | Yes | ||
| engine_version | No | ||
| flash_attention | No | ||
| hardware_system | Yes | ||
| kv_cache_type_k | No | ||
| kv_cache_type_v | No | ||
| requested_metrics | No | ||
| decode_context_depth | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||