optimize_workload
Optimise a multi-task LLM workload by assigning the cheapest qualifying model to each task instead of running everything through one model. Takes a list of workloads (task type + monthly volume + optional quality floor and capability requirements) and returns a per-task model allocation, the total monthly cost, and the saving versus the best single-model deployment. If a monthly budget is given, leftover headroom is spent on the most cost-efficient quality upgrades. Use when the user asks how to cut LLM spend across several task types, or whether tiered model routing is worth it.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| workloads | Yes | One entry per task type in the workload mix | |
| min_quality_score | No | Global quality floor (0-100) applied to every workload | |
| monthly_budget_usd | No | Total monthly budget in USD. Leftover headroom is spent on the most cost-efficient quality upgrades. |