Local Or Cloud
local_or_cloudCompare running an open model on bought hardware vs paying a cloud model per call: monthly cost, break-even month, and load capacity.
Instructions
Compare running an open model on a computer you buy with paying a cloud model per call: the cost a month each way, the month the computer pays for itself, and whether it keeps up with the load. Use when the question is whether to buy hardware for a local model. Needs timed runs of the local model (log_run) and the computer's price; electricity comes from EIA or the user's own rate. Not for cloud-only comparisons (compare_models or estimate_cost).
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"local_model": "<local_model>",
"cloud_models": "<cloud_models>",
"input_tokens": "<input_tokens>",
"output_tokens": "<output_tokens>",
"calls_per_month": "<calls_per_month>",
"hardware_price": "<hardware_price>"
},
"name": "local_or_cloud"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| state | No | A US state, for EIA's average there, for example Texas | |
| watts | No | Power the computer draws while it answers, in watts | |
| months | No | How many months to compare over | |
| thinking | No | Thinking turned on for the local model | |
| local_way | No | How the local model is called | ollama |
| local_model | Yes | The open model you would run at home, as Ollama names it, for example llama3.1:8b | |
| cloud_models | Yes | 1 to 5 cloud models to compare with | |
| input_tokens | Yes | Prompt tokens per call | |
| cached_tokens | No | Prompt tokens read from the cloud model's cache | |
| output_tokens | Yes | Answer tokens per call, including hidden thinking | |
| hardware_price | Yes | What the computer costs you, in dollars | |
| calls_per_month | Yes | Calls a month | |
| electricity_price | No | Your electricity price, dollars per kWh (default: EIA's average for homes) |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||