Local Or Cloud
local_or_cloudCompare running an open model locally against paying per call for cloud models, including monthly cost, hardware break-even, electricity, and speed.
Instructions
Pay a cloud model per call, or buy a computer and run an open model at home: the cost a month each way, the month buying pays off, and whether the computer keeps up. The local model's speed comes from your own timed runs (log_run); electricity from EIA or your price; the computer's price is yours.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| state | No | A US state, for EIA's average there, for example Texas | |
| watts | No | Power the computer draws while it answers, in watts | |
| months | No | How many months to compare over | |
| thinking | No | Thinking turned on for the local model | |
| local_way | No | How the local model is called | ollama |
| local_model | Yes | The open model you would run at home, as Ollama names it, for example llama3.1:8b | |
| cloud_models | Yes | 1 to 5 cloud models to compare with | |
| input_tokens | Yes | Prompt tokens per call | |
| cached_tokens | No | Prompt tokens read from the cloud model's cache | |
| output_tokens | Yes | Answer tokens per call, including hidden thinking | |
| hardware_price | Yes | What the computer costs you, in dollars | |
| calls_per_month | Yes | Calls a month | |
| electricity_price | No | Your electricity price, dollars per kWh (default: EIA's average for homes) |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||