Cloud waste is exploding in 2026, and the big culprit is unmanaged AI workloads. Roughly 80% of AI GPU spend is now always‑on inference in production, quietly burning cash in the background.
If you make those systems just 20% more efficient, you’re basically giving yourself a 20% margin boost at scale.
This is 6th episode in the series of Build vs Buy vs Rent: The AI Infrastructure Decision Tree for Startups with 2 more to go!. Listen to the full episode here, in Substack app, or Apple, Spotify / youtube.
In practice, the money you spend on AI in the cloud tends to leak out in four specific areas – idle compute, oversized models, wasted tokens, and hidden data transfer fees.
Idle compute:
GPU instances left running between jobs, notebooks never shut down, development endpoints serving zero traffic. The fix is auto-shutdown after two hours of idle time for development environments, and scheduled shutdown overnight for staging.
Model over-provisioning:
defaulting to a frontier model for every task.
A routing layer sending simple queries to small, cheap models can cut inference costs by 40 to 70 percent with no user-visible quality degradation.
Token waste:
long system prompts, over-retrieved context, over-long generated outputs. At scale these add tens of thousands of pounds per month. and
Egress:
data transfer costs between regions or providers, typically 80 to 90 dollars per terabyte, adding 20 to 40 percent to apparent compute costs.
FinOps basically means “know where every AI pound is going, then fix the leaks.”
First, you track every GPU, every AI API call, and every batch of tokens so you can see simple numbers like cost per user and cost per AI request. If it costs you ten pence to run an AI feature and you only charge five pence, the math will never work, no matter how impressive the top-line revenue looks
Then you run a 90‑day clean‑up: month one is wiring up the tracking, month two is killing the three biggest sources of waste, month three is locking in discounts and automatic safeguards.
You usually spend just a few percent of your AI budget on FinOps tools, and they can earn themselves back within the first quarter.
Recent Posts on AIUnfiltered and QuantOpinion.ai
GeoIntel Wargamer - How We Built using Qwen Cloud
GeoIntel is a multi-agent AI “debate room” for geopolitics, where a Historian, Strategist, and Economist argue over real-world conflicts and then synthesize probability-weighted forecasts grounded in live web search. It’s inspired by how real intelligence teams use red-teaming and structured analysis, but packaged as software you can query like any other AI tool.
Let us know your feedback here :
does this feel useful, and
what kinds of questions or
scenarios would you want to throw at a system like this?
