- Towards AGI
- Posts
- 8 AI costs leaders don't always budget for but should
8 AI costs leaders don't always budget for but should
Today, we’re diving into:
Hot Tea: The real cost of AI is not what vendors put on the invoice
Open AI: Google wants AI to disappear into everything you do
Open AI: OpenAI just solved a math problem that stumped humans for 80 years
Your AI Budget Is Missing the Most Expensive Items
Most AI leaders think the biggest costs are GPUs, model licenses, cloud bills, and implementation partners.
They are wrong.
According to new research, the most expensive AI costs often never appear on a budget sheet at all. They show up months later as failed pilots, delayed deployments, governance bottlenecks, talent churn, compliance headaches, and competitive opportunities that quietly disappear while teams remain stuck in experimentation mode.
And this is becoming a serious enterprise problem.
MIT research cited in the report found that 95% of enterprise GenAI pilots fail to generate measurable ROI or scale beyond experimentation.
That means many organizations are not losing money because AI is expensive. They are losing money because AI never reaches production in a meaningful way.
1. Failed AI Projects
A surprising number of AI pilots never reach production. The cost isn't just the money spent on vendors, consultants, and engineering hours. Failed projects also destroy internal confidence, make executives more cautious about future investments, and force teams to spend months rebuilding trust before the next initiative can even begin.
2. The Endless Pilot Trap
Some AI projects never fail. They just never launch. Organizations get stuck in permanent experimentation while competitors move into production. The hidden cost is lost time, slower decision-making, and missed market opportunities as teams continue testing use cases that never create measurable business value.
3. Governance and Compliance Debt
Many companies deploy AI first and worry about governance later. Eventually, regulations, audits, and compliance requirements catch up. Retrofitting explainability, audit trails, monitoring, and controls after deployment often becomes significantly more expensive than building them into the system from day one.
4. Talent and Knowledge Loss
AI systems depend heavily on specialized expertise. When key engineers, architects, or data scientists leave, they take critical institutional knowledge with them. New teams often spend months rediscovering old lessons, fixing avoidable mistakes, and rebuilding context that was never properly documented.
5. Human Oversight Never Goes Away
AI reduces some work but creates new review responsibilities. In regulated industries, experts still need to verify outputs, monitor decisions, and intervene when systems fail. At scale, these review processes become a permanent operational cost that many AI business cases fail to account for.
6. Model Drift and Maintenance
AI models degrade over time as markets, customer behavior, and business processes change. Maintaining accuracy requires continuous retraining, monitoring, testing, and data updates. What many companies treat as a one-time deployment quickly becomes a long-term operational commitment with ongoing costs.
7. Inference Costs and Vendor Lock-In
Training grabs headlines, but inference generates the recurring bill. Every query, workflow, and AI interaction creates ongoing expenses. At the same time, organizations that build too closely around a single provider may face expensive migrations later if pricing changes or models become obsolete.
8. Reputational Damage
A single AI failure can create outsized consequences. Biased decisions, inaccurate outputs, data leaks, or harmful recommendations can trigger regulatory scrutiny, customer distrust, negative media coverage, and brand damage. Unlike infrastructure costs, reputation losses are difficult to measure and even harder to recover from.
Your Customers May Never Visit Your Website Again if Google’s AI Plan Works
Google's latest I/O event introduced something much bigger than another AI assistant.
The company unveiled Gemini Spark, an always-on AI agent designed to search, shop, plan, organize, and act on behalf of users. Search is being rebuilt around AI reasoning. Gmail can now be queried conversationally. Shopping gets an AI-powered Universal Cart. Android XR smart glasses bring Gemini into the physical world. And Google is pushing AI deeper into nearly every product used by billions of people every day.
Most people will see this as Google's answer to ChatGPT. That is not what happened.
What Google actually launched is an operating system for decisions.
The Search Engine Era Is Ending
For the last 25 years, search worked the same way.
You asked a question → Google returned links → You did the work.
Now Google wants Gemini Spark to do the work itself.
The new Search experience can compare products, monitor information, plan trips, synthesize research, and increasingly complete tasks without forcing users to jump across dozens of websites and apps. Google has even described this as the biggest transformation of Search in over 25 years.
That changes something fundamental for businesses.
The battle is no longer about ranking #1 on Google.
The battle is about becoming the source that AI agents trust, retrieve, and act upon.
If customers increasingly interact with agents instead of websites, many traditional growth strategies begin to look outdated.
The Real Story Is Agent Infrastructure
Most executives are focused on the models, whereas they should be focused on orchestration.
Gemini Spark is part of a broader shift from conversational AI toward agentic AI. Instead of generating answers, these systems execute multi-step workflows across applications, APIs, databases, documents, and services. Google is effectively turning Gemini into an action layer spanning Search, Workspace, Shopping, YouTube, Chrome, and Android.

The technical challenge isn't intelligence anymore. It is context.
An AI agent cannot make decisions without access to accurate enterprise data, operational systems, customer records, documents, workflows, and permissions.
Which creates a problem many organizations are already experiencing.
Your AI agent is only as good as the infrastructure feeding it.
This Is What’s Going To Happen Next
Your team may have already deployed copilots, assistants, or internal agents. But as those agents begin operating across multiple systems simultaneously, fragmented data becomes the bottleneck.
Every disconnected database, undocumented workflow, and siloed application slows the agent down and reduces decision quality.
This is exactly why enterprises are increasingly investing in unified data architectures. DataManagement.AI provide agents with governed access to operational, analytical, vector, and unstructured data from a single layer, helping organizations move from isolated AI experiments to production-scale agent deployments.

Because the future bottleneck is not model capability.
It is data accessibility.
❝Google did not launch a better search engine.
It launched another employee.
The question is whether your business is prepared to work alongside it.❞
Three Questions Every Business Leader Should Ask Right Now
If customers increasingly interact with AI agents instead of websites, how does your acquisition strategy change?
Can your internal systems provide agents with trusted, real-time business context?
When AI agents begin making purchasing recommendations, who controls the decision: your brand or the platform?
Google's announcement signals something much larger than a product update.
The internet is moving from navigation to delegation.
And the organizations that understand that shift first will build the next generation of competitive advantage.
OpenAI Just Solved an 80-Year-Old Math Problem. Most Are Missing Why That's Terrifying
For decades, the AI industry has promised that machines would help humans think better.
This week, OpenAI demonstrated something far more consequential.
An internal reasoning model reportedly discovered a new solution to the famous "unit distance problem," a geometry challenge that had resisted mathematicians since 1946. The problem originated with legendary mathematician Paul Erdős, who proposed a conjecture nearly 80 years ago that generations of experts failed to either prove or disprove.
OpenAI's model did something remarkable.
It found a counterexample.
Not by retrieving an answer from the internet. Not by copying a known proof. But by exploring hundreds of pages of reasoning, constructing a higher-dimensional mathematical structure, and ultimately producing an approach that several leading mathematicians described as both elegant and genuinely interesting.
That distinction matters.
Most AI breakthroughs in mathematics so far have involved solving benchmark problems, verifying existing proofs, or accelerating known workflows.
This is different.
The result itself would have attracted serious academic attention even if a human researcher had discovered it.
The Real Breakthrough Isn't Math
The geometry result is impressive. But, the implications are much bigger.
For years, critics argued that LLMs could only remix existing knowledge. They could summarize, predict, and imitate, but not contribute meaningfully to scientific discovery.
This result challenges that assumption.
The model did not invent entirely new mathematics. It relied on known techniques and existing mathematical tools. But it combined them in a way that human experts had overlooked for nearly eight decades.

That may sound like a small distinction. It isn't.
Most scientific progress does not come from inventing entirely new laws of nature. It comes from finding unexpected connections between ideas that already exist.
In other words, the bottleneck is often exploration. And AI appears to be getting very good at exploration.
What Business Leaders Should Pay Attention To
The biggest takeaway is not that AI can solve geometry problems.
It is that AI is starting to operate in domains previously reserved for elite specialists.
Today's example is mathematics.
Tomorrow it could be materials science, drug discovery, semiconductor design, logistics optimization, financial modeling, or cybersecurity.
The advantage AI demonstrated here was not superior intelligence.
It was superior persistence.
Human experts tend to follow promising paths. AI can afford to explore thousands of unlikely ones simultaneously without fatigue, bias, or career incentives pushing it toward consensus.
That creates a new competitive reality.
The organizations that learn how to combine human judgment with machine exploration will discover opportunities their competitors never even think to investigate.
The math problem may be solved.
The bigger question is what happens when AI starts doing the same thing across every knowledge industry at once.
Journey Towards AGI
Research and advisory firm guiding on the journey to Artificial General Intelligence
Know Your Inference Maximising GenAI impact on performance and Efficiency. | Model Context Protocol Connect with us, and get end-to-end guidance on AI implementation. |
Your opinion matters!
Hope you loved reading our piece of newsletter as much as we had fun writing it.
Share your experience and feedback with us below ‘cause we take your critique very critically.
How's your experience? |
Thank you for reading
-Shen & Towards AGI team