❌

Normal view

The real cost of agentic AI

5 June 2026 at 10:00

Agentic AI has moved from conference hype to a budget line item. This is where the conversation gets more interesting and more uncomfortable. Unlike traditional AI systems that respond to a single prompt, classify a document, recommend an action, or generate a summary, agentic AI systems are designed to pursue goals. They plan, call tools, inspect results, retry failed steps, consult memory, hand off tasks to other agents, and sometimes critique their own work before producing an answer or taking an action.

That extra autonomy is the value proposition. It also introduces the cost problem.

A single chatbot interaction may consume a few thousand tokens. A useful agentic workflow can consume hundreds of thousands or millions of tokens per day because it does more than answer a question. It decomposes the problem, retrieves context, reasons through options, invokes APIs, checks the output, and often runs multiple passes before reaching a result. Therefore, the economics need to be understood at the level of “agent instances,” not just model calls.

For the estimates below, I am using a blended token cost of $3 dollars per million tokens. This is not intended to reflect a single vendor’s list price. It is a blended planning figure that assumes a mix of input and output tokens, reasoning steps, retrieval-augmented generation, summarization, tool calls, memory updates, and occasional use of larger context windows. Some enterprises will pay less through volume discounts or by routing work to smaller models. Others will pay more by using premium models, long-context prompts, web browsing, large document ingestion, and repeated reasoning loops.

The basic formula is straightforward. If an agent consumes 2 million tokens per day, it consumes 730 million tokens per year. At $3 per million tokens, that single agent costs about $2,190 per year in token burn. That number sounds surprisingly low until you multiply it by the number of agents, workflows, and users, plus the surrounding infrastructure required to run these systems safely.

What an agent really costs

In the model used here, the annual token-only cost per agent ranges from about $1,095 to $3,833, depending on the use case.

  • A lightweight HR recruiting or onboarding agent that consumes one million tokens per day costs about $1,095 per year.
  • A more demanding software engineering agent that consumes 3.5 million tokens per day costs about $3,833 per year.
  • Customer support agents are roughly $2,190 per year.
  • Legal contract agents cost about $2,409 per year.
  • Security triage agents run about $2,738 per year.
  • Research agents are around $3,066 per year.

These figures are useful but incomplete. They include only LLM token consumption and exclude orchestration platforms, vector databases, observability, model evaluation, security controls, workflow monitoring, human review, enterprise application integration, data pipelines, audit logging, prompt management, and the engineers needed to build and maintain the systems. In real deployments, I would expect the all-in operating cost to be two to five times the raw token cost. For regulated or mission-critical environments, the multiplier can be even higher.

This is where many agentic AI business cases become less clear. The model call may be inexpensive, but the system around the model is not. An agent that can update a customer relationship management system, approve a refund, generate a purchase order, or recommend a security containment action needs guardrails, permissions, logging, rollback mechanisms, and human escalation paths. These are not optional features. They are the difference between a demo and an enterprise system.

Use cases that make economic sense

Customer support is one of the more obvious use cases. A typical support automation deployment may use eight agents: an intake classifier, a knowledge retrieval agent, a response drafting agent, an escalation agent, a quality review agent, a CRM update agent, a sentiment detection agent, and an analytics agent. At two million tokens per agent per day, each agent costs about $2,190 per year in token burn, bringing the annual total to roughly $17,520. If that system deflects even a modest number of tickets or improves agent productivity, the economics can be attractive.

Sales development is another practical example. A five-agent system for account research, lead enrichment, email personalization, CRM updates, and follow-up scheduling may consume 1.2 million tokens per agent per day. That results in an annual cost of about $1,314 per agent, or $6,570 for the full agent team. This can be compelling if it improves pipeline quality, but it can also be wasteful if agents generate low-quality outreach at scale. The cost of brand damage is not measured in tokens.

Software engineering is more expensive but potentially more valuable. A 12-agent system covering requirements analysis, architecture, code generation, testing, review, security checks, documentation, CI debugging, refactoring, release notes, dependency analysis, and hot-fix support may consume 3.5 million tokens per agent per day. That works out to about $3,833 per agent annually or roughly $45,990 for the full system. Compared with engineering salaries, the token cost is small. The real question is whether the system reliably improves throughput without increasing defects, security vulnerabilities, or maintenance complexity.

Security operations also fit the agentic model because the work is repetitive, time-sensitive, and context-intensive. A 10-agent security triage system could include agents for alert triage, log analysis, threat intelligence, endpoint investigation, network investigation, incident summarization, ticketing, compliance evidence, escalation, and post-mortem. At 2.5 million tokens per agent per day, the annual token cost is about $2,738 per agent or $27,375 for the system. This is easy to justify if it reduces alert fatigue and accelerates response, but risky if the agents hallucinate causality or bury critical signals in confident summaries.

Finance, legal, healthcare administration, market research, HR, and supply chain are also viable:

  • A six-agent finance close system may cost about $9,855 per year in token burn.
  • A four-agent legal contract review system may cost about $9,636.
  • A seven-agent healthcare administrative workflow may cost about $13,797.
  • Competitive intelligence using six agents may cost $18,396.
  • HR recruiting and onboarding using five agents may cost $5,475.
  • Supply chain planning and exception management using eight agents may cost $21,024.

Across all 10 example use cases I’ve mentioned in this section, the model assumes 71 agents and a total annual token burn of about $175,638.

The comparison with traditional AI

The economics of agentic AI should always be compared with simpler approaches. Traditional AI, workflow automation, rule engines, robotic process automation, and non-agentic LLM calls are often cheaper, easier to govern, and more predictable. Agentic AI is usually overkill for tasks like classification, extraction, summarization, routing, or drafting within a narrow context. A deterministic workflow with a single model call can do the job at a fraction of the cost and risk.

Agentic systems make sense when the process requires judgment across multiple steps, dynamic planning, tool use, exception handling, and adaptation to incomplete information. They are valuable when the path to the answer cannot be fully scripted in advance. They are less valuable when enterprises use them as a trendy substitute for basic automation.

The best architecture is usually hybrid. Use traditional automation where the process is stable. Use non-agentic AI where the task is bounded. Use agentic AI only where autonomy creates measurable leverage. That means fewer agents, tighter scopes, explicit budgets, model routing, token monitoring, and human checkpoints for high-impact decisions.

The financial mistake many organizations will make is to treat agents as digital employees with near-zero marginal cost. They are not. They are probabilistic software components that consume tokens, trigger tools, create operational dependencies, and require supervision. The token bill may be manageable. The governance bill may not be.

Agentic AI can absolutely be worth the money. In many cases, the annual token burn for a useful agent team is less than the loaded cost of a single employee. But that is not the same as saying it is cheap. Companies must measure agent cost per completed business outcome, not cost per prompt or cost per model call. In the end, the question is not how much an agent costs. Ask yourself the right question: Does the autonomy an agent provides outweigh the complexity it introduces?

Why Waymo settled for the wrong car

5 June 2026 at 08:05

Forget “Florida Man.” Want to hear a California Man story? 

Here goes. 

A California man rolled up to a yoga studio in San Francisco’s Marina District in a self-driving Waymo car, walked into the studio, grabbed an armful of yoga shorts, got back in the Waymo and took off. 

Six months later, police still haven’t found him, according to a story this week in The San Francisco Chronicle. Since the rider’s credit card information didn’t lead to an arrest, we can assume the perp used a stolen phone’s Waymo account and financial information to hail the ride. And by the time police requested interior video of the man’s face, Waymo had already deleted it. 

This is a “California Man” story in part because of the association of Waymo with the city of San Francisco. Soon that association will be obsolete. (In fact, while Waymo is headquartered in San Francisco and is more visible there, Arizona got Waymos two years before San Francisco did.) 

At the moment, Waymos are publicly available to riders in 11 US cities — San Francisco, Phoenix, Los Angeles, Austin, Atlanta, Miami, Orlando, Dallas, Houston, San Antonio, Nashville.

Before long, riders will be able to enjoy robot car rides from Waymo in Las Vegas, San Diego, Washington DC, Denver, Detroit, Baltimore, Boston, Charlotte, Chicago, Minneapolis, New Orleans, New York, Philadelphia, Pittsburgh, Sacramento, Seattle, St. Louis, Tampa, London, and Tokyo.

Historically, Waymo has been taking a bath on rides. 

(I’m not talking about recent stories where Waymo cars have driven onto flooded roads. On May 12, Waymo issued a voluntary recall of 3,791 cars after a software defect allowed an autonomous vehicle in April to drive into a flooded, impassable roadway in San Antonio and be swept into a creek. A week after the recall, the company paused all freeway rides and suspended service in Atlanta, Austin, Dallas, Houston, San Antonio, and Nashville because of construction-zone navigation issues.)

To date, self-driving ride-hailing services like Waymo are a loss-leader business. Waymo is secretive about its costs, but independent estimates suggest that a $20 ride for the rider may be a $50-$100 ride for Waymo, when you factor in all costs. 

But help is on the way. 

Cars that drive themselves don’t pay for themselves

A big part of why Waymo rides have been so costly is that the car is a retrofitted Jaguar I-PACE. It’s true that Waymo got a deal on the roughly $70,000 car (a steal at $50,000 per vehicle because the company bought thousands of them). 

But then Waymo had to bolt on all kinds of costly sensors and electronics to make them self-driving, including a roof-mounted lidar assembly of five units, 29 cameras all around the car, six radar units, a custom Waymo-designed AI inference compute platform, and the wiring harness and power distribution system. 

Estimates for the total cost per car for Waymo are in the $120,000 to $200,000 range. 

Another problem is that the Jaguar I-PACE is notorious for a lack of reliability, especially involving its batteries and its longevity. Jaguar stopped making I-PACE cars two years ago. 

Finally, Waymo can’t do what regular car owners do and sell the car to recover some of the initial investment. Nobody wants an electric car with a depleted battery covered in electronics and sensors that can’t be used. 

The good news is that we learned this week that used Waymo batteries will be repurposed as backup storage for power grids in California and Texas. 

Say “Oh, Hi!” to the Ojai

The combination of growth and the end of manufacturing for the Jaguar I-PACE means that Waymo’s next platform is right on time. The car is called the Ojai, named after the unaffordable artsy hippie mecca located 80 miles northwest of Los Angeles. 

Waymo announced last week that the company will soon open Ojai cars to free rides for select riders in San Francisco, Los Angeles, and Phoenix. (See this Redditor’s drone photos  of the current fleet of Ojai cars in Mesa, AZ.)

The Ojai is a purpose-built electric minivan made by Zeekr, an arm of China-based Geely Automobile Holdings. It’s got doors that slide open like an elevator door, more legroom than the I-PACE, three screens for passengers, Braille instructions, grab bars, a flat floor with low-step height for easier entry, charge ports, cupholders, more cargo space, better batteries, faster EV charging, and easier cleaning and maintenance than the I-PACE cars. 

It’s much cheaper for Waymo to buy — and much cheaper and faster to integrate Waymo electronics. 

The Ojai gets Waymo’s sixth-generation Driver as a factory-co-engineered system with just 23 sensors (13 cameras, four lidar, six radar). While that’s far fewer sensors, they’re much more capable than the older generations of Waymo systems. One of my favorite details of the Ojai sensor package is that each car will have 10 sensor wipers with heaters and fluid sprayers specifically designed for snow, rain, and adverse weather. They’re like tiny, high-tech windshield wipers, but for the glass in front of the sensors. Ojai cars will likely do far better in rain and snow conditions. 

Weirdly, the Ojai still has needless controls, like a steering wheel and gas and brake pedals. And the only reason for those is that the US Congress is asleep at the wheel. US. federal motor vehicle safety standards require steering wheels and pedals for street-legal vehicles, and neither NHTSA nor Congress has granted a permanent exemption for purpose-built driverless vehicles. 

Despite the vestigial controls, the difference between the two cars is that the Jaguar was an old-school car designed for drivers, while the Ojai is the new concept for cars, one built for riders. And for riders, the Ojai is better in every way that matters. 

The Chinese factor

There’s only one factor keeping Ojai cars from replacing the full Jaguar I-PACE: They’re  made in China. 

Waymo is getting around the 100% tariff imposed by the Trump Administration by “location-laundering” the build. Zeekr completes the Ojai shells in Gothenburg, Sweden, and because the “substantial transformation” occurs within the EU, the vehicles are classified as EU-origin products. The stripped-down gliders arrive with no modems, ECUs, or autonomy software, and Waymo installs all connected technology at its Mesa facility, which satisfies the Commerce Department’s 2027 and 2030 rules prohibiting Chinese-linked vehicle electronics. 

Some lawmakers are using Waymo as a case study for general anxieties about Chinese technology infiltration into American infrastructure. The other problem is protectionism. If un-tariffed Chinese cars were allowed into the US market, the US car industry would likely be decimated by the competition. Chinese carmakers like BYD enjoy a 25% material cost advantage over Western carmakers. They would enter $5,000 to $10,000 cheaper than comparable U.S. offerings, according to some estimates. 

So, Washington is jittery about Chinese-made cars. 

I drove a BYD rental car in the UK last month. And I can tell you, they’re great cars and very enjoyable to drive. (My only complaint was that the steering wheel was on the wrong side.)

Instead of Waymo taking a risky bet on Ojai cars, they’re instead expanding with Hyundai Ioniq 5 EVs, which are produced locally and will be retrofitted with Waymo’s sixth-generation Driver at that Mesa facility. This is a massive deal in which Hyundai will supply Waymo with 50,000 cars by 2028. 

Waymo hasn’t disclosed plans for Ojai cars, but it’s unlikely to even come close to the number of Hyundai cars it is on the hook for. 

(The company also has around 100 Zeekr cars, but plans to expand that fleet to a few thousand.)

The right solution for Waymo’s next few years would be all Ojai cars with no steering wheel or pedals. The Ojai is purpose-built for autonomous car ride sharing, affordable, and capable in all weather. But that’s not going to happen because of Congressional inaction, China panic, and protectionism in Washington. 

Instead, Waymo’s future is to use too many cars from the past, by which I mean much or most of its fleet will be driverless cars retrofitted from cars that prioritize the driver, rather than the passengers. And reports suggest that the price of Hyundai cars will be comparable to the overpriced Jaguars. 

I’m sure the Hyundai Ioniq 5 will be nice. But an all-Ojai fleet would have been the better future for Waymo. Instead of the right car for the job, Waymo is stuck with an expensive, less comfortable, less capable car than the Ojai. 

❌