Enterprise AI Cost Basics

Key takeaways

Evidence
The most visible AI cost is usually the model invoice, but the largest costs often sit in infrastructure, people, integration, and governance.
Evidence
IDC and FinOps Foundation data suggest many organisations are still undercounting AI cost because spend is fragmented across budgets and operating layers.
Interpretation
A useful cost model distinguishes shared platform investment from local demand and updates as a service matures.
Evidence
Leaders should use AI cost basics as an entry point into the seven-category AI TCO Framework, not as a substitute for it.

Why this matters

By May 2026, corporate America had begun rationing AI access (paywalled) as costs outpaced budgets—a market signal that incomplete cost visibility was failing at scale.

Discovery at scale: In 2026, Marc Benioff said Salesforce expected to spend about $300 million on Anthropic tokens in 2026, largely for coding-related work. The spend was fragmented across departments, embedded in SaaS contracts, and categorised inconsistently across finance systems.

For more on this visibility gap, see SaaS Token Opacity: The Hidden Economics of AI Subscriptions.

The seven-layer cost taxonomy

Infrastructure - accelerated compute, GPU capacity, storage, networking, runtime services
Data and context - data ingestion, retrieval pipelines, vector systems, indexing, metadata
Models - API tokens, SaaS AI premiums, reserved capacity, fine-tuning
Integration and workflow redesign - application design, system integration, workflow changes
People and capability - platform engineers, data specialists, governance labour, support staff
Governance, safety, and compliance - evaluation, red teaming, policy, auditability, security
Operations and portfolio oversight - monitoring, incident response, allocation, portfolio review

What strong cost documentation should do

document where spend originates
connect technical activity to economic units
compare use cases with a consistent cost frame
support better investment, prioritisation, and governance decisions

When cost opacity kills value: Starbucks retired its inventory management AI agent after discovering the system's recommendations were being routinely overridden by store managers who understood local context the model missed. The agent consumed resources but delivered no measurable improvement over human judgement. The retirement decision came only after establishing baseline performance metrics and full-stack cost accounting.

Common cost blind spots

Embedded AI tiers in SaaS contracts.

Duplicate tooling across departments.

Even tier-1 enterprises struggle with this—Uber's experience of exhausting annual AI budgets in four months illustrated how fragmented spend and consumption can outpace both planning and visibility systems.

The adoption gap: Market observations in early 2026 indicated significant enterprise Copilot subscription cancellations, with organisations citing low adoption and unclear value as primary reasons. The pattern: seats purchased on potential, cancelled on measured reality. Many organisations discovered they were paying for hundreds of seats with fewer than 40% active users.

Governance and safety costs.

What to do next

For finance leaders:

Evidence
Ask whether the current cost view includes labour, governance, and integration rather than only direct vendor fees.
Evidence
Separate exploratory AI spending from operating AI services in reporting.
Interpretation
Establish a named owner for AI economics across the estate, with mandate from CFO or CIO.

For technology and platform leaders:

Evidence
Instrument the top AI workflows so cost can be tied to service behaviour, not only providers.
Evidence
Expose shared platform cost explicitly before more local use cases are approved.
Interpretation
Set guardrails where consumption is unbounded - per-task and per-run budgets on any autonomous agent, with automatic halt.

For operating-model leaders:

Evidence
Use this primer as the opening layer, then move into the seven-category AI TCO Framework, FinOps for AI, and TBM for AI for the fuller model.
Interpretation
Build attribution coverage as the lead metric - the percentage of AI spend that can be connected to measured outcomes.

Where cost basics fit in the maturity model

Optimist

Sceptic

The Optimist's Case

The Sceptic's Case

References and further reading

FinOps Foundation, FinOps for AI: Scopes and Capabilities, 2025
BCG, The Widening AI Value Gap: Build for the Future, 2025
BCG, From Potential to Profit: Closing the AI Impact Gap, 2024
NIST, AI Risk Management Framework, 2023
IDC, Worldwide AI Spending Guide, 2025
AWS, Closing the AI Value Gap, 2024