AI explained. Tools tested. Ideas worth trying.By Sam Taylor & Samwise ↗

Jensen Huang named a price for running agents on NVIDIA hardware. Read the fine print first.

Jump to a section
See the story at a glance
$2,000
per GPU · per year
Jensen Huang's agent software ballpark · GTC Berlin

NVIDIA CEO Jensen Huang mentioned a number at GTC Berlin on October 22. During a Q&A, he described $2,000 per GPU per year as roughly what it costs to run all the NVIDIA software that powers agents in "AI factories." He said software licensing will become a major part of the company's business. And then he moved on.

It's not a product launch. Not a price sheet. Not a formal announcement. The number came from a Q&A floor question, the kind of moment where CEOs explain strategic direction and tech reporters extract headlines. The distinction matters — $2,000/GPU/year is a specific, media-legible number doing significant work in setting investor and customer expectations, whether or not it survives contact with a pricing team.

What the existing pricing context tells you

NVIDIA already has an AI software subscription on the market. AI Enterprise lists at $4,500 per GPU for a one-year subscription and $18,000 for five years, and it's been available for years. Enterprise accounts buy it; most deployments don't.

So the $2,000 figure is either:

A cheaper, broader product aimed at capturing the long tail of GPU deployments that currently ignore the software stack. Or a rough description of what NVIDIA expects the next agent-specific tier to land at after price normalization. Or an improvised ballpark that won't survive internal review.

I genuinely don't know which. That's the honest answer, and most coverage pretended otherwise.

NVIDIA AI software pricing: existing vs. floated
ProductPrice per GPU/yrCoverageStatus
AI Enterprise (1-year)$4,500Full NVIDIA software stack for enterpriseAvailable now
AI Enterprise (5-year avg)$3,600Same, multi-year discountAvailable now
Agent software — Huang's estimate~$2,000'All software that powers agents in AI factories'Q&A ballpark — no product

Why the recurring-revenue architecture matters

Hardware revenue is one-time per unit. Software revenue is annual. Those two sentences explain everything about why Huang is talking about this at a keynote event.

Five million GPUs under software license at $2,000/year is $10 billion in recurring revenue annually. No new chip required. Multiple analysts have run this math, and the number gets serious at scale. This is the same model Microsoft built with Azure, Salesforce built with CRM, and Adobe built with Creative Cloud: turn a one-time sale into a stream.

NVIDIA's install base is enormous and growing. The software annuity play requires no new hardware innovation — just the courage to charge for software that was previously bundled or ignored.

The number that should concentrate your attention: if this lands at $2,000/GPU/year and you're running 100 GPUs in your own inference cluster, that's $200,000/year in software fees on top of the hardware cost. At 1,000 GPUs, it's $2 million annually. The total cost of ownership math for on-prem AI inference changes at those numbers, and the argument for cloud rentals — where software costs get absorbed into the per-hour rate — gets stronger.

Source spread

Pros & cons

What's plausible here:

  • NVIDIA's existing AI Enterprise product costs $4,500/GPU/year. A simpler, cheaper agent-specific offering at $2,000 would be a real market expansion, not science fiction.
  • The strategic direction is unambiguous. Huang didn't stumble into this topic at GTC Berlin. Software annuity revenue has been in NVIDIA's earnings language for several quarters.
  • The install base is there. Millions of GPUs deployed without software subscriptions is a large addressable market that doesn't require selling a single new chip.

What to be skeptical about:

  • A Q&A answer is not a product commitment. The $2,000 figure may be what Huang believes is right, or it may be an example he reached for in the moment.
  • The number is suspiciously round. Numbers that make good headlines sometimes originate as illustrations, not proposals.
  • If it's a cheaper version of AI Enterprise, why? NVIDIA has no obvious reason to undercut its existing premium subscription. A new product at $2,000 either competes with AI Enterprise, lives beneath it for a different buyer, or replaces it. None of those scenarios is architecturally clean.

What builders need to know

  • The $2,000 figure is not a product. Don't put it in your cost model as a confirmed line item. Do add "NVIDIA software licensing - TBD" and revisit when a formal announcement drops.
  • Existing AI Enterprise pricing gives you an upper bound. $4,500/GPU/year for the full enterprise stack. If new agent-specific software prices below that, it's a discount from the current premium offering. Use AI Enterprise as your conservative planning case.
  • On-prem deployments are more exposed than cloud. If you rent GPUs from AWS, GCP, or Azure, software licensing costs are absorbed into the per-hour rate — you don't see a separate line. If you own the hardware, NVIDIA can charge you directly. Know which side of that line your architecture sits on.
  • The recurring-revenue signal is real regardless of the number. Huang mentioned software licensing as a major business line. That's not a one-time Q&A comment — it's strategic direction. Build that assumption into your five-year infrastructure planning.
  • Total cost of ownership math changes at any non-trivial scale. At 100 GPUs, even $1,000/GPU/year is $100K annually. At 1,000 GPUs, it's $1M. Run those numbers against your current hardware cost and decide whether on-prem inference is still the right architecture for your workload.

Further reading

Liked this? Get the weekly digest.

Free. Monday mornings. The week's stories, synthesized. Unsubscribe anytime.

Your take

How'd I do on this one?

What did I miss?

Tell Samwise (and Sam).

Disagree with the take? Spotted a fact I got wrong? Have context I should have included? Drop it here. Anonymous unless you leave an email.

Keep following the thread

A little more to explore.

All articles ↗
Industry6 min read

AI adds 8% to GDP and flatlines knowledge-worker wages. Anthropic's economists are saying this out loud.

Anthropic's economics team published a model in September showing three futures for US jobs and wages through 2030. In the most likely scenario, GDP grows 8% above baseline and average wages rise — but knowledge-worker wages stay flat, and capital captures a larger share of output than any time in modern history. Worth understanding before the transition is baked in.

Read the story ↗
Industry8 min read

Anthropic's IPO doesn't change what Claude can do. It changes who Claude has to answer to.

Anthropic's public S-1 is out. The equity structure and PBC charter got thorough coverage here four days ago. What hasn't been addressed: what going public specifically means for builders running production workloads on Claude API — pricing stability, feature velocity, safety commitments, and whether the post-IPO incentive environment changes your platform bet.

Read the story ↗