Nvidia’s Huang says faster chips are the best way to reduce AI costs

Nvidia’s Huang says faster chips are the best way to reduce AI costs


Nvidia CEO Jensen Huang introduces new products as he delivers the keynote address at the GTC AI Conference in San Jose, California, on March 18, 2025.

Josh Edelson | AFP | Getty Images

At the end of Nvidia CEO Jensen Huang’s unscripted two-hour keynote on Tuesday, his message was clear: Get the fastest chips that the company makes.

Speaking at Nvidia’s GTC conference, Huang said that questions clients have about the cost and return on investment the company’s graphics processors, or GPUs, will go away with faster chips that can be digitally sliced and used to serve artificial intelligence to millions of people at the same time.

“Over the next 10 years, because we could see improving performance so dramatically, speed is the best cost-reduction system,” Huang said in a meeting with journalists shortly after his GTC keynote.

The company dedicated 10 minutes during Huang’s speech to explain the economics of faster chips for cloud providers, complete with Huang doing envelope math out loud on each chip’s cost-per-token, a measure of how much it costs to create one unit of AI output.

Huang told reporters that he presented the math because that’s what’s on the mind of hyperscale cloud and AI companies.

The company’s Blackwell Ultra systems, coming out this year, could provide data centers 50 times more revenue than its Hopper systems because it’s so much faster at serving AI to multiple users, Nvidia says. 

Investors worry about whether the four major cloud providers — Microsoft, Google, Amazon and Oracle — could slow down their torrid pace of capital expenditures centered around pricey AI chips. Nvidia doesn’t reveal prices for its AI chips, but analysts say Blackwell can cost $40,000 per GPU.

Already, the four largest cloud providers have bought 3.6 million Blackwell GPUs, under Nvidia’s new convention that counts each Blackwell as 2 GPUs. That’s up from 1.3 million Hopper GPUs, Blackwell’s predecessor, Nvidia said Tuesday. 

The company decided to announce its roadmap for 2027’s Rubin Next and 2028’s Feynman AI chips, Huang said, because cloud customers are already planning expensive data centers and want to know the broad strokes of Nvidia’s plans. 

“We know right now, as we speak, in a couple of years, several hundred billion dollars of AI infrastructure” will be built, Huang said. “You’ve got the budget approved. You got the power approved. You got the land.”

Huang dismissed the notion that custom chips from cloud providers could challenge Nvidia’s GPUs, arguing they’re not flexible enough for fast-moving AI algorithms. He also expressed doubt that many of the recently announced custom AI chips, known within the industry as ASICs, would make it to market.

“A lot of ASICs get canceled,” Huang said. “The ASIC still has to be better than the best.”

Huang said his is focus on making sure those big projects use the latest and greatest Nvidia systems.

“So the question is, what do you want for several $100 billion?” Huang said.

WATCH: CNBC’s full interview with Nvidia CEO Jensen Huang

Watch CNBC's full interview with Nvidia CEO Jensen Huang



Source

Big Tech earnings show how big, smart spending can be rewarded by the market
Technology

Big Tech earnings show how big, smart spending can be rewarded by the market

I am growing tired of the endless bubble talk about all of the data center spending. It’s obvious from this quarter that the bubble talk has been proven wrong; try getting someone to say that, though. So, who do I think I am to go there? Just an observer. One who believes that this was […]

Read More
Here are the 3 big things we’re watching in the stock market in the week ahead
Technology

Here are the 3 big things we’re watching in the stock market in the week ahead

The S & P 500 kept its record run alive last week, boosted by a strong batch of earnings reports that showed the artificial intelligence spending boom isn’t slowing down. Even more earnings are on the way in the coming week. Plus, the jobs market will be under the microscope. The market’s blistering rally in […]

Read More
The S&P 500 and Nasdaq kept their record rallies going. Here are 3 key takeaways
Technology

The S&P 500 and Nasdaq kept their record rallies going. Here are 3 key takeaways

Yet another record week for stocks. Strong first-quarter earnings and a war-driven spike in oil made for another historic week on Wall Street. Investors also made sense of a spate of economic data and the Federal Reserve’s latest interest rate decision. The S & P 500 and Nasdaq Composite gained 0.9% and 1.1%, respectively, over […]

Read More