Nvidia’s Huang says faster chips are the best way to reduce AI costs

Nvidia’s Huang says faster chips are the best way to reduce AI costs


Nvidia CEO Jensen Huang introduces new products as he delivers the keynote address at the GTC AI Conference in San Jose, California, on March 18, 2025.

Josh Edelson | AFP | Getty Images

At the end of Nvidia CEO Jensen Huang’s unscripted two-hour keynote on Tuesday, his message was clear: Get the fastest chips that the company makes.

Speaking at Nvidia’s GTC conference, Huang said that questions clients have about the cost and return on investment the company’s graphics processors, or GPUs, will go away with faster chips that can be digitally sliced and used to serve artificial intelligence to millions of people at the same time.

“Over the next 10 years, because we could see improving performance so dramatically, speed is the best cost-reduction system,” Huang said in a meeting with journalists shortly after his GTC keynote.

The company dedicated 10 minutes during Huang’s speech to explain the economics of faster chips for cloud providers, complete with Huang doing envelope math out loud on each chip’s cost-per-token, a measure of how much it costs to create one unit of AI output.

Huang told reporters that he presented the math because that’s what’s on the mind of hyperscale cloud and AI companies.

The company’s Blackwell Ultra systems, coming out this year, could provide data centers 50 times more revenue than its Hopper systems because it’s so much faster at serving AI to multiple users, Nvidia says. 

Investors worry about whether the four major cloud providers — Microsoft, Google, Amazon and Oracle — could slow down their torrid pace of capital expenditures centered around pricey AI chips. Nvidia doesn’t reveal prices for its AI chips, but analysts say Blackwell can cost $40,000 per GPU.

Already, the four largest cloud providers have bought 3.6 million Blackwell GPUs, under Nvidia’s new convention that counts each Blackwell as 2 GPUs. That’s up from 1.3 million Hopper GPUs, Blackwell’s predecessor, Nvidia said Tuesday. 

The company decided to announce its roadmap for 2027’s Rubin Next and 2028’s Feynman AI chips, Huang said, because cloud customers are already planning expensive data centers and want to know the broad strokes of Nvidia’s plans. 

“We know right now, as we speak, in a couple of years, several hundred billion dollars of AI infrastructure” will be built, Huang said. “You’ve got the budget approved. You got the power approved. You got the land.”

Huang dismissed the notion that custom chips from cloud providers could challenge Nvidia’s GPUs, arguing they’re not flexible enough for fast-moving AI algorithms. He also expressed doubt that many of the recently announced custom AI chips, known within the industry as ASICs, would make it to market.

“A lot of ASICs get canceled,” Huang said. “The ASIC still has to be better than the best.”

Huang said his is focus on making sure those big projects use the latest and greatest Nvidia systems.

“So the question is, what do you want for several $100 billion?” Huang said.

WATCH: CNBC’s full interview with Nvidia CEO Jensen Huang

Watch CNBC's full interview with Nvidia CEO Jensen Huang



Source

AI chipmaker Cerebras withdraws IPO
Technology

AI chipmaker Cerebras withdraws IPO

Artificial intelligence chipmaker Cerebras said on Friday that it’s withdrawing plans for an IPO, days after raising over $1 billion in a fundraising round. In a filing with the SEC, Cerebras said it does not intend to conduct a proposed offering “at this time,” but didn’t provide a reason. A spokesperson told CNBC on Friday […]

Read More
Amazon shutters 4 Fresh stores in Southern California as grocery strategy keeps shifting
Technology

Amazon shutters 4 Fresh stores in Southern California as grocery strategy keeps shifting

An employee arranges a salad dressing display at an Amazon Fresh grocery store on December 12, 2024 in Federal Way, Washington. David Ryder | Getty Images Amazon is closing four more Fresh supermarkets in Southern California as the e-commerce giant continues to focus its grocery strategy around Whole Foods and delivery. The closures will take […]

Read More
Quantum stocks Rigetti Computing and D-Wave surged double-digits this week. Here’s what’s driving the big move
Technology

Quantum stocks Rigetti Computing and D-Wave surged double-digits this week. Here’s what’s driving the big move

Inside Google’s quantum computing lab in Santa Barbara, California. CNBC Quantum computing stocks are wrapping up a big week of double-digit gains. Shares of Rigetti Computing, D-Wave Quantum and Quantum Computing have surged more than 20%. Rigetti and D-Wave Quantum have more than doubled and tripled, respectively, since the start of the year. Arqit Quantum […]

Read More