AWS’ custom chip strategy is showing results, and cutting into Nvidia’s AI dominance

AWS’ custom chip strategy is showing results, and cutting into Nvidia’s AI dominance


AWS announces new CPU chip: Here's what to know

Amazon Web Services is set to announce an update to its Graviton4 chip that includes 600 gigabytes per second of network bandwidth, what the company calls the highest offering in the public cloud.

Ali Saidi, a distinguished engineer at AWS, likened the speed to a machine reading 100 music CDs a second.

Graviton4, a central processing unit, or CPU, is one of many chip products that come from Amazon’s Annapurna Labs in Austin, Texas. The chip is a win for the company’s custom strategy and putting it up against traditional semiconductor players like Intel and AMD.

But the real battle is with Nvidia in the artificial intelligence infrastructure space.

At AWS’s re:Invent 2024 conference last December, the company announced Project Rainier – an AI supercomputer built for startup Anthropic. AWS has put $8 billion into backing Anthropic.

AWS Senior Director for Customer and Project Engineering Gadi Hutt said Amazon is looking to reduce AI training costs and provide an alternative to Nvidia’s expensive graphics processing units, or GPUs.

Anthropic’s Claude Opus 4 AI model launched on Trainium2 GPUs, according to AWS, and Project Rainier is powered by over half a million of the chips – an order that would have traditionally gone to Nvidia.

Hutt said that while Nvidia’s Blackwell is a higher-performing chip than Trainium2, the AWS chip offers better cost performance.

“Trainium3 is coming up this year, and it’s doubling the performance of Trainium2, and it’s going to save energy by an additional 50%,” he said.

The demand for these chips is already outpacing supply, according to Rami Sinno, director of engineering at AWS’ Annapurna Labs.

“Our supply is very, very large, but every single service that we build has a customer attached to it,” he said.

With Graviton4’s upgrade on the horizon and Project Rainier’s Trainium chips, Amazon is demonstrating its broader ambition to control the entire AI infrastructure stack, from networking to training to inference.

And as more major AI models like Claude 4 prove they can train successfully on non-Nvidia hardware, the question isn’t whether AWS can compete with the chip giant — it’s how much market share it can take.

The release schedule for the Graviton4 update will be provided by the end of June, according to an AWS spokesperson.



Source

India overtakes China in smartphone exports to the U.S. as manufacturing jumps 240%, report shows
Technology

India overtakes China in smartphone exports to the U.S. as manufacturing jumps 240%, report shows

Workers assemble smartphones at Dixon Technologies’ Padget Electronics Pvt factory in Uttar Pradesh, India, on Jan. 28, 2021. Bloomberg | Bloomberg | Getty Images India has overtaken China to become the top exporter of smartphones to the U.S., according to research firm Canalys, reflecting the shift in manufacturing supply chain away from Beijing amid tariff-fueled […]

Read More
Waymo plans to bring its robotaxi service to Dallas in 2026
Technology

Waymo plans to bring its robotaxi service to Dallas in 2026

A Waymo rider-only robotaxi is seen during a test ride in San Francisco, California, U.S., December 9, 2022.  Paresh Dave | Reuters Alphabet’s Waymo unit plans on bringing its robotaxi service to Dallas next year, adding to a growing list of prospective U.S. markets for 2026, including Miami and Washington, D.C. Rental car company Avis […]

Read More
Ray-Ban Meta smart glasses revenue tripled over the year, EssilorLuxottica says
Technology

Ray-Ban Meta smart glasses revenue tripled over the year, EssilorLuxottica says

Ray-Ban Meta smart glasses on display in the window of a Ray Ban store in London, UK, on Friday, July 19, 2024.  Bloomberg | Bloomberg | Getty Images Revenue from sales of Ray-Ban Meta smart glasses more than tripled year over year, EssilorLuxottica revealed Monday as part of the company’s most recent earnings report. EssilorLuxottica […]

Read More