You have commented 358 times on Rantburg.

Your Name
Your e-mail (optional)
Website (optional)
My Original Nic        Pic-a-Nic        Sorry. Comments have been closed on this article.
Bold Italic Underline Strike Bullet Blockquote Small Big Link Squish Foto Photo
Science & Technology
Nvidia's Blackwell is coming
2024-06-01
BLUF:
[Motley Fool] In March, Nvidia announced its most advanced AI product so far -- Blackwell. This isn't a new chip; it's a new architecture for GPUs. Nvidia says that it's "the engine of the new industrial revolution" that will "power a new era of computing."

Blackwell supports large language models (LLMs) with 1 trillion parameters. To put that into perspective, GPT-4 reportedly uses eight LLMs with 220 billion parameters each. Nvidia's new platform enables training of generative AI models up to four times faster and inference of up to 30 times faster than its H100 GPU. Blackwell also has a total cost of ownership and energy consumption that's up to 25 times less than the company's Hopper GPU architecture.

All the top-tier cloud service providers will use Blackwell: Amazon Web Services, Alphabet's Google Cloud, Microsoft Azure, and Oracle Cloud. So will Facebook parent Meta Platforms, ChatGPT creator OpenAI, Tesla, and Elon Musk's new AI company, xAI.

Nvidia CFO Colette Kress said in the company's Q1 earnings call that the demand for Blackwell is "well ahead of supply." CEO Jensen Huang revealed that production shipments will begin in the second quarter of 2024 and accelerate in Q3. He stated, "We will see a lot of Blackwell revenue this year."

THE BIGGER IMPLICATION
I think there's a bigger implication with the forthcoming launch of Blackwell that shouldn't be overlooked: Nvidia is proving that it can continue to out-innovate everyone.

Just when it seemed that Nvidia might have some competition in the GPU market, the company raised the bar. Rivals such as Advanced Micro Devices introduced new AI chips that might give Nvidia's H100 GPUs a run for their money, but they don't come close to stacking up against the Blackwell platform.

TD Cowen analyst Matt Ramsay hit the nail on the head with his comments in Nvidia's Q1 call. Ramsay said to Huang, "Jensen, I've been in the data center industry my whole career. I've never seen the velocity that you guys are introducing new platforms at the same combination of the performance jumps that you're getting."

It seems that no other chipmaker or wannabe chipmaker on the planet can keep up with Nvidia. Blackwell is proof. The new architecture isn't the end of the story, though. In Huang's response to Ramsay, he revealed, "[W]e have other Blackwells coming."
Related:
Nvidia 05/27/2024 Nvidia supplier SK Hynix to invest $3.87 bln in US chip packaging plant
Nvidia 04/05/2024 Russian role playing video game 'The Troubles'
Nvidia 01/06/2024 Pelosi's stocks surge: 'A sign of quasi-insider trading that's corrupt'

Posted by:Besoeker

#3  One twilight a digital bugle
And parting shot corticofugal
Were waking the world
While Old Glory got furled
O'er our grave neath a wave of gray Google.

"To Save Man," or, "It's a book-cook!"
Posted by: Pancho Poodle8452   2024-06-01 22:35  

#2  Is this 4-wheel security robot about to replace human security guards?
Posted by: Skidmark   2024-06-01 08:07  

#1  
Posted by: Skidmark   2024-06-01 07:50  

00:00