Intel Vision 2024: Intel Gaudi 3 boasts 50% better performance over Nvidia H100 AI processor

Updated on 10-Apr-2024
HIGHLIGHTS

The Gaudi 3 is an AI-driven chip and is Intel’s attempt to help spread its scalable and secure solutions.

Intel claims that its new chipset can train large language models 50% faster than Nvidia's H100 processor.

Intel has also collaborated with Bharti Airtel, Infosys, and Ola/Krutrim to get the Gaudi 3 running.

It is raining chipsets and how. At the Intel Vision event, the semiconductor company unveiled its new chipset, the Intel Gaudi 3. This is an AI-driven chip and is Intel’s attempt to help spread its scalable and secure solutions, especially for AI workloads. With this new launch, Intel is trying to challenge the industry leader, Nvidia. With artificial intelligence booming right now, there has been a scarcity of chipsets to meet up with the demand. This is why we are seeing new chipsets dropping every now and then.

What can the Intel Gaudi 3 do?

The Gaudi 3 was built using the 5nm processor from Taiwan Semiconductor Manufacturing Co. Intel claims that its new chipset can train large language models 50% faster than Nvidia’s H100 processor. It can even compute the generative AI responses faster. It is specially made for enterprise-scale generative AI workflows. It boasts of 4X the compute power of Gaudi 2. Further, it has 1.5X better memory bandwidth and 2X the networking bandwidth.

Also read: Google Gemini Code Assist: Here’s how you can check your code with this AI tool

Intel Gaudi 3 availability

The company is planning to make the chipset more accessible. According to Intel CEO Pat Gelsinger, the Gaudi 3 can be made available to OEMs, including Dell Technologies, HPE, Lenovo, and Supermicro, in the second quarter of 2024. He even said, “Innovation is advancing at an unprecedented pace, all enabled by silicon – and every company is quickly becoming an AI company”.

Intel’s collaborations

Intel has also collaborated with Bharti Airtel, Infosys, and Ola/Krutrim to get the Gaudi accelerator solutions up and running. Further, it has also joined hands with Google Cloud, Thales, and Cohesity to take advantage of Intel’s confidential computing capabilities in their cloud instances.

In addition to this, Intel even hinted at its upcoming next-gen datacentre GPU, which goes by the codename of Falcon Shores. It is said to combine Gaudi and Intel Xe GPU technology.

Mustafa Khan

Mustafa is new on the block and is a tech geek who is currently working with Digit as a News Writer. He tests the new gadgets that come on board and writes for the news desk. He has found his way with words and you can count on him when in need of tech advice. No judgement. He is based out of Delhi, he’s your person for good photos, good food recommendations, and to know about anything GenZ.

Connect On :