June 22nd, 2024

Intel's Gaudi 3 will cost half the price of Nvidia's H100

Intel's Gaudi 3 AI processor is priced at $15,650, half of Nvidia's H100. Intel aims to compete in the AI market dominated by Nvidia, facing challenges from cloud providers' custom AI processors.

Read original articleLink Icon
Intel's Gaudi 3 will cost half the price of Nvidia's H100

Intel's latest Gaudi 3 AI processor is priced at around $15,650, which is half the cost of Nvidia's H100. Intel revealed the pricing at Computex 2024, with eight Gaudi 2 processors on a baseboard costing less than one Nvidia B200. The Gaudi 2 accelerators are priced at $65,000 for eight on a baseboard, while the Gaudi 3 processors are priced at $125,000 for eight. This translates to a single Gaudi 2 costing around $8,125 and a Gaudi 3 costing around $15,650 when purchased in bulk with a baseboard. In comparison, Nvidia's H100 80GB cards cost $30,000, with projections for the next-generation B100 GPU and the more powerful GB200 ranging from $30,000 to $70,000. Intel's move to offer Gaudi accelerators at a discount is seen as a strategy to compete with Nvidia in the AI market, where Nvidia currently dominates. Intel faces challenges not only from Nvidia but also from custom in-house-designed AI processors used by cloud service providers like AWS and Google.

Related

Testing Generative AI for Circuit Board Design

Testing Generative AI for Circuit Board Design

A study tested Large Language Models (LLMs) like GPT-4o, Claude 3 Opus, and Gemini 1.5 for circuit board design tasks. Results showed varied performance, with Claude 3 Opus excelling in specific questions, while others struggled with complexity. Gemini 1.5 showed promise in parsing datasheet information accurately. The study emphasized the potential and limitations of using AI models in circuit board design.

Testing AMD's Bergamo: Zen 4c

Testing AMD's Bergamo: Zen 4c

AMD's Bergamo server CPU, based on Zen 4c cores, prioritizes core count over clock speed for power efficiency and density. It targets cloud providers and parallel applications, emphasizing memory performance trade-offs.

First 128TB SSDs will launch in the coming months

First 128TB SSDs will launch in the coming months

Phison's Pascari brand plans to release 128TB SSDs, competing with Samsung, Solidigm, and Kioxia. These SSDs target high-performance computing, AI, and data centers, with larger models expected soon. The X200 PCIe Gen5 Enterprise SSDs with CoXProcessor CPU architecture aim to meet the rising demand for storage solutions amidst increasing data volumes and generative AI integration, addressing businesses' data management challenges effectively.

Finnish startup says it can speed up any CPU by 100x

Finnish startup says it can speed up any CPU by 100x

A Finnish startup, Flow Computing, introduces the Parallel Processing Unit (PPU) chip promising 100x CPU performance boost for AI and autonomous vehicles. Despite skepticism, CEO Timo Valtonen is optimistic about partnerships and industry adoption.

The Gates Foundation Grants $2.7M to Jeff Hawkins' Numenta

The Gates Foundation Grants $2.7M to Jeff Hawkins' Numenta

Bill Gates backs Jeff Hawkins and Numenta for brain-inspired AI. Hawkins aims to revolutionize AI with neocortex mimicry, emphasizing sensorimotor AI over LLMs like ChatGPT. Critics debate AI scalability and intelligence.

Link Icon 2 comments
By @ggm - 5 months
What's its impact on NVDA longterm value? I can't but think it tends down anyway, nothing lasts forever. Intel have more bases covered and would presumably be an undervalue stock from the debacle of engineering sackings.
By @conover - 5 months
Nvidia’s profit margin for the H100 is supposedly in the neighborhood of 1000%. So they can afford give up some profit if they need to. Couple that with the fact that the software toolchain advantage is significant. That being said, I’m all for more competition in the space.