XAI's Memphis Supercluster has gone live, with up to 100,000 Nvidia H100 GPUs
Elon Musk launches xAI's Memphis Supercluster with 100,000 Nvidia H100 GPUs for AI training, aiming for advancements by December. Online status unclear, SemiAnalysis estimates 32,000 GPUs operational. Plans for 150MW data center expansion pending utility agreements. xAI partners with Dell and Supermicro, targeting full operation by fall 2025. Musk's humorous launch time noted.
Read original article
xAI's Memphis Supercluster, led by Elon Musk, has been launched, featuring up to 100,000 liquid-cooled Nvidia H100 GPUs connected through a single RDMA fabric. Musk claims it to be the most powerful AI training cluster globally, aiming to achieve significant advancements in AI training by December. Despite the announcement, the exact online status of the cluster remains unclear, with SemiAnalysis estimating 32,000 GPUs currently operational. The power supply for the 150MW data center is still pending agreements with utility companies, potentially adding 50MW. Plans include expanding with an additional 300,000 GPU B200 cluster next year to support xAI's Grok chatbot. The project, involving partnerships with Dell and Supermicro, is expected to be fully operational by fall 2025. xAI currently rents GPUs from Oracle Cloud and utilizes spare capacity at X/Twitter data centers. The company recently closed a $6 billion fundraising round, valuing the business at $24 billion. Musk's humorous reference to the launch time, 4:20 am, is noted, given his past jokes related to the number.
Related
Intel's Gaudi 3 will cost half the price of Nvidia's H100
Intel's Gaudi 3 AI processor is priced at $15,650, half of Nvidia's H100. Intel aims to compete in the AI market dominated by Nvidia, facing challenges from cloud providers' custom AI processors.
Why So Many Bitcoin Mining Companies Are Pivoting to AI
Bitcoin mining companies pivot to AI due to high energy demand. AI training offers stable revenue. Major miners switch equipment, boosting market value. AI's energy needs spark competition for power sources, raising environmental concerns.
AI models that cost $1B to train are underway, $100B models coming
AI training costs are rising exponentially, with models now reaching $1 billion to train. Companies are developing more powerful hardware to meet demand, but concerns about societal impact persist.
The full list of 28 US AI startups that have raised $100M or more in 2024
In the first half of 2024, global AI startups received over $35.5 billion in investments. U.S. companies secured two billion-dollar rounds and 64% of mega-rounds, with notable funding going to various AI startups.
Bye-bye Bitcoin, hello AI: Texas miners leave crypto for next new wave
Texas miners pivot to AI, exemplified by Lancium and Crusoe Energy Systems' partnership for a 200MW data center near Abilene. Shift from bitcoin mining to AI reflects industry trend for profitability and sustainability.
3 commentsBut that's his philosophy: hard work, hard motivation, and hard time constraints. So far he's on track to achieve all his dreams.
Related
Intel's Gaudi 3 will cost half the price of Nvidia's H100
Intel's Gaudi 3 AI processor is priced at $15,650, half of Nvidia's H100. Intel aims to compete in the AI market dominated by Nvidia, facing challenges from cloud providers' custom AI processors.
Why So Many Bitcoin Mining Companies Are Pivoting to AI
Bitcoin mining companies pivot to AI due to high energy demand. AI training offers stable revenue. Major miners switch equipment, boosting market value. AI's energy needs spark competition for power sources, raising environmental concerns.
AI models that cost $1B to train are underway, $100B models coming
AI training costs are rising exponentially, with models now reaching $1 billion to train. Companies are developing more powerful hardware to meet demand, but concerns about societal impact persist.
The full list of 28 US AI startups that have raised $100M or more in 2024
In the first half of 2024, global AI startups received over $35.5 billion in investments. U.S. companies secured two billion-dollar rounds and 64% of mega-rounds, with notable funding going to various AI startups.
Bye-bye Bitcoin, hello AI: Texas miners leave crypto for next new wave
Texas miners pivot to AI, exemplified by Lancium and Crusoe Energy Systems' partnership for a 200MW data center near Abilene. Shift from bitcoin mining to AI reflects industry trend for profitability and sustainability.