July 7th, 2024

Apple M5 Chip's Dual-Use Design Will Power Future Macs and AI Servers

Apple plans to use advanced SoIC packaging for M5 chips, enhancing performance for Macs, data centers, and AI tools. Collaboration with TSMC includes carbon fiber composite molding for improved thermal management. Mass production expected in 2025-2026, aligning with Apple's vertical integration strategy.

Read original articleLink Icon
Apple M5 Chip's Dual-Use Design Will Power Future Macs and AI Servers

Apple is set to utilize a more advanced SoIC packaging technology for its upcoming M5 chips, aiming to meet the demands of powering consumer Macs and enhancing data centers and AI tools. The System on Integrated Chip technology allows for stacking chips in a three-dimensional structure, offering improved electrical performance and thermal management compared to traditional designs. Apple's collaboration with TSMC on a hybrid SoIC package incorporating carbon fiber composite molding technology is in a trial production phase, with plans for mass production in 2025-2026. References to the M5 chip have been found in Apple's code, indicating its development for AI servers. The M5's dual-use design is seen as a strategic move by Apple to integrate its supply chain for AI functionality across various platforms. This development aligns with Apple's goal of vertically integrating its hardware and software for future computing needs.

Related

TSMC experimenting with rectangular wafers vs. round for more chips per wafer

TSMC experimenting with rectangular wafers vs. round for more chips per wafer

TSMC is developing an advanced chip packaging method to address AI-driven demand for computing power. Intel and Samsung are also exploring similar approaches to boost semiconductor capabilities amid the AI boom.

US Mac market share grew 22% in Q1, likely helped by new MacBook Air models

US Mac market share grew 22% in Q1, likely helped by new MacBook Air models

The US Mac market share grew by 22.4% in Q1 2024, surpassing the overall PC market growth of 5%. New MacBook Air models drove the surge, with an 8% growth forecasted due to enterprise sales and AI demand. Apple holds a 14.2% share in the US PC market, expected to increase with new Mac features and AI-capable PCs.

Intel CPU with Optical OCI Chiplet Demoed with 4Tbps of Bandwidth and 100M Reach

Intel CPU with Optical OCI Chiplet Demoed with 4Tbps of Bandwidth and 100M Reach

Intel unveiled a new CPU with an Optical Compute Interconnect chiplet, offering 4Tbps bandwidth and 100m reach. The chiplet merges Photonic and Electronic Integrated Circuits, featuring built-in lasers for improved server communication, especially in AI servers. Intel plans to scale the technology up to 32Tbps, focusing on power savings and enhanced bandwidth. This advancement aligns with the industry's move towards co-packaged optics for better efficiency and performance, marking a significant shift in server architecture towards power efficiency and high-speed data transfer.

Extreme Measures Needed to Scale Chips

Extreme Measures Needed to Scale Chips

The July 2024 IEEE Spectrum issue discusses scaling compute power for AI, exploring solutions like EUV lithography, linear accelerators, and chip stacking. Industry innovates to overcome challenges and inspire talent.

Apple just launched a public demo of its '4M' AI model

Apple just launched a public demo of its '4M' AI model

Apple publicly launches its '4M' AI model with EPFL on Hugging Face Spaces, showcasing versatile capabilities across modalities. The move signals a shift towards transparency, aligning with market growth and emphasizing user privacy amid ethical concerns.

Link Icon 14 comments
By @mise_en_place - 5 months
I could really see this taking off. Sagemaker is garbage and hugging face interfaces are laggy and buggy. The future is on-prem bespoke models you can run on commodity NPU SoCs. On my M3 MacBook I’ve been running local models like Llama-70B instead of ChatGPT for a while now.
By @dagmx - 5 months
The article and therefore people responding are focused on the most boring part of the rumour: “dual use”

The stacked logic setup is far more interesting in terms of what it means for die density and efficiency.

By @gautamcgoel - 5 months
I read the article, know a reasonable amount about CPUs, and have no idea what the article means by 'dual-use'. Typical clickbait fluff.
By @AndrewSwift - 5 months
Dual use in this case means use both in personal computers and in data centers or "cloud servers".

It would be of interest because normally you'd be optimizing for very different characteristics.

By @curt15 - 5 months
Would Apple revive OS X server or just run Linux on such AI servers?
By @treprinum - 5 months
Are they going to bundle 8TB of RAM on the CPU now?
By @daft_pink - 5 months
M5? I want a Mac with an M4 but all they offer it on is an iPad Pro with virtually no functionality improvement over my current iPad Pro.
By @jimnotgym - 5 months
Apple are making servers again?
By @forrestthewoods - 5 months
Seems like for an AI data center you’d really want a dedicated AI chip, no? The current M chips have way more CPU and GPU than inference workloads need or want, right?
By @troupo - 5 months
It will be funny to see Apple crack under pressure from the AI bubble.

They have been severely mismanaged for a decade by forcing mandatory yearly upgrades across all of their stacks.

In the past several years the cracks have started to show in their software (bugs lingering for years, features being delayed for months after yearly OS upgrades etc.). Hardware teams seemed to be mostly immune from it, and delivered insane results.

Now it's "omg must have AI don't matter if you're ready for it or no. Upper management saw LLM demos and are now forcing it everywhere. What do you mean you had other plans for M5? It's AI now damn it"

By @triyambakam - 5 months
I feel so left behind with an M1 MacBook. Is that on purpose? Am I supposed to feel shame and upgrade to M{LATEST}?
By @andrewmcwatters - 5 months
I wonder what the internal experience is like SSHing into one of these Apple Cloud Server boxes.

I mean, sure, it’s similar to what you’d surely get running Terminal.app, but I mean I doubt Apple engineers are doing some internal equivalent of apt when they need something.

There’s brew, but it would be… awkward if that’s what they used in their private cloud fleet.

By @rkwasny - 5 months
Even triple use if you could mount it in the cruise missile :-)