October 10th, 2024

Wafer Scale and Trilogy Systems: Part 1

Cerebras Systems is advancing AI with Wafer Scale Integration (WSI) technology, which simplifies designs and enhances performance, despite historical challenges like defect management and heat dissipation.

Read original articleLink Icon
Wafer Scale and Trilogy Systems: Part 1

Cerebras Systems is making headlines with its Wafer Scale Integration (WSI) technology, which allows for the creation of large integrated circuits from entire silicon wafers. This innovation is part of Cerebras's strategy to accelerate AI training and inference, positioning itself against established competitors like Nvidia and AMD. The concept of WSI is not new; it dates back to the 1980s when pioneers like Jack Kilby recognized its potential to simplify designs and enhance performance by reducing the number of interconnects between chips. However, challenges such as defect management and heat dissipation have historically hindered its commercial viability. Gene Amdahl, a key figure in computer architecture, co-founded Trilogy Systems in 1979 to explore WSI further. Trilogy aimed to develop IBM-compatible mainframes using WSI technology, which promised significant performance improvements. Despite facing intense competition and financial scrutiny, Amdahl's vision for WSI was ambitious, suggesting that it could outperform existing systems by a considerable margin. The article highlights the historical context of WSI, tracing its evolution from theoretical concepts to practical applications in modern computing, particularly in AI.

- Cerebras Systems is leveraging Wafer Scale Integration to enhance AI capabilities.

- WSI technology has roots in the 1980s, with significant contributions from pioneers like Jack Kilby.

- Gene Amdahl's Trilogy Systems aimed to commercialize WSI for IBM-compatible mainframes.

- WSI offers potential advantages in performance and design simplicity over traditional integrated circuits.

- The challenges of defect management and heat dissipation remain critical considerations for WSI technology.

Link Icon 3 comments
By @jecel - 6 months
While Trilogy ran into technical problems, Sinclair's Anamartic actually delivered working products:

https://www.computinghistory.org.uk/det/3043/Anamartic-Wafer...

The long term plan was something not that different from what Cerebras does, but in order to not scare possible investors their first product was a battery backed wafer scale static RAM to replace hard disks. This market looked attractive since disks had been stuck at 20MB for a while. But right when Anamartic got ready to sell hard disks started to grow like crazy, first going to 30MB by moving from MFM to RLL then jumping to 40MB, 80MB, 160MB, 250MB and so on. This caused all of Sinclair's investors to pull out.

By @geomark - 6 months
Interesting article. I wonder if in part 2 they will cover the work done at TRW as part of the VHSIC Phase 2 program. They succeeded with a WSI chip called the CPUAX that used some of the same redundancy techniques together with a built in self test and configuration system.
By @sschmitt - 6 months
There's also the BrainScaleS neuromorphic system that features wafer scale integration:

https://arxiv.org/abs/2303.12359