Sohu: The First Transformer ASIC
Etched secures $120 million to develop Sohu, a transformer ASIC enhancing AI model performance. Sohu enables real-time voice agents, rapid text processing, and trillion-parameter models, revolutionizing AI processing with advanced features.
Read original article
Etched has secured $120 million in funding to develop Sohu, the world's first transformer ASIC. By embedding the transformer architecture into their chips, Etched aims to enhance AI model performance significantly, making them faster and more cost-effective than GPUs. Sohu promises to enable tasks like real-time voice agents, rapid text processing, and advanced content generation. The ASIC is designed to support tomorrow's trillion-parameter models, offering open-source software and scalability up to 100T parameter models. With features like beam search, MCTS decoding, and support for MoE and transformer variants, Sohu is positioned to revolutionize AI processing. Etched's innovative approach marks a significant step towards unlocking new possibilities in AI hardware acceleration.
Related
TSMC experimenting with rectangular wafers vs. round for more chips per wafer
TSMC is developing an advanced chip packaging method to address AI-driven demand for computing power. Intel and Samsung are also exploring similar approaches to boost semiconductor capabilities amid the AI boom.
Etched Is Making the Biggest Bet in AI
Etched invests in AI with Sohu, a specialized chip for transformers, surpassing traditional models like DLRMs and CNNs. Sohu optimizes transformer models like ChatGPT, aiming to excel in AI superintelligence.
6 commentsBut isn't it the case that for LLMs what is really needed is lots of fast memory? ASICs can't help much there can they?
Related
TSMC experimenting with rectangular wafers vs. round for more chips per wafer
TSMC is developing an advanced chip packaging method to address AI-driven demand for computing power. Intel and Samsung are also exploring similar approaches to boost semiconductor capabilities amid the AI boom.
Etched Is Making the Biggest Bet in AI
Etched invests in AI with Sohu, a specialized chip for transformers, surpassing traditional models like DLRMs and CNNs. Sohu optimizes transformer models like ChatGPT, aiming to excel in AI superintelligence.