June 25th, 2024

Etched Is Making the Biggest Bet in AI

Etched invests in AI with Sohu, a specialized chip for transformers, surpassing traditional models like DLRMs and CNNs. Sohu optimizes transformer models like ChatGPT, aiming to excel in AI superintelligence.

Read original articleLink Icon
Etched Is Making the Biggest Bet in AI

Etched is making a significant investment in AI by developing Sohu, the world's first specialized chip for transformers. This chip is designed to outperform traditional AI models like DLRMs and CNNs, specifically excelling in running transformer models such as ChatGPT. The company believes that scaling is crucial for achieving superintelligence in AI models, with a focus on providing more compute power and better data. The shift towards specialized chips for transformers is seen as inevitable due to the increasing demand for transformer inference in various AI applications. Sohu's design allows for higher FLOPS utilization compared to GPUs, enabling it to handle transformer models more efficiently. The company's approach involves optimizing hardware and software specifically for transformers, aiming to lead the market in transformer-specific inference. Etched's bet on transformers is supported by the current dominance of transformer architectures in AI applications, making Sohu a key player in the evolving AI hardware landscape.

Link Icon 6 comments
By @returnInfinity - 4 months
How will these companies replace the software? Don't they need something similar to CUDA?
By @CommieBobDole - 4 months
"In five years, AI models became smarter than humans on most standardized tests."

This seems to be a novel definition of "smarter" - one could also argue that the printed answer key for a standardized test is smarter than most humans.

By @ilaksh - 4 months
Wow.. I wonder how this compares to groq?

I made a request to access their developer cloud. Anyone have any idea when they start processing those requests and how many slots they might have?

By @jeffs4271 - 4 months
Etched has an interesting approach, I am not convinced in their public info because it is vague. Could be great or could be bullshit. Well certainly some marketing.
By @candiddevmike - 4 months
> Specialized chips are inevitable

I mean, are they? Seems like the industry would prefer these things to become commodities, especially if it helps with portability and reproducibility.