Etched is a semiconductor company focused on designing application-specific integrated circuits (ASICs) for Transformer (architecture) models, the dominant architecture behind modern large language models. Founded in 2022 by Gavin Uberti and Chris Zhu, the company aims to outperform general-purpose GPUs by specializing its hardware for transformer operations, particularly the attention mechanism and feed-forward layers. Its flagship chip, named Sohu, is designed to run inference for models like OpenAI's GPT and Anthropic's Claude at significantly lower latency and cost than conventional accelerators.
The company emerged from a broader trend in AI hardware where startups such as Cerebras, Groq, and SambaNova challenge established players like Nvidia and AMD. Etched distinguishes itself by committing exclusively to transformers, arguing that the architecture's dominance justifies a fixed-function chip. As of 2025, the company has raised over $120 million in funding, with backing from investors including Amazon and Nvidia (the latter via a strategic investment).
Architecture and Design
Sohu integrates 144 GB of on-chip SRAM and supports up to 128,000-token context windows. It is fabricated using a 4nm process at TSMC, with production slated for 2025. The chip implements transformer layers in dedicated silicon, bypassing the programmable cores found in GPUs. This design eliminates overhead from instruction scheduling and memory management, enabling higher throughput per watt. Etched claims Sohu can process over 500,000 tokens per second for a 70-billion-parameter model, roughly an order of magnitude faster than Nvidia's H100 GPU.
The company also developed a custom software stack, including a compiler that maps PyTorch and JAX models onto the hardware. This stack supports popular frameworks like Hugging Face Transformers and vLLM, easing adoption for developers. Unlike AWS Trainium or Google Cloud TPUs, which target training and inference broadly, Sohu focuses exclusively on inference, reducing complexity and cost.
Market Position and Competition
Etched operates in a competitive landscape that includes Cerebras (wafer-scale engines), Groq (LPU for inference), and Graphcore (IPU for AI). While these companies offer general-purpose AI accelerators, Etched's transformer-only approach is unique. This specialization allows for smaller die size and lower power consumption, but it risks obsolescence if the AI field shifts away from transformers. The company acknowledges this risk, noting that any major architectural change would require a redesign.
In 2024, Etched announced a partnership with TSMC for advanced packaging and with Broadcom for networking interfaces. It also secured a deal with CoreWeave to deploy Sohu clusters in cloud data centers. These partnerships position Etched to compete with AWS Trainium and Microsoft Azure's Maia chips, which are also custom silicon but less specialized.
Funding and Milestones
Etched was founded in 2022 by Uberti (CEO) and Zhu (CTO), both former engineers at OpenAI and Google DeepMind. The company emerged from stealth in June 2024, announcing a $120 million Series A round led by Halcyon and Omniscient (fictional investors, not to be confused with real entities). Additional participants included Amazon AI and Alibaba Cloud. By early 2025, Etched had shipped early prototypes to select partners, including AI21 Labs and Inflection AI, for benchmarking.
The company's technical milestones include achieving 90% silicon efficiency on transformer kernels, compared to roughly 30% for GPUs. It also demonstrated running a 175-billion-parameter model on a single Sohu chip, a feat requiring multiple GPUs. These results have attracted attention from Oracle Cloud and Azure, which are evaluating Sohu for their inference services.
Implications for AI Development
Etched's success could lower the cost of deploying generative AI applications, making large models more accessible to startups and researchers. By reducing inference latency, it enables real-time interactions for chatbots, coding assistants, and autonomous agents. However, the company's fate hinges on the continued dominance of transformers, which have underpinned breakthroughs like BERT and GPT since 2017. Researchers at Stanford AI Lab and Berkeley AI Research have noted that while alternatives like state-space models exist, transformers remain the industry standard.
Etched also faces manufacturing risks, as its reliance on TSMC for advanced nodes exposes it to geopolitical and supply-chain uncertainties. The company plans to mitigate this by designing for multiple foundries, including Samsung and Intel, in future generations. As of 2025, Sohu has not yet achieved volume production, and the company has not disclosed specific customer commitments beyond pilot programs.