Amazon's Custom Chip Business Surpasses $25 Billion Annual Run Rate
Amazon's custom chip business has crossed a significant milestone, reaching an annual run rate of $25 billion. This achievement highlights the company's growing presence in the artificial intelligence computing space and its ability to offer customized AI chips.
The move into custom chip production is part of Amazon's strategy to provide high-performance computing solutions for its clients. Currently, Nvidia's GPUs are widely used in AI computing, but they are general-purpose workhorses that could be improved with customization. Amazon aims to fill this gap by offering purpose-built computing units that offer better price-performance ratios.
The Trainium2 AI chip offered by Amazon has demonstrated a 30% improvement over Nvidia's GPUs. The product has been in high demand, leading to sold-out capacity for the Trainium3 chips and significant reservations for the upcoming Trainium4 chips.