AWS Told Engineers to Conserve CPU Capacity Amid AI Compute Crunch
Amazon's cloud computing division, AWS, has told engineers to conserve CPU capacity due to an AI compute crunch. A report by The Information claims that managers directed teams in May to reduce compute usage wherever possible, including on CPU-powered servers.
The report also states that some engineers have experienced longer wait times to access CPU server capacity than in the past. According to one engineer, it now takes several days to obtain CPU server capacity that previously became available within a few hours.
AWS disputed this claim, saying it continues to meet the overwhelming majority of compute needs while promoting efficient EC2 usage. The company has also set deadlines for teams later this year to reduce compute usage by decommissioning idle EC2 instances and reallocating that capacity to customers.