Apple's Hardware Gets AI Boost as Bonsai Model Runs Locally on iPhone
A recent breakthrough in artificial intelligence (AI) has made it possible for AI models to run locally on an Apple iPhone, thanks to PrismML's Bonsai 27B model. This achievement is significant as it allows users to access capable AI without needing a monthly fee or relying on cloud-based services.
The Bonsai 27B model is built on Alibaba's open-weight Qwen3.6 and can run on an iPhone 17 Pro, as well as on iPad, Mac, and PCs. At just 3.9 gigabytes, it is a serious model that finally fits on a phone.
This breakthrough has implications for Apple's business, particularly in terms of monetization. As most consumer AI usage is free, open-weight alternatives like Bonsai may shrink the opportunity for companies to charge for AI inference. However, Apple's position as a hardware maker means it can benefit from increased memory and capacity, which raises the cost of goods sold.