Apple's Hardware Ready for On-Device AI Thanks to PrismML Breakthrough

Apple's latest hardware is capable of running advanced AI on-device, thanks to its custom-designed chips. A recent breakthrough by start-up PrismML has compressed a large open-weight model that can run locally on Apple devices, including iPhones and iPads.

The breakthrough, announced last week, involves the compression of a 27-billion-parameter model called Bonsai 27B, which retains roughly 90% of its original performance. This achievement is significant because traditional models of this size cannot fit in a phone's usable memory.

PrismML's CEO has stated that Apple is in 'very early' discussions about the technology. This development could lead to consumers having access to free, local, open-weight AI on their devices, without the need for monthly fees or cloud connectivity.