Nvidia Unveils $249 Desktop AI Computer for Local Model Running
Nvidia CEO Jensen Huang made headlines by pulling a $249 AI computer out of a kitchen oven during a recent presentation. The device, called the Jetson Orin Nano Super Developer Kit, is designed to run large language models locally without requiring a cloud subscription.
The Jetson Orin Nano Super pushes 67 to 70 TOPS (trillion operations per second) while sipping just 25 watts of power, roughly the energy draw of a standard lightbulb. It packs 8 GB of memory with bandwidth clocking in at 1,023 GB/s.
Nvidia claims it doubles the performance of its predecessor, the original Jetson Orin Nano, while delivering 50% more memory bandwidth. This device can handle workflows previously reserved for Nvidia's much larger HGX AI supercomputers.
Local inference, running AI models on your own hardware rather than through a cloud provider, addresses concerns about data privacy and decentralization in the crypto community. When you run a model locally, your prompts and data never leave your machine.