Nvidia's New 64GB DGX Spark Falls Short of Promise

Nvidia's new 64GB DGX Spark desktop AI computer is touted as an entry-level option, but it doesn't live up to that promise. The $4,999 price tag translates to about $78 per gigabyte of unified memory, making it a worse deal than the existing 128GB model, which has been repriced to $6,950 due to industry-wide DRAM and NAND price surges.

The 64GB DGX Spark runs on Nvidia's GB10 Grace Blackwell superchip, but its limited memory bandwidth of 273 GB/s is a major bottleneck for running large language models locally. A developer on Nvidia's forum noted that memory bandwidth, not capacity, is the actual limitation.

Nvidia is selling the 64GB DGX Spark as an accessible entry point into their ecosystem, but it may be more about CUDA lock-in than cheap compute. The machine comes with Nvidia's full software stack, including preinstalled AI tooling and CUDA libraries, which can make switching to competing hardware or custom silicon from a cloud provider more expensive later.