AMD's MI350P Puts Pressure on Nvidia with 43% Performance Boost

The AMD Instinct MI350P is a PCIe-based graphics card designed for data centers and enterprise buyers. It's AMD's first PCIe-form-factor Instinct accelerator since the MI210 launched in 2022, and it targets the on-premises AI inference market.

The MI350P has 144GB of HBM3E memory, a full CDNA 4 die, and a peak engine clock of 2.2GHz. It's built to fit into off-the-shelf air-cooled servers and is priced in the same $30,000-to-$40,000 band as Nvidia's H200 NVL.

AMD claims the MI350P delivers roughly 43% better FP16 performance than the H200 NVL, but Nvidia still wins on raw memory bandwidth. The MI350P has a higher memory capacity and a friendlier power envelope, which could make it more attractive to buyers who value these aspects.