Cloud GPU Prices Plummet to $3.38/Hr as Supply Chain Bottlenecks Persist

The cloud GPU market continues to be dominated by high prices due to tight supply chain conditions. According to pricing trackers, Nvidia's H100 chip has seen a significant price drop since early 2024, with rental costs now averaging $3.38 an hour in September 2026.

This is still nearly four times the original cost of renting an H100 in early 2024. The high demand for AI compute capacity and limited supply of memory have led to a bottleneck in the market, causing prices to skyrocket.

Nvidia's own executives have acknowledged that they cannot fully meet demand even with record shipments. As a result, buyers are turning to secondary marketplaces and specialist clouds when hyperscaler capacity runs out.