Big Tech Drives GPU Rental Prices Amid Shortage

Big Tech companies, including Amazon, Microsoft, and Google, have exacerbated the GPU shortage by dominating production and raising rental prices significantly. Recent reports indicate that NVIDIA GPU rental costs have surged, with prices for H100 and H200 models increasing by 20% to 48% over the past few months. This is largely due to hyper-scalers transitioning into GPU rental services as they rapidly expand their data center capabilities to meet growing AI demands, leaving smaller firms grappling with access to affordable computational power.

The rising costs and extended wait times for new GPU components (ranging from 36 to 52 weeks) signify a critical shift in the AI landscape. As companies increasingly rely on external resources for high-performance computing, dependency on foreign GPU technologies amplifies. This situation raises concerns regarding national AI autonomy, as reliance on external suppliers becomes a pressing issue in a rapidly evolving sector.