Guozhen AIGlobal AI field notes and model intelligence

Realtime AI News

NVIDIA AI Servers to Rise 15% or More as Memory Costs Surge, Adding Up to $5B per 1GW Data Center

NVIDIA has told some of its biggest customers that AI servers delivered in early 2027 could cost 15% or more, with some GB300 and Vera Rubin 200 systems reportedly rising about 17%. A 1GW AI data center could see at least $5 billion in added costs as surging memory prices squeeze GPU supply chains.

Published

NVIDIA is raising prices again. According to Bloomberg, some of NVIDIA's largest customers have been told that AI servers delivered early next year could be priced more than 15% higher, covering both the existing Grace Blackwell lineup and the next-generation flagship Vera Rubin, with the exact increase depending on GPU generation and memory configuration. The Information reports that some GB300 and Vera Rubin 200 systems are expected to rise by about 17% — and using the price model in that report, a single 1GW-scale AI data center could see at least $5 billion in added cost from this round of increases alone.

The higher prices take effect with products delivered from early 2027. By current estimates, a 72-GPU Vera Rubin rack costs around $7 million today and could reach about $8 million after the increase. Server pricing has also been unusually volatile lately: one GPU cloud executive said racks they procure were recently rising 2% to 3% per week, and some GB300 NVMe storage racks are running 10% to 15% above their normal baseline.

This is the third major round of price hikes across NVIDIA hardware in 2026. The first hit the consumer market, where RTX 50-series cards rose sharply over the summer — the RTX 5060 Ti 16GB median price climbed as much as 39%, the RTX 5070 about 36% and the RTX 5060 about 27%. The second hit professional GPUs: the 96GB RTX PRO 6000 Blackwell went from roughly $8,565 early on to $13,250 in June 2026 and $16,000 by August. Now AI servers are joining the trend.

The stated reason is surging memory costs. TrendForce expected traditional DRAM contract prices to rise 58% to 63% quarter-over-quarter in Q2 2026, with NAND Flash up 70% to 75%. Server DRAM and the HBM inside AI chips share the same wafer capacity, and HBM is far more wafer-hungry, so its rapid expansion squeezes ordinary server memory supply. With LPDDR5X tight, NVIDIA has already decided to halve the SOCAMM memory in the next-generation Vera Rubin Superchip, and suppliers can currently meet only about 60% of NVIDIA's estimated LPDRAM demand based on initial capacity allocations from Samsung, SK Hynix and Micron.

Beyond memory, the increases reflect higher system integration complexity, supply-chain tightness and a scramble among cloud providers and model companies over delivery timelines. NVIDIA is also reaching upstream into infrastructure: on August 21 it announced a minority investment in U.S. data center developer Cloverleaf Infrastructure (amount undisclosed, though The Wall Street Journal reported it could reach hundreds of millions of dollars), days after committing $1.5 billion to SoftBank-backed data center developer SB Energy, alongside efforts with Apollo, BlackRock and others to mobilize more than $500 billion in third-party capital for AI infrastructure.

Meanwhile, Amazon, Microsoft, Google and Meta are all doubling down on their own AI chips to reduce dependence on NVIDIA. After years of GPUs driving an HBM boom that keeps squeezing DRAM capacity, the memory price boomerang now pushing up GPU and AI server costs will be a key variable in cloud procurement budgets and AI compute pricing in the coming quarters.

Why it matters

Higher AI server prices will directly raise the cost of large-scale training and inference, likely feeding through to cloud pricing and accelerating customers' shift toward custom silicon and more efficient memory configurations.

NVIDIAAI ServerMemory
Back to realtime news

Nearby Updates

All