Guozhen AIGlobal AI field notes and model intelligence

Realtime AI News

Nvidia packages the AI factory into containers, promising tokens in 14 days

Nvidia's new DSX POD line pre-builds Vera Rubin compute, networking, power and liquid cooling into modular containers so a site can go live in as little as 14 days instead of roughly six months. Companion DSX MaxLPS and DSX Flex software aim to convert the same power budget into more inference throughput and grid flexibility.

Published
英伟达把AI工厂做成集装箱:到场14天即可产出token
Image source: nvidia.com

Nvidia's latest data-center push is less about selling racks than about shipping a finished AI factory. The new DSX POD hardware line packages Vera Rubin compute systems, high-speed networking, rack-level power and liquid cooling into modular containers, with cross-rack cabling, plumbing and full-system verification completed at partner factories.

The payoff is schedule. Traditional AI data-center builds require on-site node installation, wiring, power distribution and coolant piping, and delays can stretch the process past six months. Nvidia says a delivered container only needs to be connected to pre-reserved power, cooling and network infrastructure, cutting on-site deployment to as little as 14 days.

Nvidia measures the result in "time to first token": every day earlier that training and production inference start is a day earlier an operator can bill for tokens. The article's ideal case — a 10,000-GPU cluster, fully loaded and fully sold, earning $380,000 an hour — depends on assumptions that few operators will meet.

Node assembly shrinks too. Vera Rubin uses a cable-free architecture and 100% liquid cooling, which Nvidia says cuts single-node assembly from two hours on Grace Blackwell to five minutes while improving reliability and performance.

Power is the other half of the pitch. DSX MaxLPS dynamically allocates power inside an existing budget; Nvidia claims up to 30% power savings for the same token output, or extra compute when the budget is fixed. In a Lambda proof of concept on HGX B200 systems, the company reports 24% higher cluster token throughput and 19% more usable GPU capacity; at Nscale's Iceland facility, four GB300 NVL72 racks under a 264kW budget showed 49% higher inference throughput and 37% more managed GPU capacity.

DSX Flex goes further, letting a factory act as a grid asset by adjusting consumption against grid load, power prices and on-site solar or storage. In a joint test with the UK National Grid, Nebius and Emerald AI, Nvidia says a Blackwell Ultra cluster cut power draw by 40% during a simulated grid emergency without interrupting critical workloads.

On cooling, Vera Rubin supports 100% liquid cooling with coolant at up to 45°C, and the DSX reference design pairs a closed loop with outdoor dry coolers so no water evaporates. Nvidia estimates a 2GW factory saves 54 million liters of water a day versus cooling towers. On the software side, the SimReady Central library of physical assets landed on Hugging Face, and Nvidia open-sourced DSX OS with three developer preview components.

The caveats matter: 14 days, 49% and $380,000 an hour all depend on specific configurations and near-perfect utilization, and real projects are constrained by grid interconnection, customer demand and site conditions. The direction, though, is clear — Nvidia is productizing delivery time, energy efficiency and grid behavior alongside the silicon. Watch the first DSX POD customer deployments and whether third-party operators see similar gains.

Why it matters

AI infrastructure competition now runs on time-to-first-token, power efficiency and grid cooperation, not just accelerator performance, which changes how operators model data-center economics.

NVIDIAAI InfrastructureData Center
Back to realtime news

Nearby Updates

All

10/22, 05:14

Meta says Muse tops 10 million users, with shopping a leading activity

Meta said on its third-quarter earnings call that its AI app Muse has more than 10 million users, with about 25% of people who set it up using it daily. Shopping through the agent has surprised even insiders, with over a quarter of engaged shoppers averaging purchases above $200.

10/22, 05:00

OpenAI tightens Usage Policies for model routers and resale partners

OpenAI said on October 21 that it is updating its Usage Policies, effective November 20, 2026, so that services offering direct access to its models — including model routers and AI gateways — must first pass OpenAI review and approval. Partners must also maintain safeguards consistent with OpenAI's own, investigate potential violations and coordinate on enforcement.

10/22, 04:57

DeepSeek open-sources DeepInfer, the engine behind its production serving

DeepSeek has open-sourced DeepInfer, the inference framework that powers its large-scale production services, releasing an offline inference build that currently supports DeepSeek-V4.1-Flash. The code is published under Apache 2.0, with the repository listing missing pieces such as a KV cache system, disaggregated serving and cross-replica load balancing.

10/22, 04:27

Recursive ships Flint, a free coding model built largely by its own AI

Recursive released Flint, a free coding model that runs on a laptop and, according to the company, was built largely by its automated research system, the Eureka Machine. Flint is a 40-billion-parameter mixture-of-experts model with 2.5 billion active parameters, published under Apache 2.0 on Hugging Face.