Nvidia says Groq racks will be online this year following $20 billion purchase

Nvidia says the Groq racks it acquired through its roughly $20 billion purchase will be online this year, according to CNBC.

The report cites Nvidia saying that deployment of Groq racks is underway and expected to go live within the year. The timeline signals that Nvidia is moving quickly to integrate Groq's inference hardware into its infrastructure plans after closing the acquisition.

Groq is known for specialized accelerators designed for low-latency AI inference, giving it a distinctive position in the inference market. Since the deal, observers have focused on how Nvidia will combine Groq's hardware with its own GPU ecosystem.

The go-live plan is part of Nvidia's broader shift from selling chips toward offering inference as a service. As AI workloads move from training toward large-scale inference, Nvidia wants to cover both the hardware and the service layer.

Why it matters: Groq racks coming online this year means Nvidia's inference infrastructure push is entering the deployment phase, which will directly shape competition in inference services against cloud providers and emerging inference chipmakers.

To be clear, public details remain thin — the report mainly confirms the timeline, while deployment scale, customers, and pricing have not been disclosed.

What to watch next: who the first customers are, how large the deployment will be, and how Nvidia prices and operates the service.