Google DeepMind's Genie 4 world model adds real-time audio and on-the-fly steering

Google DeepMind has released Genie 4, its newest world model, as a research preview for trusted testers. According to TechCrunch, the model generates the most photorealistic and interactive worlds the team has produced, and lets users type prompts mid-simulation to change what is happening on screen.

Audio is the most visible addition. Genie 4 generates real-time sound that matches the simulated world, including music, ambient noise and interactive dialogue. The model also loosens the editing controls: weather and camera angles can be changed live, and new people or objects can be added on the fly rather than only through preset actions.

Scene persistence has doubled. Genie 4 can hold a consistent scene for up to two minutes, twice the limit of Genie 3, which Google released as a research preview a little over a year ago. Physics are better and characters move in a more human-like way, closing two gaps that made earlier world models feel like demos.

The more consequential change is how Gemini fits in. Google's model acts as a director that plans steps and checks frames while Genie produces the visuals. In a research experiment tied to Gemini Robotics, a Gemini 4 Argon model broke a task into steps that Genie 4 simulated in real time, a possible route to testing robot scenarios in simulation before they happen in the physical world.

Tejas Kulkarni, a research director at Google, described the direction as "hybrid world models," with Gemini writing code and text while Genie ingests it and simulates reality at different levels of abstraction. That division of labor turns the world model from a video generator into something closer to a simulation kernel that can be instructed and orchestrated.

The pitched commercial uses remain gaming, interactive learning and robotics. One speculative example is stepping into a painting of a historical scene and talking to its subjects; a nearer-term one is film prototyping. Testers say the real-time loop matters most in ideation and storyboarding, where keeping a creative flow is the point. Engineer Diego Rivas said users may eventually use the multimodal Gemini Omni to turn those prototypes into production assets, though those capabilities are still a ways off.

The limits are explicit. Google's team acknowledges that details and objects drift the longer a simulation runs, and that it has not fully solved accurate audio or legible in-world text. Rivas stressed that it is still early days and that the end-to-end product experience is not yet defined.

Competition is crowding in. Runway shipped its second world model, GWM Worlds 2, a couple of months ago; World Labs is being acquired by AMD, Amazon is in talks to buy Decart, and Rivian just bought Third Dimension to bring simulation in-house for self-driving testing. Genie 4 is open now to trusted testers and will reach Google AI Ultra subscribers in Project Genie and early access partners on the Gemini API and AI Studio in the coming weeks.