NVIDIA Cosmos3-H-Dreams brings a real-time world model to surgical robotics
Cosmos3-H-Dreams turns visual dynamics learned from clinical cholecystectomy recordings into real-time video simulation conditioned on robot commands.
AT A GLANCE
Key points
- Specialized on clinical cholecystectomy video and robot kinematics.
- Two student checkpoints use four and two denoising steps.
- Targets interactive streaming on a single RTX PRO 6000 GPU.
- A research simulator, not a clinically validated patient-care system.
What is changing?
NVIDIA released the Cosmos3-H-Dreams research model on October 20. Built on Cosmos 3, the system learns from cholecystectomy video and robot kinematics recorded on CMR Surgical’s Versius platform. Given an initial frame and tool commands, it generates new video frames that respond to the motion of two surgical instruments.
The model processes 28 action dimensions, with training data aligned at 832×480 resolution and 10 Hz. NVIDIA provides two student models using four and two denoising steps. The company says the system runs interactively on a single RTX PRO 6000 GPU through its FlashDreams streaming stack.
Researchers can use the model to test robotic-surgery policies in safe, repeatable simulations. Visual realism, however, is not proof of biomechanical accuracy. NVIDIA describes the system as a research simulator, not a clinically validated product for patient care.
Explore the original sources
Source date: 20 October 2026.
Published by AI Radar: 20 Oct 2026, 23:03 (Istanbul, UTC+3).
FOLLOW THE TOPIC
Topics and tags
Share your discovery.
Send this story to a friend.
Reader comments
What do you think about this development? Share your experience or question. Comments are published after editorial approval.
Your name/nickname and comment become public if approved. Read: Privacy notice.
Loading comments…