NVIDIA Cosmos: Transforming Autonomous Mobility with Physical AI

NVIDIA unveils Cosmos, a platform integrating generative physical AI to advance autonomous mobility and robotics. This platform uses World Foundation Models (WFMs) and advanced data processing to transform human-driven data into scalable, synthetic datasets, enhancing safety, efficiency, and development speed for AVs and industrial systems.
NVIDIA Cosmos: Transforming Autonomous Mobility with Physical AI
Image Credit: Nvidia

At CES 2025 in Las Vegas, NVIDIA made a groundbreaking announcement that promises to reshape the landscape of autonomous mobility and industrial systems. The company introduced NVIDIA Cosmos, a platform integrating generative World Foundation Models (WFMs), advanced tokenizers, guardrails, and a high-speed video processing pipeline designed to accelerate the development of physical AI systems like autonomous vehicles (AVs) and robotics.


This innovation builds upon NVIDIAโ€™s existing “three-computer solution,” a synergistic ecosystem of cutting-edge technologies that includes:

  1. NVIDIA DGX systems for training AI in data centers.
  2. NVIDIA Omniverse on OVX systems for simulation and synthetic data generation.
  3. NVIDIA AGX in-vehicle computers for real-time sensor data processing and safety.

The addition of Cosmos enhances these systems, creating a seamless feedback loop that transforms human-driven data into high-quality, scalable synthetic datasets. This ensures smarter and faster development cycles, improving the performance and safety of autonomous technologies.

What Cosmos Brings to the Table

The Cosmos platform introduces a “data flywheel” that can turn thousands of miles driven by humans into billions of virtually driven miles, significantly amplifying the scale and quality of training data. According to Sanja Fidler, NVIDIAโ€™s Vice President of AI Research, the process leverages 4D reconstruction and AI to create diverse driving scenarios for training and closed-loop evaluations.

Norm Marks, NVIDIAโ€™s Vice President of Automotive, emphasized the transformative impact of Cosmos on physical AI development. Traditionally, creating such systems has been resource-intensive, requiring extensive real-world data collection and curation. Cosmos simplifies this by using generative AI to streamline dataset preparation, enabling faster and more precise development of AI models for AVs and robotics.

Real-World Applications and Adoption

NVIDIAโ€™s Cosmos platform is already gaining traction among transportation industry leaders. Notable early adopters include:

  • Waabi, which uses Cosmos for searching and curating video data to accelerate AV software development and simulation.
  • Wayve, which is leveraging Cosmos to identify rare edge and corner-case driving scenarios critical for safety and validation.
  • Foretellix, an AV toolchain provider, which is utilizing Cosmos alongside NVIDIA Omniverse Sensor RTX APIs to scale high-fidelity testing scenarios.

Additionally, ridesharing giant Uber has partnered with NVIDIA to enhance autonomous mobility. Uber’s extensive driving datasets, combined with Cosmos and NVIDIA DGX Cloud capabilities, will enable the development of robust and efficient AI models.

From Digital Twins to Physical AI

The Cosmos platform aligns perfectly with NVIDIAโ€™s vision of integrating physical AI into various industries. This includes not only autonomous transportation but also factory automation, smart city infrastructure, and even surgical environments. By harnessing WFMs capable of understanding the three-dimensional world, NVIDIA bridges the gap between digital and physical realms.

Rev Lebaredian, NVIDIAโ€™s Vice President of Omniverse and Simulation Technology, underscored the shift from traditional AI models to “physical AI.” Unlike language models, which are one-dimensional, or image-generation models, which are two-dimensional, physical AI demands systems that comprehend and interact with a 3D world. The Cosmos platform, together with NVIDIAโ€™s Omniverse, enables the creation of digital twins โ€” virtual replicas of physical systems that improve continuously through real-world sensor feedback.

The Future of Physical AI

NVIDIAโ€™s CEO, Jensen Huang, highlighted the transformative potential of Cosmos and physical AI in his keynote at CES. He described the evolution from traditional AI to agentic AI and humanoid robots, which can interpret and act within the physical world. With investments in this next wave of innovation, NVIDIA aims to enable the proliferation of billions of physical and virtual robots, unlocking unprecedented possibilities in industries ranging from logistics to healthcare.

โ€œThe world is about to change dramatically,โ€ Huang said. โ€œSoon weโ€™ll have billions of physical and virtual robots powered by AI.โ€

Availability and Accessibility

Cosmos WFMs are currently available under an open model license through Hugging Face and the NVIDIA NGC catalog, with plans to release optimized microservices as NVIDIA NIM. These models are set to empower developers across the globe, democratizing access to state-of-the-art tools for autonomous mobility and beyond.

Conclusion

NVIDIAโ€™s Cosmos platform marks a pivotal moment in the journey toward fully autonomous systems and advanced physical AI. By combining the power of generative AI with its robust three-computer solution, NVIDIA is accelerating the development of safer, smarter, and more efficient technologies. As adoption grows, Cosmos is poised to become the backbone of innovation in autonomous vehicles, robotics, and industrial automation, ushering in a new era of AI-driven transformation.


Recent Content

NVIDIA and AMD will launch AI chips in China by July 2025, including the B20 and Radeon AI PRO R9700, tailored to comply with U.S. export rules. With performance capped under regulatory thresholds, these GPUs aim to support Chinaโ€™s enterprise AI needs without violating tech trade restrictions. NVIDIA is also rolling out a lower-cost chip based on Blackwell architecture, signaling a shift toward compliant yet capable AI compute options in restricted markets.
Generative AI has been disrupting every industry since its launch, and software development is no different. This technology has the ability to do things much faster and more accurately than humans, which is the driving force behind its rapid adoption by businesses around the globe. This article explores the seven ways of how generative AI is beneficial in Software development.
Web3 is redefining the telecom industry by introducing decentralized infrastructure, blockchain-based billing, smart contracts, NFTs, and digital identity. This article explores how telcos can evolve from connectivity providers to key players in Web3 ecosystemsโ€”offering programmable services, token economies, and secure, user-centric digital experiences.
AI is helping small businesses compete with the big guys in e-commerce, making it easier to offer personalized shopping, provide instant customer support, and streamline operations. From smart chatbots to inventory management and fraud detection, small businesses now have access to powerful tools that boost growth without breaking the bank. In this article, we explore how AI is leveling the playing field and share practical tips for small businesses to stay competitive in todayโ€™s digital world.
As the telecom industry celebrates World Telecom Day 2025, the theme is clear: connectivity is not just infrastructureโ€”it is empowerment. It is what enables a student in a rural village to access world-class education, a farmer to monitor crops via smart sensors, or a doctor to conduct remote surgery with millisecond precision.
AT&T will acquire Lumenโ€™s consumer fiber business in a $5.75B deal to expand its broadband coverage to 60 million U.S. locations by 2030. The transaction gives AT&T access to 4M enabled locations, 1M subscribers, and new metro markets like Seattle and Phoenix. Meanwhile, Lumen refocuses on enterprise innovation and AI-first networking.
Whitepaper
Telecom networks are facing unprecedented complexity with 5G, IoT, and cloud services. Traditional service assurance methods are becoming obsolete, making AI-driven, real-time analytics essential for competitive advantage. This independent industry whitepaper explores how DPUs, GPUs, and Generative AI (GenAI) are enabling predictive automation, reducing operational costs, and improving service quality....
Whitepaper
Explore the collaboration between Purdue Research Foundation, Purdue University, Ericsson, and Saab at the Aviation Innovation Hub. Discover how private 5G networks, real-time analytics, and sustainable innovations are shaping the "Airport of the Future" for a smarter, safer, and greener aviation industry....
Article & Insights
This article explores the deployment of 5G NR Transparent Non-Terrestrial Networks (NTNs), detailing the architecture's advantages and challenges. It highlights how this "bent-pipe" NTN approach integrates ground-based gNodeB components with NGSO satellite constellations to expand global connectivity. Key challenges like moving beam management, interference mitigation, and latency are discussed, underscoring...

Download Magazine

With Subscription

Subscribe To Our Newsletter

Scroll to Top