Choreographed integration of human employees, robotic and agentic methods, and gear in a facility digital twin. | Supply: Accenture, KION Group.
NVIDIA Corp.’s CEO Jensen Huang made a slew of bulletins yesterday at CES 2025 in Las Vegas. They included the Mega Omniverse blueprint for constructing industrial robotic fleet digital twins, including generative bodily AI to Omniverse, launching the Cosmos World Basis Mannequin platform, and releasing updates to its Isaac platform.
These bulletins confirmed how NVIDIA is doubling down on investing in synthetic intelligence applied sciences, notably generative AI, for robotics. Along with its new merchandise, the Santa Clara, Calif.-based firm introduced that Toyota, Aurora, and Continental are growing their shopper and business car fleets with NVIDIA computing and AI.
NVIDIA additionally stated its DRIVE Hyperion Platform has achieved essential automotive security and cybersecurity milestones. It stated the platform has handed industry-safety assessments by TÜV SÜD and TÜV Rheinland — two {industry} authorities for automotive-grade security and cybersecurity.
The corporate’s “end-to-end” system consists of the DRIVE AGX system-on-a-chip (SoC) and reference board design, the NVIDIA DriveOS automotive working system, a sensor suite, and an lively security and SAE Degree 2+ driving stack.
NVIDIA updates Omniverse
NVIDIA introduced Mega, an Omniverse blueprint for growing, testing, and optimizing bodily AI and robotic fleets at scale in digital twins earlier than deployment into real-world services.
Mega provides enterprises a reference structure of its accelerated computing, AI, NVIDIA Isaac, and NVIDIA Omniverse applied sciences, the corporate stated. This enables them to develop and take a look at digital twins for testing AI-powered “brains” that drive robots, video analytics, AI brokers, gear, and extra.
NVIDIA added that the brand new Omniverse framework can deal with monumental complexity and scale. It might probably deliver software-defined capabilities to bodily services, enabling steady growth, testing, optimization, and deployment, claimed the corporate.
With Mega-driven digital twins, together with a world simulator that coordinates all robotic actions and sensor information, enterprises can repeatedly replace robots for clever routes and duties for operational efficiencies, NVIDIA stated.
The blueprint makes use of Omniverse Cloud Sensor RTX software programming interfaces (APIs), which allow builders to render information from any sort of clever machine within the manufacturing unit, concurrently, for high-fidelity large-scale sensor simulation. This enables robots to be examined in an infinite variety of eventualities throughout the digital twin, utilizing artificial information in a software-in–the-loop pipeline with NVIDIA Isaac ROS.
NVIDIA additionally introduced generative AI fashions and blueprints to broaden NVIDIA Omniverse integration additional into bodily AI functions reminiscent of robotics, autonomous automobiles (AVs), and imaginative and prescient AI. The corporate stated these fashions speed up every step of making 3D worlds for bodily AI simulation, together with world-building, labeling the world with bodily attributes, and making it photoreal.
“Bodily AI will revolutionize the $50 trillion manufacturing and logistics industries. Every little thing that strikes — from vehicles and vehicles to factories and warehouses — might be robotic and embodied by AI,” said Huang. “NVIDIA’s Omniverse digital twin working system and Cosmos bodily AI function the foundational libraries for digitalizing the world’s bodily industries.”
Cosmos world basis mannequin goals to speed up bodily AI growth
Corporations together with 1X, Agile Robots, Agility, Determine AI, Foretellix, Fourier, Galbot, Hillbot, IntBot, Neura Robotics, Skild AI, Uber, Digital Incision, Waabi, and XPENG are among the many first to undertake Cosmos. | Supply: NVIDIA
Along with its Omniverse updates, NVIDIA additionally launched Cosmos, a platform composed of generative world basis fashions, superior tokenizers, guardrails, and an accelerated video processing pipeline constructed to advance the event of bodily AI methods reminiscent of AVs and robots.
The corporate asserted that bodily AI fashions are expensive to develop and require huge quantities of real-world information and testing. Cosmos world basis fashions, or WFMs, provide builders a simple strategy to generate large quantities of photoreal, physics-based artificial information to coach and consider their present fashions. Builders may construct customized fashions by fine-tuning Cosmos WFMs.
NVIDIA famous that Cosmos’ suite of open fashions allows builders to customise the WFMs with datasets, reminiscent of video recordings of AV journeys or robots navigating a warehouse, based on the wants of their goal functions.
The corporate stated it designed its WFMs for bodily AI analysis and growth. The WFMs can generate physics-based movies from a mix of inputs, like textual content, picture, and video, in addition to robotic sensor or movement information.
“The ChatGPT second for robotics is coming. Like massive language fashions, world basis fashions are elementary to advancing robotic and AV growth, but not all builders have the experience and sources to coach their very own,” Huang stated. “We created Cosmos to democratize bodily AI and put basic robotics in attain of each developer.”
NVIDIA stated Cosmos fashions might be out there below an open mannequin license to speed up the work of the robotics, AI, and AV neighborhood. Builders can preview the primary fashions on the NVIDIA API catalog, or obtain the household of fashions and fine-tuning framework from the NVIDIA NGC catalog or Hugging Face.
NVIDIA additionally revises Isaac
NVIDIA Isaac is a platform of accelerated libraries, software frameworks, and AI fashions that it stated can speed up the event of AI robots. It’s made up of 4 completely different functions: Isaac Sim, Isaac Lab, Isaac Manipulator, and Isaac Perceptor.
NVIDIA Isaac Sim is a reference software constructed on NVIDIA Omniverse that allows customers to develop, simulate, and take a look at AI-driven robots in bodily primarily based digital environments. Isaac Sim 4.5 will provide quite a lot of important adjustments, together with the next:
- A reference software template
- Improved Unified Robotic Description Format (URDF) import and setup
- Improved physics simulation and modeling
- New joint visualization instrument
- Simulation accuracy and statistics
- NVIDIA Cosmos world basis mannequin
NVIDIA Isaac Lab is an open-source unified framework for robotic studying to coach robotic insurance policies. Isaac Lab is constructed on high of NVIDIA Isaac Sim, serving to builders and researchers extra effectively construct clever, adaptable robots with sturdy, perception-enabled, simulation-trained insurance policies. The up to date model of Isaac Lab consists of efficiency and usefulness enhancements like tiled rendering and different quality-of-life enhancements.
NVIDIA Isaac Manipulator, constructed on ROS 2, is a set of NVIDIA CUDA-accelerated libraries, AI fashions, and reference workflows. It now consists of new end-to-end reference workflows for pick-and-place and object following, enabling customers to shortly get began on elementary industrial robotic arm duties, together with object-following and pick-and-place.
Lastly, NVIDIA Isaac Perceptor, additionally constructed on ROS 2, is a set of libraries, fashions, and reference workflows for the event of autonomous cellular robots (AMRs). It allows AMRs to understand, localize, and function in unstructured environments reminiscent of warehouses or factories.
NVIDIA stated its newest updates deliver important enhancements to AMR environmental consciousness and operational effectivity in dynamic settings. They embrace a brand new end-to-end visible simultaneous localization and mapping (SLAM) reference workflow, new examples of working nvblox with a number of cameras for 3D scene reconstruction with folks detection and dynamic scene components, and improved D scene reconstruction by working Isaac Perceptor on a number of RGB-D cameras.
Register right this moment to avoid wasting 40% on convention passes!
