Nvidia adds generative AI to power humanoid robots

Nvidia announces hardware and software platform for building humanoid robots with AI features including software genAI

 Nvidia on Monday announced a hardware and software platform for building human-like robots that includes generative artificial intelligence features.

The new platform will consist of a computer system that will power the robot and AI, plus a package of software including genAI and other tools in order to build robots that are human-life, the company said at its annual developer conference.

The addition of genAI will let the humanoid robots take actions based on inputs with a combination of language, video, "human demonstrations," and past experiences. Called Project GR00T, the genAI components will add to the company's existing hardware and software platform for robotics.

"These smarter, faster, better robots will be deployed in the world's heavy industries," said Rev Lebaredian, Vice President, Omniverse and Simulation Technology, in a briefing with reporters. "We are working with the world's entire robot and simulation ecosystem to accelerate development and adoption."

The powerful computer behind the genAI software is called the "Jetson Thor" and is based around one of the company's AI chips and other hardware. Th computer will give a robot enough computing horsepower to perform complex tasks and interact with people and machines, the company said.

The suite of software tools is called the "Isaac" platform, and the new GR00T genAI features are designed to operate for "any robot embodiment in any environment," it said. The tools include the ability to train the software to make better decisions over time, a process known as reinforcement learning.

Nvidia also said it would release pre-trained robotics models and other software that will improve robotic arm functions and multi-camera sensing capabilities.