Insider Brief
- Nvidia and Hugging Face are adding Nvidia robotics models and tools to LeRobot, Hugging Face’s open-source library for physical AI developers.
- Nvidia said the collaboration brings Isaac GR00T 1.7 and Isaac Teleop into LeRobot, with Cosmos 3 planned for a future integration.
- The integrations are intended to give developers a common way to collect robot data, train and fine-tune models, evaluate performance and deploy models through open workflows.
Nvidia and Hugging Face are adding Nvidia robotics models and tools to LeRobot, Hugging Face’s open-source library for physical AI developers.
According to Nvidia, the collaboration brings Isaac GR00T 1.7 and Isaac Teleop into LeRobot, with Cosmos 3 planned for a future integration. The additions are intended to give developers a more common way to collect data, train and fine-tune robot models, evaluate performance and deploy models through open workflows.
LeRobot is an open-source library for training, running and sharing robot datasets, models, policies and workflows. Nvidia said its partnership with Hugging Face connects its 3 million robotics developers with Hugging Face’s 16 million AI builders.
The LeRobot integrations include:
- Isaac Teleop, an open-source framework for collecting robot training data from human demonstrations using standardized formats.
- Isaac GR00T 1.7, an open vision-language-action model for humanoid robots that developers can post-train and deploy through LeRobot workflows.
- World foundation model Cosmos 3 is planned for LeRobot and would support data generation, simulation and policy development when real-world data is limited or expensive to collect.
“Open source is how a field turns advanced research into something people can study, adapt and build on,” Hugging Face cofounder and chief science officer Thomas Wolf said in the announcement. “With NVIDIA Isaac GR00T 1.7 and Isaac TeleOp in LeRobot today, robotics developers can use shared models, data and workflows to train and evaluate robots in the open. And with NVIDIA Cosmos 3 planned next, the community will have a path to bring frontier world models into that same collaborative loop.”
Nvidia noted that the integrations build on other resources already connected to LeRobot, including:
- An open-source physical AI dataset with more than 350,000 real and simulated trajectories and 57 million grasps.
- Isaac Sim and Isaac Lab simulation frameworks for setting up environments, generating robot data, testing policies and validating behaviors before using physical robots.
- Isaac Lab-Arena in the LeRobot Environment Hub, which lets developers prototype simulation environments and use them in the LeRobot ecosystem.
- Jetson Thor integration with LeRobot’s Reachy 2 to support deployment of vision-language-action models on open-source humanoid robots.
Image credit: Nvidia
