Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Just released five robotics simulation environments we have been using to train reinforcement learning from vision and touch! Very easy to install. Powered by Google DeepMind MuJoCo, Gymnasium, and robosuite. GitHub link:

carlo_sferrazza's profile picture

Carlo Sferrazza

2,517 subscribers

24,389 Aufrufe • vor 2 Jahren •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

From simulation to reality 🤖 Robotics creator Skyentific built a walking bipedal robot using a simulation-first approach to design, test, and iterating in virtual environments before deploying in the real world. Powered by the NVIDIA Isaac platform and NVIDIA Jetson for on-device AI and control. 📖 #NationalRoboticsWeek
0:12

From simulation to reality 🤖 Robotics creator Skyentific built a walking bipedal robot using a simulation-first approach to design, test, and iterating in virtual environments before deploying in the real world. Powered by the NVIDIA Isaac platform and NVIDIA Jetson for on-device AI and control. 📖 #NationalRoboticsWeek

NVIDIA Robotics

21,846 Aufrufe • vor 5 Monaten

The laws of physics apply everywhere. ⚛️ Co-developed by NVIDIA, Google DeepMind and Disney Research, Walt Disney Imagineering, the new Newton Beta, managed by the The Linux Foundation, now also runs with Isaac Lab and with MuJoCo Warp, which delivers warp speed for robot learning. Learn how to train a quadruped and simulate multiphysics in our tech blog. 🔗 #CoRL2025
0:11

The laws of physics apply everywhere. ⚛️ Co-developed by NVIDIA, Google DeepMind and Disney Research, Walt Disney Imagineering, the new Newton Beta, managed by the The Linux Foundation, now also runs with Isaac Lab and with MuJoCo Warp, which delivers warp speed for robot learning. Learn how to train a quadruped and simulate multiphysics in our tech blog. 🔗 #CoRL2025

NVIDIA Robotics

83,151 Aufrufe • vor 11 Monaten

What you’re seeing isn’t science fiction, it’s the future of robotics being trained in real time MasterBOT’s simulation engine accelerates AI learning without hardware, powered by community and data Welcome to the new era of Robotics x web3 $BOT
0:19

What you’re seeing isn’t science fiction, it’s the future of robotics being trained in real time MasterBOT’s simulation engine accelerates AI learning without hardware, powered by community and data Welcome to the new era of Robotics x web3 $BOT

MasterBOT

23,183 Aufrufe • vor 11 Monaten

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch
0:11

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch

NVIDIA Robotics

18,568 Aufrufe • vor 7 Monaten

Robora Sim: A PyBullet-Powered Environment for Learning Robotic Physical Intelligence We are currently building our Robora simulation environment setup for our sim based learning, leveraging PyBullet, an industry-standard physics engine widely used in AI-driven robotics research and development. The environment is optimized with GPU-accelerated learning algorithms, enabling high-speed imitation learning and reinforcement learning within a safe and controlled virtual setup before shipping out to real world. This simulation platform allows our models to learn, adapt, and generalize across different robot morphologies, terrain types and task objectives - all before deployment to the real world. At it's core, the system combines a VLA-powered high-level planner with low-level motion control algorithms, working cohesively to produce emergent, physically intelligent behaviors. This synergy between simulation, learning, and real-world transfer marks a major step forward in our pursuit of adaptive and intelligent robotic systems. Through advanced domain randomization and synthetic data generation, the Robora Simulation Environment ensures that policies trained in simulation transfer effectively to real-world robots, minimizing the sim-to-real gap. Moreover, users will be able to test and integrate their own hardware kits within selected simulation environments in the Robora Dapp, ensuring seamless compatibility and safer real-world implementation.
0:14

Robora Sim: A PyBullet-Powered Environment for Learning Robotic Physical Intelligence We are currently building our Robora simulation environment setup for our sim based learning, leveraging PyBullet, an industry-standard physics engine widely used in AI-driven robotics research and development. The environment is optimized with GPU-accelerated learning algorithms, enabling high-speed imitation learning and reinforcement learning within a safe and controlled virtual setup before shipping out to real world. This simulation platform allows our models to learn, adapt, and generalize across different robot morphologies, terrain types and task objectives - all before deployment to the real world. At it's core, the system combines a VLA-powered high-level planner with low-level motion control algorithms, working cohesively to produce emergent, physically intelligent behaviors. This synergy between simulation, learning, and real-world transfer marks a major step forward in our pursuit of adaptive and intelligent robotic systems. Through advanced domain randomization and synthetic data generation, the Robora Simulation Environment ensures that policies trained in simulation transfer effectively to real-world robots, minimizing the sim-to-real gap. Moreover, users will be able to test and integrate their own hardware kits within selected simulation environments in the Robora Dapp, ensuring seamless compatibility and safer real-world implementation.

Robora

23,522 Aufrufe • vor 11 Monaten

RL X-mas came early. 🎄 For too long, building powerful AI agents with Reinforcement Learning has been blocked by GPU scarcity and complex infrastructure. That ends today. Introducing Serverless RL from wandb, powered by CoreWeave! We're making RL accessible to all.
0:15

RL X-mas came early. 🎄 For too long, building powerful AI agents with Reinforcement Learning has been blocked by GPU scarcity and complex infrastructure. That ends today. Introducing Serverless RL from wandb, powered by CoreWeave! We're making RL accessible to all.

Weights & Biases

112,753 Aufrufe • vor 11 Monaten

Holy moly, another big one by Google DeepMind! "Our SIMA 2 research offers a strong path towards applications in robotics and another step towards AGI in the real world" Google DeepMind just unveiled SIMA 2 - an AI agent that doesn’t just follow instructions but thinks and reasons with you. The first version, SIMA 1, learned to perform over 600 basic actions in 3D environments. SIMA 2 takes a leap forward: it understands goals, holds conversations, and learns from experience. This marks a shift from “Do this” to “Let’s figure out how to achieve this together.” A thread with examples and how it works🧵:
0:10

Holy moly, another big one by Google DeepMind! "Our SIMA 2 research offers a strong path towards applications in robotics and another step towards AGI in the real world" Google DeepMind just unveiled SIMA 2 - an AI agent that doesn’t just follow instructions but thinks and reasons with you. The first version, SIMA 1, learned to perform over 600 basic actions in 3D environments. SIMA 2 takes a leap forward: it understands goals, holds conversations, and learns from experience. This marks a shift from “Do this” to “Let’s figure out how to achieve this together.” A thread with examples and how it works🧵:

Chubby♨️

43,309 Aufrufe • vor 10 Monaten

Qualia has been selected for the Google DeepMind Robotics Program. We train embodied models that put a robot on a real manual task and make it work, on the floor, not in a demo. Foundation models and reasoning are where robotics is heading, and doing that work alongside DeepMind, who are pushing this frontier, is exactly where we want to be. If you are a company looking to see how a new generation of robots can help your manual tasks, contact us at hello@qualiastudios.dev More soon
0:16

Qualia has been selected for the Google DeepMind Robotics Program. We train embodied models that put a robot on a real manual task and make it work, on the floor, not in a demo. Foundation models and reasoning are where robotics is heading, and doing that work alongside DeepMind, who are pushing this frontier, is exactly where we want to be. If you are a company looking to see how a new generation of robots can help your manual tasks, contact us at [email protected] More soon

Qualia

87,991 Aufrufe • vor 3 Monaten

Yeah! Teleoperation on low-cost robot arm from Tau Robotics working natively at 200Hz with and a very simple code. We are working a video tutorial to make it easy for anyone to reproduce our setup (in simulation or with a real robot). Stay tuned 😋
0:17

Yeah! Teleoperation on low-cost robot arm from Tau Robotics working natively at 200Hz with and a very simple code. We are working a video tutorial to make it easy for anyone to reproduce our setup (in simulation or with a real robot). Stay tuned 😋

Remi Cadene

31,497 Aufrufe • vor 2 Jahren

Haven't been to a conference in a while, really excited to be at #NeurIPS2024! I'll be helping present 4 of our group's recent papers: 1. Overcoming the Sim-to-Real Gap: Leveraging Simulation to Learn to Explore for Real-World RL 2. Distributional Successor Features Enable Zero-Shot Policy Optimization 3. Learning to Cooperate with Humans using Generative Agents 4. Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learning Find more details on each paper and where to find us in this thread (1/6)
0:25

Haven't been to a conference in a while, really excited to be at #NeurIPS2024! I'll be helping present 4 of our group's recent papers: 1. Overcoming the Sim-to-Real Gap: Leveraging Simulation to Learn to Explore for Real-World RL 2. Distributional Successor Features Enable Zero-Shot Policy Optimization 3. Learning to Cooperate with Humans using Generative Agents 4. Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learning Find more details on each paper and where to find us in this thread (1/6)

Abhishek Gupta

10,803 Aufrufe • vor 1 Jahr

Announcing our commercial partnership with Booster Robotics Booster builds humanoid robot hardware, OS, and developer tools to make humanoid robots more affordable, reliable, and practical. The partnership centers on using simulation to multiply the value of real-robot data—expanding teleoperation demonstrations into scalable training data across diverse tasks and scenes. This joint effort powers sim-real co-training and foundation-model development, accelerating progress from hardware iteration to deployable robot policies. Together, we're building simulation‑powered data infrastructure for Physical AI — making scalable training data accessible to model developers and the broader robotics ecosystem.
0:12

Announcing our commercial partnership with Booster Robotics Booster builds humanoid robot hardware, OS, and developer tools to make humanoid robots more affordable, reliable, and practical. The partnership centers on using simulation to multiply the value of real-robot data—expanding teleoperation demonstrations into scalable training data across diverse tasks and scenes. This joint effort powers sim-real co-training and foundation-model development, accelerating progress from hardware iteration to deployable robot policies. Together, we're building simulation‑powered data infrastructure for Physical AI — making scalable training data accessible to model developers and the broader robotics ecosystem.

Axis Robotics

70,387 Aufrufe • vor 1 Monat

teleoperator kicking himself over not programming Asimov's Laws of Robotics... Worth considering if we should base today's reality on the science fiction musings from the past. Testing with humanoid robots is a very interesting new challenge. Historically robots have been confined to keep out zones with rigid walls and laser barriers, lock-out/tag-out, etc. This is the easy way to ensure people don't get hurt by very capable machines. But the more we integrate humanoid robotics into collaborative roles with humans the more we need to remove those barriers by nature of the work.
0:10

teleoperator kicking himself over not programming Asimov's Laws of Robotics... Worth considering if we should base today's reality on the science fiction musings from the past. Testing with humanoid robots is a very interesting new challenge. Historically robots have been confined to keep out zones with rigid walls and laser barriers, lock-out/tag-out, etc. This is the easy way to ensure people don't get hurt by very capable machines. But the more we integrate humanoid robotics into collaborative roles with humans the more we need to remove those barriers by nature of the work.

Wes

677,762 Aufrufe • vor 8 Monaten

What if we could teach an AI to master the strategic game of 2048 through pure reinforcement learning? I did exactly that with "Agent 2048" - fine-tuning Qwen 7B model using GRPO to develop spatial reasoning and merge strategies with zero prior gameplay SFTdata! Thanks to Hugging Face and Unsloth AI for their easy to use implementation kalomaze and will brown you might like this :)
0:20

What if we could teach an AI to master the strategic game of 2048 through pure reinforcement learning? I did exactly that with "Agent 2048" - fine-tuning Qwen 7B model using GRPO to develop spatial reasoning and merge strategies with zero prior gameplay SFTdata! Thanks to Hugging Face and Unsloth AI for their easy to use implementation kalomaze and will brown you might like this :)

Hrishbh Dalal

31,863 Aufrufe • vor 1 Jahr

Building robots that can effectively operate alongside human workers is difficult. 🛠️ Advances in open-source physics, open foundation models, and frameworks are helping accelerate physical #AI deployment. ✔️ Newton Physics Engine, an open-source GPU-powered simulation built on OpenUSD, speeds up robot learning for advanced manipulation and mobility. ✔️ NVIDIA Cosmos Reason, an open reasoning vision language model, gives robots the ability to think like humans using prior knowledge, common sense and physics ✔️NVIDIA Isaac GR00T N1.6, an open robot foundation model, enables humanoids to understand ambiguous instructions Leading robotics developers including Agility Robotics, Lightwheel, Mentee Robotics, UniversalRobots, and Wandelbots are adopting simulation technologies and libraries to accelerate physical AI development and deployment. Omniverse Ambassador Dylan Tobin built an AI chatbot trained on Isaac Sim workflows, helping devs navigate Omniverse faster. Read the full blog 👉
0:13

Building robots that can effectively operate alongside human workers is difficult. 🛠️ Advances in open-source physics, open foundation models, and frameworks are helping accelerate physical #AI deployment. ✔️ Newton Physics Engine, an open-source GPU-powered simulation built on OpenUSD, speeds up robot learning for advanced manipulation and mobility. ✔️ NVIDIA Cosmos Reason, an open reasoning vision language model, gives robots the ability to think like humans using prior knowledge, common sense and physics ✔️NVIDIA Isaac GR00T N1.6, an open robot foundation model, enables humanoids to understand ambiguous instructions Leading robotics developers including Agility Robotics, Lightwheel, Mentee Robotics, UniversalRobots, and Wandelbots are adopting simulation technologies and libraries to accelerate physical AI development and deployment. Omniverse Ambassador Dylan Tobin built an AI chatbot trained on Isaac Sim workflows, helping devs navigate Omniverse faster. Read the full blog 👉

NVIDIA

48,500 Aufrufe • vor 11 Monaten

Did you know #IndustrialAI and #Robotics Days are coming to #GTCParis at #VivaTech? 🗼✨ Check out some of our top sessions: ◦ Powered by AI: The Operating System for Future Factories Siemens ◦ AI-Powered Railways: Digitalizing Train Manufacturing to Smart Operations Hitachi Rail (ENG) ◦ AI Safety: From Autonomous Vehicles to Broader #PhysicalAI Wayve 🔗
0:16

Did you know #IndustrialAI and #Robotics Days are coming to #GTCParis at #VivaTech? 🗼✨ Check out some of our top sessions: ◦ Powered by AI: The Operating System for Future Factories Siemens ◦ AI-Powered Railways: Digitalizing Train Manufacturing to Smart Operations Hitachi Rail (ENG) ◦ AI Safety: From Autonomous Vehicles to Broader #PhysicalAI Wayve 🔗

NVIDIA Omniverse

28,302 Aufrufe • vor 1 Jahr

🚨 We have won the toss and choose to bat! Here’s the playing XI! Powered by: Hakeem easy finance! Good luck boys, let’s win it 🙌 #PINDIZvPAK #HBLPSL11
0:12

🚨 We have won the toss and choose to bat! Here’s the playing XI! Powered by: Hakeem easy finance! Good luck boys, let’s win it 🙌 #PINDIZvPAK #HBLPSL11

RawalPINDIZ

55,255 Aufrufe • vor 5 Monaten

It’s never been easier for 3D animators to bring their creative vision to life. This is motion capture powered by AI. No suits or markers needed. You can now capture multiple people anywhere using standard cameras, and Move AI will generate 3D motion data from the 2D video.
0:11

It’s never been easier for 3D animators to bring their creative vision to life. This is motion capture powered by AI. No suits or markers needed. You can now capture multiple people anywhere using standard cameras, and Move AI will generate 3D motion data from the 2D video.

Move AI

116,379 Aufrufe • vor 2 Jahren

Something big is happening in robotics - and it’s hiding in plain sight. This post is not about dancing robots but in the data that powers them. Open robotics datasets have exploded this year, turning the field into a more scalable and collaborative ecosystem. In just two years, Hugging Face datasets grew from 11k to over 600k - and robotics is by far the fastest-growing segment. We went from 1k robotics datasets in 2024 to 27k in 2025! For comparison, text generation, the second-largest category, has only around 5k datasets in 2025. That gap is massive. Open datasets are important because robotics lives and dies by real-world robot data - video, actions, sensors, failures. By making this data easy to upload, reuse, and benchmark, researchers, startups, and large players are now releasing real-robot datasets that would have stayed locked inside labs just a few years ago. Major contributors include NVIDIA, LeRobot initiative, and a rapidly growing maker community. This surge is also enabled by cheaper video storage, better tooling, and an open-source AI culture now spilling into the physical world. And it really matters: open robotics data dramatically lowers entry barriers, accelerates learning-by-doing, and speeds up progress toward generalist and humanoid robots. Robotics won’t scale through hardware alone - but to a large extent through shared data. Viz below from AI World - link to the story and more viz/filters in comment.
0:11

Something big is happening in robotics - and it’s hiding in plain sight. This post is not about dancing robots but in the data that powers them. Open robotics datasets have exploded this year, turning the field into a more scalable and collaborative ecosystem. In just two years, Hugging Face datasets grew from 11k to over 600k - and robotics is by far the fastest-growing segment. We went from 1k robotics datasets in 2024 to 27k in 2025! For comparison, text generation, the second-largest category, has only around 5k datasets in 2025. That gap is massive. Open datasets are important because robotics lives and dies by real-world robot data - video, actions, sensors, failures. By making this data easy to upload, reuse, and benchmark, researchers, startups, and large players are now releasing real-robot datasets that would have stayed locked inside labs just a few years ago. Major contributors include NVIDIA, LeRobot initiative, and a rapidly growing maker community. This surge is also enabled by cheaper video storage, better tooling, and an open-source AI culture now spilling into the physical world. And it really matters: open robotics data dramatically lowers entry barriers, accelerates learning-by-doing, and speeds up progress toward generalist and humanoid robots. Robotics won’t scale through hardware alone - but to a large extent through shared data. Viz below from AI World - link to the story and more viz/filters in comment.

Pierre-Alexandre Balland

186,094 Aufrufe • vor 8 Monaten