Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

🤖🤖🤖 Following RoboVerse, we introduce another work focused on Robotic Tactile Simulation - Taccel Simulator. Taccel is a high-performance simulation platform for vision-based tactile sensors and robots. 🚀🚀🚀 Boosted by Nvidia Warp, we optimize Taccel with highly parallelized simulations and support 900fps simulation with 4k+ parallel training envs. 🤝🤝🤝...

siyuanhuang95's profile picture

Siyuan Huang

5,037 subscribers

10,660 Aufrufe • vor 1 Jahr •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

4 Kommentare

Profilbild von Siyuan Huang
Siyuan Huangvor 1 Jahr

Taccel is a joint work with PKU CoRE lab (PI, Prof. Yixin Zhu) and UCLA AIVC Lab (PI, Prof. Chenfanfu Jiang), shout out to the wonderful collaborators and project leader @aidenli_thu

Profilbild von Junshan Huang
Junshan Huangvor 1 Jahr

Awesome work! Just starred the repo — looking forward to trying it out later.

Profilbild von LECCA Intern (Ø,G) 🍜
LECCA Intern (Ø,G) 🍜vor 1 Jahr

900fps + 4K parallel envs? That’s some next-level sim performance.

Profilbild von Siyuan Huang
Siyuan Huangvor 1 Jahr

Thank you for the interest! In this case, the total simulation speed is 900fps and ~0.22fps for each env. We are still optimizing it!

Ähnliche Videos

In my past research experience, finding or developing an appropriate simulation environment, dataset, and benchmark has always been a challenge. Missing features, limited support, or unexpected bugs often occupied my days and nights. Moreover, current simulation platforms are relatively fragmented—making it challenging to replicate the success of the RT-X dataset in unifying community efforts. Introducing RoboVerse, we provide a unified platform, dataset, and benchmark for scalable and generalizable robot learning. We hope to build a shared foundation to combine the community efforts. RoboVerse includes: MetaSim: We carefully designed a configuration system and a universal interface to align current robotic simulators. With MetaSim, you can use any simulator with the same code—bringing together the community’s diverse efforts under one framework! RoboVerse Dataset and Benchmark: We unify popular simulation environments and benchmarks into a single cohesive system and introduce the RoboVerse dataset—a large-scale, high-quality synthetic dataset. Additionally, we propose a standardized benchmark across both imitation learning and reinforcement learning. A cool feature enabled by our unified framework: Hybrid Simulation! You can now integrate physics engines and renderers from different simulators—e.g., using MuJoCo precise physics with Isaac photorealistic rendering. This not only elevates simulation fidelity but also significantly enhances real-world transfer performance across complex robotic applications. Hopefully, our team’s efforts could serve the robotic community to thrive vibrantly in the years to come. RoboVerse is open-sourced🥳!!! Project Page: Documentation: Github Repo: Paper:
2:21

In my past research experience, finding or developing an appropriate simulation environment, dataset, and benchmark has always been a challenge. Missing features, limited support, or unexpected bugs often occupied my days and nights. Moreover, current simulation platforms are relatively fragmented—making it challenging to replicate the success of the RT-X dataset in unifying community efforts. Introducing RoboVerse, we provide a unified platform, dataset, and benchmark for scalable and generalizable robot learning. We hope to build a shared foundation to combine the community efforts. RoboVerse includes: MetaSim: We carefully designed a configuration system and a universal interface to align current robotic simulators. With MetaSim, you can use any simulator with the same code—bringing together the community’s diverse efforts under one framework! RoboVerse Dataset and Benchmark: We unify popular simulation environments and benchmarks into a single cohesive system and introduce the RoboVerse dataset—a large-scale, high-quality synthetic dataset. Additionally, we propose a standardized benchmark across both imitation learning and reinforcement learning. A cool feature enabled by our unified framework: Hybrid Simulation! You can now integrate physics engines and renderers from different simulators—e.g., using MuJoCo precise physics with Isaac photorealistic rendering. This not only elevates simulation fidelity but also significantly enhances real-world transfer performance across complex robotic applications. Hopefully, our team’s efforts could serve the robotic community to thrive vibrantly in the years to come. RoboVerse is open-sourced🥳!!! Project Page: Documentation: Github Repo: Paper:

Haoran Geng

84,215 Aufrufe • vor 1 Jahr

🚀 First step to unlocking Generalist Robots! Introducing 🤖LAPA🤖, a new SOTA open-sourced 7B VLA pretrained without using action labels. 💪SOTA VLA trained with Open X (outperforming OpenVLA on cross and multi embodiment) 😯LAPA enables learning from human videos, unlocking potential for robotic foundation model ❗Over 30x pretraining efficiency for VLA training 🤗Code and checkpoints are all open-sourced!
0:51

🚀 First step to unlocking Generalist Robots! Introducing 🤖LAPA🤖, a new SOTA open-sourced 7B VLA pretrained without using action labels. 💪SOTA VLA trained with Open X (outperforming OpenVLA on cross and multi embodiment) 😯LAPA enables learning from human videos, unlocking potential for robotic foundation model ❗Over 30x pretraining efficiency for VLA training 🤗Code and checkpoints are all open-sourced!

Seonghyeon Ye

33,239 Aufrufe • vor 1 Jahr

🚀 Can we make a humanoid move like Cristiano Ronaldo, LeBron James and Kobe Byrant? YES! 🤖 Introducing ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skills Website: Code:
0:55

🚀 Can we make a humanoid move like Cristiano Ronaldo, LeBron James and Kobe Byrant? YES! 🤖 Introducing ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skills Website: Code:

Tairan He

258,472 Aufrufe • vor 1 Jahr

We visited Paxini in Shenzhen, a company focused on the sense of touch for robots. We got hands-on with their dual-modal Dexter Hands (cameras + tactile sensors) and their Tora Double One humanoid. Humanoid robots will need this touch layer to get truly dexterous. Lena RoboHub🤖
6:50

We visited Paxini in Shenzhen, a company focused on the sense of touch for robots. We got hands-on with their dual-modal Dexter Hands (cameras + tactile sensors) and their Tora Double One humanoid. Humanoid robots will need this touch layer to get truly dexterous. Lena RoboHub🤖

The Humanoid Hub

22,782 Aufrufe • vor 10 Tagen

The next frontier of AI is physical. 🤖 From simulation to synthetic data, developers are training robots to understand the real world with NVIDIA Cosmos, Isaac simulation frameworks and open-source physics engine, Newton. Watch the video to see how partners like Hon Hai Technology Group (Foxconn), Hexagon, Humanoid, Noble Machines, and Skild AI are building the future. 🎥
0:51

The next frontier of AI is physical. 🤖 From simulation to synthetic data, developers are training robots to understand the real world with NVIDIA Cosmos, Isaac simulation frameworks and open-source physics engine, Newton. Watch the video to see how partners like Hon Hai Technology Group (Foxconn), Hexagon, Humanoid, Noble Machines, and Skild AI are building the future. 🎥

NVIDIA Robotics

21,664 Aufrufe • vor 3 Monaten

State of The Posemesh 2024: $AUKI TGE Premiere 🚀 See how we're changing the way we solve real-world problems together with each other and AI. 🌐🤝🤖 This is how we win. 🏆💪 #posemesh #DePIN
17:11

State of The Posemesh 2024: $AUKI TGE Premiere 🚀 See how we're changing the way we solve real-world problems together with each other and AI. 🌐🤝🤖 This is how we win. 🏆💪 #posemesh #DePIN

Auki

151,111 Aufrufe • vor 1 Jahr

Simulating and training robots requires a physics-first approach. 🤖 With Newton, the open-source physics simulation engine co-developed by Disney Research, Walt Disney Imagineering, Google DeepMind and NVIDIA, Disney’s BDX Droid can move through shifting sand and gravel with exceptional precision. Watch to see how Newton is playing a key role in teaching robots how to move, behave, and interact with different objects and materials in the real world. #CES2026
0:59

Simulating and training robots requires a physics-first approach. 🤖 With Newton, the open-source physics simulation engine co-developed by Disney Research, Walt Disney Imagineering, Google DeepMind and NVIDIA, Disney’s BDX Droid can move through shifting sand and gravel with exceptional precision. Watch to see how Newton is playing a key role in teaching robots how to move, behave, and interact with different objects and materials in the real world. #CES2026

NVIDIA Robotics

45,717 Aufrufe • vor 5 Monaten

📢📢📢 Excited to release ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual Learning (CVPR25). 🤏🤙✌️With ManipTrans, we can transfer dexterous manipulation skills into robotic hands in simulation and deploy them on a real robot, using a residual policy learned for dex manipulation. 🤖🤖🤖The video below illustrates how the MoCap data can be transferred to Inspire, Shadow, Xhand, Allegro, and Mano. With ManipTrans, we can scale up dex manip data greatly with minimal effort. For more details, please check our -webpage: -code: -huggingface:
1:59

📢📢📢 Excited to release ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual Learning (CVPR25). 🤏🤙✌️With ManipTrans, we can transfer dexterous manipulation skills into robotic hands in simulation and deploy them on a real robot, using a residual policy learned for dex manipulation. 🤖🤖🤖The video below illustrates how the MoCap data can be transferred to Inspire, Shadow, Xhand, Allegro, and Mano. With ManipTrans, we can scale up dex manip data greatly with minimal effort. For more details, please check our -webpage: -code: -huggingface:

Siyuan Huang

20,918 Aufrufe • vor 1 Jahr

Can we bring human-like Touch to robots🤖? Introducing our CoRL work on 3D-ViTac. Humans rely on both vision 👁️ and touch 🫳 for complex tasks. With combined visual-tactile sensing, robots can now tackle challenging tasks, like precise in-hand reorientation, fragile objects grasping. Website: #Robotics #CoRL2024 #Touch #tactile #AI #ML
0:22

Can we bring human-like Touch to robots🤖? Introducing our CoRL work on 3D-ViTac. Humans rely on both vision 👁️ and touch 🫳 for complex tasks. With combined visual-tactile sensing, robots can now tackle challenging tasks, like precise in-hand reorientation, fragile objects grasping. Website: #Robotics #CoRL2024 #Touch #tactile #AI #ML

Binghao Huang

49,500 Aufrufe • vor 1 Jahr

🤖Simulation-Ready Human–Scene Interaction Reconstruction🤖 #HSImul3R reconstructs sim-ready 3D human-scene interactions from casual videos with *physics-in-the-loop* that can be directly deployed to humanoids. - Project: - Code:
0:40

🤖Simulation-Ready Human–Scene Interaction Reconstruction🤖 #HSImul3R reconstructs sim-ready 3D human-scene interactions from casual videos with *physics-in-the-loop* that can be directly deployed to humanoids. - Project: - Code:

Ziwei Liu

15,544 Aufrufe • vor 3 Monaten

Control a robot in simulation with the Gemini Robotics Embodied Reasoning model 🤖 Direct tasks like object localization and placement by simply prompting a robotic arm to pick up and place objects.
0:20

Control a robot in simulation with the Gemini Robotics Embodied Reasoning model 🤖 Direct tasks like object localization and placement by simply prompting a robotic arm to pick up and place objects.

Google AI Developers

1,296,462 Aufrufe • vor 5 Monaten

We just open-sourced luwu_mjlab: an RL training environment for Luwu Dynamics quadruped robots. Built on mjlab + MuJoCo Warp, it lets us train locomotion and get-up policies in simulation, then validate them on real robots. GitHub:
0:32

We just open-sourced luwu_mjlab: an RL training environment for Luwu Dynamics quadruped robots. Built on mjlab + MuJoCo Warp, it lets us train locomotion and get-up policies in simulation, then validate them on real robots. GitHub:

XGO Robot

11,617 Aufrufe • vor 29 Tagen

Humanoid robot development is too fragmented to scale. 🤖 With NVIDIA Isaac GR00T, developers unify simulation, data, and training in one open platform, cutting setup time from days to hours. See how Isaac GR00T helps research teams move faster from robot bring-up to skill development and real-world validation. Watch now 📺
0:38

Humanoid robot development is too fragmented to scale. 🤖 With NVIDIA Isaac GR00T, developers unify simulation, data, and training in one open platform, cutting setup time from days to hours. See how Isaac GR00T helps research teams move faster from robot bring-up to skill development and real-world validation. Watch now 📺

NVIDIA Robotics

21,929 Aufrufe • vor 15 Tagen

Today at Meta FAIR we’re announcing three new cutting-edge developments in robotics and touch perception — and releasing a collection of artifacts to empower the community to build on this work. Details on all of this new work ➡️ 1️⃣ Meta Sparsh is the first general-purpose encoder for vision-based tactile sensing that works across many tactile sensors and many tasks. Trained on 460K+ tactile images using self-supervised learning. 2️⃣ Meta Digit 360 is a breakthrough artificial fingertip-based tactile sensor, equipped with 18+ sensing features to deliver detailed touch data with human-level precision and touch-sensing capabilities. 3️⃣ Meta Digit Plexus is a standardized platform for robotic sensor connections and interactions. It provides a hardware-software solution to integrate tactile sensors on a single robot hand and enables seamless data collection, control and analysis over a single cable. The potential impact of expanding capabilities and components like these for the open source community ranges from medical research to supply chain, manufacturing and much more. We’re excited to continue this work with the broader community.
2:35

Today at Meta FAIR we’re announcing three new cutting-edge developments in robotics and touch perception — and releasing a collection of artifacts to empower the community to build on this work. Details on all of this new work ➡️ 1️⃣ Meta Sparsh is the first general-purpose encoder for vision-based tactile sensing that works across many tactile sensors and many tasks. Trained on 460K+ tactile images using self-supervised learning. 2️⃣ Meta Digit 360 is a breakthrough artificial fingertip-based tactile sensor, equipped with 18+ sensing features to deliver detailed touch data with human-level precision and touch-sensing capabilities. 3️⃣ Meta Digit Plexus is a standardized platform for robotic sensor connections and interactions. It provides a hardware-software solution to integrate tactile sensors on a single robot hand and enables seamless data collection, control and analysis over a single cable. The potential impact of expanding capabilities and components like these for the open source community ranges from medical research to supply chain, manufacturing and much more. We’re excited to continue this work with the broader community.

AI at Meta

453,197 Aufrufe • vor 1 Jahr

Hey #PitchYaGame ! Cyber Aces: Hope is a story-driven, fast-paced action RPG with social simulation element. ⚔️Combat inspired by Musou and DMC 📗Choose moves to equip, no complex pattern 🤝Social simulation inspired by Persona and Kiseki Wishlist now on Steam!
1:05

Hey #PitchYaGame ! Cyber Aces: Hope is a story-driven, fast-paced action RPG with social simulation element. ⚔️Combat inspired by Musou and DMC 📗Choose moves to equip, no complex pattern 🤝Social simulation inspired by Persona and Kiseki Wishlist now on Steam!

Cyber Aces - Wishlist on Steam

17,182 Aufrufe • vor 1 Jahr

Besides reading cool papers, my Twitter account is mostly used for catching up Formula 1 news. Very excited about Lando Norris 's great performance recently. Now we combine Formula Racing to AI research: The following video shows we train a Reinforcement Learning policy to drive a Dallara F317 in Monza and Barcelona Circuits autonomously in simulation. You can think of it as optimizing a Qualifying lap: You want the car to run a single lap, no opponents, with the fastest speed, and shortest lap time. We open-source the code to train RL in a racing simulator with Assetto Corsa, a widely deployed platform for esports. We also train with human demonstrations with multiple expert drivers including a professional e-sports driver. Interestingly AI is not beating the professional yet, but close. See our open-sourced code, simulator, and data here:
3:18

Besides reading cool papers, my Twitter account is mostly used for catching up Formula 1 news. Very excited about Lando Norris 's great performance recently. Now we combine Formula Racing to AI research: The following video shows we train a Reinforcement Learning policy to drive a Dallara F317 in Monza and Barcelona Circuits autonomously in simulation. You can think of it as optimizing a Qualifying lap: You want the car to run a single lap, no opponents, with the fastest speed, and shortest lap time. We open-source the code to train RL in a racing simulator with Assetto Corsa, a widely deployed platform for esports. We also train with human demonstrations with multiple expert drivers including a professional e-sports driver. Interestingly AI is not beating the professional yet, but close. See our open-sourced code, simulator, and data here:

Xiaolong Wang

32,361 Aufrufe • vor 1 Jahr

Are We In a Simulation? Well, it does work as if we are. So for all intents and purposes you should adopt this mentality! Life responds to you, primarily your thoughts, beliefs, energy and actions. Whether or not there's a giant computer doesn't matter; simulation can simply be an allegory for how this reality operates. As such, we can work with this simulation to create the reality that we desire, and improve our lives. Becoming conscious is the goal. Then, work to understand WHY we are in this "simulation", and what our aims should be...
1:50

Are We In a Simulation? Well, it does work as if we are. So for all intents and purposes you should adopt this mentality! Life responds to you, primarily your thoughts, beliefs, energy and actions. Whether or not there's a giant computer doesn't matter; simulation can simply be an allegory for how this reality operates. As such, we can work with this simulation to create the reality that we desire, and improve our lives. Becoming conscious is the goal. Then, work to understand WHY we are in this "simulation", and what our aims should be...

⚡️🌞 Sol Brah 🌞🐬

19,252 Aufrufe • vor 1 Jahr