Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

I trained a grasping policy on objects of various shapes and sizes using the new mjlab feature and this really cool pivot grasp strategy emerges for large flat objects that are larger than the gripper aperture. So cool and beautiful to see!

Kevin Zakka

18,803 subscribers

20,458 views • 2 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

A robot hand grasp over 500 totally new objects without fail? Zero-shot, single-view & super reliable ⬇️ + Paper Grasping random objects is hard for robots, especially when shapes, weights, and materials vary. RobustDexGrasp solves this with a smart new way of seeing and controlling the hand, leading to near-perfect grasping, even in noisy or cluttered scenes. Thank you for sharing, Hui Zhang 🙏 Follow him!! What makes it special ✅ Grabs 500+ unseen objects with 94.6% success using only single-view input ✅ Learns local shapes, not full geometry, for better generalization ✅ Trained with just 35 objects in sim but works in the real world with hundreds more ✅ Adapts to noise, unexpected forces, and even plays chess with VLM planning It shows that smart sensing and adaptive control can take dexterous grasping to the next level. Project: Paper:

A robot hand grasp over 500 totally new objects without fail? Zero-shot, single-view & super reliable ⬇️ + Paper Grasping random objects is hard for robots, especially when shapes, weights, and materials vary. RobustDexGrasp solves this with a smart new way of seeing and controlling the hand, leading to near-perfect grasping, even in noisy or cluttered scenes. Thank you for sharing, Hui Zhang 🙏 Follow him!! What makes it special ✅ Grabs 500+ unseen objects with 94.6% success using only single-view input ✅ Learns local shapes, not full geometry, for better generalization ✅ Trained with just 35 objects in sim but works in the real world with hundreds more ✅ Adapts to noise, unexpected forces, and even plays chess with VLM planning It shows that smart sensing and adaptive control can take dexterous grasping to the next level. Project: Paper:

Ilir Aliu

37,980 views • 1 year ago

Robots with tentacles! 🐙 SpiRobs are soft robots inspired by nature, designed in the shape of a logarithmic spiral. They mimic the flexible movements of octopus arms and elephant trunks to grasp objects. 🐘 SpiRobs use simple cables to move, making them easy to control and operate. They can scale from small to large sizes, ranging from centimeters to meters. The robots can adapt to different object shapes, improving their grasping ability. A mini version can act as a tiny gripper, while a large version can be mounted on drones. Interestingly, multiple robots can work together to wrap around and hold large objects. That's just out of this world! 😮‍💨 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Robots with tentacles! 🐙 SpiRobs are soft robots inspired by nature, designed in the shape of a logarithmic spiral. They mimic the flexible movements of octopus arms and elephant trunks to grasp objects. 🐘 SpiRobs use simple cables to move, making them easy to control and operate. They can scale from small to large sizes, ranging from centimeters to meters. The robots can adapt to different object shapes, improving their grasping ability. A mini version can act as a tiny gripper, while a large version can be mounted on drones. Interestingly, multiple robots can work together to wrap around and hold large objects. That's just out of this world! 😮‍💨 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

121,234 views • 6 months ago

Researchers at the University of Science and Technology of China have created an octopus-inspired robot called Spirob. It uses bioinspired soft technology to handle objects of various sizes, shapes, and weights with high accuracy. The robot is also easy and fast to produce in different sizes using 3D printing.

Researchers at the University of Science and Technology of China have created an octopus-inspired robot called Spirob. It uses bioinspired soft technology to handle objects of various sizes, shapes, and weights with high accuracy. The robot is also easy and fast to produce in different sizes using 3D printing.

Space and Technology

67,826 views • 3 months ago

Introducing Omnigrasp: Grasping Diverse Objects with Simulated Humanoids. With Omnigrasp, we show that we can control a humanoid equipped with dexterous hands to grasp diverse objects (>1200) and follow diverse trajectories, with one policy! 🌐: 📜:

Introducing Omnigrasp: Grasping Diverse Objects with Simulated Humanoids. With Omnigrasp, we show that we can control a humanoid equipped with dexterous hands to grasp diverse objects (>1200) and follow diverse trajectories, with one policy! 🌐: 📜:

Zhengyi “Zen” Luo

92,152 views • 2 years ago

On June 15th, Creative Mode comes to Teardown! Effortlessly build new objects of all shapes and sizes with various materials, including wood, brick, metal, and more. From there, you can easily save, spawn, move, and duplicate the fruits of your labor! #PCgamingshow

On June 15th, Creative Mode comes to Teardown! Effortlessly build new objects of all shapes and sizes with various materials, including wood, brick, metal, and more. From there, you can easily save, spawn, move, and duplicate the fruits of your labor! #PCgamingshow

Teardown

4,436,562 views • 3 years ago

Cubes are one of the most powerful tools for learning to draw, When you modify cubes you’re training perspective, form, and line control all at once. This is how artists learn to see objects in 3D instead of copying flat shapes.

Cubes are one of the most powerful tools for learning to draw, When you modify cubes you’re training perspective, form, and line control all at once. This is how artists learn to see objects in 3D instead of copying flat shapes.

ANGRYPOP ©

90,836 views • 4 months ago

Amazing comparison of the sizes of astronomical objects (and not only)

Amazing comparison of the sizes of astronomical objects (and not only)

Black Hole

27,647 views • 1 year ago

I am working on a feature that allows the height of objects, paths and surfaces to be adjusted continuously. It is also possible to customize the environment.

I am working on a feature that allows the height of objects, paths and surfaces to be adjusted continuously. It is also possible to customize the environment.

Canvas of Kings | Might of Merchants

17,722 views • 2 years ago

Researchers at RAI Institute developed the Koala gripper to help robots handle tools and objects more naturally. The system includes a handheld version for humans and a motorized version for robots, both using the same design and sensors. By learning from human demonstrations recorded with cameras and force sensors, robots can repeat the same tasks using the Koala gripper.

Researchers at RAI Institute developed the Koala gripper to help robots handle tools and objects more naturally. The system includes a handheld version for humans and a motorized version for robots, both using the same design and sensors. By learning from human demonstrations recorded with cameras and force sensors, robots can repeat the same tasks using the Koala gripper.

Space and Technology

21,980 views • 28 days ago

I have been cleaning my daughter's mess for more than two years now. Last weekend our robot came to home to do the job for me. 🤖 Our new work on visual whole-body control learns a policy to coordinate the robot legs and arms for mobile manipulation. See how the legs bend on grasping objects on the ground based on visual inputs autonomously. (It is NOT teleoperation!) We again adopt a Sim2Real approach and our policy generalizes to beaches, forests, and streets in San Diego. 👇🧵

I have been cleaning my daughter's mess for more than two years now. Last weekend our robot came to home to do the job for me. 🤖 Our new work on visual whole-body control learns a policy to coordinate the robot legs and arms for mobile manipulation. See how the legs bend on grasping objects on the ground based on visual inputs autonomously. (It is NOT teleoperation!) We again adopt a Sim2Real approach and our policy generalizes to beaches, forests, and streets in San Diego. 👇🧵

Xiaolong Wang

159,222 views • 2 years ago

I procrastinated and didn't build any features I planned... ...but now you can change the color of buildings and objects, and it looks kinda cool! #gamedev #screenshotsaturday

I procrastinated and didn't build any features I planned... ...but now you can change the color of buildings and objects, and it looks kinda cool! #gamedev #screenshotsaturday

Slava Korolev 🏘️ Making Monterona

52,738 views • 1 year ago

she’s perfect she’s everything i can’t believe we really getting jean fucking grey in a modern day game and this way the psionic energy engulfs objects is so beautiful i really can’t wait to see more of her powers in the game and what will be her relationship to logan

she’s perfect she’s everything i can’t believe we really getting jean fucking grey in a modern day game and this way the psionic energy engulfs objects is so beautiful i really can’t wait to see more of her powers in the game and what will be her relationship to logan

marcus🇵🇸CEO of Teen Titans

61,183 views • 1 month ago

✨️❤️Beautiful song that I really enjoyed. And this singer still has that amazing voice, how cool! The 80s are the best.🍀

✨️❤️Beautiful song that I really enjoyed. And this singer still has that amazing voice, how cool! The 80s are the best.🍀

𝐌𝐮𝐬𝐢𝐜 - 𝐌𝐨𝐯𝐢𝐞 - 𝐀𝐧𝐝 𝐌𝐨𝐫𝐞⭐️❤️

45,026 views • 6 months ago

I have a thing for objects made from pretty glass! Beautiful and so satisfying to watch!

I have a thing for objects made from pretty glass! Beautiful and so satisfying to watch!

AllieJade

28,367 views • 4 months ago

SpiRobs morphologically replicate the logarithmic spiral that is ubiquitous in natural organisms. They are easy and fast to build across scales via 3D printing. They are actuated by cables, which allow for fast and life-like movements. Besides, a single robot can handle a wide variety of objects (in terms of size, shape, and weight). A key to this is a bioinspired grasping strategy that is found in the octopus. Finally, this work demonstrates a wide range of prototypes, including a miniaturized gripper, a manipulator mounted on a drone, and multi-robot arrays that can grasp in a tendril-like fashion. Authors: Zhanchi Wang, Nikolaos M. Freris, and Xi Wei University of Science and Technology of China Video Credit: ———————————————— Stay ahead of the curve! Follow more cutting edge robotics content, including research, reports and articles on Wevolver:

SpiRobs morphologically replicate the logarithmic spiral that is ubiquitous in natural organisms. They are easy and fast to build across scales via 3D printing. They are actuated by cables, which allow for fast and life-like movements. Besides, a single robot can handle a wide variety of objects (in terms of size, shape, and weight). A key to this is a bioinspired grasping strategy that is found in the octopus. Finally, this work demonstrates a wide range of prototypes, including a miniaturized gripper, a manipulator mounted on a drone, and multi-robot arrays that can grasp in a tendril-like fashion. Authors: Zhanchi Wang, Nikolaos M. Freris, and Xi Wei University of Science and Technology of China Video Credit: ———————————————— Stay ahead of the curve! Follow more cutting edge robotics content, including research, reports and articles on Wevolver:

Wevolver

23,154 views • 1 year ago

Changing a light bulb with a robot! 💡 Researchers at the Korea Institute of Machinery & Materials developed a gripper that can handle complex manipulation tasks like bulb and bolt installation. It has three fingers with nine degrees of freedom (9 DoF), allowing precise control. Each finger moves using a special linkage system that enables flexible motion. The gripper can grasp objects of different shapes and adjust their positions accurately. Tests showed that it can lift up to 12 kg and apply a fingertip force of 40 N with high precision. Complex manipulation can be handled by robots! 🦾

Changing a light bulb with a robot! 💡 Researchers at the Korea Institute of Machinery & Materials developed a gripper that can handle complex manipulation tasks like bulb and bolt installation. It has three fingers with nine degrees of freedom (9 DoF), allowing precise control. Each finger moves using a special linkage system that enables flexible motion. The gripper can grasp objects of different shapes and adjust their positions accurately. Tests showed that it can lift up to 12 kg and apply a fingertip force of 40 N with high precision. Complex manipulation can be handled by robots! 🦾

Lukas Ziegler

27,548 views • 1 year ago

I’m thrilled to announce that we just released GraspGen, a multi-year project we have been cooking at NVIDIA Robotics 🚀 GraspGen: A Diffusion-Based Framework for 6-DOF Grasping Grasping is a foundational challenge in robotics 🤖 — whether for industrial picking or general-purpose humanoids. VLA + real data collection is all the rage now but is expensive and scales poorly for this task. For every new gripper and/or scene, you’ll have to recollect the dataset in this paradigm for the best perf. 💡Key Idea: Since grasping is such a well-defined task in simulation - why can’t we just scale synthetic data generation and train a generative model for grasping? By embracing modularity and standardized grasp formats, we can make this a turnkey technology that works zero-shot for multiple settings. GraspGen is a modular framework for diffusion-based 6-DOF grasp generation that scales across embodiment types, observability conditions, clutter, task complexity. Key Features: ✅ Multi-embodiment support: suction, parallel-jaw, and multi-fingered grippers ✅ Generalization to partial + complete 3D point clouds ✅ Generalization to single-objects + cluttered scenes ✅ Modular design uses other robotics modules and foundation models (SAM2, cuRobo, FoundationStereo, FoundationPose). This allows GraspGen to focus on only one thing - grasp generation ✅ Training recipe: grasp discriminator is trained with On-Generator data from the diffusion model - so that it learns to correct the mistakes (if any) of the diffusion generator ✅ Real-time performance (~20 Hz) before any GPU acceleration; low memory footprint 📊 Results: • SOTA on the FetchBench [Han et al. CoRL 2024] benchmark • Zero-shot sim-to-real transfer on unknown objects and cluttered scenes • Dataset of 53M simulated grasps across 8K objects from Objaverse 📄 arXiv: 🌐 Website: 💻 Code: A huge thank you to everyone involved in this journey — excited to see what the community builds on top of it! Joint work with Clemens Eppner , Balakumar Sundaralingam , Yu-Wei, Jun Yamada Wentao Yuan and other collaborators #robotics #diffusionmodels #physicalAI #simtoreal

I’m thrilled to announce that we just released GraspGen, a multi-year project we have been cooking at NVIDIA Robotics 🚀 GraspGen: A Diffusion-Based Framework for 6-DOF Grasping Grasping is a foundational challenge in robotics 🤖 — whether for industrial picking or general-purpose humanoids. VLA + real data collection is all the rage now but is expensive and scales poorly for this task. For every new gripper and/or scene, you’ll have to recollect the dataset in this paradigm for the best perf. 💡Key Idea: Since grasping is such a well-defined task in simulation - why can’t we just scale synthetic data generation and train a generative model for grasping? By embracing modularity and standardized grasp formats, we can make this a turnkey technology that works zero-shot for multiple settings. GraspGen is a modular framework for diffusion-based 6-DOF grasp generation that scales across embodiment types, observability conditions, clutter, task complexity. Key Features: ✅ Multi-embodiment support: suction, parallel-jaw, and multi-fingered grippers ✅ Generalization to partial + complete 3D point clouds ✅ Generalization to single-objects + cluttered scenes ✅ Modular design uses other robotics modules and foundation models (SAM2, cuRobo, FoundationStereo, FoundationPose). This allows GraspGen to focus on only one thing - grasp generation ✅ Training recipe: grasp discriminator is trained with On-Generator data from the diffusion model - so that it learns to correct the mistakes (if any) of the diffusion generator ✅ Real-time performance (~20 Hz) before any GPU acceleration; low memory footprint 📊 Results: • SOTA on the FetchBench [Han et al. CoRL 2024] benchmark • Zero-shot sim-to-real transfer on unknown objects and cluttered scenes • Dataset of 53M simulated grasps across 8K objects from Objaverse 📄 arXiv: 🌐 Website: 💻 Code: A huge thank you to everyone involved in this journey — excited to see what the community builds on top of it! Joint work with Clemens Eppner , Balakumar Sundaralingam , Yu-Wei, Jun Yamada Wentao Yuan and other collaborators #robotics #diffusionmodels #physicalAI #simtoreal

Adithya Murali

23,841 views • 11 months ago

The new voxel format is finally starting to come together. It uses a brickmap that enables large, sparse objects, unique properties for each voxel (no palette) and really fast scene updates.

The new voxel format is finally starting to come together. It uses a brickmap that enables large, sparse objects, unique properties for each voxel (no palette) and really fast scene updates.

Dennis Gustafsson

119,096 views • 1 year ago

Time is a flat circle. The pats are back in the SB and Dave is sending “whoops I didn’t mean to send you that!” texts. Cool cool. Sick life.

Time is a flat circle. The pats are back in the SB and Dave is sending “whoops I didn’t mean to send you that!” texts. Cool cool. Sick life.

KFC

268,757 views • 5 months ago