Загрузка видео...

Не удалось загрузить видео

На главную

I trained a grasping policy on objects of various shapes and sizes using the new mjlab feature and this really cool pivot grasp strategy emerges for large flat objects that are larger than the gripper aperture. So cool and beautiful to see!

kevin_zakka's profile picture

Kevin Zakka

18,803 subscribers

20,458 просмотров • 4 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

A robot hand grasp over 500 totally new objects without fail? Zero-shot, single-view & super reliable ⬇️ + Paper Grasping random objects is hard for robots, especially when shapes, weights, and materials vary. RobustDexGrasp solves this with a smart new way of seeing and controlling the hand, leading to near-perfect grasping, even in noisy or cluttered scenes. Thank you for sharing, Hui Zhang 🙏 Follow him!! What makes it special ✅ Grabs 500+ unseen objects with 94.6% success using only single-view input ✅ Learns local shapes, not full geometry, for better generalization ✅ Trained with just 35 objects in sim but works in the real world with hundreds more ✅ Adapts to noise, unexpected forces, and even plays chess with VLM planning It shows that smart sensing and adaptive control can take dexterous grasping to the next level. Project: Paper:
0:25

A robot hand grasp over 500 totally new objects without fail? Zero-shot, single-view & super reliable ⬇️ + Paper Grasping random objects is hard for robots, especially when shapes, weights, and materials vary. RobustDexGrasp solves this with a smart new way of seeing and controlling the hand, leading to near-perfect grasping, even in noisy or cluttered scenes. Thank you for sharing, Hui Zhang 🙏 Follow him!! What makes it special ✅ Grabs 500+ unseen objects with 94.6% success using only single-view input ✅ Learns local shapes, not full geometry, for better generalization ✅ Trained with just 35 objects in sim but works in the real world with hundreds more ✅ Adapts to noise, unexpected forces, and even plays chess with VLM planning It shows that smart sensing and adaptive control can take dexterous grasping to the next level. Project: Paper:

Ilir Aliu

37,980 просмотров • 1 год назад

Robots with tentacles! 🐙 SpiRobs are soft robots inspired by nature, designed in the shape of a logarithmic spiral. They mimic the flexible movements of octopus arms and elephant trunks to grasp objects. 🐘 SpiRobs use simple cables to move, making them easy to control and operate. They can scale from small to large sizes, ranging from centimeters to meters. The robots can adapt to different object shapes, improving their grasping ability. A mini version can act as a tiny gripper, while a large version can be mounted on drones. Interestingly, multiple robots can work together to wrap around and hold large objects. That's just out of this world! 😮‍💨 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
1:04

Robots with tentacles! 🐙 SpiRobs are soft robots inspired by nature, designed in the shape of a logarithmic spiral. They mimic the flexible movements of octopus arms and elephant trunks to grasp objects. 🐘 SpiRobs use simple cables to move, making them easy to control and operate. They can scale from small to large sizes, ranging from centimeters to meters. The robots can adapt to different object shapes, improving their grasping ability. A mini version can act as a tiny gripper, while a large version can be mounted on drones. Interestingly, multiple robots can work together to wrap around and hold large objects. That's just out of this world! 😮‍💨 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

121,386 просмотров • 8 месяцев назад

Researchers at the University of Science and Technology of China have created an octopus-inspired robot called Spirob. It uses bioinspired soft technology to handle objects of various sizes, shapes, and weights with high accuracy. The robot is also easy and fast to produce in different sizes using 3D printing.
0:35

Researchers at the University of Science and Technology of China have created an octopus-inspired robot called Spirob. It uses bioinspired soft technology to handle objects of various sizes, shapes, and weights with high accuracy. The robot is also easy and fast to produce in different sizes using 3D printing.

Space and Technology

68,337 просмотров • 4 месяцев назад

On June 15th, Creative Mode comes to Teardown! Effortlessly build new objects of all shapes and sizes with various materials, including wood, brick, metal, and more. From there, you can easily save, spawn, move, and duplicate the fruits of your labor! #PCgamingshow
1:00

On June 15th, Creative Mode comes to Teardown! Effortlessly build new objects of all shapes and sizes with various materials, including wood, brick, metal, and more. From there, you can easily save, spawn, move, and duplicate the fruits of your labor! #PCgamingshow

Teardown

4,436,774 просмотров • 3 лет назад

Cubes are one of the most powerful tools for learning to draw, When you modify cubes you’re training perspective, form, and line control all at once. This is how artists learn to see objects in 3D instead of copying flat shapes.
0:31

Cubes are one of the most powerful tools for learning to draw, When you modify cubes you’re training perspective, form, and line control all at once. This is how artists learn to see objects in 3D instead of copying flat shapes.

ANGRYPOP ©

90,836 просмотров • 6 месяцев назад

I am working on a feature that allows the height of objects, paths and surfaces to be adjusted continuously. It is also possible to customize the environment.
0:24

I am working on a feature that allows the height of objects, paths and surfaces to be adjusted continuously. It is also possible to customize the environment.

Canvas of Kings | Might of Merchants

17,728 просмотров • 2 лет назад

I have been cleaning my daughter's mess for more than two years now. Last weekend our robot came to home to do the job for me. 🤖 Our new work on visual whole-body control learns a policy to coordinate the robot legs and arms for mobile manipulation. See how the legs bend on grasping objects on the ground based on visual inputs autonomously. (It is NOT teleoperation!) We again adopt a Sim2Real approach and our policy generalizes to beaches, forests, and streets in San Diego. 👇🧵
3:15

I have been cleaning my daughter's mess for more than two years now. Last weekend our robot came to home to do the job for me. 🤖 Our new work on visual whole-body control learns a policy to coordinate the robot legs and arms for mobile manipulation. See how the legs bend on grasping objects on the ground based on visual inputs autonomously. (It is NOT teleoperation!) We again adopt a Sim2Real approach and our policy generalizes to beaches, forests, and streets in San Diego. 👇🧵

Xiaolong Wang

159,222 просмотров • 2 лет назад

Researchers at RAI Institute developed the Koala gripper to help robots handle tools and objects more naturally. The system includes a handheld version for humans and a motorized version for robots, both using the same design and sensors. By learning from human demonstrations recorded with cameras and force sensors, robots can repeat the same tasks using the Koala gripper.
0:24

Researchers at RAI Institute developed the Koala gripper to help robots handle tools and objects more naturally. The system includes a handheld version for humans and a motorized version for robots, both using the same design and sensors. By learning from human demonstrations recorded with cameras and force sensors, robots can repeat the same tasks using the Koala gripper.

Space and Technology

21,980 просмотров • 2 месяцев назад

she’s perfect she’s everything i can’t believe we really getting jean fucking grey in a modern day game and this way the psionic energy engulfs objects is so beautiful i really can’t wait to see more of her powers in the game and what will be her relationship to logan
0:22

she’s perfect she’s everything i can’t believe we really getting jean fucking grey in a modern day game and this way the psionic energy engulfs objects is so beautiful i really can’t wait to see more of her powers in the game and what will be her relationship to logan

marcus🇵🇸CEO of Teen Titans

61,183 просмотров • 2 месяцев назад

I’m thrilled to announce that we just released GraspGen, a multi-year project we have been cooking at NVIDIA Robotics 🚀 GraspGen: A Diffusion-Based Framework for 6-DOF Grasping Grasping is a foundational challenge in robotics 🤖 — whether for industrial picking or general-purpose humanoids. VLA + real data collection is all the rage now but is expensive and scales poorly for this task. For every new gripper and/or scene, you’ll have to recollect the dataset in this paradigm for the best perf. 💡Key Idea: Since grasping is such a well-defined task in simulation - why can’t we just scale synthetic data generation and train a generative model for grasping? By embracing modularity and standardized grasp formats, we can make this a turnkey technology that works zero-shot for multiple settings. GraspGen is a modular framework for diffusion-based 6-DOF grasp generation that scales across embodiment types, observability conditions, clutter, task complexity. Key Features: ✅ Multi-embodiment support: suction, parallel-jaw, and multi-fingered grippers ✅ Generalization to partial + complete 3D point clouds ✅ Generalization to single-objects + cluttered scenes ✅ Modular design uses other robotics modules and foundation models (SAM2, cuRobo, FoundationStereo, FoundationPose). This allows GraspGen to focus on only one thing - grasp generation ✅ Training recipe: grasp discriminator is trained with On-Generator data from the diffusion model - so that it learns to correct the mistakes (if any) of the diffusion generator ✅ Real-time performance (~20 Hz) before any GPU acceleration; low memory footprint 📊 Results: • SOTA on the FetchBench [Han et al. CoRL 2024] benchmark • Zero-shot sim-to-real transfer on unknown objects and cluttered scenes • Dataset of 53M simulated grasps across 8K objects from Objaverse 📄 arXiv: 🌐 Website: 💻 Code: A huge thank you to everyone involved in this journey — excited to see what the community builds on top of it! Joint work with Clemens Eppner , Balakumar Sundaralingam , Yu-Wei, Jun Yamada Wentao Yuan and other collaborators #robotics #diffusionmodels #physicalAI #simtoreal
0:39

I’m thrilled to announce that we just released GraspGen, a multi-year project we have been cooking at NVIDIA Robotics 🚀 GraspGen: A Diffusion-Based Framework for 6-DOF Grasping Grasping is a foundational challenge in robotics 🤖 — whether for industrial picking or general-purpose humanoids. VLA + real data collection is all the rage now but is expensive and scales poorly for this task. For every new gripper and/or scene, you’ll have to recollect the dataset in this paradigm for the best perf. 💡Key Idea: Since grasping is such a well-defined task in simulation - why can’t we just scale synthetic data generation and train a generative model for grasping? By embracing modularity and standardized grasp formats, we can make this a turnkey technology that works zero-shot for multiple settings. GraspGen is a modular framework for diffusion-based 6-DOF grasp generation that scales across embodiment types, observability conditions, clutter, task complexity. Key Features: ✅ Multi-embodiment support: suction, parallel-jaw, and multi-fingered grippers ✅ Generalization to partial + complete 3D point clouds ✅ Generalization to single-objects + cluttered scenes ✅ Modular design uses other robotics modules and foundation models (SAM2, cuRobo, FoundationStereo, FoundationPose). This allows GraspGen to focus on only one thing - grasp generation ✅ Training recipe: grasp discriminator is trained with On-Generator data from the diffusion model - so that it learns to correct the mistakes (if any) of the diffusion generator ✅ Real-time performance (~20 Hz) before any GPU acceleration; low memory footprint 📊 Results: • SOTA on the FetchBench [Han et al. CoRL 2024] benchmark • Zero-shot sim-to-real transfer on unknown objects and cluttered scenes • Dataset of 53M simulated grasps across 8K objects from Objaverse 📄 arXiv: 🌐 Website: 💻 Code: A huge thank you to everyone involved in this journey — excited to see what the community builds on top of it! Joint work with Clemens Eppner , Balakumar Sundaralingam , Yu-Wei, Jun Yamada Wentao Yuan and other collaborators #robotics #diffusionmodels #physicalAI #simtoreal

Adithya Murali

24,106 просмотров • 1 год назад

SpiRobs morphologically replicate the logarithmic spiral that is ubiquitous in natural organisms. They are easy and fast to build across scales via 3D printing. They are actuated by cables, which allow for fast and life-like movements. Besides, a single robot can handle a wide variety of objects (in terms of size, shape, and weight). A key to this is a bioinspired grasping strategy that is found in the octopus. Finally, this work demonstrates a wide range of prototypes, including a miniaturized gripper, a manipulator mounted on a drone, and multi-robot arrays that can grasp in a tendril-like fashion. Authors: Zhanchi Wang, Nikolaos M. Freris, and Xi Wei University of Science and Technology of China Video Credit: ———————————————— Stay ahead of the curve! Follow more cutting edge robotics content, including research, reports and articles on Wevolver:
0:33

SpiRobs morphologically replicate the logarithmic spiral that is ubiquitous in natural organisms. They are easy and fast to build across scales via 3D printing. They are actuated by cables, which allow for fast and life-like movements. Besides, a single robot can handle a wide variety of objects (in terms of size, shape, and weight). A key to this is a bioinspired grasping strategy that is found in the octopus. Finally, this work demonstrates a wide range of prototypes, including a miniaturized gripper, a manipulator mounted on a drone, and multi-robot arrays that can grasp in a tendril-like fashion. Authors: Zhanchi Wang, Nikolaos M. Freris, and Xi Wei University of Science and Technology of China Video Credit: ———————————————— Stay ahead of the curve! Follow more cutting edge robotics content, including research, reports and articles on Wevolver:

Wevolver

23,154 просмотров • 1 год назад

It's really cool that the EN and JP AOD videos are allowed to be so different. Since they're using VTuber models, you actually get to see different body language, expressions, and interactions across the regional versions of the same video.
0:57

It's really cool that the EN and JP AOD videos are allowed to be so different. Since they're using VTuber models, you actually get to see different body language, expressions, and interactions across the regional versions of the same video.

Chzchan 🔜 SacAnime UM39

108,124 просмотров • 16 дней назад

✨️❤️Beautiful song that I really enjoyed. And this singer still has that amazing voice, how cool! The 80s are the best.🍀
1:11

✨️❤️Beautiful song that I really enjoyed. And this singer still has that amazing voice, how cool! The 80s are the best.🍀

𝐌𝐮𝐬𝐢𝐜 - 𝐌𝐨𝐯𝐢𝐞 - 𝐀𝐧𝐝 𝐌𝐨𝐫𝐞⭐️❤️

45,026 просмотров • 8 месяцев назад

The new voxel format is finally starting to come together. It uses a brickmap that enables large, sparse objects, unique properties for each voxel (no palette) and really fast scene updates.
0:53

The new voxel format is finally starting to come together. It uses a brickmap that enables large, sparse objects, unique properties for each voxel (no palette) and really fast scene updates.

Dennis Gustafsson

119,267 просмотров • 1 год назад

Time is a flat circle. The pats are back in the SB and Dave is sending “whoops I didn’t mean to send you that!” texts. Cool cool. Sick life.
0:38

Time is a flat circle. The pats are back in the SB and Dave is sending “whoops I didn’t mean to send you that!” texts. Cool cool. Sick life.

KFC

268,757 просмотров • 7 месяцев назад

Announcing a significant upgrade to Agentic Document Extraction! LandingAI's new DPT (Document Pre-trained Transformer) accurately extracts even from complex docs. For example, from large, complex tables, which is important for many finance and healthcare applications. And a new SDK makes using it require only 3 simple lines of code. Please see the video for technical details. I hope this unlocks a lot of value from the "dark data" currently stuck in PDF files, and that you'll build something cool with this!
3:25

Announcing a significant upgrade to Agentic Document Extraction! LandingAI's new DPT (Document Pre-trained Transformer) accurately extracts even from complex docs. For example, from large, complex tables, which is important for many finance and healthcare applications. And a new SDK makes using it require only 3 simple lines of code. Please see the video for technical details. I hope this unlocks a lot of value from the "dark data" currently stuck in PDF files, and that you'll build something cool with this!

Andrew Ng

299,624 просмотров • 11 месяцев назад

Really cool to see how rising filmmakers are creating powerful stories on iPhone for MAMI Mumbai Film Festival... and using MacBook Pro and iPad Pro!
2:10

Really cool to see how rising filmmakers are creating powerful stories on iPhone for MAMI Mumbai Film Festival... and using MacBook Pro and iPad Pro!

Greg Joswiak

66,445 просмотров • 3 месяцев назад

What if drop shadows actually look like real shadows? We are using Omma to explore a new kind of canvas that employs real-light approximations rather than simple 2D drop shadows. It runs on WebGPU and uses real-time path tracing to simulate more realistic shading. It also supports SVG shapes. The Z-index defines actual depth, too (objects with a lower z-index would be affected by shadows of other objects).
0:37

What if drop shadows actually look like real shadows? We are using Omma to explore a new kind of canvas that employs real-light approximations rather than simple 2D drop shadows. It runs on WebGPU and uses real-time path tracing to simulate more realistic shading. It also supports SVG shapes. The Z-index defines actual depth, too (objects with a lower z-index would be affected by shadows of other objects).

Omma

12,155 просмотров • 3 месяцев назад