Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

HOI-DETR (Hand-Object Interaction) is a new zero-shot framework that integrates hand-object and object-object interaction -Hand + tool detections -Interaction links (+secondary object) Huge for robotics training 🔥🔥

mirrash.eth 🦇🔊

2,408 subscribers

301,255 views • 1 month ago •via X (Twitter)

Health & Wellness Education Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

HDMI (HumanoiD iMitation for Interaction) is a framework enabling humanoid robots to learn whole-body object interaction skills from monocular RGB human videos. It extracts and retargets human poses and object trajectories using GVHMR and LocoMujoco, building reference datasets with contact annotations. The data is used to train an RL policy via robot-object co-tracking. HDMI achieved 67 consecutive door traversals.

HDMI (HumanoiD iMitation for Interaction) is a framework enabling humanoid robots to learn whole-body object interaction skills from monocular RGB human videos. It extracts and retargets human poses and object trajectories using GVHMR and LocoMujoco, building reference datasets with contact annotations. The data is used to train an RL policy via robot-object co-tracking. HDMI achieved 67 consecutive door traversals.

The Humanoid Hub

17,395 views • 10 months ago

This is a demonstration video of in-hand object rotation with new Torobo Hand. By leveraging large-scale parallel reinforcement learning in NVIDIA Isaac Sim, the learned policy can perform object manipulation in MuJoCo and on the real robot without any additional training.

This is a demonstration video of in-hand object rotation with new Torobo Hand. By leveraging large-scale parallel reinforcement learning in NVIDIA Isaac Sim, the learned policy can perform object manipulation in MuJoCo and on the real robot without any additional training.

東京ロボティクス株式会社

10,860 views • 1 year ago

Introduce EgoInfinity: a web-scale (14.6 yrs, 142M clips) data engine that automatically lifts Youtube videos into 4D hand-object interaction, and retargets for robot learning Not only a dataset, but a modular, upgradable engine HF Space:

Introduce EgoInfinity: a web-scale (14.6 yrs, 142M clips) data engine that automatically lifts Youtube videos into 4D hand-object interaction, and retargets for robot learning Not only a dataset, but a modular, upgradable engine HF Space:

Vector Wang

107,906 views • 1 month ago

Track Anything: Segment Anything Meets Videos Track-Anything is a flexible and interactive tool for video object tracking and segmentation suitable for: - Video object tracking and segmentation with shot changes. - Visualized development and data annnotation for video object tracking and segmentation. - Object-centric downstream video tasks, such as video inpainting and editing. abs: github:

Track Anything: Segment Anything Meets Videos Track-Anything is a flexible and interactive tool for video object tracking and segmentation suitable for: - Video object tracking and segmentation with shot changes. - Visualized development and data annnotation for video object tracking and segmentation. - Object-centric downstream video tasks, such as video inpainting and editing. abs: github:

AK

578,661 views • 3 years ago

We can convert human videos to robot hand-object interaction trajectories in 4D. Enjoy! Paper: Website: Code: Authors:Bhawna Paliwal,Haritheja,Will Liang, Pieter Abbeel , Mahi Shafiullah 🏠🤖 , Jitendra MALIK

We can convert human videos to robot hand-object interaction trajectories in 4D. Enjoy! Paper: Website: Code: Authors:Bhawna Paliwal,Haritheja,Will Liang, Pieter Abbeel , Mahi Shafiullah 🏠🤖 , Jitendra MALIK

Jitendra MALIK

72,927 views • 1 month ago

Introducing HO-Cap: A Capture System and Dataset for 3D Reconstruction and Pose Tracking of Hand-Object Interaction. We built a multi-camera system and a semi-automatic method for annotating the shape and pose of hands and objects Project page:

Introducing HO-Cap: A Capture System and Dataset for 3D Reconstruction and Pose Tracking of Hand-Object Interaction. We built a multi-camera system and a semi-automatic method for annotating the shape and pose of hands and objects Project page:

Yu Xiang

57,357 views • 1 year ago

In-hand object manipulation is a dexterity litmus test for robot hands. Our new system in Science Robotics Science Robotics can dynamically reorient many different objects in hand in the air. 📚Project website: 🧑‍💻Code: 🧵1/n

In-hand object manipulation is a dexterity litmus test for robot hands. Our new system in Science Robotics Science Robotics can dynamically reorient many different objects in hand in the air. 📚Project website: 🧑‍💻Code: 🧵1/n

Tao Chen

30,666 views • 2 years ago

Check out Christian Diller's CG-HOI :) We generate realistic 3D human-object interactions, from object geometry and text description. A key ingredient is explicit modeling of contact, during training and as guidance during inference.

Check out Christian Diller's CG-HOI :) We generate realistic 3D human-object interactions, from object geometry and text description. A key ingredient is explicit modeling of contact, during training and as guidance during inference.

Angela Dai

20,514 views • 2 years ago

🤖 Introducing Human-Object Interaction from Human-Level Instructions! First complete system that generates physically plausible, long-horizon human-object interactions with finger motions in contextual environments, driven by human-level instructions. 🔍 Our approach: - LLMs transform instructions into execution plans & target layouts - Multi-stage framework generates synchronized object, body & finger motions - RL policy tracks generated motions in physics simulation Project: Demo: Paper:

🤖 Introducing Human-Object Interaction from Human-Level Instructions! First complete system that generates physically plausible, long-horizon human-object interactions with finger motions in contextual environments, driven by human-level instructions. 🔍 Our approach: - LLMs transform instructions into execution plans & target layouts - Multi-stage framework generates synchronized object, body & finger motions - RL policy tracks generated motions in physics simulation Project: Demo: Paper:

Jiaman Li

104,729 views • 1 year ago

Holy… 🤯 this is literally a superhuman hand. One hand can act as both a left and a right hand. Depending on the task or the object being grasped, it can autonomously switch between left-hand and right-hand configurations, bend in reverse, and achieve degrees of freedom beyond a human hand,maximizing the efficiency of a single hand. it comes from a company in Jiangsu called ChangingTek Robotics. You could say the hand is a bit like an octopus,but it isn’t soft. It’s rigid and capable of gripping tools like wrenches, screwdrivers, drinks, and basically almost any object.

Holy… 🤯 this is literally a superhuman hand. One hand can act as both a left and a right hand. Depending on the task or the object being grasped, it can autonomously switch between left-hand and right-hand configurations, bend in reverse, and achieve degrees of freedom beyond a human hand,maximizing the efficiency of a single hand. it comes from a company in Jiangsu called ChangingTek Robotics. You could say the hand is a bit like an octopus,but it isn’t soft. It’s rigid and capable of gripping tools like wrenches, screwdrivers, drinks, and basically almost any object.

CyberRobo

65,363 views • 5 months ago

vMAP: Vectorised Object Mapping for Neural Field SLAM, new at #CVPR2023! Each object is represented by a separate MLP, optimised in parallel via vectorised training. Full info: Dyson Robotics Lab, Imperial College, Shikun Liu, Marwan Taher, Andrew Davison.

vMAP: Vectorised Object Mapping for Neural Field SLAM, new at #CVPR2023! Each object is represented by a separate MLP, optimised in parallel via vectorised training. Full info: Dyson Robotics Lab, Imperial College, Shikun Liu, Marwan Taher, Andrew Davison.

Xin Kong

23,743 views • 3 years ago

Daily #Blender tip: Thanks to a free add-on, it's now possible to turn your 3D object into a pillowy object that looks like it was hand-made from cloth. You can even print out a sewing pattern to recreate the object in real life! Get the add-on here #b3d

Daily #Blender tip: Thanks to a free add-on, it's now possible to turn your 3D object into a pillowy object that looks like it was hand-made from cloth. You can even print out a sewing pattern to recreate the object in real life! Get the add-on here #b3d

Jan van den Hemel

98,782 views • 3 years ago

GPT-4V picks up an object with my robot hand. 1 hour to setup 0 tuning. Using laptop camera. Output is wrist angles and grip type. #Robotics

GPT-4V picks up an object with my robot hand. 1 hour to setup 0 tuning. Using laptop camera. Output is wrist angles and grip type. #Robotics

Saba Khalilnaji

16,932 views • 2 years ago

Excited to share HOI-PAGE, to appear at #ICML2026! 🚀 Lei Li generates 4D human-object interactions zero-shot from text A part-affordance graph grounds interactions via LLM+video priors, enabling complex multi-person, multi-object interactions 👉

Excited to share HOI-PAGE, to appear at #ICML2026! 🚀 Lei Li generates 4D human-object interactions zero-shot from text A part-affordance graph grounds interactions via LLM+video priors, enabling complex multi-person, multi-object interactions 👉

Angela Dai

12,198 views • 3 months ago

Imagine if you have an object in hand, you can rotate the object by feeling without even looking. This is what we enable the robot to do now: Rotating without Seeing. Our multi-finger robot hand learns to rotate diverse objects using only touch sensing.

Imagine if you have an object in hand, you can rotate the object by feeling without even looking. This is what we enable the robot to do now: Rotating without Seeing. Our multi-finger robot hand learns to rotate diverse objects using only touch sensing.

Xiaolong Wang

65,273 views • 3 years ago

#b3d #geometrynodes a comb of Melting Object + Object-Controlled fire sim. made to test partial melting in the place & time I want. For example, in some movies, only a hand is liquefied before full body melts? some jag due to missing sub-frames in blender.

#b3d #geometrynodes a comb of Melting Object + Object-Controlled fire sim. made to test partial melting in the place & time I want. For example, in some movies, only a hand is liquefied before full body melts? some jag due to missing sub-frames in blender.

FaustKeinz

27,724 views • 10 months ago

The home Object Shows deserve, built by fans, for fans ^^ Object Stream Community is a free platform made just for Object Shows: one clean place to discover, watch, track, and review the series you love :) #ObjectShow #ObjectShows #ObjectStreamCommunity #Kickstarter #BFDI

The home Object Shows deserve, built by fans, for fans ^^ Object Stream Community is a free platform made just for Object Shows: one clean place to discover, watch, track, and review the series you love :) #ObjectShow #ObjectShows #ObjectStreamCommunity #Kickstarter #BFDI

Object Stream Community

653,584 views • 1 month ago

we are introducing a state-of-the-art real-time object detection model, RF-DETR RF-DETR outperforms all existing object detection models on real world datasets and is the first real-time model to achieve 60+ Average Precision on COCO talked w/ NVIDIA about it at GTC:

we are introducing a state-of-the-art real-time object detection model, RF-DETR RF-DETR outperforms all existing object detection models on real world datasets and is the first real-time model to achieve 60+ Average Precision on COCO talked w/ NVIDIA about it at GTC:

Joseph Nelson

18,231 views • 1 year ago

🚨 JUST IN: Sen. Eric Schmitt (R-MO) BLOCKS a Democrat bill on the floor that would've granted amnesty to 350,000 THOUSAND Haitian TPS migrants THANK YOU, Eric Schmitt! 👏🏻 "I OBJECT to the bill, which would keep 350,000 Haitians here permanently. I object to changing TEMPORARY to PERMANENT. I object to flooding American communities with cheap, foreign labor! I object to treating foreigners as the priority, and Americans as the afterthought!" 🔥 "I object to mass migration. Temporary must mean temporary. Elections have consequences. Therefore, Mr. President, I object."

🚨 JUST IN: Sen. Eric Schmitt (R-MO) BLOCKS a Democrat bill on the floor that would've granted amnesty to 350,000 THOUSAND Haitian TPS migrants THANK YOU, Eric Schmitt! 👏🏻 "I OBJECT to the bill, which would keep 350,000 Haitians here permanently. I object to changing TEMPORARY to PERMANENT. I object to flooding American communities with cheap, foreign labor! I object to treating foreigners as the priority, and Americans as the afterthought!" 🔥 "I object to mass migration. Temporary must mean temporary. Elections have consequences. Therefore, Mr. President, I object."

Eric Daugherty

204,270 views • 23 days ago