Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

HOI-DETR (Hand-Object Interaction) is a new zero-shot framework that integrates hand-object and object-object interaction -Hand + tool detections -Interaction links (+secondary object) Huge for robotics training 🔥🔥

mirrash.eth 🦇🔊

2,303 subscribers

298,630 views • 6 days ago •via X (Twitter)

Health & Wellness Education Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

HDMI (HumanoiD iMitation for Interaction) is a framework enabling humanoid robots to learn whole-body object interaction skills from monocular RGB human videos. It extracts and retargets human poses and object trajectories using GVHMR and LocoMujoco, building reference datasets with contact annotations. The data is used to train an RL policy via robot-object co-tracking. HDMI achieved 67 consecutive door traversals.

HDMI (HumanoiD iMitation for Interaction) is a framework enabling humanoid robots to learn whole-body object interaction skills from monocular RGB human videos. It extracts and retargets human poses and object trajectories using GVHMR and LocoMujoco, building reference datasets with contact annotations. The data is used to train an RL policy via robot-object co-tracking. HDMI achieved 67 consecutive door traversals.

The Humanoid Hub

17,395 views • 9 months ago

Introduce EgoInfinity: a web-scale (14.6 yrs, 142M clips) data engine that automatically lifts Youtube videos into 4D hand-object interaction, and retargets for robot learning Not only a dataset, but a modular, upgradable engine HF Space:

Introduce EgoInfinity: a web-scale (14.6 yrs, 142M clips) data engine that automatically lifts Youtube videos into 4D hand-object interaction, and retargets for robot learning Not only a dataset, but a modular, upgradable engine HF Space:

Vector Wang

106,333 views • 10 days ago

We can convert human videos to robot hand-object interaction trajectories in 4D. Enjoy! Paper: Website: Code: Authors:Bhawna Paliwal,Haritheja,Will Liang, Pieter Abbeel , Mahi Shafiullah 🏠🤖 , Jitendra MALIK

We can convert human videos to robot hand-object interaction trajectories in 4D. Enjoy! Paper: Website: Code: Authors:Bhawna Paliwal,Haritheja,Will Liang, Pieter Abbeel , Mahi Shafiullah 🏠🤖 , Jitendra MALIK

Jitendra MALIK

58,200 views • 10 days ago

Track Anything: Segment Anything Meets Videos Track-Anything is a flexible and interactive tool for video object tracking and segmentation suitable for: - Video object tracking and segmentation with shot changes. - Visualized development and data annnotation for video object tracking and segmentation. - Object-centric downstream video tasks, such as video inpainting and editing. abs: github:

Track Anything: Segment Anything Meets Videos Track-Anything is a flexible and interactive tool for video object tracking and segmentation suitable for: - Video object tracking and segmentation with shot changes. - Visualized development and data annnotation for video object tracking and segmentation. - Object-centric downstream video tasks, such as video inpainting and editing. abs: github:

AK

578,577 views • 3 years ago

Introducing HO-Cap: A Capture System and Dataset for 3D Reconstruction and Pose Tracking of Hand-Object Interaction. We built a multi-camera system and a semi-automatic method for annotating the shape and pose of hands and objects Project page:

Introducing HO-Cap: A Capture System and Dataset for 3D Reconstruction and Pose Tracking of Hand-Object Interaction. We built a multi-camera system and a semi-automatic method for annotating the shape and pose of hands and objects Project page:

Yu Xiang

57,228 views • 1 year ago

In-hand object manipulation is a dexterity litmus test for robot hands. Our new system in Science Robotics Science Robotics can dynamically reorient many different objects in hand in the air. 📚Project website: 🧑‍💻Code: 🧵1/n

In-hand object manipulation is a dexterity litmus test for robot hands. Our new system in Science Robotics Science Robotics can dynamically reorient many different objects in hand in the air. 📚Project website: 🧑‍💻Code: 🧵1/n

Tao Chen

30,666 views • 2 years ago

The council of NPR Suzanne totally approves hand-painting object space normal. #b3d

The council of NPR Suzanne totally approves hand-painting object space normal. #b3d

Omar Faruq Tawsif🍉

114,112 views • 2 years ago

“ObJeCt ShOwS aRe FoR BaBiEs!!” object shows:

Sensitive content

“ObJeCt ShOwS aRe FoR BaBiEs!!” object shows:

SUBSPACETRIPMINEKISSER69 (NSFW DNI)

108,934 views • 16 days ago

Check out Christian Diller's CG-HOI :) We generate realistic 3D human-object interactions, from object geometry and text description. A key ingredient is explicit modeling of contact, during training and as guidance during inference.

Check out Christian Diller's CG-HOI :) We generate realistic 3D human-object interactions, from object geometry and text description. A key ingredient is explicit modeling of contact, during training and as guidance during inference.

Angela Dai

20,508 views • 2 years ago

🤖 Introducing Human-Object Interaction from Human-Level Instructions! First complete system that generates physically plausible, long-horizon human-object interactions with finger motions in contextual environments, driven by human-level instructions. 🔍 Our approach: - LLMs transform instructions into execution plans & target layouts - Multi-stage framework generates synchronized object, body & finger motions - RL policy tracks generated motions in physics simulation Project: Demo: Paper:

🤖 Introducing Human-Object Interaction from Human-Level Instructions! First complete system that generates physically plausible, long-horizon human-object interactions with finger motions in contextual environments, driven by human-level instructions. 🔍 Our approach: - LLMs transform instructions into execution plans & target layouts - Multi-stage framework generates synchronized object, body & finger motions - RL policy tracks generated motions in physics simulation Project: Demo: Paper:

Jiaman Li

104,609 views • 1 year ago

Holy… 🤯 this is literally a superhuman hand. One hand can act as both a left and a right hand. Depending on the task or the object being grasped, it can autonomously switch between left-hand and right-hand configurations, bend in reverse, and achieve degrees of freedom beyond a human hand,maximizing the efficiency of a single hand. it comes from a company in Jiangsu called ChangingTek Robotics. You could say the hand is a bit like an octopus,but it isn’t soft. It’s rigid and capable of gripping tools like wrenches, screwdrivers, drinks, and basically almost any object.

Holy… 🤯 this is literally a superhuman hand. One hand can act as both a left and a right hand. Depending on the task or the object being grasped, it can autonomously switch between left-hand and right-hand configurations, bend in reverse, and achieve degrees of freedom beyond a human hand,maximizing the efficiency of a single hand. it comes from a company in Jiangsu called ChangingTek Robotics. You could say the hand is a bit like an octopus,but it isn’t soft. It’s rigid and capable of gripping tools like wrenches, screwdrivers, drinks, and basically almost any object.

CyberRobo

65,363 views • 3 months ago

vMAP: Vectorised Object Mapping for Neural Field SLAM, new at #CVPR2023! Each object is represented by a separate MLP, optimised in parallel via vectorised training. Full info: Dyson Robotics Lab, Imperial College, Shikun Liu, Marwan Taher, Andrew Davison.

vMAP: Vectorised Object Mapping for Neural Field SLAM, new at #CVPR2023! Each object is represented by a separate MLP, optimised in parallel via vectorised training. Full info: Dyson Robotics Lab, Imperial College, Shikun Liu, Marwan Taher, Andrew Davison.

Xin Kong

23,743 views • 3 years ago

Daily #Blender tip: Thanks to a free add-on, it's now possible to turn your 3D object into a pillowy object that looks like it was hand-made from cloth. You can even print out a sewing pattern to recreate the object in real life! Get the add-on here #b3d

Daily #Blender tip: Thanks to a free add-on, it's now possible to turn your 3D object into a pillowy object that looks like it was hand-made from cloth. You can even print out a sewing pattern to recreate the object in real life! Get the add-on here #b3d

Jan van den Hemel

98,759 views • 3 years ago

Unknown Foreign Object In Makueni: Police, Kenya Space Agency officials say the metal object that landed in Makueni is a foreign object. #NTVTonight Michelle Ngele-Odhiambo

Unknown Foreign Object In Makueni: Police, Kenya Space Agency officials say the metal object that landed in Makueni is a foreign object. #NTVTonight Michelle Ngele-Odhiambo

NTV Kenya

101,347 views • 1 year ago

GPT-4V picks up an object with my robot hand. 1 hour to setup 0 tuning. Using laptop camera. Output is wrist angles and grip type. #Robotics

GPT-4V picks up an object with my robot hand. 1 hour to setup 0 tuning. Using laptop camera. Output is wrist angles and grip type. #Robotics

Saba Khalilnaji

16,932 views • 2 years ago

Excited to share HOI-PAGE, to appear at #ICML2026! 🚀 Lei Li generates 4D human-object interactions zero-shot from text A part-affordance graph grounds interactions via LLM+video priors, enabling complex multi-person, multi-object interactions 👉

Excited to share HOI-PAGE, to appear at #ICML2026! 🚀 Lei Li generates 4D human-object interactions zero-shot from text A part-affordance graph grounds interactions via LLM+video priors, enabling complex multi-person, multi-object interactions 👉

Angela Dai

10,481 views • 1 month ago

The moveable object 🔥

The moveable object 🔥

Jake Rabadi

540,949 views • 5 months ago

Try Move Object on Lovart 🚀 Select, move, and modify any object instantly.

Try Move Object on Lovart 🚀 Select, move, and modify any object instantly.

LovartAI

16,080 views • 3 months ago

#b3d #geometrynodes a comb of Melting Object + Object-Controlled fire sim. made to test partial melting in the place & time I want. For example, in some movies, only a hand is liquefied before full body melts? some jag due to missing sub-frames in blender.

#b3d #geometrynodes a comb of Melting Object + Object-Controlled fire sim. made to test partial melting in the place & time I want. For example, in some movies, only a hand is liquefied before full body melts? some jag due to missing sub-frames in blender.

FaustKeinz

27,724 views • 8 months ago