Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

HOI-DETR (Hand-Object Interaction) is a new zero-shot framework that integrates hand-object and object-object interaction -Hand + tool detections -Interaction links (+secondary object) Huge for robotics training 🔥🔥

mirrash7's profile picture

mirrash.eth 🦇🔊

2,408 subscribers

301,255 Aufrufe • vor 1 Monat •via X (Twitter)

Gesundheit & WellnessBildungWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

HDMI (HumanoiD iMitation for Interaction) is a framework enabling humanoid robots to learn whole-body object interaction skills from monocular RGB human videos. It extracts and retargets human poses and object trajectories using GVHMR and LocoMujoco, building reference datasets with contact annotations. The data is used to train an RL policy via robot-object co-tracking. HDMI achieved 67 consecutive door traversals.
0:45

HDMI (HumanoiD iMitation for Interaction) is a framework enabling humanoid robots to learn whole-body object interaction skills from monocular RGB human videos. It extracts and retargets human poses and object trajectories using GVHMR and LocoMujoco, building reference datasets with contact annotations. The data is used to train an RL policy via robot-object co-tracking. HDMI achieved 67 consecutive door traversals.

The Humanoid Hub

17,395 Aufrufe • vor 10 Monaten

This is a demonstration video of in-hand object rotation with new Torobo Hand. By leveraging large-scale parallel reinforcement learning in NVIDIA Isaac Sim, the learned policy can perform object manipulation in MuJoCo and on the real robot without any additional training.
1:09

This is a demonstration video of in-hand object rotation with new Torobo Hand. By leveraging large-scale parallel reinforcement learning in NVIDIA Isaac Sim, the learned policy can perform object manipulation in MuJoCo and on the real robot without any additional training.

東京ロボティクス株式会社

10,860 Aufrufe • vor 1 Jahr

Introduce EgoInfinity: a web-scale (14.6 yrs, 142M clips) data engine that automatically lifts Youtube videos into 4D hand-object interaction, and retargets for robot learning Not only a dataset, but a modular, upgradable engine HF Space:
0:53

Introduce EgoInfinity: a web-scale (14.6 yrs, 142M clips) data engine that automatically lifts Youtube videos into 4D hand-object interaction, and retargets for robot learning Not only a dataset, but a modular, upgradable engine HF Space:

Vector Wang

107,906 Aufrufe • vor 1 Monat

Track Anything: Segment Anything Meets Videos Track-Anything is a flexible and interactive tool for video object tracking and segmentation suitable for: - Video object tracking and segmentation with shot changes. - Visualized development and data annnotation for video object tracking and segmentation. - Object-centric downstream video tasks, such as video inpainting and editing. abs: github:
0:22

Track Anything: Segment Anything Meets Videos Track-Anything is a flexible and interactive tool for video object tracking and segmentation suitable for: - Video object tracking and segmentation with shot changes. - Visualized development and data annnotation for video object tracking and segmentation. - Object-centric downstream video tasks, such as video inpainting and editing. abs: github:

AK

578,661 Aufrufe • vor 3 Jahren

We can convert human videos to robot hand-object interaction trajectories in 4D. Enjoy! Paper: Website: Code: Authors:Bhawna Paliwal,Haritheja,Will Liang, Pieter Abbeel , Mahi Shafiullah 🏠🤖 , Jitendra MALIK
0:31

We can convert human videos to robot hand-object interaction trajectories in 4D. Enjoy! Paper: Website: Code: Authors:Bhawna Paliwal,Haritheja,Will Liang, Pieter Abbeel , Mahi Shafiullah 🏠🤖 , Jitendra MALIK

Jitendra MALIK

72,927 Aufrufe • vor 1 Monat

Introducing HO-Cap: A Capture System and Dataset for 3D Reconstruction and Pose Tracking of Hand-Object Interaction. We built a multi-camera system and a semi-automatic method for annotating the shape and pose of hands and objects Project page:
1:00

Introducing HO-Cap: A Capture System and Dataset for 3D Reconstruction and Pose Tracking of Hand-Object Interaction. We built a multi-camera system and a semi-automatic method for annotating the shape and pose of hands and objects Project page:

Yu Xiang

57,357 Aufrufe • vor 1 Jahr

In-hand object manipulation is a dexterity litmus test for robot hands. Our new system in Science Robotics Science Robotics can dynamically reorient many different objects in hand in the air. 📚Project website: 🧑‍💻Code: 🧵1/n
0:49

In-hand object manipulation is a dexterity litmus test for robot hands. Our new system in Science Robotics Science Robotics can dynamically reorient many different objects in hand in the air. 📚Project website: 🧑‍💻Code: 🧵1/n

Tao Chen

30,666 Aufrufe • vor 2 Jahren

Check out Christian Diller's CG-HOI :) We generate realistic 3D human-object interactions, from object geometry and text description. A key ingredient is explicit modeling of contact, during training and as guidance during inference.
0:31

Check out Christian Diller's CG-HOI :) We generate realistic 3D human-object interactions, from object geometry and text description. A key ingredient is explicit modeling of contact, during training and as guidance during inference.

Angela Dai

20,514 Aufrufe • vor 2 Jahren

🤖 Introducing Human-Object Interaction from Human-Level Instructions! First complete system that generates physically plausible, long-horizon human-object interactions with finger motions in contextual environments, driven by human-level instructions. 🔍 Our approach: - LLMs transform instructions into execution plans & target layouts - Multi-stage framework generates synchronized object, body & finger motions - RL policy tracks generated motions in physics simulation Project: Demo: Paper:
0:34

🤖 Introducing Human-Object Interaction from Human-Level Instructions! First complete system that generates physically plausible, long-horizon human-object interactions with finger motions in contextual environments, driven by human-level instructions. 🔍 Our approach: - LLMs transform instructions into execution plans & target layouts - Multi-stage framework generates synchronized object, body & finger motions - RL policy tracks generated motions in physics simulation Project: Demo: Paper:

Jiaman Li

104,729 Aufrufe • vor 1 Jahr

Holy… 🤯 this is literally a superhuman hand. One hand can act as both a left and a right hand. Depending on the task or the object being grasped, it can autonomously switch between left-hand and right-hand configurations, bend in reverse, and achieve degrees of freedom beyond a human hand,maximizing the efficiency of a single hand. it comes from a company in Jiangsu called ChangingTek Robotics. You could say the hand is a bit like an octopus,but it isn’t soft. It’s rigid and capable of gripping tools like wrenches, screwdrivers, drinks, and basically almost any object.
0:56

Holy… 🤯 this is literally a superhuman hand. One hand can act as both a left and a right hand. Depending on the task or the object being grasped, it can autonomously switch between left-hand and right-hand configurations, bend in reverse, and achieve degrees of freedom beyond a human hand,maximizing the efficiency of a single hand. it comes from a company in Jiangsu called ChangingTek Robotics. You could say the hand is a bit like an octopus,but it isn’t soft. It’s rigid and capable of gripping tools like wrenches, screwdrivers, drinks, and basically almost any object.

CyberRobo

65,363 Aufrufe • vor 5 Monaten

vMAP: Vectorised Object Mapping for Neural Field SLAM, new at #CVPR2023! Each object is represented by a separate MLP, optimised in parallel via vectorised training. Full info: Dyson Robotics Lab, Imperial College, Shikun Liu, Marwan Taher, Andrew Davison.
0:24

vMAP: Vectorised Object Mapping for Neural Field SLAM, new at #CVPR2023! Each object is represented by a separate MLP, optimised in parallel via vectorised training. Full info: Dyson Robotics Lab, Imperial College, Shikun Liu, Marwan Taher, Andrew Davison.

Xin Kong

23,743 Aufrufe • vor 3 Jahren

Daily #Blender tip: Thanks to a free add-on, it's now possible to turn your 3D object into a pillowy object that looks like it was hand-made from cloth. You can even print out a sewing pattern to recreate the object in real life! Get the add-on here #b3d
1:00

Daily #Blender tip: Thanks to a free add-on, it's now possible to turn your 3D object into a pillowy object that looks like it was hand-made from cloth. You can even print out a sewing pattern to recreate the object in real life! Get the add-on here #b3d

Jan van den Hemel

98,782 Aufrufe • vor 3 Jahren

GPT-4V picks up an object with my robot hand. 1 hour to setup 0 tuning. Using laptop camera. Output is wrist angles and grip type. #Robotics
2:07

GPT-4V picks up an object with my robot hand. 1 hour to setup 0 tuning. Using laptop camera. Output is wrist angles and grip type. #Robotics

Saba Khalilnaji

16,932 Aufrufe • vor 2 Jahren

Excited to share HOI-PAGE, to appear at #ICML2026! 🚀 Lei Li generates 4D human-object interactions zero-shot from text A part-affordance graph grounds interactions via LLM+video priors, enabling complex multi-person, multi-object interactions 👉
0:20

Excited to share HOI-PAGE, to appear at #ICML2026! 🚀 Lei Li generates 4D human-object interactions zero-shot from text A part-affordance graph grounds interactions via LLM+video priors, enabling complex multi-person, multi-object interactions 👉

Angela Dai

12,198 Aufrufe • vor 3 Monaten

Imagine if you have an object in hand, you can rotate the object by feeling without even looking. This is what we enable the robot to do now: Rotating without Seeing. Our multi-finger robot hand learns to rotate diverse objects using only touch sensing.
2:19

Imagine if you have an object in hand, you can rotate the object by feeling without even looking. This is what we enable the robot to do now: Rotating without Seeing. Our multi-finger robot hand learns to rotate diverse objects using only touch sensing.

Xiaolong Wang

65,273 Aufrufe • vor 3 Jahren

#b3d #geometrynodes a comb of Melting Object + Object-Controlled fire sim. made to test partial melting in the place & time I want. For example, in some movies, only a hand is liquefied before full body melts? some jag due to missing sub-frames in blender.
0:23

#b3d #geometrynodes a comb of Melting Object + Object-Controlled fire sim. made to test partial melting in the place & time I want. For example, in some movies, only a hand is liquefied before full body melts? some jag due to missing sub-frames in blender.

FaustKeinz

27,724 Aufrufe • vor 10 Monaten

The home Object Shows deserve, built by fans, for fans ^^ Object Stream Community is a free platform made just for Object Shows: one clean place to discover, watch, track, and review the series you love :) #ObjectShow #ObjectShows #ObjectStreamCommunity #Kickstarter #BFDI
1:58

The home Object Shows deserve, built by fans, for fans ^^ Object Stream Community is a free platform made just for Object Shows: one clean place to discover, watch, track, and review the series you love :) #ObjectShow #ObjectShows #ObjectStreamCommunity #Kickstarter #BFDI

Object Stream Community

653,584 Aufrufe • vor 1 Monat

we are introducing a state-of-the-art real-time object detection model, RF-DETR RF-DETR outperforms all existing object detection models on real world datasets and is the first real-time model to achieve 60+ Average Precision on COCO talked w/ NVIDIA about it at GTC:
2:31

we are introducing a state-of-the-art real-time object detection model, RF-DETR RF-DETR outperforms all existing object detection models on real world datasets and is the first real-time model to achieve 60+ Average Precision on COCO talked w/ NVIDIA about it at GTC:

Joseph Nelson

18,231 Aufrufe • vor 1 Jahr

🚨 JUST IN: Sen. Eric Schmitt (R-MO) BLOCKS a Democrat bill on the floor that would've granted amnesty to 350,000 THOUSAND Haitian TPS migrants THANK YOU, Eric Schmitt! 👏🏻 "I OBJECT to the bill, which would keep 350,000 Haitians here permanently. I object to changing TEMPORARY to PERMANENT. I object to flooding American communities with cheap, foreign labor! I object to treating foreigners as the priority, and Americans as the afterthought!" 🔥 "I object to mass migration. Temporary must mean temporary. Elections have consequences. Therefore, Mr. President, I object."
0:30

🚨 JUST IN: Sen. Eric Schmitt (R-MO) BLOCKS a Democrat bill on the floor that would've granted amnesty to 350,000 THOUSAND Haitian TPS migrants THANK YOU, Eric Schmitt! 👏🏻 "I OBJECT to the bill, which would keep 350,000 Haitians here permanently. I object to changing TEMPORARY to PERMANENT. I object to flooding American communities with cheap, foreign labor! I object to treating foreigners as the priority, and Americans as the afterthought!" 🔥 "I object to mass migration. Temporary must mean temporary. Elections have consequences. Therefore, Mr. President, I object."

Eric Daugherty

204,270 Aufrufe • vor 23 Tagen