Loading video...

Video Failed to Load

Go Home

We can replay the HO-Cap data in #IsaacSim No physics enabled. It is setting the poses of hands and objects according to our annotations

YuXiang_IRVL's profile picture

Yu Xiang

5,993 subscribers

41,550 views • 1 year ago •via X (Twitter)

Science & TechnologyTravelNews & Politics#IsaacSim
LIVE

Anya Rossi• Live Now

Private livecam show

5 Comments

Chen Tessler's profile picture
Chen Tessler1 year ago

Nice!

RedDeer.Games's profile picture
RedDeer.Games1 year ago

We can't spill the beans about the release date of Maki: Paw of Fury, but make no mistake, things are happening! 🫘😎 We remind you that the game is coming to #NintendoSwitch and #PC #Steam and you can play the demo on PC, here ⤵️ >>> Have a great day!

Chris Matthieu's profile picture
Chris Matthieu1 year ago

Awesome!

Igor Kotenkov's profile picture
Igor Kotenkov1 year ago

mind sharing the code? (haven't seen it in the main hocap repo, maybe I've missed it)

Yu Xiang's profile picture
Yu Xiang1 year ago

It is still an ongoing project. We will share the code later

Related Videos

In v37.40, General Physics will enter Beta so you can publish islands with dynamic, physics-enabled gameplay. Players will be able to push, topple, hit, and move objects in more engaging ways. Get your islands physics-ready!
0:30

In v37.40, General Physics will enter Beta so you can publish islands with dynamic, physics-enabled gameplay. Players will be able to push, topple, hit, and move objects in more engaging ways. Get your islands physics-ready!

iFireMonkey

86,980 views • 9 months ago

The Government's digital ID scheme is deeply un-British, according to their own experts will make our data less secure, and hands the Government vast surveillance capabilities that we have seen they can and will misuse for their own ends.
0:49

The Government's digital ID scheme is deeply un-British, according to their own experts will make our data less secure, and hands the Government vast surveillance capabilities that we have seen they can and will misuse for their own ends.

David Davis MP

145,481 views • 8 months ago

Introducing HO-Cap: A Capture System and Dataset for 3D Reconstruction and Pose Tracking of Hand-Object Interaction. We built a multi-camera system and a semi-automatic method for annotating the shape and pose of hands and objects Project page:
1:00

Introducing HO-Cap: A Capture System and Dataset for 3D Reconstruction and Pose Tracking of Hand-Object Interaction. We built a multi-camera system and a semi-automatic method for annotating the shape and pose of hands and objects Project page:

Yu Xiang

57,228 views • 1 year ago

Our data belongs to all of us. We need to know how the NHS deals with our data. We need the right to say no. No to sneaky data grabs and no to Palantir 👇
1:23

Our data belongs to all of us. We need to know how the NHS deals with our data. We need the right to say no. No to sneaky data grabs and no to Palantir 👇

Good Law Project

18,470 views • 3 months ago

A dollar in the hands of the worker who earns it is always better than in the hands of the Liberal government that taxed it. Lower taxes and cap spending so workers can earn more, build more, and fix more, in an affordable Canada.
1:01

A dollar in the hands of the worker who earns it is always better than in the hands of the Liberal government that taxed it. Lower taxes and cap spending so workers can earn more, build more, and fix more, in an affordable Canada.

Pierre Poilievre

36,790 views • 1 month ago

'How far do we want to go in allowing the government to keep people's data and use it?' Marcus Johnstone discusses the risk the Online Safety Act poses to Brits' data security.
4:32

'How far do we want to go in allowing the government to keep people's data and use it?' Marcus Johnstone discusses the risk the Online Safety Act poses to Brits' data security.

GB News

16,877 views • 10 months ago

All of this is enabled by fleet scale auto-labelling. By using video data from multiple trips in the same location, we can reconstruct the entire scene
1:14

All of this is enabled by fleet scale auto-labelling. By using video data from multiple trips in the same location, we can reconstruct the entire scene

Tesla AI

232,597 views • 3 years ago

The power to #EndViolence against children is in our hands. We must and have to do it!
1:28

The power to #EndViolence against children is in our hands. We must and have to do it!

Tedros Adhanom Ghebreyesus

42,553 views • 1 year ago

The United States has aggressively attacked seven sovereign countries in the past year, enabled and emboldened by our so-called "leaders" in the European Union every step of the way. No to war! No to American terrorism! Hands off Venezuela!
4:35

The United States has aggressively attacked seven sovereign countries in the past year, enabled and emboldened by our so-called "leaders" in the European Union every step of the way. No to war! No to American terrorism! Hands off Venezuela!

Clare Daly

50,307 views • 5 months ago

The more we learn about the ACA the more it stinks, We have to ask ourselves why would the government want to cap the amount of money we can save in our healthcare account🤔
2:29

The more we learn about the ACA the more it stinks, We have to ask ourselves why would the government want to cap the amount of money we can save in our healthcare account🤔

𝓜𝓐𝓖𝓐 𝕏 𝓣𝓘𝓜𝓔𝓢 𝓓𝓐𝓘𝓛𝓨 𝓝𝓔𝓦𝓢🇺🇸

25,493 views • 7 months ago

PTI has come a long way. In past elections where we were victims of rigging, we demanded investigations. This time we took the data in our hands, studied that data for a week and finished investigation with authentic Form 45 data and manipulated Form 47 data. Good news is that we have 2/3 majority and we can prove it. Findings were presented brilliantly by ShandanaGulzarKhan at the #PTIPressConference today for national and international media. Hats off to all #Form45Avengers , you are always going to be my heroes. #MandateThieves have no place to hide now.
1:17

PTI has come a long way. In past elections where we were victims of rigging, we demanded investigations. This time we took the data in our hands, studied that data for a week and finished investigation with authentic Form 45 data and manipulated Form 47 data. Good news is that we have 2/3 majority and we can prove it. Findings were presented brilliantly by ShandanaGulzarKhan at the #PTIPressConference today for national and international media. Hats off to all #Form45Avengers , you are always going to be my heroes. #MandateThieves have no place to hide now.

Jibran Ilyas

92,982 views • 2 years ago

At Axis, every trajectory submitted by our community undergoes a strict replay validation process. We run each submission through checker to verify whether the target task was successfully completed. To see how strict it is, check this demo (Task: Place The Toy Train On The Board Game Box). Real human data passes smoothly (Video 1). However, bots or manually altered data will fail (Video 2). Why? Faking numbers breaks the simulation's physics causality. Even tiny tweaks cause error accumulation, resulting in failed movements. This invalid data is automatically rejected. Because of this mechanism, data submitted via bots will ultimately fail our replay verification. Invalid data is strictly excluded from model training, and the task slot is reopened to the community to collect genuine, high-quality trajectories. Furthermore, we actively monitor for duplicated data. Trajectories that are identical lack the diversity required for robot learning and will not be credited by our scoring system. If we detect accounts submitting a massive volume of identical trajectories, all associated addresses will be permanently banned. For Axis, the quality and diversity of data are the only ways to solve the robotics generalization gap. They will always be our absolute top priorities.
0:41

At Axis, every trajectory submitted by our community undergoes a strict replay validation process. We run each submission through checker to verify whether the target task was successfully completed. To see how strict it is, check this demo (Task: Place The Toy Train On The Board Game Box). Real human data passes smoothly (Video 1). However, bots or manually altered data will fail (Video 2). Why? Faking numbers breaks the simulation's physics causality. Even tiny tweaks cause error accumulation, resulting in failed movements. This invalid data is automatically rejected. Because of this mechanism, data submitted via bots will ultimately fail our replay verification. Invalid data is strictly excluded from model training, and the task slot is reopened to the community to collect genuine, high-quality trajectories. Furthermore, we actively monitor for duplicated data. Trajectories that are identical lack the diversity required for robot learning and will not be credited by our scoring system. If we detect accounts submitting a massive volume of identical trajectories, all associated addresses will be permanently banned. For Axis, the quality and diversity of data are the only ways to solve the robotics generalization gap. They will always be our absolute top priorities.

Axis Robotics

30,447 views • 2 months ago

(1/2) Introducing annotations in Mixboard! With the annotations tool, you can doodle directly on your board to add or edit elements. Just mark the area, describe it, and watch it appear.
0:24

(1/2) Introducing annotations in Mixboard! With the annotations tool, you can doodle directly on your board to add or edit elements. Just mark the area, describe it, and watch it appear.

Google Labs

60,516 views • 7 months ago

Our message to Mícheál Martin, Simon Harris and Ursula Von der Leyen is clear – hands off Irish neutrality. Now more than ever, we must defend it - and enshrine it in our constitution to ensure no government can discard it without the people’s consent.
1:32

Our message to Mícheál Martin, Simon Harris and Ursula Von der Leyen is clear – hands off Irish neutrality. Now more than ever, we must defend it - and enshrine it in our constitution to ensure no government can discard it without the people’s consent.

Sinn Féin

26,240 views • 1 year ago

According to this woman, we can no longer share our kindness, empathy, and compassion with MAGA folks. When they refuse to acknowledge that our way is the only way, we must cut them from of our lives. This is the most tolerant option.
1:12

According to this woman, we can no longer share our kindness, empathy, and compassion with MAGA folks. When they refuse to acknowledge that our way is the only way, we must cut them from of our lives. This is the most tolerant option.

Dr. Jebra Faushay

204,756 views • 1 year ago

Pioneers, the Revolution Is in Our Hands! 🌏 We are living in a historic moment! Pi Network is not just another cryptocurrency – it is a global movement that can forever transform the world’s financial system. But for this to happen, we must act with intelligence, unity, and determination. We are millions of Pioneers across the planet, connected by a single ideal: building a decentralized, fair, and accessible future for all. No government, bank, or financial elite can dictate the value of Pi. We are the force driving this revolution! The True Value of Pi Is in Our Hands! The GCV of $314,159 is not just a number – it is a symbol of our vision, our confidence, and our mission. Pi is worth what we believe and make happen. If we want to see Pi shine, we must act now: Say NO to exchanges that try to manipulate Pi’s value! Withdraw and protect your coins. Refuse to sell your Pi for unfair prices! We determine its value. Use Pi in real transactions! The more we use it, the stronger it becomes. Spread the word, encourage others, make history! The more people believe, the more powerful it gets. Create scarcity! The harder it is to obtain Pi, the more valuable it will be. The World Is Watching – Let’s Show Them Our Strength! The early days of Bitcoin were filled with uncertainty. Many doubted it. Today, it is a global phenomenon! Now, we stand before an even greater moment: the birth of a cryptocurrency that is truly accessible to all. But Pi’s future will not be written by speculators. It will be written by US! The decision is in our hands. We can allow our dream to be manipulated, or we can change history and make Pi a global powerhouse! If every Pioneer acts with faith, strategy, and commitment, the GCV of $314,159 will not be a wish – it will be an undeniable reality! Together, we are unstoppable! The future is now! I am Sérgio Cruz, the Global GCV Ambassador from Portugal 🇵🇹
3:39

Pioneers, the Revolution Is in Our Hands! 🌏 We are living in a historic moment! Pi Network is not just another cryptocurrency – it is a global movement that can forever transform the world’s financial system. But for this to happen, we must act with intelligence, unity, and determination. We are millions of Pioneers across the planet, connected by a single ideal: building a decentralized, fair, and accessible future for all. No government, bank, or financial elite can dictate the value of Pi. We are the force driving this revolution! The True Value of Pi Is in Our Hands! The GCV of $314,159 is not just a number – it is a symbol of our vision, our confidence, and our mission. Pi is worth what we believe and make happen. If we want to see Pi shine, we must act now: Say NO to exchanges that try to manipulate Pi’s value! Withdraw and protect your coins. Refuse to sell your Pi for unfair prices! We determine its value. Use Pi in real transactions! The more we use it, the stronger it becomes. Spread the word, encourage others, make history! The more people believe, the more powerful it gets. Create scarcity! The harder it is to obtain Pi, the more valuable it will be. The World Is Watching – Let’s Show Them Our Strength! The early days of Bitcoin were filled with uncertainty. Many doubted it. Today, it is a global phenomenon! Now, we stand before an even greater moment: the birth of a cryptocurrency that is truly accessible to all. But Pi’s future will not be written by speculators. It will be written by US! The decision is in our hands. We can allow our dream to be manipulated, or we can change history and make Pi a global powerhouse! If every Pioneer acts with faith, strategy, and commitment, the GCV of $314,159 will not be a wish – it will be an undeniable reality! Together, we are unstoppable! The future is now! I am Sérgio Cruz, the Global GCV Ambassador from Portugal 🇵🇹

Doris Yin 东方紫莲🪷

17,699 views • 1 year ago

Physics-based Motion Retargeting from Sparse Inputs paper page: Avatars are important to create interactive and immersive experiences in virtual worlds. One challenge in animating these characters to mimic a user's motion is that commercial AR/VR products consist only of a headset and controllers, providing very limited sensor data of the user's pose. Another challenge is that an avatar might have a different skeleton structure than a human and the mapping between them is unclear. In this work we address both of these challenges. We introduce a method to retarget motions in real-time from sparse human sensor data to characters of various morphologies. Our method uses reinforcement learning to train a policy to control characters in a physics simulator. We only require human motion capture data for training, without relying on artist-generated animations for each avatar. This allows us to use large motion capture datasets to train general policies that can track unseen users from real and sparse data in real-time. We demonstrate the feasibility of our approach on three characters with different skeleton structure: a dinosaur, a mouse-like creature and a human. We show that the avatar poses often match the user surprisingly well, despite having no sensor information of the lower body available. We discuss and ablate the important components in our framework, specifically the kinematic retargeting step, the imitation, contact and action reward as well as our asymmetric actor-critic observations. We further explore the robustness of our method in a variety of settings including unbalancing, dancing and sports motions.
7:12

Physics-based Motion Retargeting from Sparse Inputs paper page: Avatars are important to create interactive and immersive experiences in virtual worlds. One challenge in animating these characters to mimic a user's motion is that commercial AR/VR products consist only of a headset and controllers, providing very limited sensor data of the user's pose. Another challenge is that an avatar might have a different skeleton structure than a human and the mapping between them is unclear. In this work we address both of these challenges. We introduce a method to retarget motions in real-time from sparse human sensor data to characters of various morphologies. Our method uses reinforcement learning to train a policy to control characters in a physics simulator. We only require human motion capture data for training, without relying on artist-generated animations for each avatar. This allows us to use large motion capture datasets to train general policies that can track unseen users from real and sparse data in real-time. We demonstrate the feasibility of our approach on three characters with different skeleton structure: a dinosaur, a mouse-like creature and a human. We show that the avatar poses often match the user surprisingly well, despite having no sensor information of the lower body available. We discuss and ablate the important components in our framework, specifically the kinematic retargeting step, the imitation, contact and action reward as well as our asymmetric actor-critic observations. We further explore the robustness of our method in a variety of settings including unbalancing, dancing and sports motions.

AK

106,519 views • 3 years ago

AI only exists today because it is trained on real data. The better the data input, The better the AI output. We capture incredibly high-quality raw data of real humans, in 3D, from all angles. You do the Math ✍🏻 Our data can vastly improve and expand the capabilities of AI
1:04

AI only exists today because it is trained on real data. The better the data input, The better the AI output. We capture incredibly high-quality raw data of real humans, in 3D, from all angles. You do the Math ✍🏻 Our data can vastly improve and expand the capabilities of AI

Metahero.io

24,527 views • 2 years ago

Are we witnessing the AI vs. Memes flippening? AI is booming, and altcoins are gaining momentum. According to our data, the surge of attention toward AI began roughly a week ago. As shown in our app, AI-related metrics have now surpassed memes. Check it out in our app: With the recent resurgence of #Ethereum, AI projects are seeing significant growth. Combined with a rise in the altcoin market cap and a strengthening Altcoin Season Index, the first clear and confirmed signs of this shift are here. This is no longer speculation—AI is back in the spotlight. What's your AI Prediction? Is it going to be the lead narrative for #Altcoin run? Or is it an another sector? #ai #memecoins #eth $ETH $SPECT
0:55

Are we witnessing the AI vs. Memes flippening? AI is booming, and altcoins are gaining momentum. According to our data, the surge of attention toward AI began roughly a week ago. As shown in our app, AI-related metrics have now surpassed memes. Check it out in our app: With the recent resurgence of #Ethereum, AI projects are seeing significant growth. Combined with a rise in the altcoin market cap and a strengthening Altcoin Season Index, the first clear and confirmed signs of this shift are here. This is no longer speculation—AI is back in the spotlight. What's your AI Prediction? Is it going to be the lead narrative for #Altcoin run? Or is it an another sector? #ai #memecoins #eth $ETH $SPECT

SPECTRE AI

17,388 views • 1 year ago

Michio Kaku on UFO's: "The data indicates that something is out there that can travel between Mach 5, five times the speed of sound, up to Mach 20." 👽🛸 These objects drop 70,000 to 80,000 feet in seconds and create G-forces in the hundreds of times gravity. "It would crush the bones of any organism that we're familiar with." Kaku concludes they are probably advanced drones exceeding our aircraft capabilities, defying known human limits. Mind blowing physics that challenges everything we understand about technology and flight.
0:49

Michio Kaku on UFO's: "The data indicates that something is out there that can travel between Mach 5, five times the speed of sound, up to Mach 20." 👽🛸 These objects drop 70,000 to 80,000 feet in seconds and create G-forces in the hundreds of times gravity. "It would crush the bones of any organism that we're familiar with." Kaku concludes they are probably advanced drones exceeding our aircraft capabilities, defying known human limits. Mind blowing physics that challenges everything we understand about technology and flight.

Interstellar

108,130 views • 27 days ago