Loading video...

Video Failed to Load

Go Home

Implementing motion imitation methods involves lots of nuisances. Not many codebases get all the details right. So, we're excited to release MimicKit! A framework with high quality implementations of our methods: DeepMimic, AMP, ASE, ADD, and more to come!

xbpeng4's profile picture

Jason Peng

6,257 subscribers

169,418 views • 9 months ago •via X (Twitter)

Science & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Burkina Faso adopts new methods of road construction which involves putting bags of sand on the road. It is described by most, as the Japanese methods. The state is implementing it in rural areas and side roads..
2:43

Burkina Faso adopts new methods of road construction which involves putting bags of sand on the road. It is described by most, as the Japanese methods. The state is implementing it in rural areas and side roads..

Sahel Revolutionary Soldier

26,722 views • 1 year ago

Example-based Motion Synthesis via Generative Motion Matching paper page: present GenMM, a generative model that "mines" as many diverse motions as possible from a single or few example sequences. In stark contrast to existing data-driven methods, which typically require long offline training time, are prone to visual artifacts, and tend to fail on large and complex skeletons, GenMM inherits the training-free nature and the superior quality of the well-known Motion Matching method. GenMM can synthesize a high-quality motion within a fraction of a second, even with highly complex and large skeletal structures. At the heart of our generative framework lies the generative motion matching module, which utilizes the bidirectional visual similarity as a generative cost function to motion matching, and operates in a multi-stage framework to progressively refine a random guess using exemplar motion matches. In addition to diverse motion generation, we show the versatility of our generative framework by extending it to a number of scenarios that are not possible with motion matching alone, including motion completion, key frame-guided generation, infinite looping, and motion reassembly.
5:56

Example-based Motion Synthesis via Generative Motion Matching paper page: present GenMM, a generative model that "mines" as many diverse motions as possible from a single or few example sequences. In stark contrast to existing data-driven methods, which typically require long offline training time, are prone to visual artifacts, and tend to fail on large and complex skeletons, GenMM inherits the training-free nature and the superior quality of the well-known Motion Matching method. GenMM can synthesize a high-quality motion within a fraction of a second, even with highly complex and large skeletal structures. At the heart of our generative framework lies the generative motion matching module, which utilizes the bidirectional visual similarity as a generative cost function to motion matching, and operates in a multi-stage framework to progressively refine a random guess using exemplar motion matches. In addition to diverse motion generation, we show the versatility of our generative framework by extending it to a number of scenarios that are not possible with motion matching alone, including motion completion, key frame-guided generation, infinite looping, and motion reassembly.

AK

93,694 views • 3 years ago

We're excited to partner with Multiply Labs. Their cutting edge technology will bolster our efforts to add 10 years to healthy human lifespan. Read the press release for more details:
0:30

We're excited to partner with Multiply Labs. Their cutting edge technology will bolster our efforts to add 10 years to healthy human lifespan. Read the press release for more details:

Retro Biosciences

10,463 views • 2 years ago

We cannot air condition our way out of the heat crisis. Many cooling methods add planet warming emissions, in-turn increasing cooling demand. But solutions exist to make cooling more sustainable & affordable: #COP30
1:00

We cannot air condition our way out of the heat crisis. Many cooling methods add planet warming emissions, in-turn increasing cooling demand. But solutions exist to make cooling more sustainable & affordable: #COP30

UN Environment Programme

12,095 views • 7 months ago

We're so excited to share the first details with you about our new event - SideQuest: A Little Off-season Adventure! January 1st - 5th, 2025, near Minneapolis, MN! Check out some details in this thread, with many more to come. Make sure you're subscribed to the newsletter!
0:28

We're so excited to share the first details with you about our new event - SideQuest: A Little Off-season Adventure! January 1st - 5th, 2025, near Minneapolis, MN! Check out some details in this thread, with many more to come. Make sure you're subscribed to the newsletter!

CAPCon

104,854 views • 1 year ago

The North Western Modelers are VERY excited to announce our summer show will take place at the Railroad Museum of Pennsylvania in Strasburg, PA on July 26th and 27th to celebrate 25 Years of Thomas & The Magic Railroad! There's LOTS more details to come, so stay tuned!
0:49

The North Western Modelers are VERY excited to announce our summer show will take place at the Railroad Museum of Pennsylvania in Strasburg, PA on July 26th and 27th to celebrate 25 Years of Thomas & The Magic Railroad! There's LOTS more details to come, so stay tuned!

North Western Modelers

45,094 views • 1 year ago

Introducing ConceptAttention, an approach to interpreting diffusion transformer models! Write a prompt, choose some concepts, generate an image, and get high-quality heatmaps of text concepts. Our method outperforms existing methods like cross attention. Link to demo 👇
0:30

Introducing ConceptAttention, an approach to interpreting diffusion transformer models! Write a prompt, choose some concepts, generate an image, and get high-quality heatmaps of text concepts. Our method outperforms existing methods like cross attention. Link to demo 👇

Alec Helbling

36,644 views • 1 year ago

Loopy Taming Audio-Driven Portrait Avatar with Long-Term Motion Dependency paper page: With the introduction of diffusion-based video generation techniques, audio-conditioned human video generation has recently achieved significant breakthroughs in both the naturalness of motion and the synthesis of portrait details. Due to the limited control of audio signals in driving human motion, existing methods often add auxiliary spatial signals to stabilize movements, which may compromise the naturalness and freedom of motion. In this paper, we propose an end-to-end audio-only conditioned video diffusion model named Loopy. Specifically, we designed an inter- and intra-clip temporal module and an audio-to-latents module, enabling the model to leverage long-term motion information from the data to learn natural motion patterns and improving audio-portrait movement correlation. This method removes the need for manually specified spatial motion templates used in existing methods to constrain motion during inference. Extensive experiments show that Loopy outperforms recent audio-driven portrait diffusion models, delivering more lifelike and high-quality results across various scenarios.
0:45

Loopy Taming Audio-Driven Portrait Avatar with Long-Term Motion Dependency paper page: With the introduction of diffusion-based video generation techniques, audio-conditioned human video generation has recently achieved significant breakthroughs in both the naturalness of motion and the synthesis of portrait details. Due to the limited control of audio signals in driving human motion, existing methods often add auxiliary spatial signals to stabilize movements, which may compromise the naturalness and freedom of motion. In this paper, we propose an end-to-end audio-only conditioned video diffusion model named Loopy. Specifically, we designed an inter- and intra-clip temporal module and an audio-to-latents module, enabling the model to leverage long-term motion information from the data to learn natural motion patterns and improving audio-portrait movement correlation. This method removes the need for manually specified spatial motion templates used in existing methods to constrain motion during inference. Extensive experiments show that Loopy outperforms recent audio-driven portrait diffusion models, delivering more lifelike and high-quality results across various scenarios.

AK

128,803 views • 1 year ago

In line with this year's #WorldFoodSafetyDay theme of "Science in action," here's how we partner with a third party laboratory to apply scientific rigour to our testing methods and build trust in the safety and quality of food products in our stores.
2:26

In line with this year's #WorldFoodSafetyDay theme of "Science in action," here's how we partner with a third party laboratory to apply scientific rigour to our testing methods and build trust in the safety and quality of food products in our stores.

Massmart

51,462 views • 1 year ago

Introducing: LetzAI V4. We're excited to release the newest version of LetzAI with Video Models, a new Image Editor, a new Upscaler, an improved LetzAI Chat, and a better UI. All at $0.01 per high-quality image. Create what you love.
1:23

Introducing: LetzAI V4. We're excited to release the newest version of LetzAI with Video Models, a new Image Editor, a new Upscaler, an improved LetzAI Chat, and a better UI. All at $0.01 per high-quality image. Create what you love.

LetzAI

112,913 views • 9 months ago

There are many ways to collect high-quality data. GenRobot seems to be closer to human-like methods. It uses a wearable exoskeleton robotic hand: a person simply wears the Gen DAS Dex and can flexibly complete various tasks, while simultaneously capturing the entire human motion trajectory and converting it into high-quality data for use by the humanoid robot. >23 degrees of freedom omnidirectional hand capture with millimeter-level precision >Tactile and visual fusion >Sub-millisecond head-hand synchronization
1:33

There are many ways to collect high-quality data. GenRobot seems to be closer to human-like methods. It uses a wearable exoskeleton robotic hand: a person simply wears the Gen DAS Dex and can flexibly complete various tasks, while simultaneously capturing the entire human motion trajectory and converting it into high-quality data for use by the humanoid robot. >23 degrees of freedom omnidirectional hand capture with millimeter-level precision >Tactile and visual fusion >Sub-millisecond head-hand synchronization

CyberRobo

18,098 views • 3 months ago

Motion Shooting: last week of summer access for us quarter schools. Excited about our improvement and commitment to excellence. Lots to work on. Screening, spacing, and work without the ball need to get better but love our trajectory. Lots of weapons. #GrowthMindset #GoBruins
1:33

Motion Shooting: last week of summer access for us quarter schools. Excited about our improvement and commitment to excellence. Lots to work on. Screening, spacing, and work without the ball need to get better but love our trajectory. Lots of weapons. #GrowthMindset #GoBruins

Cori Close

48,920 views • 1 year ago

'The BANNING of Russian oil, these are NEOCOLONIAL methods' — Russian FM Lavrov 'Methods to exploit others, not everyone caves in to such pressure' A sneak peek at India, Russia & the World exclusive interview
1:28

'The BANNING of Russian oil, these are NEOCOLONIAL methods' — Russian FM Lavrov 'Methods to exploit others, not everyone caves in to such pressure' A sneak peek at India, Russia & the World exclusive interview

RT

14,382 views • 1 month ago

Excited to share this demo video of Vincent! Check out the user-owned AI framework in action and get a glimpse of how you can take control of AI. Full blog post with more details in the replies! 👇
1:47

Excited to share this demo video of Vincent! Check out the user-owned AI framework in action and get a glimpse of how you can take control of AI. Full blog post with more details in the replies! 👇

David Sneider 🎆

16,716 views • 1 year ago

WE'RE IN A HIGH ALERT. SO MANY ABDUCTIONS HAPPENING TO YOUNG GIRLS AND WOMEN! REDMAN, LEGENDARY HIP HOP ARTIST IS SOUNDING THE ALARM. HE IS GIVING ADVICE FOR ALL OF YOU TO SHARE WITH YOUR CHILDREN AND FOR WOMEN AND MEN. THERE IS MORE THAN EPSTEIN HAPPENING! LOTS OF BAD GUYS HERE
5:21

WE'RE IN A HIGH ALERT. SO MANY ABDUCTIONS HAPPENING TO YOUNG GIRLS AND WOMEN! REDMAN, LEGENDARY HIP HOP ARTIST IS SOUNDING THE ALARM. HE IS GIVING ADVICE FOR ALL OF YOU TO SHARE WITH YOUR CHILDREN AND FOR WOMEN AND MEN. THERE IS MORE THAN EPSTEIN HAPPENING! LOTS OF BAD GUYS HERE

Peggy Dodson

451,551 views • 11 months ago

Little in depth showing of current quality suits! So many improvements since 2023, and so many more to come!!
3:29

Little in depth showing of current quality suits! So many improvements since 2023, and so many more to come!!

Lily Moon suits

15,147 views • 8 months ago

We're building a UI Engineering team at Shopify. If high quality design translation, motion, and implementation polish is what you're all about, DM Tasha A. to get the conversation started. More detail in the video 👇🏻
2:18

We're building a UI Engineering team at Shopify. If high quality design translation, motion, and implementation polish is what you're all about, DM Tasha A. to get the conversation started. More detail in the video 👇🏻

Derek Briggs

82,168 views • 5 months ago