Загрузка видео...

Не удалось загрузить видео

Возникла проблема при загрузке этого видео. Это может быть связано с временными проблемами сети или видео может быть недоступно.

На главную

"A Generative Motion Rig for Artist Driven Motion Authoring" from Disney Research Zurich and ETH Zurich So cool! Full video: Paper:

Chris Offner

4,781 subscribers

38,126 просмотров • 3 месяцев назад •via X (Twitter)

Искусство Наука и технологии Образование

Anya Rossi• Live Now

Private livecam show

Комментарии: 9

Фото профиля Yun

Yun3 месяцев назад

what a beautiful work 🥸

Фото профиля Edmond

Edmond3 месяцев назад

so where's the plugin?

Фото профиля Bounty Hunter

Bounty Hunter3 месяцев назад

Amazing work ! Is it open source ?

Фото профиля SNDAYS

SNDAYS3 месяцев назад

@sidefx

Фото профиля Stüssy Senik

Stüssy Senik3 месяцев назад

Wow, this is exciting!! Very organic motion.

Фото профиля AmyNote

AmyNote3 месяцев назад

Framing this as a rig instead of a text-to-motion box is the actual unlock — the bottleneck was never generation quality, it was giving artists a handle they can iterate against like any other slider.

Фото профиля Dungeon Fox

Dungeon Fox3 месяцев назад

oh hey this is pretty much the method I use but I have a sparse to dense processor in-between. really realizing the faults of using AI and Hardware that steals data...meh will be nice to eventually use technology to track down every instance.

Фото профиля AI Mastery Guide

AI Mastery Guide3 месяцев назад

Sampling different motions like that gives artists so much more control

Фото профиля StudioGaltMocap

StudioGaltMocap3 месяцев назад

Would to see if this could be used to transition with sign language animations. Most inbetweening systems are still quite robotic.

Похожие видео

badminton robot from ETH Zurich

badminton robot from ETH Zurich

pfung

229,466 просмотров • 1 год назад

Synthesia research releases HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motion a 4D dynamic neural scene representation that captures full-body appearance in motion from multi-view video input, and enables playback from novel, unseen viewpoints project page: paper page:

Synthesia research releases HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motion a 4D dynamic neural scene representation that captures full-body appearance in motion from multi-view video input, and enables playback from novel, unseen viewpoints project page: paper page:

AK

160,787 просмотров • 3 лет назад

$Example-based Motion Synthesis via Generative Motion Matching paper page: present GenMM, a generative model that "mines" as many diverse motions as possible from a single or few example sequences. In stark contrast to existing data-driven methods, which typically require long offline training time, are prone to visual artifacts, and tend to fail on large and complex skeletons, GenMM inherits the training-free nature and the superior quality of the well-known Motion Matching method. GenMM can synthesize a high-quality motion within a fraction of a second, even with highly complex and large skeletal structures. At the heart of our generative framework lies the generative motion matching module, which utilizes the bidirectional visual similarity as a generative cost function to motion matching, and operates in a multi-stage framework to progressively refine a random guess using exemplar motion matches. In addition to diverse motion generation, we show the versatility of our generative framework by extending it to a number of scenarios that are not possible with motion matching alone, including motion completion, key frame-guided generation, infinite looping, and motion reassembly.$

Example-based Motion Synthesis via Generative Motion Matching paper page: present GenMM, a generative model that "mines" as many diverse motions as possible from a single or few example sequences. In stark contrast to existing data-driven methods, which typically require long offline training time, are prone to visual artifacts, and tend to fail on large and complex skeletons, GenMM inherits the training-free nature and the superior quality of the well-known Motion Matching method. GenMM can synthesize a high-quality motion within a fraction of a second, even with highly complex and large skeletal structures. At the heart of our generative framework lies the generative motion matching module, which utilizes the bidirectional visual similarity as a generative cost function to motion matching, and operates in a multi-stage framework to progressively refine a random guess using exemplar motion matches. In addition to diverse motion generation, we show the versatility of our generative framework by extending it to a number of scenarios that are not possible with motion matching alone, including motion completion, key frame-guided generation, infinite looping, and motion reassembly.

AK

93,773 просмотров • 3 лет назад

Excited to share our latest work on 🎧spatial audio-driven human motion generation. We aim to tackle a largely underexplored yet important problem of enabling virtual humans to move naturally in response to spatial audio—capturing not just what is heard, but also where the sound is coming from. To this end, we introduce the Spatial Audio-Driven Human Motion (SAM) dataset—the first comprehensive dataset featuring paired high-quality human motion and spatial audio recordings. For benchmarking, we develop a generative framework for human MOtion generation driven by SPAtial audio, termed MOSPA, which learns to synthesize realistic and diverse human motions conditioned on spatial audio input. We hope this research could provide a foundation for future research in spatial perception, virtual characters, and embodied AI. The dataset and model will be open-sourced soon. A big thank you to our intern, Shuyang Xu, for the wonderful collaboration! Congratulations, Shuyang! Project page: Paper: Video: #Animation #CG #CV #AIGC #DL #Deeplearning #Motion #Graphics #AI #GenerativeAI

Excited to share our latest work on 🎧spatial audio-driven human motion generation. We aim to tackle a largely underexplored yet important problem of enabling virtual humans to move naturally in response to spatial audio—capturing not just what is heard, but also where the sound is coming from. To this end, we introduce the Spatial Audio-Driven Human Motion (SAM) dataset—the first comprehensive dataset featuring paired high-quality human motion and spatial audio recordings. For benchmarking, we develop a generative framework for human MOtion generation driven by SPAtial audio, termed MOSPA, which learns to synthesize realistic and diverse human motions conditioned on spatial audio input. We hope this research could provide a foundation for future research in spatial perception, virtual characters, and embodied AI. The dataset and model will be open-sourced soon. A big thank you to our intern, Shuyang Xu, for the wonderful collaboration! Congratulations, Shuyang! Project page: Paper: Video: #Animation #CG #CV #AIGC #DL #Deeplearning #Motion #Graphics #AI #GenerativeAI

Zhiyang (Frank) Dou

14,728 просмотров • 1 год назад

A new paper by Disney Research introduces a 2-stage technique for motion tracking in physics-based character animation, using a pretrained latent space and RL to control diverse and unseen motions on both virtual and real-world humanoid robots. Paper:

A new paper by Disney Research introduces a 2-stage technique for motion tracking in physics-based character animation, using a pretrained latent space and RL to control diverse and unseen motions on both virtual and real-world humanoid robots. Paper:

The Humanoid Hub

20,117 просмотров • 2 лет назад

Fully Funded Master's at ETH Zurich Switzerland 🇨🇭

Fully Funded Master's at ETH Zurich Switzerland 🇨🇭

Ghost 👨🏽‍💻🇨🇦

35,346 просмотров • 6 месяцев назад

Transformer robot is now opening doors for you! ETH Zürich @swiss_mile D-MAVT, ETH Zurich Full video: Authors: Clemens Schwarke, Victor Klemm, Matthijs van der Boon, Marko Bjelonic, and Marco Hutter #robotics #ai #reinforcementlearning #ethzurich

Transformer robot is now opening doors for you! ETH Zürich @swiss_mile D-MAVT, ETH Zurich Full video: Authors: Clemens Schwarke, Victor Klemm, Matthijs van der Boon, Marko Bjelonic, and Marco Hutter #robotics #ai #reinforcementlearning #ethzurich

Robotic Systems Lab

105,598 просмотров • 3 лет назад

$Check out the online demo for #OpenNeRF ✨ ➡️ 🚀 📄Paper: 👩‍💻Code: 📽️ Project: \w Federico Tombari Marc Pollefeys Michael Niemeyer et al. ICLR ETH Zurich ETH AI Center Google AI$

Check out the online demo for #OpenNeRF ✨ ➡️ 🚀 📄Paper: 👩‍💻Code: 📽️ Project: \w Federico Tombari Marc Pollefeys Michael Niemeyer et al. ICLR ETH Zurich ETH AI Center Google AI

Francis Engelmann

23,670 просмотров • 2 лет назад

POV: We make a cool Motion video for your company

POV: We make a cool Motion video for your company

Aizal Khan

28,557 просмотров • 1 месяц назад

From live video to 3D avatar in seconds. This #SIGGRAPH2025 paper from Adobe Research reconstructs a realistic head avatar on the fly, with no pre-cached data, and adapts seamlessly to facial motion for VR, animation, and online communication. 🔗

Adobe Research

29,286 просмотров • 1 год назад

RobotMDM, by Disney Research, combines diffusion-based motion generation with RL to produce physics-aware humanoid motions from text prompts. Trained on human motion data with a reward surrogate for physical feasibility, it ensures realistic motions.

RobotMDM, by Disney Research, combines diffusion-based motion generation with RL to produce physics-aware humanoid motions from text prompts. Trained on human motion data with a reward surrogate for physical feasibility, it ensures realistic motions.

The Humanoid Hub

22,943 просмотров • 2 лет назад

Generative video is dope but AI motion capture is just as cool. Pretty much James Cameron ish in your living room — and that too with just a 2D camera

Generative video is dope but AI motion capture is just as cool. Pretty much James Cameron ish in your living room — and that too with just a 2D camera

Bilawal Sidhu

89,178 просмотров • 2 лет назад

What is missing to bring real-time motion research into AAA games and real-world robotics? We present MotionBricks, a step toward bridging this gap with two key components: - a single generative latent motion backbone covering 350,000+ motion skills, running at 15,000 FPS with 2 ms latency and substantially improved quality and reliability. - a unified smart primitive interface for locomotion, object / scene interaction, with fine-grained control over generated behaviors. Webpage: Code: Paper: (ACM TOG / SIGGRAPH 2026)

What is missing to bring real-time motion research into AAA games and real-world robotics? We present MotionBricks, a step toward bridging this gap with two key components: - a single generative latent motion backbone covering 350,000+ motion skills, running at 15,000 FPS with 2 ms latency and substantially improved quality and reliability. - a unified smart primitive interface for locomotion, object / scene interaction, with fine-grained control over generated behaviors. Webpage: Code: Paper: (ACM TOG / SIGGRAPH 2026)

tingwu.wang

154,882 просмотров • 6 месяцев назад

MotionGPT: Human Motion as a Foreign Language paper page: Though the advancement of pre-trained large language models unfolds, the exploration of building a unified model for language and other multi-modal data, such as motion, remains challenging and untouched so far. Fortunately, human motion displays a semantic coupling akin to human language, often perceived as a form of body language. By fusing language data with large-scale motion models, motion-language pre-training that can enhance the performance of motion-related tasks becomes feasible. Driven by this insight, we propose MotionGPT, a unified, versatile, and user-friendly motion-language model to handle multiple motion-relevant tasks. Specifically, we employ the discrete vector quantization for human motion and transfer 3D motion into motion tokens, similar to the generation process of word tokens. Building upon this "motion vocabulary", we perform language modeling on both motion and text in a unified manner, treating human motion as a specific language. Moreover, inspired by prompt learning, we pre-train MotionGPT with a mixture of motion-language data and fine-tune it on prompt-based question-and-answer tasks. Extensive experiments demonstrate that MotionGPT achieves state-of-the-art performances on multiple motion tasks including text-driven motion generation, motion captioning, motion prediction, and motion in-between.

MotionGPT: Human Motion as a Foreign Language paper page: Though the advancement of pre-trained large language models unfolds, the exploration of building a unified model for language and other multi-modal data, such as motion, remains challenging and untouched so far. Fortunately, human motion displays a semantic coupling akin to human language, often perceived as a form of body language. By fusing language data with large-scale motion models, motion-language pre-training that can enhance the performance of motion-related tasks becomes feasible. Driven by this insight, we propose MotionGPT, a unified, versatile, and user-friendly motion-language model to handle multiple motion-relevant tasks. Specifically, we employ the discrete vector quantization for human motion and transfer 3D motion into motion tokens, similar to the generation process of word tokens. Building upon this "motion vocabulary", we perform language modeling on both motion and text in a unified manner, treating human motion as a specific language. Moreover, inspired by prompt learning, we pre-train MotionGPT with a mixture of motion-language data and fine-tune it on prompt-based question-and-answer tasks. Extensive experiments demonstrate that MotionGPT achieves state-of-the-art performances on multiple motion tasks including text-driven motion generation, motion captioning, motion prediction, and motion in-between.

AK

125,403 просмотров • 3 лет назад

Happy new week. A fountain and a part of the Swiss alps at the end. Switzerland - Zurich - Lake Zurich

Happy new week. A fountain and a part of the Swiss alps at the end. Switzerland - Zurich - Lake Zurich

Nicole Zierer

51,572 просмотров • 1 год назад

Forza Motorsport Fujimi Kaido PSR Full Motion Sim Rig

Forza Motorsport Fujimi Kaido PSR Full Motion Sim Rig

Virtual Motorsports Studio

30,245 просмотров • 1 год назад