Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

byebye expensive motion tracking equipment 👋 ai makes motion capturing so easy now! nvidia presented GENMO last week, a new model that can generate and estimate human motion from text, audio, video, and 3D keyframes

Dreaming Tulpa 🥓👑

54,918 subscribers

73,693 Aufrufe • vor 1 Jahr •via X (Twitter)

Gesundheit & Wellness Wissenschaft & Technologie Bildung

Anya Rossi• Live Now

Private livecam show

10 Kommentare

Profilbild von PowerBeatsVR

PowerBeatsVRvor 3 Jahren

Get ready for a full-body VR workout that’s fun, fast, and intuitive — Play PowerBeatsVR (Now on Meta Quest) 🔥

Profilbild von Paliesk Debesį

Paliesk Debesįvor 1 Jahr

Is it real time? Would love to use something like this for VR chat.

Profilbild von Adrian Werner

Adrian Wernervor 1 Jahr

It's not going to replace expensive motion tracking for high end production because the fidelity is too low. But it is a cool stuff to have for indie studios. It's not anything new, plenty of such systems are already in use, for example inZOI has inhouse one.

Profilbild von NΞXUS STUDIO ⒶI

NΞXUS STUDIO ⒶIvor 1 Jahr

Awesome, is it possible to generate a tracking shot of a car too?

Profilbild von Atiko 💎

Atiko 💎vor 1 Jahr

Wow

Profilbild von BLENDER SUSHI 🫶 X - 24/7 Blenderian

BLENDER SUSHI 🫶 X - 24/7 Blenderianvor 1 Jahr

Fingers typing behind clothes :)

Profilbild von JSFILMZ

JSFILMZvor 1 Jahr

ai mocap been out for like 5 years

Profilbild von WaveSpeedAI

WaveSpeedAIvor 1 Jahr

Cool!

Profilbild von Jorge

Jorgevor 1 Jahr

some people might complain about "le ai is taking le work" but actually you still gotta know dem moves I've seen people doing mocaps at home and moving really weirdly, with like 3000€ equipment

Profilbild von rey

reyvor 1 Jahr

@grok buddy, wt the hell is going on, I thought this wasn't suppose to come till 2030 ,r we in the singularity already 😂

Ähnliche Videos

AI can synthesize dynamic textures on 3D meshes without UV maps! MeshNCA is a model that can generate dynamic textures from images, text prompts, and motion vector fields.

AI can synthesize dynamic textures on 3D meshes without UV maps! MeshNCA is a model that can generate dynamic textures from images, text prompts, and motion vector fields.

Dreaming Tulpa 🥓👑

79,629 Aufrufe • vor 3 Jahren

The free UE5.5 AI motion capture plugin is compatible with Unity, Blender, and VMC. It supports both real-time motion capture via webcam and video uploads to generate 3D motion data. Powered by a 1-billion-parameter motion model running locally on your computer, it requires 8GB of VRAM for real-time processing. Compatible with Nvidia, AMD, and Intel GPUs, it can leverage NVIDIA CUDA to significantly boost graphics computation efficiency.

The free UE5.5 AI motion capture plugin is compatible with Unity, Blender, and VMC. It supports both real-time motion capture via webcam and video uploads to generate 3D motion data. Powered by a 1-billion-parameter motion model running locally on your computer, it requires 8GB of VRAM for real-time processing. Compatible with Nvidia, AMD, and Intel GPUs, it can leverage NVIDIA CUDA to significantly boost graphics computation efficiency.

CYANPUPPETS

17,842 Aufrufe • vor 1 Jahr

Next-level motion from @HeyGen_Official I got to play with the new AI Motion from HeyGen, and it blew my mind! You generate an image and describe the motion; then, you can generate long videos from that avatar. Sound effects included! 1. Tales from The Heartland

Alex Patrascu

57,728 Aufrufe • vor 1 Jahr

MotionGPT: Human Motion as a Foreign Language paper page: Though the advancement of pre-trained large language models unfolds, the exploration of building a unified model for language and other multi-modal data, such as motion, remains challenging and untouched so far. Fortunately, human motion displays a semantic coupling akin to human language, often perceived as a form of body language. By fusing language data with large-scale motion models, motion-language pre-training that can enhance the performance of motion-related tasks becomes feasible. Driven by this insight, we propose MotionGPT, a unified, versatile, and user-friendly motion-language model to handle multiple motion-relevant tasks. Specifically, we employ the discrete vector quantization for human motion and transfer 3D motion into motion tokens, similar to the generation process of word tokens. Building upon this "motion vocabulary", we perform language modeling on both motion and text in a unified manner, treating human motion as a specific language. Moreover, inspired by prompt learning, we pre-train MotionGPT with a mixture of motion-language data and fine-tune it on prompt-based question-and-answer tasks. Extensive experiments demonstrate that MotionGPT achieves state-of-the-art performances on multiple motion tasks including text-driven motion generation, motion captioning, motion prediction, and motion in-between.

MotionGPT: Human Motion as a Foreign Language paper page: Though the advancement of pre-trained large language models unfolds, the exploration of building a unified model for language and other multi-modal data, such as motion, remains challenging and untouched so far. Fortunately, human motion displays a semantic coupling akin to human language, often perceived as a form of body language. By fusing language data with large-scale motion models, motion-language pre-training that can enhance the performance of motion-related tasks becomes feasible. Driven by this insight, we propose MotionGPT, a unified, versatile, and user-friendly motion-language model to handle multiple motion-relevant tasks. Specifically, we employ the discrete vector quantization for human motion and transfer 3D motion into motion tokens, similar to the generation process of word tokens. Building upon this "motion vocabulary", we perform language modeling on both motion and text in a unified manner, treating human motion as a specific language. Moreover, inspired by prompt learning, we pre-train MotionGPT with a mixture of motion-language data and fine-tune it on prompt-based question-and-answer tasks. Extensive experiments demonstrate that MotionGPT achieves state-of-the-art performances on multiple motion tasks including text-driven motion generation, motion captioning, motion prediction, and motion in-between.

AK

125,403 Aufrufe • vor 3 Jahren

Grok Imagine Video 1.5 is live on AITOPIA. @xAI's latest video model is here. Generate from text or image. Native audio with dialogue, music, and effects. Realistic motion and strong prompt adherence. Try it now →

Grok Imagine Video 1.5 is live on AITOPIA. @xAI's latest video model is here. Generate from text or image. Native audio with dialogue, music, and effects. Realistic motion and strong prompt adherence. Try it now →

AITOPIA

46,050 Aufrufe • vor 4 Monaten

New Open-Source AI Animator: Text-to-Animation for Humans, Animals, Creatures, Robots & More UniMate generates motion from text prompts for rigged 3D characters. Describe an action and turn it into animation. Highlights: • One model, different skeletons—no separate retraining for each rig. • Generate transitions between existing keyframes. • Edit motion with text while keeping selected joints unchanged. • Extend animations with a sequence of prompts. • Export animated meshes as FBX and GLB. • MIT-licensed code + downloadable preview weights.

New Open-Source AI Animator: Text-to-Animation for Humans, Animals, Creatures, Robots & More UniMate generates motion from text prompts for rigged 3D characters. Describe an action and turn it into animation. Highlights: • One model, different skeletons—no separate retraining for each rig. • Generate transitions between existing keyframes. • Edit motion with text while keeping selected joints unchanged. • Extend animations with a sequence of prompts. • Export animated meshes as FBX and GLB. • MIT-licensed code + downloadable preview weights.

Stefan 3D AI

246,714 Aufrufe • vor 1 Monat

Introducing 3D Motion. You can now turn any image into a 3D motion video on Morphic.

Introducing 3D Motion. You can now turn any image into a 3D motion video on Morphic.

Morphic

222,108 Aufrufe • vor 1 Jahr

Text animation and audio are now available in Figma Motion (!!)

Text animation and audio are now available in Figma Motion (!!)

Figma

58,325 Aufrufe • vor 29 Tagen

animators are not needed anymore this 3D AI motion capture plugin can convert character movement from real video to 3D data and.. you can apply the motion to any 3D character.. link in comments

animators are not needed anymore this 3D AI motion capture plugin can convert character movement from real video to 3D data and.. you can apply the motion to any 3D character.. link in comments

el.cine

64,848 Aufrufe • vor 11 Monaten

$3 to create motion graphics that look like a $3,000 After Effects project? That’s Topview Motion Studio. Powered by Seedance 2.5. No timelines. No keyframes. No motion designer required. Just upload your references, describe your idea, pick a style, and generate a polished motion video in minutes. #TopviewAI #AIVideo #AIMotionVideo #AIContentCreation #AIMarketing

$3 to create motion graphics that look like a $3,000 After Effects project? That’s Topview Motion Studio. Powered by Seedance 2.5. No timelines. No keyframes. No motion designer required. Just upload your references, describe your idea, pick a style, and generate a polished motion video in minutes. #TopviewAI #AIVideo #AIMotionVideo #AIContentCreation #AIMarketing

TopviewAI

1,022,648 Aufrufe • vor 2 Monaten

Want to experience humanoid behavior foundation model in your browser? SONIC Web demo now live at Featuring: - Motion tracking - Text to motion using Kimodo Try it out!

Want to experience humanoid behavior foundation model in your browser? SONIC Web demo now live at Featuring: - Motion tracking - Text to motion using Kimodo Try it out!

Zhengyi “Zen” Luo

38,637 Aufrufe • vor 6 Monaten

Splatter a Video can turn a video into a 3D Gaussian representation! This allows for enhanced video tracking, depth prediction, motion and appearance editing, and stereoscopic video generation.

Splatter a Video can turn a video into a 3D Gaussian representation! This allows for enhanced video tracking, depth prediction, motion and appearance editing, and stereoscopic video generation.

Dreaming Tulpa 🥓👑

11,586 Aufrufe • vor 2 Jahren

Excited to share our latest work on 🎧spatial audio-driven human motion generation. We aim to tackle a largely underexplored yet important problem of enabling virtual humans to move naturally in response to spatial audio—capturing not just what is heard, but also where the sound is coming from. To this end, we introduce the Spatial Audio-Driven Human Motion (SAM) dataset—the first comprehensive dataset featuring paired high-quality human motion and spatial audio recordings. For benchmarking, we develop a generative framework for human MOtion generation driven by SPAtial audio, termed MOSPA, which learns to synthesize realistic and diverse human motions conditioned on spatial audio input. We hope this research could provide a foundation for future research in spatial perception, virtual characters, and embodied AI. The dataset and model will be open-sourced soon. A big thank you to our intern, Shuyang Xu, for the wonderful collaboration! Congratulations, Shuyang! Project page: Paper: Video: #Animation #CG #CV #AIGC #DL #Deeplearning #Motion #Graphics #AI #GenerativeAI

Excited to share our latest work on 🎧spatial audio-driven human motion generation. We aim to tackle a largely underexplored yet important problem of enabling virtual humans to move naturally in response to spatial audio—capturing not just what is heard, but also where the sound is coming from. To this end, we introduce the Spatial Audio-Driven Human Motion (SAM) dataset—the first comprehensive dataset featuring paired high-quality human motion and spatial audio recordings. For benchmarking, we develop a generative framework for human MOtion generation driven by SPAtial audio, termed MOSPA, which learns to synthesize realistic and diverse human motions conditioned on spatial audio input. We hope this research could provide a foundation for future research in spatial perception, virtual characters, and embodied AI. The dataset and model will be open-sourced soon. A big thank you to our intern, Shuyang Xu, for the wonderful collaboration! Congratulations, Shuyang! Project page: Paper: Video: #Animation #CG #CV #AIGC #DL #Deeplearning #Motion #Graphics #AI #GenerativeAI

Zhiyang (Frank) Dou

14,728 Aufrufe • vor 1 Jahr

EgoExoMoCap: Distributed Ego-Exo Human Motion Capture ECCV 2026 (Oral) Meta Reality Labs/ETH Zürich With two or more people wearing smart glasses, EgoExoMoCap combines each wearer’s egocentric (Ego) and exocentric (Exo) views to estimate full-body motion. Without bulky multi-camera setups or mocap suits, it reconstructs 3D human motion even under occlusions using head/wrist tracking and DINOv3-based visual features.

EgoExoMoCap: Distributed Ego-Exo Human Motion Capture ECCV 2026 (Oral) Meta Reality Labs/ETH Zürich With two or more people wearing smart glasses, EgoExoMoCap combines each wearer’s egocentric (Ego) and exocentric (Exo) views to estimate full-body motion. Without bulky multi-camera setups or mocap suits, it reconstructs 3D human motion even under occlusions using head/wrist tracking and DINOv3-based visual features.

Ryohei Sasaki@engineer

26,236 Aufrufe • vor 2 Monaten

SpatialTrackerV2: unified, end-to-end 3D point tracking model which simultaneously estimates Camera Motion, Consistent Geometry and Pixel-wise 3D Trajectories.

SpatialTrackerV2: unified, end-to-end 3D point tracking model which simultaneously estimates Camera Motion, Consistent Geometry and Pixel-wise 3D Trajectories.

Bilawal Sidhu

20,346 Aufrufe • vor 1 Jahr

Sonilo has released Sound Effects 1.0, a video-native audio model that can read on-screen motion, scene context, and timing. > It can make sound effects synced to the footage. > Video-to-Sound-Effects runs automatically without requiring a prompt. > Text-to-Sound-Effects is able to generate standalone assets from a written description.

Sonilo has released Sound Effects 1.0, a video-native audio model that can read on-screen motion, scene context, and timing. > It can make sound effects synced to the footage. > Video-to-Sound-Effects runs automatically without requiring a prompt. > Text-to-Sound-Effects is able to generate standalone assets from a written description.

🚨 AI News | TestingCatalog

15,523 Aufrufe • vor 3 Monaten

NVIDIA just revealed MotionBricks, a new AI model trained on more than 350,000 motion clips. What’s really impressive is that the same model can animate a digital character and control a humanoid robot in the real world.

NVIDIA just revealed MotionBricks, a new AI model trained on more than 350,000 motion clips. What’s really impressive is that the same model can animate a digital character and control a humanoid robot in the real world.

Justin Ryan

84,954 Aufrufe • vor 3 Monaten

Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model abs: project page:

Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model abs: project page:

AK

90,089 Aufrufe • vor 3 Jahren