Загрузка видео...

Не удалось загрузить видео

На главную

Adobe presents SynCHMR! A method that can reconstruct camera trajectory, human motion, and scene in one global coordinate from videos 🔥

dreamingtulpa's profile picture

Dreaming Tulpa 🥓👑

54,632 subscribers

108,620 просмотров • 2 лет назад •via X (Twitter)

ОбразованиеНаука и технологииИскусство
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 7

Фото профиля Dreaming Tulpa 🥓👑
Dreaming Tulpa 🥓👑2 лет назад

If you like Tweets like this, you might enjoy my weekly newsletter, #aiartweekly. A free, once–weekly e-mail round-up of the latest AI art news, interviews with artists and useful tools & resources. Join 3500+ subscribers here:

Фото профиля Jules revenue-driven SEO
Jules revenue-driven SEO2 лет назад

What is the use case of this?

Фото профиля Chad
Chad2 лет назад

Code or demo coming soon I hope??

Фото профиля Steve Korshakov
Steve Korshakov2 лет назад

no code?

Фото профиля Yacine Mahdid
Yacine Mahdid2 лет назад

100% thought grandma was about to do some fire parkour

Фото профиля Emīls Geršinskis
Emīls Geršinskis2 лет назад

Adobe is cool only on paper

Фото профиля toni
toni2 лет назад

is this another version of EasyMocap ? utilizing SMPL-X ?

Похожие видео

Bye bye expensive mocap equipment 👋 AiOS is yet another method that can reconstruct human from videos and images! This one also supports hands and facial expressions.
1:01

Bye bye expensive mocap equipment 👋 AiOS is yet another method that can reconstruct human from videos and images! This one also supports hands and facial expressions.

Dreaming Tulpa 🥓👑

59,479 просмотров • 2 лет назад

adobe just released a method that can generate transparent videos from text and images 👀
0:21

adobe just released a method that can generate transparent videos from text and images 👀

Dreaming Tulpa 🥓👑

77,051 просмотров • 1 год назад

Researchers presented Vid2Avatar, a method that creates human avatars from in-the-wild videos via self-supervised scene decomposition. See more: #AI #ArtificialIntelligence #3dart #research
0:22

Sensitive content

Researchers presented Vid2Avatar, a method that creates human avatars from in-the-wild videos via self-supervised scene decomposition. See more: #AI #ArtificialIntelligence #3dart #research

80 LEVEL

247,399 просмотров • 3 лет назад

New Adobe Premiere plug-in that edits podcasts and multi-camera videos automatically
0:42

New Adobe Premiere plug-in that edits podcasts and multi-camera videos automatically

AutoPod

1,019,248 просмотров • 3 лет назад

Let's Check In On MIT's ONE TRILLION FPS (Frames Per Second) Camera. A Camera That Can Film Light In Motion.
1:45

Let's Check In On MIT's ONE TRILLION FPS (Frames Per Second) Camera. A Camera That Can Film Light In Motion.

🔥⭐️Edwin⭐️🔥

223,413 просмотров • 6 месяцев назад

Can we hear what's inside your head? 🧠→🎶 Our new paper in PLOS Biology, led by Jong-Yun Park, presents an AI-based method to reconstruct arbitrary natural sounds directly from a person's brain activity measured with fMRI.
0:30

Can we hear what's inside your head? 🧠→🎶 Our new paper in PLOS Biology, led by Jong-Yun Park, presents an AI-based method to reconstruct arbitrary natural sounds directly from a person's brain activity measured with fMRI.

Yuki Kamitani

10,702 просмотров • 10 месяцев назад

new Loopy model from ByteDance can generate whole videos of realistic face motion from just ONE IMAGE and a SOUND getting that feeling again...
0:45

new Loopy model from ByteDance can generate whole videos of realistic face motion from just ONE IMAGE and a SOUND getting that feeling again...

the real deepfates

305,547 просмотров • 1 год назад

Meta presents Garment3DGen! A method that can stylize the geometry and textures from 2D image and 3D mesh garments, which can be fitted on top of parametric bodies and be simulated 🔥 More examples ⬇️
0:37

Meta presents Garment3DGen! A method that can stylize the geometry and textures from 2D image and 3D mesh garments, which can be fitted on top of parametric bodies and be simulated 🔥 More examples ⬇️

Dreaming Tulpa 🥓👑

157,951 просмотров • 2 лет назад

adobe is cooking a new method that can automatically rig 3D assets by generating joints, skeletons, and skinning weights 👀
0:57

adobe is cooking a new method that can automatically rig 3D assets by generating joints, skeletons, and skinning weights 👀

Dreaming Tulpa 🥓👑

99,404 просмотров • 1 год назад

Want a robot that learns household tasks by watching you? EquiBot is a ✨ generalizable and 🚰 data-efficient method for visuomotor policy learning, robust to changes in object shapes, lighting, and scene makeup, even from just 5 mins of human videos. 🧵↓
0:31

Want a robot that learns household tasks by watching you? EquiBot is a ✨ generalizable and 🚰 data-efficient method for visuomotor policy learning, robust to changes in object shapes, lighting, and scene makeup, even from just 5 mins of human videos. 🧵↓

Jingyun Yang

88,290 просмотров • 1 год назад

🤖Simulation-Ready Human–Scene Interaction Reconstruction🤖 #HSImul3R reconstructs sim-ready 3D human-scene interactions from casual videos with *physics-in-the-loop* that can be directly deployed to humanoids. - Project: - Code:
0:40

🤖Simulation-Ready Human–Scene Interaction Reconstruction🤖 #HSImul3R reconstructs sim-ready 3D human-scene interactions from casual videos with *physics-in-the-loop* that can be directly deployed to humanoids. - Project: - Code:

Ziwei Liu

15,326 просмотров • 2 месяцев назад

Proof that human videos can be converted into context-aware humanoid locomotion. VideoMimic is a real-to-sim-to-real pipeline that reconstructs humans and scenes from video, retargets motion to a humanoid, and trains a single policy in sim immediately deployable on real robots.
1:44

Proof that human videos can be converted into context-aware humanoid locomotion. VideoMimic is a real-to-sim-to-real pipeline that reconstructs humans and scenes from video, retargets motion to a humanoid, and trains a single policy in sim immediately deployable on real robots.

The Humanoid Hub

63,226 просмотров • 1 год назад

Spatio-Temporal Reconstruction Model for Large-Scale Outdoor Scenes Contributions: • We propose STORM, the first feed-forward, self-supervised method for fast and accurate reconstruction of dynamic 3D scenes from sparse, multi-timestep, posed camera images. • Our bottom-up framework aggregates and transforms per-frame 3D Gaussian Splats into a cohesive scene representation, enabling self-supervised motion estimation. Furthermore, we introduce motion tokens that capture common motion primitives and regularize motion predictions, facilitating dynamic motion group segmentation without explicit motion or correspondence supervision. • We present several enhancements for in-the-wild scenarios, including sky modeling, camera exposure inconsistency handling, large novel-view extrapolation, and fine-grained human motions reconstruction, making STORM well-suited for real-world applications.
0:31

Spatio-Temporal Reconstruction Model for Large-Scale Outdoor Scenes Contributions: • We propose STORM, the first feed-forward, self-supervised method for fast and accurate reconstruction of dynamic 3D scenes from sparse, multi-timestep, posed camera images. • Our bottom-up framework aggregates and transforms per-frame 3D Gaussian Splats into a cohesive scene representation, enabling self-supervised motion estimation. Furthermore, we introduce motion tokens that capture common motion primitives and regularize motion predictions, facilitating dynamic motion group segmentation without explicit motion or correspondence supervision. • We present several enhancements for in-the-wild scenarios, including sky modeling, camera exposure inconsistency handling, large novel-view extrapolation, and fine-grained human motions reconstruction, making STORM well-suited for real-world applications.

MrNeRF

53,292 просмотров • 1 год назад

Nvidia presents DreamDojo A Generalist Robot World Model from Large-Scale Human Videos
1:21

Nvidia presents DreamDojo A Generalist Robot World Model from Large-Scale Human Videos

AK

38,690 просмотров • 4 месяцев назад

📢📢📢 Excited to share our new work *Autonomous Character-Scene Interaction Synthesis from Text Instruction* (Siggraph Asia 24). It presents a unified model for flexible scene-conditioned motion generation given text, scene, trajectory conditions. The results with smooth interaction look very impressive! 📰Paper: Project: Code and data will be released soon.
6:34

📢📢📢 Excited to share our new work *Autonomous Character-Scene Interaction Synthesis from Text Instruction* (Siggraph Asia 24). It presents a unified model for flexible scene-conditioned motion generation given text, scene, trajectory conditions. The results with smooth interaction look very impressive! 📰Paper: Project: Code and data will be released soon.

Siyuan Huang

11,340 просмотров • 1 год назад

Motion cues from human videos + Reasoning from VLMs enables 3D hand trajectory prediction in-the-wild for novel tasks in novel scenes! Very excited to share the EgoMan project, a huge effort led by Mingfei Chen during an internship with us at Meta. Video summary ⬇️
3:17

Motion cues from human videos + Reasoning from VLMs enables 3D hand trajectory prediction in-the-wild for novel tasks in novel scenes! Very excited to share the EgoMan project, a huge effort led by Mingfei Chen during an internship with us at Meta. Video summary ⬇️

Homanga Bharadhwaj @ CVPR

10,506 просмотров • 5 месяцев назад