Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Adobe presents SynCHMR! A method that can reconstruct camera trajectory, human motion, and scene in one global coordinate from videos 🔥

dreamingtulpa's profile picture

Dreaming Tulpa 🥓👑

54,632 subscribers

108,620 Aufrufe • vor 2 Jahren •via X (Twitter)

BildungWissenschaft & TechnologieKunst
LIVE

Anya Rossi• Live Now

Private livecam show

7 Kommentare

Profilbild von Dreaming Tulpa 🥓👑
Dreaming Tulpa 🥓👑vor 2 Jahren

If you like Tweets like this, you might enjoy my weekly newsletter, #aiartweekly. A free, once–weekly e-mail round-up of the latest AI art news, interviews with artists and useful tools & resources. Join 3500+ subscribers here:

Profilbild von Jules revenue-driven SEO
Jules revenue-driven SEOvor 2 Jahren

What is the use case of this?

Profilbild von Chad
Chadvor 2 Jahren

Code or demo coming soon I hope??

Profilbild von Steve Korshakov
Steve Korshakovvor 2 Jahren

no code?

Profilbild von Yacine Mahdid
Yacine Mahdidvor 2 Jahren

100% thought grandma was about to do some fire parkour

Profilbild von Emīls Geršinskis
Emīls Geršinskisvor 2 Jahren

Adobe is cool only on paper

Profilbild von toni
tonivor 2 Jahren

is this another version of EasyMocap ? utilizing SMPL-X ?

Ähnliche Videos

Bye bye expensive mocap equipment 👋 AiOS is yet another method that can reconstruct human from videos and images! This one also supports hands and facial expressions.
1:01

Bye bye expensive mocap equipment 👋 AiOS is yet another method that can reconstruct human from videos and images! This one also supports hands and facial expressions.

Dreaming Tulpa 🥓👑

59,479 Aufrufe • vor 2 Jahren

adobe just released a method that can generate transparent videos from text and images 👀
0:21

adobe just released a method that can generate transparent videos from text and images 👀

Dreaming Tulpa 🥓👑

77,051 Aufrufe • vor 1 Jahr

Researchers presented Vid2Avatar, a method that creates human avatars from in-the-wild videos via self-supervised scene decomposition. See more: #AI #ArtificialIntelligence #3dart #research
0:22

Sensitive content

Researchers presented Vid2Avatar, a method that creates human avatars from in-the-wild videos via self-supervised scene decomposition. See more: #AI #ArtificialIntelligence #3dart #research

80 LEVEL

247,399 Aufrufe • vor 3 Jahren

New Adobe Premiere plug-in that edits podcasts and multi-camera videos automatically
0:42

New Adobe Premiere plug-in that edits podcasts and multi-camera videos automatically

AutoPod

1,019,248 Aufrufe • vor 3 Jahren

Let's Check In On MIT's ONE TRILLION FPS (Frames Per Second) Camera. A Camera That Can Film Light In Motion.
1:45

Let's Check In On MIT's ONE TRILLION FPS (Frames Per Second) Camera. A Camera That Can Film Light In Motion.

🔥⭐️Edwin⭐️🔥

223,413 Aufrufe • vor 6 Monaten

Can we hear what's inside your head? 🧠→🎶 Our new paper in PLOS Biology, led by Jong-Yun Park, presents an AI-based method to reconstruct arbitrary natural sounds directly from a person's brain activity measured with fMRI.
0:30

Can we hear what's inside your head? 🧠→🎶 Our new paper in PLOS Biology, led by Jong-Yun Park, presents an AI-based method to reconstruct arbitrary natural sounds directly from a person's brain activity measured with fMRI.

Yuki Kamitani

10,702 Aufrufe • vor 10 Monaten

new Loopy model from ByteDance can generate whole videos of realistic face motion from just ONE IMAGE and a SOUND getting that feeling again...
0:45

new Loopy model from ByteDance can generate whole videos of realistic face motion from just ONE IMAGE and a SOUND getting that feeling again...

the real deepfates

305,547 Aufrufe • vor 1 Jahr

Meta presents Garment3DGen! A method that can stylize the geometry and textures from 2D image and 3D mesh garments, which can be fitted on top of parametric bodies and be simulated 🔥 More examples ⬇️
0:37

Meta presents Garment3DGen! A method that can stylize the geometry and textures from 2D image and 3D mesh garments, which can be fitted on top of parametric bodies and be simulated 🔥 More examples ⬇️

Dreaming Tulpa 🥓👑

157,951 Aufrufe • vor 2 Jahren

adobe is cooking a new method that can automatically rig 3D assets by generating joints, skeletons, and skinning weights 👀
0:57

adobe is cooking a new method that can automatically rig 3D assets by generating joints, skeletons, and skinning weights 👀

Dreaming Tulpa 🥓👑

99,404 Aufrufe • vor 1 Jahr

Want a robot that learns household tasks by watching you? EquiBot is a ✨ generalizable and 🚰 data-efficient method for visuomotor policy learning, robust to changes in object shapes, lighting, and scene makeup, even from just 5 mins of human videos. 🧵↓
0:31

Want a robot that learns household tasks by watching you? EquiBot is a ✨ generalizable and 🚰 data-efficient method for visuomotor policy learning, robust to changes in object shapes, lighting, and scene makeup, even from just 5 mins of human videos. 🧵↓

Jingyun Yang

88,290 Aufrufe • vor 1 Jahr

🤖Simulation-Ready Human–Scene Interaction Reconstruction🤖 #HSImul3R reconstructs sim-ready 3D human-scene interactions from casual videos with *physics-in-the-loop* that can be directly deployed to humanoids. - Project: - Code:
0:40

🤖Simulation-Ready Human–Scene Interaction Reconstruction🤖 #HSImul3R reconstructs sim-ready 3D human-scene interactions from casual videos with *physics-in-the-loop* that can be directly deployed to humanoids. - Project: - Code:

Ziwei Liu

15,326 Aufrufe • vor 2 Monaten

Proof that human videos can be converted into context-aware humanoid locomotion. VideoMimic is a real-to-sim-to-real pipeline that reconstructs humans and scenes from video, retargets motion to a humanoid, and trains a single policy in sim immediately deployable on real robots.
1:44

Proof that human videos can be converted into context-aware humanoid locomotion. VideoMimic is a real-to-sim-to-real pipeline that reconstructs humans and scenes from video, retargets motion to a humanoid, and trains a single policy in sim immediately deployable on real robots.

The Humanoid Hub

63,226 Aufrufe • vor 1 Jahr

Spatio-Temporal Reconstruction Model for Large-Scale Outdoor Scenes Contributions: • We propose STORM, the first feed-forward, self-supervised method for fast and accurate reconstruction of dynamic 3D scenes from sparse, multi-timestep, posed camera images. • Our bottom-up framework aggregates and transforms per-frame 3D Gaussian Splats into a cohesive scene representation, enabling self-supervised motion estimation. Furthermore, we introduce motion tokens that capture common motion primitives and regularize motion predictions, facilitating dynamic motion group segmentation without explicit motion or correspondence supervision. • We present several enhancements for in-the-wild scenarios, including sky modeling, camera exposure inconsistency handling, large novel-view extrapolation, and fine-grained human motions reconstruction, making STORM well-suited for real-world applications.
0:31

Spatio-Temporal Reconstruction Model for Large-Scale Outdoor Scenes Contributions: • We propose STORM, the first feed-forward, self-supervised method for fast and accurate reconstruction of dynamic 3D scenes from sparse, multi-timestep, posed camera images. • Our bottom-up framework aggregates and transforms per-frame 3D Gaussian Splats into a cohesive scene representation, enabling self-supervised motion estimation. Furthermore, we introduce motion tokens that capture common motion primitives and regularize motion predictions, facilitating dynamic motion group segmentation without explicit motion or correspondence supervision. • We present several enhancements for in-the-wild scenarios, including sky modeling, camera exposure inconsistency handling, large novel-view extrapolation, and fine-grained human motions reconstruction, making STORM well-suited for real-world applications.

MrNeRF

53,292 Aufrufe • vor 1 Jahr

Nvidia presents DreamDojo A Generalist Robot World Model from Large-Scale Human Videos
1:21

Nvidia presents DreamDojo A Generalist Robot World Model from Large-Scale Human Videos

AK

38,690 Aufrufe • vor 3 Monaten

📢📢📢 Excited to share our new work *Autonomous Character-Scene Interaction Synthesis from Text Instruction* (Siggraph Asia 24). It presents a unified model for flexible scene-conditioned motion generation given text, scene, trajectory conditions. The results with smooth interaction look very impressive! 📰Paper: Project: Code and data will be released soon.
6:34

📢📢📢 Excited to share our new work *Autonomous Character-Scene Interaction Synthesis from Text Instruction* (Siggraph Asia 24). It presents a unified model for flexible scene-conditioned motion generation given text, scene, trajectory conditions. The results with smooth interaction look very impressive! 📰Paper: Project: Code and data will be released soon.

Siyuan Huang

11,340 Aufrufe • vor 1 Jahr

Motion cues from human videos + Reasoning from VLMs enables 3D hand trajectory prediction in-the-wild for novel tasks in novel scenes! Very excited to share the EgoMan project, a huge effort led by Mingfei Chen during an internship with us at Meta. Video summary ⬇️
3:17

Motion cues from human videos + Reasoning from VLMs enables 3D hand trajectory prediction in-the-wild for novel tasks in novel scenes! Very excited to share the EgoMan project, a huge effort led by Mingfei Chen during an internship with us at Meta. Video summary ⬇️

Homanga Bharadhwaj

10,465 Aufrufe • vor 5 Monaten