正在加载视频...

视频加载失败

返回首页

Adobe presents SynCHMR! A method that can reconstruct camera trajectory, human motion, and scene in one global coordinate from videos 🔥

dreamingtulpa's profile picture

Dreaming Tulpa 🥓👑

54,632 subscribers

108,620 次观看 • 2 年前 •via X (Twitter)

教育科学技术艺术
LIVE

Anya Rossi• Live Now

Private livecam show

7 条评论

Dreaming Tulpa 🥓👑 的头像
Dreaming Tulpa 🥓👑2 年前

If you like Tweets like this, you might enjoy my weekly newsletter, #aiartweekly. A free, once–weekly e-mail round-up of the latest AI art news, interviews with artists and useful tools & resources. Join 3500+ subscribers here:

Jules revenue-driven SEO 的头像
Jules revenue-driven SEO2 年前

What is the use case of this?

Chad 的头像
Chad2 年前

Code or demo coming soon I hope??

Steve Korshakov 的头像
Steve Korshakov2 年前

no code?

Yacine Mahdid 的头像
Yacine Mahdid2 年前

100% thought grandma was about to do some fire parkour

Emīls Geršinskis 的头像
Emīls Geršinskis2 年前

Adobe is cool only on paper

toni 的头像
toni2 年前

is this another version of EasyMocap ? utilizing SMPL-X ?

相关视频

Bye bye expensive mocap equipment 👋 AiOS is yet another method that can reconstruct human from videos and images! This one also supports hands and facial expressions.
1:01

Bye bye expensive mocap equipment 👋 AiOS is yet another method that can reconstruct human from videos and images! This one also supports hands and facial expressions.

Dreaming Tulpa 🥓👑

59,479 次观看 • 2 年前

adobe just released a method that can generate transparent videos from text and images 👀
0:21

adobe just released a method that can generate transparent videos from text and images 👀

Dreaming Tulpa 🥓👑

77,051 次观看 • 1 年前

Researchers presented Vid2Avatar, a method that creates human avatars from in-the-wild videos via self-supervised scene decomposition. See more: #AI #ArtificialIntelligence #3dart #research
0:22

Sensitive content

Researchers presented Vid2Avatar, a method that creates human avatars from in-the-wild videos via self-supervised scene decomposition. See more: #AI #ArtificialIntelligence #3dart #research

80 LEVEL

247,399 次观看 • 3 年前

New Adobe Premiere plug-in that edits podcasts and multi-camera videos automatically
0:42

New Adobe Premiere plug-in that edits podcasts and multi-camera videos automatically

AutoPod

1,019,248 次观看 • 3 年前

Let's Check In On MIT's ONE TRILLION FPS (Frames Per Second) Camera. A Camera That Can Film Light In Motion.
1:45

Let's Check In On MIT's ONE TRILLION FPS (Frames Per Second) Camera. A Camera That Can Film Light In Motion.

🔥⭐️Edwin⭐️🔥

223,413 次观看 • 6 个月前

Can we hear what's inside your head? 🧠→🎶 Our new paper in PLOS Biology, led by Jong-Yun Park, presents an AI-based method to reconstruct arbitrary natural sounds directly from a person's brain activity measured with fMRI.
0:30

Can we hear what's inside your head? 🧠→🎶 Our new paper in PLOS Biology, led by Jong-Yun Park, presents an AI-based method to reconstruct arbitrary natural sounds directly from a person's brain activity measured with fMRI.

Yuki Kamitani

10,702 次观看 • 10 个月前

new Loopy model from ByteDance can generate whole videos of realistic face motion from just ONE IMAGE and a SOUND getting that feeling again...
0:45

new Loopy model from ByteDance can generate whole videos of realistic face motion from just ONE IMAGE and a SOUND getting that feeling again...

the real deepfates

305,547 次观看 • 1 年前

Meta presents Garment3DGen! A method that can stylize the geometry and textures from 2D image and 3D mesh garments, which can be fitted on top of parametric bodies and be simulated 🔥 More examples ⬇️
0:37

Meta presents Garment3DGen! A method that can stylize the geometry and textures from 2D image and 3D mesh garments, which can be fitted on top of parametric bodies and be simulated 🔥 More examples ⬇️

Dreaming Tulpa 🥓👑

157,951 次观看 • 2 年前

adobe is cooking a new method that can automatically rig 3D assets by generating joints, skeletons, and skinning weights 👀
0:57

adobe is cooking a new method that can automatically rig 3D assets by generating joints, skeletons, and skinning weights 👀

Dreaming Tulpa 🥓👑

99,404 次观看 • 1 年前

Want a robot that learns household tasks by watching you? EquiBot is a ✨ generalizable and 🚰 data-efficient method for visuomotor policy learning, robust to changes in object shapes, lighting, and scene makeup, even from just 5 mins of human videos. 🧵↓
0:31

Want a robot that learns household tasks by watching you? EquiBot is a ✨ generalizable and 🚰 data-efficient method for visuomotor policy learning, robust to changes in object shapes, lighting, and scene makeup, even from just 5 mins of human videos. 🧵↓

Jingyun Yang

88,290 次观看 • 1 年前

🤖Simulation-Ready Human–Scene Interaction Reconstruction🤖 #HSImul3R reconstructs sim-ready 3D human-scene interactions from casual videos with *physics-in-the-loop* that can be directly deployed to humanoids. - Project: - Code:
0:40

🤖Simulation-Ready Human–Scene Interaction Reconstruction🤖 #HSImul3R reconstructs sim-ready 3D human-scene interactions from casual videos with *physics-in-the-loop* that can be directly deployed to humanoids. - Project: - Code:

Ziwei Liu

15,326 次观看 • 2 个月前

Proof that human videos can be converted into context-aware humanoid locomotion. VideoMimic is a real-to-sim-to-real pipeline that reconstructs humans and scenes from video, retargets motion to a humanoid, and trains a single policy in sim immediately deployable on real robots.
1:44

Proof that human videos can be converted into context-aware humanoid locomotion. VideoMimic is a real-to-sim-to-real pipeline that reconstructs humans and scenes from video, retargets motion to a humanoid, and trains a single policy in sim immediately deployable on real robots.

The Humanoid Hub

63,226 次观看 • 1 年前

Spatio-Temporal Reconstruction Model for Large-Scale Outdoor Scenes Contributions: • We propose STORM, the first feed-forward, self-supervised method for fast and accurate reconstruction of dynamic 3D scenes from sparse, multi-timestep, posed camera images. • Our bottom-up framework aggregates and transforms per-frame 3D Gaussian Splats into a cohesive scene representation, enabling self-supervised motion estimation. Furthermore, we introduce motion tokens that capture common motion primitives and regularize motion predictions, facilitating dynamic motion group segmentation without explicit motion or correspondence supervision. • We present several enhancements for in-the-wild scenarios, including sky modeling, camera exposure inconsistency handling, large novel-view extrapolation, and fine-grained human motions reconstruction, making STORM well-suited for real-world applications.
0:31

Spatio-Temporal Reconstruction Model for Large-Scale Outdoor Scenes Contributions: • We propose STORM, the first feed-forward, self-supervised method for fast and accurate reconstruction of dynamic 3D scenes from sparse, multi-timestep, posed camera images. • Our bottom-up framework aggregates and transforms per-frame 3D Gaussian Splats into a cohesive scene representation, enabling self-supervised motion estimation. Furthermore, we introduce motion tokens that capture common motion primitives and regularize motion predictions, facilitating dynamic motion group segmentation without explicit motion or correspondence supervision. • We present several enhancements for in-the-wild scenarios, including sky modeling, camera exposure inconsistency handling, large novel-view extrapolation, and fine-grained human motions reconstruction, making STORM well-suited for real-world applications.

MrNeRF

53,292 次观看 • 1 年前

Nvidia presents DreamDojo A Generalist Robot World Model from Large-Scale Human Videos
1:21

Nvidia presents DreamDojo A Generalist Robot World Model from Large-Scale Human Videos

AK

38,690 次观看 • 4 个月前

📢📢📢 Excited to share our new work *Autonomous Character-Scene Interaction Synthesis from Text Instruction* (Siggraph Asia 24). It presents a unified model for flexible scene-conditioned motion generation given text, scene, trajectory conditions. The results with smooth interaction look very impressive! 📰Paper: Project: Code and data will be released soon.
6:34

📢📢📢 Excited to share our new work *Autonomous Character-Scene Interaction Synthesis from Text Instruction* (Siggraph Asia 24). It presents a unified model for flexible scene-conditioned motion generation given text, scene, trajectory conditions. The results with smooth interaction look very impressive! 📰Paper: Project: Code and data will be released soon.

Siyuan Huang

11,340 次观看 • 1 年前

Motion cues from human videos + Reasoning from VLMs enables 3D hand trajectory prediction in-the-wild for novel tasks in novel scenes! Very excited to share the EgoMan project, a huge effort led by Mingfei Chen during an internship with us at Meta. Video summary ⬇️
3:17

Motion cues from human videos + Reasoning from VLMs enables 3D hand trajectory prediction in-the-wild for novel tasks in novel scenes! Very excited to share the EgoMan project, a huge effort led by Mingfei Chen during an internship with us at Meta. Video summary ⬇️

Homanga Bharadhwaj @ CVPR

10,506 次观看 • 5 个月前