正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Monocular pose estimation has gotten really good Grab any 2D video and transfer the performance to a 3D character

Bilawal Sidhu

68,749 subscribers

27,074 次观看 • 1 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

I always thought camera pose estimation is necessary for 3D reconstruction, until Zequn and Stephen proved me wrong! Introducing PreF3R, purely feed-forward 3D Gaussian Splatting without any intermediate pose estimation and COLMAP initialization. Video in, 3D Gaussians and novel view rendering out. Key technique: spatial memory network from Spann3R and Gaussian head supervised by pointmap loss plus photometric loss. See more at:

I always thought camera pose estimation is necessary for 3D reconstruction, until Zequn and Stephen proved me wrong! Introducing PreF3R, purely feed-forward 3D Gaussian Splatting without any intermediate pose estimation and COLMAP initialization. Video in, 3D Gaussians and novel view rendering out. Key technique: spatial memory network from Spann3R and Gaussian head supervised by pointmap loss plus photometric loss. See more at:

Heng Yang

20,160 次观看 • 1 年前

Learn how to combine a deep learning model for pose estimation to perform a 3D reconstruction using two cameras 📸

Learn how to combine a deep learning model for pose estimation to perform a 3D reconstruction using two cameras 📸

MATLAB

15,699 次观看 • 1 年前

Comp breakdown. 🤗 Character is 3D. Background is a 2D painting (photoshop) VFX are 2D (Animate) #blender #animation #p2design #2D #3D

Comp breakdown. 🤗 Character is 3D. Background is a 2D painting (photoshop) VFX are 2D (Animate) #blender #animation #p2design #2D #3D

Pierrick Picaut

47,226 次观看 • 10 个月前

Discover the right 3D Geometric Foundation Model for your task—whether it’s stereo matching, multi-view depth estimation, video depth, pose estimation, semantic understanding, or novel view synthesis. Explore more insights in our #E3DBench #FoundationModel #3D #GaussianSplatting. Project Webpage:

Discover the right 3D Geometric Foundation Model for your task—whether it’s stereo matching, multi-view depth estimation, video depth, pose estimation, semantic understanding, or novel view synthesis. Explore more insights in our #E3DBench #FoundationModel #3D #GaussianSplatting. Project Webpage:

Zhiwen(Aaron) Fan

30,010 次观看 • 1 年前

SpatialTracker Tracking Any 2D Pixels in 3D Space Recovering dense and long-range pixel motion in videos is a challenging problem. Part of the difficulty arises from the 3D-to-2D projection process, leading to occlusions and discontinuities in the 2D motion domain.

SpatialTracker Tracking Any 2D Pixels in 3D Space Recovering dense and long-range pixel motion in videos is a challenging problem. Part of the difficulty arises from the 3D-to-2D projection process, leading to occlusions and discontinuities in the 2D motion domain.

AK

77,162 次观看 • 2 年前

Soon, thanks to AI, we’ll be able to turn any 2D character we create in Midjourney into fully customizable 3D assets!

Soon, thanks to AI, we’ll be able to turn any 2D character we create in Midjourney into fully customizable 3D assets!

el.cine

115,133 次观看 • 1 年前

Spent some time this week playing with depth estimation models. Monocular depth estimation has come a long way, but in terms of metric accuracy and geometric consistency, stereo depth still has it beat by a wide margin. DepthPro (mono) vs FoundationStereo (stereo)

Spent some time this week playing with depth estimation models. Monocular depth estimation has come a long way, but in terms of metric accuracy and geometric consistency, stereo depth still has it beat by a wide margin. DepthPro (mono) vs FoundationStereo (stereo)

FrostyFridge

27,774 次观看 • 1 年前

They’ve really mastered the art of mixing 3d and 2d

They’ve really mastered the art of mixing 3d and 2d

Agnis

500,065 次观看 • 15 天前

the transition from 2d to 3d cutscene was done really well

the transition from 2d to 3d cutscene was done really well

Marko

88,566 次观看 • 4 个月前

How to turn any 2d object into 3d!

How to turn any 2d object into 3d!

xarr

59,259 次观看 • 1 年前

AnyDepth: Lightweight zero-shot monocular depth estimation; surpasses DPT; - nicely preserves detail.

AnyDepth: Lightweight zero-shot monocular depth estimation; surpasses DPT; - nicely preserves detail.

Wildminder

18,152 次观看 • 5 个月前

Given a monocular video as input, #HOLD reconstructs 3D hand and object surfaces for every frame without assuming a known object template. Our key insight is that interacting hands and objects provide complementary cues about each other's shape and pose. 1/4

Given a monocular video as input, #HOLD reconstructs 3D hand and object surfaces for every frame without assuming a known object template. Our key insight is that interacting hands and objects provide complementary cues about each other's shape and pose. 1/4

Michael Black

21,594 次观看 • 2 年前

Gave a robot 3D vision with just a regular camera👁️ Full Tutorial: Deployed #Depth Anything V3 on NVIDIA Robotics Jetson AGX Orin. It estimates depth from 2D images in real-time—no special sensors needed. Just need #Monocular depth estimation + #TensorRT optimization + #ROS2 integration. 👉 Learn more about reComputer Robotics J5011: #TheAIHardwarePartner

Gave a robot 3D vision with just a regular camera👁️ Full Tutorial: Deployed #Depth Anything V3 on NVIDIA Robotics Jetson AGX Orin. It estimates depth from 2D images in real-time—no special sensors needed. Just need #Monocular depth estimation + #TensorRT optimization + #ROS2 integration. 👉 Learn more about reComputer Robotics J5011: #TheAIHardwarePartner

Seeed Studio

16,966 次观看 • 4 个月前

Who needs a mocap suit? 😁Testing out AIOS - All-in-One-Stage Expressive Human Pose and Shape Estimation (link in thread). I uploaded a video from Pexels and it created the 3D mesh, which I was able to import into Blender and use Geometry nodes to control. (see thread for nodes).

Who needs a mocap suit? 😁Testing out AIOS - All-in-One-Stage Expressive Human Pose and Shape Estimation (link in thread). I uploaded a video from Pexels and it created the 3D mesh, which I was able to import into Blender and use Geometry nodes to control. (see thread for nodes).

👣KᗪᗩᗯG👣 🔶

11,560 次观看 • 1 年前

YOU CAN NOW REMASTER ANY 2D GAME INTO A 3D WORLD Pokémon Ruby defined a generation of top-down handheld gaming. 2D is fast and solo-friendly: tiles, sprites, simple animations. 3D has always been brutal modeling, rigging, lighting, LODs, and months of specialized work that kills most small teams. Mint shatters that One screenshot → instant coherent 3D worlds No more waiting for studios to invest a 2D game becomes 3D today.

YOU CAN NOW REMASTER ANY 2D GAME INTO A 3D WORLD Pokémon Ruby defined a generation of top-down handheld gaming. 2D is fast and solo-friendly: tiles, sprites, simple animations. 3D has always been brutal modeling, rigging, lighting, LODs, and months of specialized work that kills most small teams. Mint shatters that One screenshot → instant coherent 3D worlds No more waiting for studios to invest a 2D game becomes 3D today.

mint

16,280 次观看 • 20 天前

hi all, excited to join! i'm building an expressive mini "shoggoth" robot which will eventually be hooked up to gpt4o realtime voice. i'm currently working on the low-level policies, which are trained in a mujoco simulation with RL. to delay working on raw-pixels for now, i trained a pose-estimation model using deeplabcut and triangulate the position in 3d space using the stereo cameras. eventually, i'll use gpt4o's tool calling capabilities to activate several of these policies (closed and open loop) based on the dialog flow! captions: manual actuation of the tentacle / 3d pose estimation / target design

hi all, excited to join! i'm building an expressive mini "shoggoth" robot which will eventually be hooked up to gpt4o realtime voice. i'm currently working on the low-level policies, which are trained in a mujoco simulation with RL. to delay working on raw-pixels for now, i trained a pose-estimation model using deeplabcut and triangulate the position in 3d space using the stereo cameras. eventually, i'll use gpt4o's tool calling capabilities to activate several of these policies (closed and open loop) based on the dialog flow! captions: manual actuation of the tentacle / 3d pose estimation / target design

Matthieu LC

45,506 次观看 • 1 年前

grab a pen character design using Freepik Spaces and Nano Banana Pro workflow: > draw on paper > apply your 3D style > build the 3D character > animate it with Kling 2.6

grab a pen character design using Freepik Spaces and Nano Banana Pro workflow: > draw on paper > apply your 3D style > build the 3D character > animate it with Kling 2.6

INK

190,435 次观看 • 6 个月前

jaehyun read a comment asking sohee to do duck pose but seems like sohee has been tricked by jaehyun many times so he didnt believe jaehyun and had to grab the phone to confirm if there was really a comment like that 🤣🤣🤣 his cute duck pose 🐥🐥

jaehyun read a comment asking sohee to do duck pose but seems like sohee has been tricked by jaehyun many times so he didnt believe jaehyun and had to grab the phone to confirm if there was really a comment like that 🤣🤣🤣 his cute duck pose 🐥🐥

넷

78,796 次观看 • 2 年前

Figured out a way to do muzzleflashes that light up the background. Our game is pre-rendered, meaning that background and environment is fully 2D. The only thing 3D is the character and the rain. So it's pretty neat!

Figured out a way to do muzzleflashes that light up the background. Our game is pre-rendered, meaning that background and environment is fully 2D. The only thing 3D is the character and the rain. So it's pretty neat!

Ground Zero - Malformation Games

57,448 次观看 • 1 年前

How can we use test-time compute for spatial understanding? 🤔 In InterPose, we propose to repeatedly sample generative video models to help two-view pose estimation and reconstruction, by leveraging the video models' keyframe interpolation abilities. A 🧵... (1/8)

How can we use test-time compute for spatial understanding? 🤔 In InterPose, we propose to repeatedly sample generative video models to help two-view pose estimation and reconstruction, by leveraging the video models' keyframe interpolation abilities. A 🧵... (1/8)

Ricardo Martin-Brualla

21,685 次观看 • 1 年前