Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Learn how to combine a deep learning model for pose estimation to perform a 3D reconstruction using two cameras 📸

MATLAB

102,559 subscribers

15,665 views • 1 year ago •via X (Twitter)

Science & Technology Education Arts

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

hi all, excited to join! i'm building an expressive mini "shoggoth" robot which will eventually be hooked up to gpt4o realtime voice. i'm currently working on the low-level policies, which are trained in a mujoco simulation with RL. to delay working on raw-pixels for now, i trained a pose-estimation model using deeplabcut and triangulate the position in 3d space using the stereo cameras. eventually, i'll use gpt4o's tool calling capabilities to activate several of these policies (closed and open loop) based on the dialog flow! captions: manual actuation of the tentacle / 3d pose estimation / target design

hi all, excited to join! i'm building an expressive mini "shoggoth" robot which will eventually be hooked up to gpt4o realtime voice. i'm currently working on the low-level policies, which are trained in a mujoco simulation with RL. to delay working on raw-pixels for now, i trained a pose-estimation model using deeplabcut and triangulate the position in 3d space using the stereo cameras. eventually, i'll use gpt4o's tool calling capabilities to activate several of these policies (closed and open loop) based on the dialog flow! captions: manual actuation of the tentacle / 3d pose estimation / target design

Matthieu LC

45,506 views • 1 year ago

How can we use test-time compute for spatial understanding? 🤔 In InterPose, we propose to repeatedly sample generative video models to help two-view pose estimation and reconstruction, by leveraging the video models' keyframe interpolation abilities. A 🧵... (1/8)

How can we use test-time compute for spatial understanding? 🤔 In InterPose, we propose to repeatedly sample generative video models to help two-view pose estimation and reconstruction, by leveraging the video models' keyframe interpolation abilities. A 🧵... (1/8)

Ricardo Martin-Brualla

21,685 views • 1 year ago

I've started reading Dungeon Meshi and also been doing a lot of 2D/3D mixed stuff in Blender recently, so of course I had to combine the two. Had a lot of fun learning how to combine vertex painting with pixel textures for this one. #dungeonmeshi #pixelart #Blender3d

I've started reading Dungeon Meshi and also been doing a lot of 2D/3D mixed stuff in Blender recently, so of course I had to combine the two. Had a lot of fun learning how to combine vertex painting with pixel textures for this one. #dungeonmeshi #pixelart #Blender3d

Paul Veer

279,458 views • 3 years ago

Monocular pose estimation has gotten really good Grab any 2D video and transfer the performance to a 3D character

Monocular pose estimation has gotten really good Grab any 2D video and transfer the performance to a 3D character

Bilawal Sidhu

27,074 views • 1 year ago

Try new poses and angles! 3D drawing figures are ideal for when you have a pose in mind but can't find that perfect reference image. Learn how to apply poses and other fun additions like BVH files to your 3D model in this tutorial: #clipstudio

Try new poses and angles! 3D drawing figures are ideal for when you have a pose in mind but can't find that perfect reference image. Learn how to apply poses and other fun additions like BVH files to your 3D model in this tutorial: #clipstudio

CLIP STUDIO PAINT

165,643 views • 11 months ago

ViTPose -- best open-source pose estimation model just landed to Hugging Face transformers 🕺🏻💃🏻 See how to use on the next one ⤵️

ViTPose -- best open-source pose estimation model just landed to Hugging Face transformers 🕺🏻💃🏻 See how to use on the next one ⤵️

merve

83,367 views • 1 year ago

Discover the right 3D Geometric Foundation Model for your task—whether it’s stereo matching, multi-view depth estimation, video depth, pose estimation, semantic understanding, or novel view synthesis. Explore more insights in our #E3DBench #FoundationModel #3D #GaussianSplatting. Project Webpage:

Discover the right 3D Geometric Foundation Model for your task—whether it’s stereo matching, multi-view depth estimation, video depth, pose estimation, semantic understanding, or novel view synthesis. Explore more insights in our #E3DBench #FoundationModel #3D #GaussianSplatting. Project Webpage:

Zhiwen(Aaron) Fan

29,920 views • 1 year ago

Created a quick VFX to make Wimbledon more green🌱 Using Camera Pose Estimation, body & ball segmentation to incorporate the grass simulation 🙂

Created a quick VFX to make Wimbledon more green🌱 Using Camera Pose Estimation, body & ball segmentation to incorporate the grass simulation 🙂

Alexandre Devaux

19,557 views • 11 months ago

I always thought camera pose estimation is necessary for 3D reconstruction, until Zequn and Stephen proved me wrong! Introducing PreF3R, purely feed-forward 3D Gaussian Splatting without any intermediate pose estimation and COLMAP initialization. Video in, 3D Gaussians and novel view rendering out. Key technique: spatial memory network from Spann3R and Gaussian head supervised by pointmap loss plus photometric loss. See more at:

I always thought camera pose estimation is necessary for 3D reconstruction, until Zequn and Stephen proved me wrong! Introducing PreF3R, purely feed-forward 3D Gaussian Splatting without any intermediate pose estimation and COLMAP initialization. Video in, 3D Gaussians and novel view rendering out. Key technique: spatial memory network from Spann3R and Gaussian head supervised by pointmap loss plus photometric loss. See more at:

Heng Yang

20,160 views • 1 year ago

random model find; might be the best 3D multi-person pose estimation I have ever seen; it's Apache-2.0 Multi-HMR: Regressing Whole-Body Human Meshes for Multiple Persons in a Single Shot; ECCV2024

random model find; might be the best 3D multi-person pose estimation I have ever seen; it's Apache-2.0 Multi-HMR: Regressing Whole-Body Human Meshes for Multiple Persons in a Single Shot; ECCV2024

SkalskiP

31,150 views • 1 year ago

Ever had a perfect image in mind that a text-to-image model just couldn't capture? Our new reinforcement learning agent, PASTA, turns image generation into a collaborative conversation, learning your style to bring your vision to life. Learn how it works:

Ever had a perfect image in mind that a text-to-image model just couldn't capture? Our new reinforcement learning agent, PASTA, turns image generation into a collaborative conversation, learning your style to bring your vision to life. Learn how it works:

Google Research

25,808 views • 8 months ago

Create a 3D model from a single image, set of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”

Create a 3D model from a single image, set of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”

Bilawal Sidhu

92,760 views • 2 years ago

🌿 Introducing pesto~ for Max/MSP! A standalone wrapper for real-time neural pitch estimation powered by Sony CSL's PESTO deep learning model. Get robust, timbre-agnostic, low-latency (<5ms) pitch tracking with confidence & amplitude outputs in your Max patches.

🌿 Introducing pesto~ for Max/MSP! A standalone wrapper for real-time neural pitch estimation powered by Sony CSL's PESTO deep learning model. Get robust, timbre-agnostic, low-latency (<5ms) pitch tracking with confidence & amplitude outputs in your Max patches.

Qosmo — AI Creativity & Music Lab

16,822 views • 1 year ago

Recently, I've been working a lot on Gaussian Splatting. I built a repo for camera pose estimation using Rerun, Gradio, and prefix.dev that merges GLOMAP with hloc! 🧵More info below

Recently, I've been working a lot on Gaussian Splatting. I built a repo for camera pose estimation using Rerun, Gradio, and prefix.dev that merges GLOMAP with hloc! 🧵More info below

Pablo Vela

67,547 views • 1 year ago

pretty confident in the model being done now, all thats left is rigging! learning how to set up a proper foot roll for this model

pretty confident in the model being done now, all thats left is rigging! learning how to set up a proper foot roll for this model

LogiBob

26,744 views • 5 months ago

Tips & Teach How To Pose 😍📸

Tips & Teach How To Pose 😍📸

Photography 📸 Tips & Trick

103,655 views • 2 years ago

Detect worker falls in real time with Ultralytics YOLO26! 📦 Combine object detection and pose estimation to identify when a person carrying luggage boxes falls, helping logistics teams improve warehouse safety and respond faster to incidents. Get started ➡️ #Ultralytics #YOLO26 #AI #Logistics #WorkplaceSafety

Detect worker falls in real time with Ultralytics YOLO26! 📦 Combine object detection and pose estimation to identify when a person carrying luggage boxes falls, helping logistics teams improve warehouse safety and respond faster to incidents. Get started ➡️ #Ultralytics #YOLO26 #AI #Logistics #WorkplaceSafety

Ultralytics

15,927 views • 1 month ago

A lot of people mistake the frog pose to dog pose Watch and learn

A lot of people mistake the frog pose to dog pose Watch and learn

BERNARDO 🏴‍☠️

38,991 views • 4 months ago

📢We introduce “RefFusion”, a novel inpainting method for scenes reconstructed using 3D Gaussian Splatting. 🔗 TLDR: we personalize an image diffusion model to a given reference image and distill its knowledge to 3D through score distillation sampling.

📢We introduce “RefFusion”, a novel inpainting method for scenes reconstructed using 3D Gaussian Splatting. 🔗 TLDR: we personalize an image diffusion model to a given reference image and distill its knowledge to 3D through score distillation sampling.

Ashkan Mirzaei

34,683 views • 2 years ago