Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Monocular pose estimation has gotten really good Grab any 2D video and transfer the performance to a 3D character

bilawalsidhu's profile picture

Bilawal Sidhu

68,749 subscribers

27,074 Aufrufe • vor 1 Jahr •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Learn how to combine a deep learning model for pose estimation to perform a 3D reconstruction using two cameras 📸
0:13

Learn how to combine a deep learning model for pose estimation to perform a 3D reconstruction using two cameras 📸

MATLAB

15,702 Aufrufe • vor 1 Jahr

Discover the right 3D Geometric Foundation Model for your task—whether it’s stereo matching, multi-view depth estimation, video depth, pose estimation, semantic understanding, or novel view synthesis. Explore more insights in our #E3DBench #FoundationModel #3D #GaussianSplatting. Project Webpage:
0:14

Discover the right 3D Geometric Foundation Model for your task—whether it’s stereo matching, multi-view depth estimation, video depth, pose estimation, semantic understanding, or novel view synthesis. Explore more insights in our #E3DBench #FoundationModel #3D #GaussianSplatting. Project Webpage:

Zhiwen(Aaron) Fan

30,010 Aufrufe • vor 1 Jahr

SpatialTracker Tracking Any 2D Pixels in 3D Space Recovering dense and long-range pixel motion in videos is a challenging problem. Part of the difficulty arises from the 3D-to-2D projection process, leading to occlusions and discontinuities in the 2D motion domain.
0:11

SpatialTracker Tracking Any 2D Pixels in 3D Space Recovering dense and long-range pixel motion in videos is a challenging problem. Part of the difficulty arises from the 3D-to-2D projection process, leading to occlusions and discontinuities in the 2D motion domain.

AK

77,162 Aufrufe • vor 2 Jahren

Soon, thanks to AI, we’ll be able to turn any 2D character we create in Midjourney into fully customizable 3D assets!
0:14

Soon, thanks to AI, we’ll be able to turn any 2D character we create in Midjourney into fully customizable 3D assets!

el.cine

115,133 Aufrufe • vor 1 Jahr

They’ve really mastered the art of mixing 3d and 2d
0:12

They’ve really mastered the art of mixing 3d and 2d

Agnis

500,187 Aufrufe • vor 1 Monat

the transition from 2d to 3d cutscene was done really well
0:12

the transition from 2d to 3d cutscene was done really well

Marko

88,566 Aufrufe • vor 5 Monaten

Given a monocular video as input, #HOLD reconstructs 3D hand and object surfaces for every frame without assuming a known object template. Our key insight is that interacting hands and objects provide complementary cues about each other's shape and pose. 1/4
0:10

Given a monocular video as input, #HOLD reconstructs 3D hand and object surfaces for every frame without assuming a known object template. Our key insight is that interacting hands and objects provide complementary cues about each other's shape and pose. 1/4

Michael Black

21,606 Aufrufe • vor 2 Jahren

Gave a robot 3D vision with just a regular camera👁️ Full Tutorial: Deployed #Depth Anything V3​ on NVIDIA Robotics Jetson AGX Orin. It estimates depth from 2D images in real-time—no special sensors needed. Just need #Monocular depth estimation + #TensorRT​ optimization + #ROS2​ integration. 👉 Learn more about reComputer Robotics J5011: #TheAIHardwarePartner
0:18

Gave a robot 3D vision with just a regular camera👁️ Full Tutorial: Deployed #Depth Anything V3​ on NVIDIA Robotics Jetson AGX Orin. It estimates depth from 2D images in real-time—no special sensors needed. Just need #Monocular depth estimation + #TensorRT​ optimization + #ROS2​ integration. 👉 Learn more about reComputer Robotics J5011: #TheAIHardwarePartner

Seeed Studio

16,966 Aufrufe • vor 5 Monaten

YOU CAN NOW REMASTER ANY 2D GAME INTO A 3D WORLD Pokémon Ruby defined a generation of top-down handheld gaming. 2D is fast and solo-friendly: tiles, sprites, simple animations. 3D has always been brutal modeling, rigging, lighting, LODs, and months of specialized work that kills most small teams. Mint shatters that One screenshot → instant coherent 3D worlds No more waiting for studios to invest a 2D game becomes 3D today.
0:13

YOU CAN NOW REMASTER ANY 2D GAME INTO A 3D WORLD Pokémon Ruby defined a generation of top-down handheld gaming. 2D is fast and solo-friendly: tiles, sprites, simple animations. 3D has always been brutal modeling, rigging, lighting, LODs, and months of specialized work that kills most small teams. Mint shatters that One screenshot → instant coherent 3D worlds No more waiting for studios to invest a 2D game becomes 3D today.

mint

16,515 Aufrufe • vor 1 Monat

Who needs a mocap suit? 😁Testing out AIOS - All-in-One-Stage Expressive Human Pose and Shape Estimation (link in thread). I uploaded a video from Pexels and it created the 3D mesh, which I was able to import into Blender and use Geometry nodes to control. (see thread for nodes).
0:15

Who needs a mocap suit? 😁Testing out AIOS - All-in-One-Stage Expressive Human Pose and Shape Estimation (link in thread). I uploaded a video from Pexels and it created the 3D mesh, which I was able to import into Blender and use Geometry nodes to control. (see thread for nodes).

👣KᗪᗩᗯG👣 🔶

11,560 Aufrufe • vor 1 Jahr

hi all, excited to join! i'm building an expressive mini "shoggoth" robot which will eventually be hooked up to gpt4o realtime voice. i'm currently working on the low-level policies, which are trained in a mujoco simulation with RL. to delay working on raw-pixels for now, i trained a pose-estimation model using deeplabcut and triangulate the position in 3d space using the stereo cameras. eventually, i'll use gpt4o's tool calling capabilities to activate several of these policies (closed and open loop) based on the dialog flow! captions: manual actuation of the tentacle / 3d pose estimation / target design
0:29

hi all, excited to join! i'm building an expressive mini "shoggoth" robot which will eventually be hooked up to gpt4o realtime voice. i'm currently working on the low-level policies, which are trained in a mujoco simulation with RL. to delay working on raw-pixels for now, i trained a pose-estimation model using deeplabcut and triangulate the position in 3d space using the stereo cameras. eventually, i'll use gpt4o's tool calling capabilities to activate several of these policies (closed and open loop) based on the dialog flow! captions: manual actuation of the tentacle / 3d pose estimation / target design

Matthieu LC

45,587 Aufrufe • vor 1 Jahr

grab a pen character design using Freepik Spaces and Nano Banana Pro workflow: > draw on paper > apply your 3D style > build the 3D character > animate it with Kling 2.6
0:14

grab a pen character design using Freepik Spaces and Nano Banana Pro workflow: > draw on paper > apply your 3D style > build the 3D character > animate it with Kling 2.6

INK

190,748 Aufrufe • vor 7 Monaten

jaehyun read a comment asking sohee to do duck pose but seems like sohee has been tricked by jaehyun many times so he didnt believe jaehyun and had to grab the phone to confirm if there was really a comment like that 🤣🤣🤣 his cute duck pose 🐥🐥
0:10

jaehyun read a comment asking sohee to do duck pose but seems like sohee has been tricked by jaehyun many times so he didnt believe jaehyun and had to grab the phone to confirm if there was really a comment like that 🤣🤣🤣 his cute duck pose 🐥🐥

넷

78,998 Aufrufe • vor 2 Jahren

More PixiJS 3D testing 👀 Take any live 2D PixiJS content (sprites, text, graphics) and render it onto 3D geometry Our goal is to make working between 2D and 3D as seamless as possible in our WebGPU/WebGL renderer Let us know what features you'd like to see!
0:17

More PixiJS 3D testing 👀 Take any live 2D PixiJS content (sprites, text, graphics) and render it onto 3D geometry Our goal is to make working between 2D and 3D as seamless as possible in our WebGPU/WebGL renderer Let us know what features you'd like to see!

PixiJS

30,996 Aufrufe • vor 1 Monat

How can we use test-time compute for spatial understanding? 🤔 In InterPose, we propose to repeatedly sample generative video models to help two-view pose estimation and reconstruction, by leveraging the video models' keyframe interpolation abilities. A 🧵... (1/8)
0:17

How can we use test-time compute for spatial understanding? 🤔 In InterPose, we propose to repeatedly sample generative video models to help two-view pose estimation and reconstruction, by leveraging the video models' keyframe interpolation abilities. A 🧵... (1/8)

Ricardo Martin-Brualla

21,685 Aufrufe • vor 1 Jahr

I've figured out how to constantly switch between 2D and 3D in order my gaslight the chat. I can start out as a 2D model then zoom out to reveal we were in 3D the whole time.
0:15

I've figured out how to constantly switch between 2D and 3D in order my gaslight the chat. I can start out as a 2D model then zoom out to reveal we were in 3D the whole time.

shindigs

54,090 Aufrufe • vor 1 Jahr

random model find; might be the best 3D multi-person pose estimation I have ever seen; it's Apache-2.0 Multi-HMR: Regressing Whole-Body Human Meshes for Multiple Persons in a Single Shot; ECCV2024
0:17

random model find; might be the best 3D multi-person pose estimation I have ever seen; it's Apache-2.0 Multi-HMR: Regressing Whole-Body Human Meshes for Multiple Persons in a Single Shot; ECCV2024

SkalskiP

31,150 Aufrufe • vor 1 Jahr