Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Checkout ObjectForesight! We tackle the problem of predicting future 3D object trajectories given a past context, purely from human videos of everyday interactions! [1/n]

Homanga Bharadhwaj

3,567 subscribers

21,118 views • 8 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Introducing MotionForesight: A very simple approach re-purposing video models for forecasting future 3D scene flow given a short observed video context Trained with just 40k RGB human videos, it generalizes well to completely new home/office scenes! 1/n

Introducing MotionForesight: A very simple approach re-purposing video models for forecasting future 3D scene flow given a short observed video context Trained with just 40k RGB human videos, it generalizes well to completely new home/office scenes! 1/n

Homanga Bharadhwaj

16,549 views • 2 months ago

#ECCV24 We introduce Controllable Human-Object Interaction Synthesis (CHOIS) to generate interactions given text in a 3D scene. w alex, Roozbeh Mottaghi Jiajun Wu Xavier Puig Karen. code: project page:

#ECCV24 We introduce Controllable Human-Object Interaction Synthesis (CHOIS) to generate interactions given text in a 3D scene. w alex, Roozbeh Mottaghi Jiajun Wu Xavier Puig Karen. code: project page:

Jiaman Li

13,203 views • 2 years ago

We recently obtained the highest-resolution 3D images of the human brain ever taken from outside the skull. This is the first look. Introducing Aleph, a research lab building brain interfaces for the telepathic future. (1/n)

We recently obtained the highest-resolution 3D images of the human brain ever taken from outside the skull. This is the first look. Introducing Aleph, a research lab building brain interfaces for the telepathic future. (1/n)

Aleph

1,626,374 views • 2 months ago

we open sourced the code to transform human videos into robot trajectories, so you can train robots with your hands 👐🏻 we used it in our recent paper R+X: Retrieval and Execution from Everyday Human Videos (ICRA 2025 🇺🇸) link and details in thread 🧵

we open sourced the code to transform human videos into robot trajectories, so you can train robots with your hands 👐🏻 we used it in our recent paper R+X: Retrieval and Execution from Everyday Human Videos (ICRA 2025 🇺🇸) link and details in thread 🧵

Norman Di Palo

10,604 views • 1 year ago

If you’re not in freefall, you’re likely contacting something. Yet 3D human-object interaction (HOI) reconstruction remains underexplored. PICO (#CVPR2025) recovers humans 🏃‍♂️, objects 🏓, and their interactions 👉🍎- all in 3D, from just a single internet image. 1/11

If you’re not in freefall, you’re likely contacting something. Yet 3D human-object interaction (HOI) reconstruction remains underexplored. PICO (#CVPR2025) recovers humans 🏃‍♂️, objects 🏓, and their interactions 👉🍎- all in 3D, from just a single internet image. 1/11

Shashank Tripathi

24,444 views • 1 year ago

Humans are social creatures and physical interaction with other humans plays an important role in our everyday life. In this thread, we explain how such interactions can be reconstructed in 3D from a single image utilising a denoising diffusion probabilistic model. (1/n)

Humans are social creatures and physical interaction with other humans plays an important role in our everyday life. In this thread, we explain how such interactions can be reconstructed in 3D from a single image utilising a denoising diffusion probabilistic model. (1/n)

Lea Wilken/Müller

76,563 views • 2 years ago

The context size of video world models is only a few frames. Like a human with severe memory loss! We design a long-term memory for world models based on explicit 3D representations inspired by the human mind. This enables long-term consistency. 1/3

The context size of video world models is only a few frames. Like a human with severe memory loss! We design a long-term memory for world models based on explicit 3D representations inspired by the human mind. This enables long-term consistency. 1/3

Gordon Wetzstein

35,104 views • 1 year ago

Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models Contributions: • We introduce Diffuman4D, a novel diffusion model that generates spatio-temporally consistent and high-resolution (1024p) human videos from sparse-view video inputs. • We propose a sliding iterative denoising mechanism that enhances both the spatial and temporal consistency of generated long-term videos while maintaining efficient inference. • We design a human pose conditioning scheme to enhance the appearance quality and motion accuracy of generated human videos. • We plan to release our processed version of the DNA-Rendering dataset, which we believe will benefit future research in this area.

Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models Contributions: • We introduce Diffuman4D, a novel diffusion model that generates spatio-temporally consistent and high-resolution (1024p) human videos from sparse-view video inputs. • We propose a sliding iterative denoising mechanism that enhances both the spatial and temporal consistency of generated long-term videos while maintaining efficient inference. • We design a human pose conditioning scheme to enhance the appearance quality and motion accuracy of generated human videos. • We plan to release our processed version of the DNA-Rendering dataset, which we believe will benefit future research in this area.

MrNeRF

24,729 views • 1 year ago

Fit-up of bent or warped material is one of the most challenging aspects of autonomous shipbuilding. This lil’ snippet from an upcoming video shows how we’re solving that problem. The future of shipbuilding will look very different from the past.

Fit-up of bent or warped material is one of the most challenging aspects of autonomous shipbuilding. This lil’ snippet from an upcoming video shows how we’re solving that problem. The future of shipbuilding will look very different from the past.

Dustin Walper

55,697 views • 3 months ago

Real-time generation isn’t about predicting the next pixel, it requires understanding the structure and context of a 3D world. That’s the shift. Read more about our real-time game-native diffusion model on our blog. Moonlake's Reverie v0.1.0

Real-time generation isn’t about predicting the next pixel, it requires understanding the structure and context of a 3D world. That’s the shift. Read more about our real-time game-native diffusion model on our blog. Moonlake's Reverie v0.1.0

Moonlake

14,439 views • 9 months ago

Introducing “FlowCam: Training Generalizable 3D Radiance Fields w/o Camera Poses via Pixel-Aligned Scene Flow”! We train a generalizable 3D scene representation self-supervised on datasets of raw videos, without any pre-computed camera poses or SFM! 1/n

Introducing “FlowCam: Training Generalizable 3D Radiance Fields w/o Camera Poses via Pixel-Aligned Scene Flow”! We train a generalizable 3D scene representation self-supervised on datasets of raw videos, without any pre-computed camera poses or SFM! 1/n

Vincent Sitzmann

88,503 views • 3 years ago

From a recent conversation with the great Kevin DeAnna (Kevin DeAnna) as part of his program Identity Politcs. We must build a future as glorious as our past.

From a recent conversation with the great Kevin DeAnna (Kevin DeAnna) as part of his program Identity Politcs. We must build a future as glorious as our past.

Jared Taylor

19,795 views • 5 months ago

(1/2) MonoNPHM will be presented as a #CVPR2024 Highlight! Our Neural Parametric Head Model parametrizes both geometry and appearance. With the learned model, we can then 3D reconstruct and track human heads from images or videos.

(1/2) MonoNPHM will be presented as a #CVPR2024 Highlight! Our Neural Parametric Head Model parametrizes both geometry and appearance. With the learned model, we can then 3D reconstruct and track human heads from images or videos.

Matthias Niessner

17,209 views • 2 years ago

Thread of beautiful things from the past 🧵 1. A stunning drinks cabinet from the 1930s

Thread of beautiful things from the past 🧵 1. A stunning drinks cabinet from the 1930s

James Lucas

636,946 views • 1 year ago

SpatialTracker Tracking Any 2D Pixels in 3D Space Recovering dense and long-range pixel motion in videos is a challenging problem. Part of the difficulty arises from the 3D-to-2D projection process, leading to occlusions and discontinuities in the 2D motion domain.

SpatialTracker Tracking Any 2D Pixels in 3D Space Recovering dense and long-range pixel motion in videos is a challenging problem. Part of the difficulty arises from the 3D-to-2D projection process, leading to occlusions and discontinuities in the 2D motion domain.

AK

77,162 views • 2 years ago

Huawei's new 3D lock screen wallpaper is actually pretty interesting. Unlike iPhone's Spatial Photo, which creates a fixed stereoscopic depth effect from a photo, this lets you scan an object 360°, generate a full 3D Gaussian Splatting asset, and use that as your lock screen. Tilt the phone and you're moving through a reconstructed 3D scene, not a fixed stereo image. The part worth paying attention to: 3D capture moving out of creative pipelines and into everyday phone personalization. That's a different kind of adoption curve.

Huawei's new 3D lock screen wallpaper is actually pretty interesting. Unlike iPhone's Spatial Photo, which creates a fixed stereoscopic depth effect from a photo, this lets you scan an object 360°, generate a full 3D Gaussian Splatting asset, and use that as your lock screen. Tilt the phone and you're moving through a reconstructed 3D scene, not a fixed stereo image. The part worth paying attention to: 3D capture moving out of creative pipelines and into everyday phone personalization. That's a different kind of adoption curve.

KIRI Engine - 3D Scanner App

186,235 views • 3 months ago

Foreign ministers from the 46 Council of Europe member states have adopted a political declaration underlining and clarifying key aspects of the European Convention on Human Rights system, notably in the context of migration.

Foreign ministers from the 46 Council of Europe member states have adopted a political declaration underlining and clarifying key aspects of the European Convention on Human Rights system, notably in the context of migration.

Council of Europe

17,804 views • 4 months ago

A glimpse of the future: this is a 3D printed and painted model. That's right, it's straight out the machine, no human operated brush has touched this 🤯 Pre-production test model from MyMiniFactory shown at Salute 2023. Incredible! #Warmongers #3dprinted

A glimpse of the future: this is a 3D printed and painted model. That's right, it's straight out the machine, no human operated brush has touched this 🤯 Pre-production test model from MyMiniFactory shown at Salute 2023. Incredible! #Warmongers #3dprinted

Leakycheese

20,995 views • 3 years ago