Checkout ObjectForesight! We tackle the problem of predicting future... 3D object trajectories given a past context, purely from human videos of everyday interactions! [1/n]show more

#ECCV24 We introduce Controllable Human-Object Interaction Synthesis (CHOIS) to... generate interactions given text in a 3D scene. w alex, Roozbeh Mottaghi Jiajun Wu Xavier Puig Karen. code: project page:show more

we open sourced the code to transform human videos... into robot trajectories, so you can train robots with your hands 👐🏻 we used it in our recent paper R+X: Retrieval and Execution from Everyday Human Videos (ICRA 2025 🇺🇸) link and details in thread 🧵show more

If you’re not in freefall, you’re likely contacting something.... Yet 3D human-object interaction (HOI) reconstruction remains underexplored. PICO (#CVPR2025) recovers humans 🏃‍♂️, objects 🏓, and their interactions 👉🍎- all in 3D, from just a single internet image. 1/11show more

Humans are social creatures and physical interaction with other... humans plays an important role in our everyday life. In this thread, we explain how such interactions can be reconstructed in 3D from a single image utilising a denoising diffusion probabilistic model. (1/n)show more

The context size of video world models is only... a few frames. Like a human with severe memory loss! We design a long-term memory for world models based on explicit 3D representations inspired by the human mind. This enables long-term consistency. 1/3show more

Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos... with Spatio-Temporal Diffusion Models Contributions: • We introduce Diffuman4D, a novel diffusion model that generates spatio-temporally consistent and high-resolution (1024p) human videos from sparse-view video inputs. • We propose a sliding iterative denoising mechanism that enhances both the spatial and temporal consistency of generated long-term videos while maintaining efficient inference. • We design a human pose conditioning scheme to enhance the appearance quality and motion accuracy of generated human videos. • We plan to release our processed version of the DNA-Rendering dataset, which we believe will benefit future research in this area.show more

😇 Announcing Human, a global decentralized ID registry of... all humanity With the core principle of 1 human = 1 account, we solve the problem of knowing if someone online is a real person, bot, or AI. Read more about our Alpha testing below 🧵show more

How do we create realistic models of dressed humans... directly from visual data? We introduce PhysAvatar, a framework that estimates the shape, appearance, and physical parameters of dressed human avatars from multi-view videos. Page: (1/6)show more

Fit-up of bent or warped material is one of... the most challenging aspects of autonomous shipbuilding. This lil’ snippet from an upcoming video shows how we’re solving that problem. The future of shipbuilding will look very different from the past.show more

Real-time generation isn’t about predicting the next pixel, it... requires understanding the structure and context of a 3D world. That’s the shift. Read more about our real-time game-native diffusion model on our blog. Moonlake's Reverie v0.1.0show more

Introducing “FlowCam: Training Generalizable 3D Radiance Fields w/o Camera... Poses via Pixel-Aligned Scene Flow”! We train a generalizable 3D scene representation self-supervised on datasets of raw videos, without any pre-computed camera poses or SFM! 1/nshow more

Out of Context Human Race a friendly reminder

Announcing AlphaFold 3: our state-of-the-art AI model for predicting... the structure and interactions of all life’s molecules. 🧬 Here’s how we built it with Isomorphic Labs and what it means for biology. 🧵show more

From a recent conversation with the great Kevin DeAnna... (Kevin DeAnna) as part of his program Identity Politcs. We must build a future as glorious as our past.show more

the future is predicting the future

Is this an IQ problem?? whats the point of... this tackle from Gusto when you already leading by 3 goals?..show more

(1/2) MonoNPHM will be presented as a #CVPR2024 Highlight!... Our Neural Parametric Head Model parametrizes both geometry and appearance. With the learned model, we can then 3D reconstruct and track human heads from images or videos.show more

Thread of beautiful things from the past 🧵 1.... A stunning drinks cabinet from the 1930sshow more

SpatialTracker Tracking Any 2D Pixels in 3D Space Recovering... dense and long-range pixel motion in videos is a challenging problem. Part of the difficulty arises from the 3D-to-2D projection process, leading to occlusions and discontinuities in the 2D motion domain.show more

Out of Context Human Race Truck drives into a protester