Checkout ObjectForesight! We tackle the problem of predicting future... 3D object trajectories given a past context, purely from human videos of everyday interactions! [1/n]show more

Introducing MotionForesight: A very simple approach re-purposing video models... for forecasting future 3D scene flow given a short observed video context Trained with just 40k RGB human videos, it generalizes well to completely new home/office scenes! 1/nshow more

#ECCV24 We introduce Controllable Human-Object Interaction Synthesis (CHOIS) to... generate interactions given text in a 3D scene. w alex, Roozbeh Mottaghi Jiajun Wu Xavier Puig Karen. code: project page:show more

We recently obtained the highest-resolution 3D images of the... human brain ever taken from outside the skull. This is the first look. Introducing Aleph, a research lab building brain interfaces for the telepathic future. (1/n)show more

we open sourced the code to transform human videos... into robot trajectories, so you can train robots with your hands 👐🏻 we used it in our recent paper R+X: Retrieval and Execution from Everyday Human Videos (ICRA 2025 🇺🇸) link and details in thread 🧵show more

If you’re not in freefall, you’re likely contacting something.... Yet 3D human-object interaction (HOI) reconstruction remains underexplored. PICO (#CVPR2025) recovers humans 🏃‍♂️, objects 🏓, and their interactions 👉🍎- all in 3D, from just a single internet image. 1/11show more

Humans are social creatures and physical interaction with other... humans plays an important role in our everyday life. In this thread, we explain how such interactions can be reconstructed in 3D from a single image utilising a denoising diffusion probabilistic model. (1/n)show more

The context size of video world models is only... a few frames. Like a human with severe memory loss! We design a long-term memory for world models based on explicit 3D representations inspired by the human mind. This enables long-term consistency. 1/3show more

Even AI can't fake triangle formation of orbs flying... around a plane in 3D, but people think someone faked two videos in just a couple weeks. I don't build anything because the problem of free energy is purely psychological. We have to stop believing what we were told and think for ourselves.show more

Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos... with Spatio-Temporal Diffusion Models Contributions: • We introduce Diffuman4D, a novel diffusion model that generates spatio-temporally consistent and high-resolution (1024p) human videos from sparse-view video inputs. • We propose a sliding iterative denoising mechanism that enhances both the spatial and temporal consistency of generated long-term videos while maintaining efficient inference. • We design a human pose conditioning scheme to enhance the appearance quality and motion accuracy of generated human videos. • We plan to release our processed version of the DNA-Rendering dataset, which we believe will benefit future research in this area.show more

Fit-up of bent or warped material is one of... the most challenging aspects of autonomous shipbuilding. This lil’ snippet from an upcoming video shows how we’re solving that problem. The future of shipbuilding will look very different from the past.show more

Real-time generation isn’t about predicting the next pixel, it... requires understanding the structure and context of a 3D world. That’s the shift. Read more about our real-time game-native diffusion model on our blog. Moonlake's Reverie v0.1.0show more

Introducing “FlowCam: Training Generalizable 3D Radiance Fields w/o Camera... Poses via Pixel-Aligned Scene Flow”! We train a generalizable 3D scene representation self-supervised on datasets of raw videos, without any pre-computed camera poses or SFM! 1/nshow more

Out of Context Human Race a friendly reminder

Announcing AlphaFold 3: our state-of-the-art AI model for predicting... the structure and interactions of all life’s molecules. 🧬 Here’s how we built it with Isomorphic Labs and what it means for biology. 🧵show more

From a recent conversation with the great Kevin DeAnna... (Kevin DeAnna) as part of his program Identity Politcs. We must build a future as glorious as our past.show more

Is this an IQ problem?? whats the point of... this tackle from Gusto when you already leading by 3 goals?..show more

(1/2) MonoNPHM will be presented as a #CVPR2024 Highlight!... Our Neural Parametric Head Model parametrizes both geometry and appearance. With the learned model, we can then 3D reconstruct and track human heads from images or videos.show more

the future is predicting the future

Thread of beautiful things from the past 🧵 1.... A stunning drinks cabinet from the 1930sshow more