Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Forget lidar. One single camera. Runs in real time & is open source: A streaming 3D model that reconstructs scenes live, at ~20 FPS, over long sequences. End-to-end. Optimization tricks, cleanup steps? Nope. And it beats both streaming and even some offline methods. Perception is becoming software-first. Closer to... show more

Ilir Aliu

56,745 subscribers

112,718 views • 6 days ago •via X (Twitter)

Science & Technology

Anya Rossi• Live Now

Private livecam show

8 Comments

Jeremy Longworth6 days ago

This is a big step for software-defined perception. A single camera feeding a model that can maintain geometry, pose and long-range context at ~20 FPS changes the economics of giving machines spatial awareness. I wouldn’t write lidar off, but the amount of useful 3D understanding we can now extract from ordinary vision is accelerating fast.

SpiderMonkey ☀️🌳6 days ago

This looks awesome, might see if I can slap this on Boop to help navigate the home

Pacer6 days ago

In daylight or places that are lit, yes. Cameras are great for mapping things. Sometimes it may be a little innaccurate, depending on its speed and computation. With anything living or moving in the picture, I assume it would look like an expsoure technique swirling around.

ThisMightWork6 days ago

The 10,000+ frame runs are the interesting part for me. Does revisiting an earlier room tighten the map, or mainly reveal how much it drifted? A “walk out, take a long detour, come back” demo would be useful.

WhatAboutFrank6 days ago

INSANEO

Stephane6 days ago

This is great. Love this kind of work.

Cato6 days ago

if i have mutliple cameras can it merge them?

BreezeOg6 days ago

one camera and 20 fps live lidar companies sweating

Related Videos

China open-sourced a model that reconstructs any scene in 3D from a regular video, in real-time. one camera. no LiDAR. 10,000+ frames without falling apart. just walk around with your camera and watch the entire world get rebuilt in 3D at 20 fps. → runs at ~20 FPS on a single GPU → Stable over 10,000+ frames → Beats optimization-based methods on benchmarks → Works on drone footage, driving videos, indoor walkthroughs 100% open source.

China open-sourced a model that reconstructs any scene in 3D from a regular video, in real-time. one camera. no LiDAR. 10,000+ frames without falling apart. just walk around with your camera and watch the entire world get rebuilt in 3D at 20 fps. → runs at ~20 FPS on a single GPU → Stable over 10,000+ frames → Beats optimization-based methods on benchmarks → Works on drone footage, driving videos, indoor walkthroughs 100% open source.

Superman

1,459,844 views • 2 months ago

China open-sourced a model that reconstructs any scene in 3D from a regular video, in real-time. one camera. no LiDAR. 10,000+ frames without falling apart. just walk around with your camera and watch the entire world get rebuilt in 3D at 20 fps. → runs at ~20 FPS on a single GPU → Stable over 10,000+ frames → Beats optimization-based methods on benchmarks → Works on drone footage, driving videos, indoor walkthroughs 100% open source.

China open-sourced a model that reconstructs any scene in 3D from a regular video, in real-time. one camera. no LiDAR. 10,000+ frames without falling apart. just walk around with your camera and watch the entire world get rebuilt in 3D at 20 fps. → runs at ~20 FPS on a single GPU → Stable over 10,000+ frames → Beats optimization-based methods on benchmarks → Works on drone footage, driving videos, indoor walkthroughs 100% open source.

Yasir Ai

254,803 views • 2 months ago

The first open-source unified world model for scalable robot manipulation: 5B-parameter open-source unified video-action world model that combines policy and world modeling to generate robot actions, predict future visuals, and evaluate task progress from observations, language, and state. The model is trained on 27.3K hours of heterogeneous data (17.8K real-robot teleop, 6.5K UMI demos, 3K egocentric human videos), enabling it to perform complex manipulation tasks like faucet connecting, bag packing, and toolbox storing as shown in demo videos. The approach supports test-time action refinement and points toward deployment-driven continuous improvement via fleet data. Thanks for sharing, Jianlan Luo (Jianlan Luo)! 📌 Resource links for τ0-WM: • Project page: • GitHub (code): • Hugging Face (model weights): • Paper (PDF): ——- Weekly robotics and AI insights. Subscribe free:

The first open-source unified world model for scalable robot manipulation: 5B-parameter open-source unified video-action world model that combines policy and world modeling to generate robot actions, predict future visuals, and evaluate task progress from observations, language, and state. The model is trained on 27.3K hours of heterogeneous data (17.8K real-robot teleop, 6.5K UMI demos, 3K egocentric human videos), enabling it to perform complex manipulation tasks like faucet connecting, bag packing, and toolbox storing as shown in demo videos. The approach supports test-time action refinement and points toward deployment-driven continuous improvement via fleet data. Thanks for sharing, Jianlan Luo (Jianlan Luo)! 📌 Resource links for τ0-WM: • Project page: • GitHub (code): • Hugging Face (model weights): • Paper (PDF): ——- Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

28,276 views • 4 months ago

🚀 We open-sourced LongLive — interactive, real-time long-video generation. 👥Generates video in real time as users enter text prompts. ⚡️20.7 FPS on a single H100,⏱️up to 240s per clip. 🎬Fine-tunes SOTA short-video models (e.g., Wan) into long-video generators. 🌍One step closer to World Models. All code for training & inference, model weights, demo page, and videos released! Paper: Code: Model: Demo Page: Introduction Video:

🚀 We open-sourced LongLive — interactive, real-time long-video generation. 👥Generates video in real time as users enter text prompts. ⚡️20.7 FPS on a single H100,⏱️up to 240s per clip. 🎬Fine-tunes SOTA short-video models (e.g., Wan) into long-video generators. 🌍One step closer to World Models. All code for training & inference, model weights, demo page, and videos released! Paper: Code: Model: Demo Page: Introduction Video:

Yukang Chen

11,943 views • 1 year ago

Stereo depth models usually force a tradeoff. 📌 Paper + Code Either strong zero-shot generalization or real-time speed. Fast-FoundationStereo closes that gap. The model accelerates FoundationStereo by more than 10× while keeping comparable depth quality, making real-time stereo matching practical for robotics and XR. On an RTX 3090, it produces dense metric depth maps and 3D point clouds in real time, outperforming existing real-time stereo approaches and even challenging some heavier zero-shot models. The key idea is a divide-and-conquer architecture that removes bottlenecks in common stereo matching components while preserving the strengths of the original teacher model. Training also tackles a major constraint in stereo vision: the lack of ground-truth metric depth data. The team built an automatic data curation pipeline that generates pseudo-labels from internet-scale stereo imagery using the Stereo4D dataset. Result: a real-time stereo foundation model with strong zero-shot performance and practical runtime speed. Code, pretrained weights, and pseudo-labeled stereo data will be released. Thanks for sharing, Bowen Wen! 📍Paper: Code: Project: ——- Weekly robotics and AI insights. Subscribe free:

Stereo depth models usually force a tradeoff. 📌 Paper + Code Either strong zero-shot generalization or real-time speed. Fast-FoundationStereo closes that gap. The model accelerates FoundationStereo by more than 10× while keeping comparable depth quality, making real-time stereo matching practical for robotics and XR. On an RTX 3090, it produces dense metric depth maps and 3D point clouds in real time, outperforming existing real-time stereo approaches and even challenging some heavier zero-shot models. The key idea is a divide-and-conquer architecture that removes bottlenecks in common stereo matching components while preserving the strengths of the original teacher model. Training also tackles a major constraint in stereo vision: the lack of ground-truth metric depth data. The team built an automatic data curation pipeline that generates pseudo-labels from internet-scale stereo imagery using the Stereo4D dataset. Result: a real-time stereo foundation model with strong zero-shot performance and practical runtime speed. Code, pretrained weights, and pseudo-labeled stereo data will be released. Thanks for sharing, Bowen Wen! 📍Paper: Code: Project: ——- Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

11,914 views • 1 month ago

We're helping AI to see the 3D world in motion as humans do. 🌐 Enter D4RT: a unified model that turns video into 4D representations faster than previous methods - enabling it to understand space and time. This is how it works 🧵

We're helping AI to see the 3D world in motion as humans do. 🌐 Enter D4RT: a unified model that turns video into 4D representations faster than previous methods - enabling it to understand space and time. This is how it works 🧵

Google DeepMind

369,857 views • 8 months ago

That was quick: last week Genie 3 was revealed. One week later Skywork AI releases Matrix-Game 2.0: An Open-Source, Real-Time, and Streaming Interactive World Model. Matrix-Game 2.0 can generate high-quality minute-level videos across diverse scenes at an ultra-fast speed of 25 FPS. They open-source our model weights and codebase to advance research in interactive world modeling. Some examples:

That was quick: last week Genie 3 was revealed. One week later Skywork AI releases Matrix-Game 2.0: An Open-Source, Real-Time, and Streaming Interactive World Model. Matrix-Game 2.0 can generate high-quality minute-level videos across diverse scenes at an ultra-fast speed of 25 FPS. They open-source our model weights and codebase to advance research in interactive world modeling. Some examples:

Chubby♨️

115,301 views • 1 year ago

RobotGPT anyone? I’m thrilled to announce a project that I consider the first steps towards it, a virtual environment to act as a foundational training ground for end-to-end models. Next phase is using it to build and train models. Check it out: special thanks to Harrison Kinsley Chris Paxton Hasan

RobotGPT anyone? I’m thrilled to announce a project that I consider the first steps towards it, a virtual environment to act as a foundational training ground for end-to-end models. Next phase is using it to build and train models. Check it out: special thanks to Harrison Kinsley Chris Paxton Hasan

Devrim Yasar

33,491 views • 2 years ago

Scaling 3D scene data is a long-standing challenge in scene understanding, spatial reasoning, and robotics. Since scanning, reconstruction, and labeling are so labor-intensive, data scarcity has remained a major bottleneck. 🛑 To solve this, we propose SceneVerse++: Lifting Unlabeled Internet-level Data for 3D Scene Understanding (CVPR 2026). By reconstructing internet videos and annotating 3D scenes automatically, we’ve created a massive real-world dataset for end-to-end understanding. 🌐📐 SceneVerse++ makes it easy to scale "in-the-wild" 3D scenes toward more capable spatial reasoning systems. This significantly promotes progress in 3D VQA, visual navigation, and broader tasks in Embodied AI and Robotics. 🤖🦾 We are fully open-sourced! Check out the paper, code, and data here: 🌐 Project: 📄 Paper: 📊 Dataset: Code:

Scaling 3D scene data is a long-standing challenge in scene understanding, spatial reasoning, and robotics. Since scanning, reconstruction, and labeling are so labor-intensive, data scarcity has remained a major bottleneck. 🛑 To solve this, we propose SceneVerse++: Lifting Unlabeled Internet-level Data for 3D Scene Understanding (CVPR 2026). By reconstructing internet videos and annotating 3D scenes automatically, we’ve created a massive real-world dataset for end-to-end understanding. 🌐📐 SceneVerse++ makes it easy to scale "in-the-wild" 3D scenes toward more capable spatial reasoning systems. This significantly promotes progress in 3D VQA, visual navigation, and broader tasks in Embodied AI and Robotics. 🤖🦾 We are fully open-sourced! Check out the paper, code, and data here: 🌐 Project: 📄 Paper: 📊 Dataset: Code:

Siyuan Huang

12,842 views • 5 months ago

MINT is now open source. From first-person RGB video, MINT reconstructs 3D camera trajectories and bimanual hand motion in a shared world coordinate system. Reconstructed human hand motion can also be retargeted to WUJI Hand. The release includes model weights, training and inference code, visualization and evaluation tools, EgoPipeline reference code, and structured annotations for 560,649 episodes covering 1,021 hours of first-person video. Project: Code: #MINT #EmbodiedAI #Robotics #WUJIHand

MINT is now open source. From first-person RGB video, MINT reconstructs 3D camera trajectories and bimanual hand motion in a shared world coordinate system. Reconstructed human hand motion can also be retargeted to WUJI Hand. The release includes model weights, training and inference code, visualization and evaluation tools, EgoPipeline reference code, and structured annotations for 560,649 episodes covering 1,021 hours of first-person video. Project: Code: #MINT #EmbodiedAI #Robotics #WUJIHand

WUJI

23,264 views • 1 month ago

PERCEPTRON JUST DROPPED WHAT MIGHT BE THE BEST OPEN-WEIGHT MODEL FOR ROBOTICS Isaac 0.5 is an absolute beast. Instead of treating vision and movement as separate systems, it is a fully open foundation model that learns to process both at the exact same time. .. and by merging perception and control, it unlocks true real-time visual decision making. Some core stats: → 35 hardware embodiments → 100k hours of demonstrations → SOTA across core embodied reasoning benchmarks → Significantly lower inference FLOPs Best part? Perceptron AI open-sourced the ENTIRE stack! Training code, inference code, and weights are all public. Repo, weights, and paper in 🧵 ↓

PERCEPTRON JUST DROPPED WHAT MIGHT BE THE BEST OPEN-WEIGHT MODEL FOR ROBOTICS Isaac 0.5 is an absolute beast. Instead of treating vision and movement as separate systems, it is a fully open foundation model that learns to process both at the exact same time. .. and by merging perception and control, it unlocks true real-time visual decision making. Some core stats: → 35 hardware embodiments → 100k hours of demonstrations → SOTA across core embodied reasoning benchmarks → Significantly lower inference FLOPs Best part? Perceptron AI open-sourced the ENTIRE stack! Training code, inference code, and weights are all public. Repo, weights, and paper in 🧵 ↓

Charly Wargnier ♨️

47,979 views • 1 month ago

1/ Tencent releases HY World 1.5 (WorldPlay), an open-source real-time world model with 24fps A streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency In direct comparison to Genie 3, it's technically inferior, and there's no information on how long the consistency will last. However, Tencent has released a significant world model as open source for the first time, making it available to everyone. A few more examples, a thread 🧵

1/ Tencent releases HY World 1.5 (WorldPlay), an open-source real-time world model with 24fps A streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency In direct comparison to Genie 3, it's technically inferior, and there's no information on how long the consistency will last. However, Tencent has released a significant world model as open source for the first time, making it available to everyone. A few more examples, a thread 🧵

Chubby♨️

37,776 views • 10 months ago

Open-source robot arm meets hand tracking [📍GitHub below] It is designed with an industrial mindset but built as a 3D-printed desktop system. PAROL6 paired with a LEAP Motion controller is a nice example of how accessible robot teleoperation has become. • Hand motion is streamed to the robot at 100 Hz via UDP • A pneumatic gripper is controlled by simple fist open and close gestures • The entire robot stack is open source, from mechanics to control software Combine that with low-latency hand tracking and you get a very practical platform for learning manipulation, teleoperation, and human-robot interfaces. This kind of setup is great for experimentation, teleop, data collection, and teaching robots by demonstration All without proprietary hardware or locked software. Credit to SourceRobotics 📍Code: —— Weekly robotics and AI insights. Subscribe free:

Open-source robot arm meets hand tracking [📍GitHub below] It is designed with an industrial mindset but built as a 3D-printed desktop system. PAROL6 paired with a LEAP Motion controller is a nice example of how accessible robot teleoperation has become. • Hand motion is streamed to the robot at 100 Hz via UDP • A pneumatic gripper is controlled by simple fist open and close gestures • The entire robot stack is open source, from mechanics to control software Combine that with low-latency hand tracking and you get a very practical platform for learning manipulation, teleoperation, and human-robot interfaces. This kind of setup is great for experimentation, teleop, data collection, and teaching robots by demonstration All without proprietary hardware or locked software. Credit to SourceRobotics 📍Code: —— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

32,823 views • 23 days ago

🚀 Excited to release LongLive 2.0! 🎬 An end-to-end infrastructure for long video generation, with FP4 and parallelism at the core of both training and inference. ⚡45.7 FPS generation speed on 5B model⚡ ✨ LongLive 2.0 supports real-video training, few-step distillation, multi-shot training/inference, sequence-parallel acceleration, NVFP4 KV cache, and async VAE decoding deployment. 🧩 To our knowledge, this is the first open-source 4-bit long video generation infra that covers both training and inference. 🙌 Welcome to check it out, try it, and share feedback! 🔗 Code: 📰 Paper: 🎥 Demo: #LongVideoGeneration #VideoGeneration #Realtime #AIInfra #EfficientAI #FP4 #Parallel #NVIDIA

🚀 Excited to release LongLive 2.0! 🎬 An end-to-end infrastructure for long video generation, with FP4 and parallelism at the core of both training and inference. ⚡45.7 FPS generation speed on 5B model⚡ ✨ LongLive 2.0 supports real-video training, few-step distillation, multi-shot training/inference, sequence-parallel acceleration, NVFP4 KV cache, and async VAE decoding deployment. 🧩 To our knowledge, this is the first open-source 4-bit long video generation infra that covers both training and inference. 🙌 Welcome to check it out, try it, and share feedback! 🔗 Code: 📰 Paper: 🎥 Demo: #LongVideoGeneration #VideoGeneration #Realtime #AIInfra #EfficientAI #FP4 #Parallel #NVIDIA

Yukang Chen

59,949 views • 4 months ago

Tired of teleoperation? One human video → 1,000s of robot demos. (📍GitHub ) Scaling Robot Data Without Dynamics Simulation or Robot Hardware Real2Render2Real (R2R2R) is a new way to scale robot data without physics simulation or hardware. You take a phone scan + a single monocular human demo. It tracks the motion, renders photorealistic scenes, and generates diverse, robot-agnostic trajectories ready for training. > No teleop, no sim, no robot, just a phone and a video > Train VLA models and diffusion policies directly on the output > Supports multiple robot embodiments with kinematic consistency > 1000s of demos in 1/27 the time of real-world collection Thank you, Max Fu, for sharing!! Project: Paper: Code coming soon: It shows that with the right pipeline, you can scale robot learning data without touching a robot. One of the most interesting directions in scalable robotics today. —— Weekly robotics and AI insights. Subscribe free:

Tired of teleoperation? One human video → 1,000s of robot demos. (📍GitHub ) Scaling Robot Data Without Dynamics Simulation or Robot Hardware Real2Render2Real (R2R2R) is a new way to scale robot data without physics simulation or hardware. You take a phone scan + a single monocular human demo. It tracks the motion, renders photorealistic scenes, and generates diverse, robot-agnostic trajectories ready for training. > No teleop, no sim, no robot, just a phone and a video > Train VLA models and diffusion policies directly on the output > Supports multiple robot embodiments with kinematic consistency > 1000s of demos in 1/27 the time of real-world collection Thank you, Max Fu, for sharing!! Project: Paper: Code coming soon: It shows that with the right pipeline, you can scale robot learning data without touching a robot. One of the most interesting directions in scalable robotics today. —— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

42,864 views • 8 months ago

A GUY PUT GPT-LEVEL AI INSIDE A 3D PRINTED ROBOT AND RELEASED THE ENTIRE THING FOR FREE Most people look at a 3D printer and see plastic toys This guy printed a robot with expressive eyes, object tracking, image recognition, support for ChatGPT, Qwen and offline models, then uploaded the STL files, code and hardware designs for anyone to build themselves The interesting part isn't the robot It's how fast the gap between "I have an idea" and "I built a working product" is disappearing A few years ago this required a team of engineers Now one person with a printer, open-source software and enough curiosity can build something that looks like it came from a robotics startup We're getting very close to a world where manufacturing, AI and robotics stop being separate industries and start becoming the same thing

A GUY PUT GPT-LEVEL AI INSIDE A 3D PRINTED ROBOT AND RELEASED THE ENTIRE THING FOR FREE Most people look at a 3D printer and see plastic toys This guy printed a robot with expressive eyes, object tracking, image recognition, support for ChatGPT, Qwen and offline models, then uploaded the STL files, code and hardware designs for anyone to build themselves The interesting part isn't the robot It's how fast the gap between "I have an idea" and "I built a working product" is disappearing A few years ago this required a team of engineers Now one person with a printer, open-source software and enough curiosity can build something that looks like it came from a robotics startup We're getting very close to a world where manufacturing, AI and robotics stop being separate industries and start becoming the same thing

Deydara

57,467 views • 4 months ago

2D is what the camera sees.👀 3D is what the world is. 🌍 Today, we’re proudly open-sourcing QuerySplat — an open-source feed-forward 3D model that turns a few unposed images into a navigable 3D scene in seconds (run on 4090🪶). Your input: a few unposed images Our output: a sharp, navigable 3D scene — generated in seconds! 🚀 🧠 organize scenes with 3D queries, not pixel-bound Gaussians 📷 no camera poses or manual calibration required ⚡ reconstruct new scenes in a single forward pass ✨ preserve sharp geometry and high-frequency appearance 🏆 achieve state-of-the-art results on DL3DV-Evaluation 🔓 code and model weights are now open-source From pixels to scenes, we are making 3D generation scalable. Try our free iOS app — it’s a lot of fun! 😆 🔗 Try it on the Web: 🔗 Paper: 🔗 Code & weights: 🔗 Project page: 🔗 #AIGC #3DGS #AI #Computervision #3D #artist #3dartist #3d

2D is what the camera sees.👀 3D is what the world is. 🌍 Today, we’re proudly open-sourcing QuerySplat — an open-source feed-forward 3D model that turns a few unposed images into a navigable 3D scene in seconds (run on 4090🪶). Your input: a few unposed images Our output: a sharp, navigable 3D scene — generated in seconds! 🚀 🧠 organize scenes with 3D queries, not pixel-bound Gaussians 📷 no camera poses or manual calibration required ⚡ reconstruct new scenes in a single forward pass ✨ preserve sharp geometry and high-frequency appearance 🏆 achieve state-of-the-art results on DL3DV-Evaluation 🔓 code and model weights are now open-source From pixels to scenes, we are making 3D generation scalable. Try our free iOS app — it’s a lot of fun! 😆 🔗 Try it on the Web: 🔗 Paper: 🔗 Code & weights: 🔗 Project page: 🔗 #AIGC #3DGS #AI #Computervision #3D #artist #3dartist #3d

InSpatio｜影溯

29,806 views • 2 months ago

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a camera-conditioned video diffusion model can be transformed into a generative reconstruction model that directly outputs a high-quality 3D Gaussian Splatting representation through self-distillation, without requiring real-world training data. Check out our results in the video (wait for dynamic scenes in the second half!) : Project Page: Code and Models: Paper:

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a camera-conditioned video diffusion model can be transformed into a generative reconstruction model that directly outputs a high-quality 3D Gaussian Splatting representation through self-distillation, without requiring real-world training data. Check out our results in the video (wait for dynamic scenes in the second half!) : Project Page: Code and Models: Paper:

Sherwin Bahmani

66,897 views • 1 year ago

Before AI can understand the physical world, it needs data about the physical world. Not just images. Spatial environments. Real streets, buildings, parks, stores, museums, and public spaces captured in 3D. OVER has already reconstructed 290,000+ real-world 3D scenes, creating a growing dataset for the next generation of spatial and embodied AI. And this is exactly the kind of real-world spatial data AI companies are looking for. We're already in conversations with multiple AI and Robotics companies exploring how OVER's dataset can support the development and training of models that need to understand the physical world. The next AI race will be about real-world data.

Before AI can understand the physical world, it needs data about the physical world. Not just images. Spatial environments. Real streets, buildings, parks, stores, museums, and public spaces captured in 3D. OVER has already reconstructed 290,000+ real-world 3D scenes, creating a growing dataset for the next generation of spatial and embodied AI. And this is exactly the kind of real-world spatial data AI companies are looking for. We're already in conversations with multiple AI and Robotics companies exploring how OVER's dataset can support the development and training of models that need to understand the physical world. The next AI race will be about real-world data.

Over the Reality 🌐

24,152 views • 18 days ago

I don't know if you really understand what these people just did... They built an AI that looks at a few casual real-world videos or photos and instantly turns them into a full 3D playground. You can MOVE THE CAMERA HOWEVER YOU WANT, change the lighting, move objects around, and even let physics play out like in the real world. View events from impossible angles because Atlas knows what was there. This is massive! Let's take robotics. Until now training robots meant collecting tons of expensive real-world data. Now a handful of recordings can become thousands of different simulated situations. Robots can practice the same task in new rooms, with different objects and lighting without anyone having to film it all again. For the industry it means we can train robots way faster and cheaper. Home robots, warehouse robots, whatever... they can learn new environments at scale instead of staying stuck in the lab. This is one of the first real bridges between “cool AI video models” and actual physical machines that have to work in the real world. Blog: The team behind World Labs: Fei-Fei Li, Justin Johnson, Ben Mildenhall and Yunzhu Li. The video is from David Pantera. Follow for more insights into robotics and AI. —— Weekly robotics and AI insights. Subscribe free:

I don't know if you really understand what these people just did... They built an AI that looks at a few casual real-world videos or photos and instantly turns them into a full 3D playground. You can MOVE THE CAMERA HOWEVER YOU WANT, change the lighting, move objects around, and even let physics play out like in the real world. View events from impossible angles because Atlas knows what was there. This is massive! Let's take robotics. Until now training robots meant collecting tons of expensive real-world data. Now a handful of recordings can become thousands of different simulated situations. Robots can practice the same task in new rooms, with different objects and lighting without anyone having to film it all again. For the industry it means we can train robots way faster and cheaper. Home robots, warehouse robots, whatever... they can learn new environments at scale instead of staying stuck in the lab. This is one of the first real bridges between “cool AI video models” and actual physical machines that have to work in the real world. Blog: The team behind World Labs: Fei-Fei Li, Justin Johnson, Ben Mildenhall and Yunzhu Li. The video is from David Pantera. Follow for more insights into robotics and AI. —— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

273,520 views • 1 month ago