Loading video...

Video Failed to Load

Go Home

Robotics is almost solved! Pun intended. Sunday published a "Solve" standard. They declared the scope (garment types, lighting, surfaces, starting configurations) and adaptation cost (zero—no fine-tuning per home) before evaluating. The same model weights run everywhere. This might be the differentiation between a good demo and reliable work of...

lukas_m_ziegler's profile picture

Lukas Ziegler

60,125 subscribers

37,023 views • 1 month ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

JUST IN: Dyna Robotics just published one of the most important research papers in robotics this year. It could fundamentally change how robot foundation models are trained. A scaling law that transfers from human video to robot performance. Dyna-2 is out and it's 🔥 Here's what that means in plain terms. Dyna-2 was pre-trained on ONE MILLION hours of egocentric human video, 170 years of continuous human experience, cooking, folding, assembling, cleaning. And as that human data scaled, robot performance improved. Predictably. Monotonically. Across 39 tasks on two different robot embodiments the model had never seen. → 1,000 hours pre-training → 20% normalised task performance → 10,000 hours → 28% → 100,000 hours → 45% → 1,000,000 hours → 53% Human video exists at effectively unlimited scale. Every cook, every factory worker, every craftsperson wearing a camera is generating training data for future robots. But the finding that stunned even the researchers, world modeling is what makes the transfer work. A model trained to predict future video AND actions massively outperforms one trained on actions alone. Video is the new scaling axis for robotics. One more jaw-dropping data point. 13 minutes of teleoperation data was enough to fine-tune Dyna-2 to open a bottle cap using two five-fingered robot hands. The robots are coming, and they're learning from us directly :D Read more here: Congrats Jason Ma and team! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
1:35

JUST IN: Dyna Robotics just published one of the most important research papers in robotics this year. It could fundamentally change how robot foundation models are trained. A scaling law that transfers from human video to robot performance. Dyna-2 is out and it's 🔥 Here's what that means in plain terms. Dyna-2 was pre-trained on ONE MILLION hours of egocentric human video, 170 years of continuous human experience, cooking, folding, assembling, cleaning. And as that human data scaled, robot performance improved. Predictably. Monotonically. Across 39 tasks on two different robot embodiments the model had never seen. → 1,000 hours pre-training → 20% normalised task performance → 10,000 hours → 28% → 100,000 hours → 45% → 1,000,000 hours → 53% Human video exists at effectively unlimited scale. Every cook, every factory worker, every craftsperson wearing a camera is generating training data for future robots. But the finding that stunned even the researchers, world modeling is what makes the transfer work. A model trained to predict future video AND actions massively outperforms one trained on actions alone. Video is the new scaling axis for robotics. One more jaw-dropping data point. 13 minutes of teleoperation data was enough to fine-tune Dyna-2 to open a bottle cap using two five-fingered robot hands. The robots are coming, and they're learning from us directly :D Read more here: Congrats Jason Ma and team! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

23,576 views • 28 days ago

Brain-controlled exoskeletons to train humanoid robots! 🧠 Fourier just presented human tele-operators using brain control interfaces and exoskeletal arms to train humanoid robots on home tasks. The brain control interface is the interesting part. Instead of using a controller or joystick to teleoperate, the operator's movements and intentions are captured more naturally through the exoskeleton and BCI. This means the demonstrations are more fluid, more human-like, and better suited for training robots to perform delicate home tasks. Multiple tele-operators are simultaneously generating training data across multiple robots. This is how you build the dataset needed for eventual full autonomy, without waiting years for it to arrive. This might be the bridge between "robots that work in controlled environments" and "robots that work in homes." Not full autonomy right away, but trusted human intelligence operating through a robot body, getting better with every task completed. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:56

Brain-controlled exoskeletons to train humanoid robots! 🧠 Fourier just presented human tele-operators using brain control interfaces and exoskeletal arms to train humanoid robots on home tasks. The brain control interface is the interesting part. Instead of using a controller or joystick to teleoperate, the operator's movements and intentions are captured more naturally through the exoskeleton and BCI. This means the demonstrations are more fluid, more human-like, and better suited for training robots to perform delicate home tasks. Multiple tele-operators are simultaneously generating training data across multiple robots. This is how you build the dataset needed for eventual full autonomy, without waiting years for it to arrive. This might be the bridge between "robots that work in controlled environments" and "robots that work in homes." Not full autonomy right away, but trusted human intelligence operating through a robot body, getting better with every task completed. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

20,898 views • 7 months ago

Are you kidding me??? It grasps multiple objects with different ways, all at once with… a single hand??? No pauses. 1x speed. GENE-26.5 is Genesis AI’s robotics-native multimodal foundation model. It’s trained on 200,000+ hours of real human hand data (motion, force, touch) and runs on a 54-DoF bimanual system: Scaling that human data 4x lifted real-robot success rates from 16.6% to 65.6% on long-horizon dexterous tasks!! Same model weights, zero fine-tuning for this exact sequence. You know those tiny coordinated movements you do without thinking…? Robots couldn’t reliably do that before. Now they can. Today. This is the video you’ll send to my friends, outside of our bubble, when they say “robots are still just demos.” Congrats to the entire team around Zhou Xian! Credit: Seen at Zu Wang (Zu Wang) Genesis official announcement for the full story + longer demo: ——— Weekly robotics and AI insights. Subscribe free:
0:20

Are you kidding me??? It grasps multiple objects with different ways, all at once with… a single hand??? No pauses. 1x speed. GENE-26.5 is Genesis AI’s robotics-native multimodal foundation model. It’s trained on 200,000+ hours of real human hand data (motion, force, touch) and runs on a 54-DoF bimanual system: Scaling that human data 4x lifted real-robot success rates from 16.6% to 65.6% on long-horizon dexterous tasks!! Same model weights, zero fine-tuning for this exact sequence. You know those tiny coordinated movements you do without thinking…? Robots couldn’t reliably do that before. Now they can. Today. This is the video you’ll send to my friends, outside of our bubble, when they say “robots are still just demos.” Congrats to the entire team around Zhou Xian! Credit: Seen at Zu Wang (Zu Wang) Genesis official announcement for the full story + longer demo: ——— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

204,550 views • 4 months ago

Sunday Robotics' Tony Zhao runs a fully autonomous robot demo live and unscripted, and it corrects itself every time you mess with it: brexton: "I want to confirm for the audience right now that this is fully autonomous. There's no teleoperation, no one behind the curtain, and this is real time. And we did not prepare this demo before. Why do you think seeing real-time demos is so rare for robotics? What the audience is seeing right now is not that common." Tony Zhao: "In order for a live demo to work, it's really stressing all parts of the system. From the bottom is the reliability of the hardware, then the software system, then the model. Because we're a full-stack company, we're able to do excellent work across all of them. We have these robots running pretty much every day, and it just keeps getting better as they practice." brexton: "So kids can bump into Memo, people can drop clothes, and it will correct itself just on the fly." Tony Zhao: "Act Two is the first robotic policy that can handle the diversity of homes in a way that is this reliable. You can see as I'm twisting it, if I twist it in again, it will keep doing it. So Memo has infinite patience." Sunday
5:32

Sunday Robotics' Tony Zhao runs a fully autonomous robot demo live and unscripted, and it corrects itself every time you mess with it: brexton: "I want to confirm for the audience right now that this is fully autonomous. There's no teleoperation, no one behind the curtain, and this is real time. And we did not prepare this demo before. Why do you think seeing real-time demos is so rare for robotics? What the audience is seeing right now is not that common." Tony Zhao: "In order for a live demo to work, it's really stressing all parts of the system. From the bottom is the reliability of the hardware, then the software system, then the model. Because we're a full-stack company, we're able to do excellent work across all of them. We have these robots running pretty much every day, and it just keeps getting better as they practice." brexton: "So kids can bump into Memo, people can drop clothes, and it will correct itself just on the fly." Tony Zhao: "Act Two is the first robotic policy that can handle the diversity of homes in a way that is this reliable. You can see as I'm twisting it, if I twist it in again, it will keep doing it. So Memo has infinite patience." Sunday

MTS

134,079 views • 1 month ago

This is not a 2050 warehouse. This is a modern air hub of Amazon. Amazon uses robots to help sort and ship billions of packages each year. At Amazon Air, the company's main air hub in Kentucky, hundreds of self-charging robots zoom across the warehouse floor to organize orders. These robots, called “drives,” follow small stickers on the floor to know where to go and when to speed up or slow down. Amazon has more than ONE MILLION robots in its facilities, and it’s even deploying more new types of robots that can sort items of different shapes and sizes. P.S. Can you guess how many robots they had back in 2013? ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:23

This is not a 2050 warehouse. This is a modern air hub of Amazon. Amazon uses robots to help sort and ship billions of packages each year. At Amazon Air, the company's main air hub in Kentucky, hundreds of self-charging robots zoom across the warehouse floor to organize orders. These robots, called “drives,” follow small stickers on the floor to know where to go and when to speed up or slow down. Amazon has more than ONE MILLION robots in its facilities, and it’s even deploying more new types of robots that can sort items of different shapes and sizes. P.S. Can you guess how many robots they had back in 2013? ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

178,090 views • 1 month ago

Sunday Robotics CEO Tony Zhao believes home robots only need to master a handful of chores before they become indispensable. "What is the minimum number of tasks that a robot needs to do to justify its own existence so that people love having it in their homes? I actually think the list is pretty short. The tasks are pretty repetitive. You just need to learn it and just keep doing that over and over again, like folding shirts or loading dishwashers."
1:39

Sunday Robotics CEO Tony Zhao believes home robots only need to master a handful of chores before they become indispensable. "What is the minimum number of tasks that a robot needs to do to justify its own existence so that people love having it in their homes? I actually think the list is pretty short. The tasks are pretty repetitive. You just need to learn it and just keep doing that over and over again, like folding shirts or loading dishwashers."

TBPN

65,880 views • 1 month ago

Robot simulation is getting a big upgrade! 🔥 Normally, building a simulation environment, a kitchen, warehouse, office takes days or weeks. You have to model the geometry, add textures, set lighting, generate collision meshes… all before a robot can even interact with it. Marble by World Labs removes most of that work. You type a text prompt or give it an image, and it generates a full 3D scene with depth, lighting, and a collider mesh you can export into engines like MuJoCo. That means researchers can quickly create lots of different environments to train robots on, which is exactly what domain randomization needs. If we want robots to learn faster, we need to create worlds faster. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:59

Robot simulation is getting a big upgrade! 🔥 Normally, building a simulation environment, a kitchen, warehouse, office takes days or weeks. You have to model the geometry, add textures, set lighting, generate collision meshes… all before a robot can even interact with it. Marble by World Labs removes most of that work. You type a text prompt or give it an image, and it generates a full 3D scene with depth, lighting, and a collider mesh you can export into engines like MuJoCo. That means researchers can quickly create lots of different environments to train robots on, which is exactly what domain randomization needs. If we want robots to learn faster, we need to create worlds faster. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

15,498 views • 9 months ago

Foundation models are enough to solve robotics! Unfortunately, this is not true. We keep hearing that Vision-Language-Action (VLA) models struggle because of the gap between static training and the dynamic real world. A German startup (Sereact) just released a solution that bridges this gap perfectly. They are introducing a new paradigm called Interactive RL Policy Patching. It's a distributed framework that allows robots to self-learn from human corrections without needing full retraining. When a robot fails, a human operator provides a brief "patch" or demonstration. The system then uses online off-policy reinforcement learning to update the behavior instantly. This is powered by a massive foundation model trained on hundreds of millions of interactions from over 100 deployed robot stations. The best part is the distributed parameter synchronization... When one robot learns a fix, the update is published fleet-wide... meaning the entire swarm gets smarter from a single human intervention. They are already proving this on complex manipulation tasks like shoe unboxing and screw sorting, drastically reducing the data needed to handle edge cases. Real-world environments are unforgiving, and I love seeing systems that can actually adapt on the fly! 📍 More info:
0:38

Foundation models are enough to solve robotics! Unfortunately, this is not true. We keep hearing that Vision-Language-Action (VLA) models struggle because of the gap between static training and the dynamic real world. A German startup (Sereact) just released a solution that bridges this gap perfectly. They are introducing a new paradigm called Interactive RL Policy Patching. It's a distributed framework that allows robots to self-learn from human corrections without needing full retraining. When a robot fails, a human operator provides a brief "patch" or demonstration. The system then uses online off-policy reinforcement learning to update the behavior instantly. This is powered by a massive foundation model trained on hundreds of millions of interactions from over 100 deployed robot stations. The best part is the distributed parameter synchronization... When one robot learns a fix, the update is published fleet-wide... meaning the entire swarm gets smarter from a single human intervention. They are already proving this on complex manipulation tasks like shoe unboxing and screw sorting, drastically reducing the data needed to handle edge cases. Real-world environments are unforgiving, and I love seeing systems that can actually adapt on the fly! 📍 More info:

Ilir Aliu

18,210 views • 7 months ago

Robot trained entirely in simulation! 🤯 Sudo AI just released #sudo R1. This could be the moment the data bottleneck in robotics finally breaks, a major step forward for getting simulation-trained robots to actually work in the real world. #sudo R1 is a manipulation foundation model that reliably picks objects it has never seen: glass, fabric, metal, irregular shapes. All with zero real-world training data. No tele-op. No demos. No manual labeling. Pure simulation. And picking isn't just any skill, it's the foundation. Almost everything we want robots to do starts with being able to reliably pick something up. Data collection is the bottleneck holding the whole field back. Every new task means hours of tele-op and armies of labelers. If simulation alone can actually deliver production-grade picking, that bottleneck starts to disappear. Really exciting to see! If the results hold, the path to general-purpose robots just got a whole lot shorter. 👇 Read more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:59

Robot trained entirely in simulation! 🤯 Sudo AI just released #sudo R1. This could be the moment the data bottleneck in robotics finally breaks, a major step forward for getting simulation-trained robots to actually work in the real world. #sudo R1 is a manipulation foundation model that reliably picks objects it has never seen: glass, fabric, metal, irregular shapes. All with zero real-world training data. No tele-op. No demos. No manual labeling. Pure simulation. And picking isn't just any skill, it's the foundation. Almost everything we want robots to do starts with being able to reliably pick something up. Data collection is the bottleneck holding the whole field back. Every new task means hours of tele-op and armies of labelers. If simulation alone can actually deliver production-grade picking, that bottleneck starts to disappear. Really exciting to see! If the results hold, the path to general-purpose robots just got a whole lot shorter. 👇 Read more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

25,901 views • 4 months ago

Sunday Robotics raised $165M to deploy their home robot Memo, but the more interesting story is how they got here. Instead of starting with a robot, they started by putting sensor-equipped gloves into real homes to capture how people actually do chores like dishes, laundry, and cleaning. That data is now what powers Memo. Here’s my conversation with Co-founder & CEO Tony Zhao. 1:34 Why does the world need Sunday? 2:07 What does Sunday get right? 2:37 Hardest part of building a home robot? 3:12 What does the future of robotics look like? 4:54 What is Memo? 5:23 Biggest misconception about robotics? 5:54 What does a successful launch look like? 6:29 $1B valuation pre-launch. How do you handle it? 8:12 What do people underestimate about Sunday? 10:34 Favorite consumer hardware product Tony Zhao Sunday
14:39

Sunday Robotics raised $165M to deploy their home robot Memo, but the more interesting story is how they got here. Instead of starting with a robot, they started by putting sensor-equipped gloves into real homes to capture how people actually do chores like dishes, laundry, and cleaning. That data is now what powers Memo. Here’s my conversation with Co-founder & CEO Tony Zhao. 1:34 Why does the world need Sunday? 2:07 What does Sunday get right? 2:37 Hardest part of building a home robot? 3:12 What does the future of robotics look like? 4:54 What is Memo? 5:23 Biggest misconception about robotics? 5:54 What does a successful launch look like? 6:29 $1B valuation pre-launch. How do you handle it? 8:12 What do people underestimate about Sunday? 10:34 Favorite consumer hardware product Tony Zhao Sunday

Ritwik Pavan

26,762 views • 4 months ago

That's one of the coolest robotics demos! 😮‍💨 Generalist showed GEN-1 handling box folding and screw packing during Automate Show. The boxes are cardboard with real variability: creasing, deformation, different configurations. GEN-1 retries when things go wrong. It adapts mid-task. This is a jump from GEN-0, shown 3 months ago during GTC. GEN-0 handled rigid, predictable boxes. GEN-1 handles deformable ones with chaotic behavior. The scaling is straightforward. GEN-1 trained on 500,000 hours of proprietary, real-world dexterous manipulation data. Scaling laws are working. More high-quality real-world data leads to better physics understanding, better retry behavior, better generalization. And the time to get a working demo is shrinking drastically. They're not even at scale yet. They're just starting to see what happens when you pre-train on massive amounts of actual robot data. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:43

That's one of the coolest robotics demos! 😮‍💨 Generalist showed GEN-1 handling box folding and screw packing during Automate Show. The boxes are cardboard with real variability: creasing, deformation, different configurations. GEN-1 retries when things go wrong. It adapts mid-task. This is a jump from GEN-0, shown 3 months ago during GTC. GEN-0 handled rigid, predictable boxes. GEN-1 handles deformable ones with chaotic behavior. The scaling is straightforward. GEN-1 trained on 500,000 hours of proprietary, real-world dexterous manipulation data. Scaling laws are working. More high-quality real-world data leads to better physics understanding, better retry behavior, better generalization. And the time to get a working demo is shrinking drastically. They're not even at scale yet. They're just starting to see what happens when you pre-train on massive amounts of actual robot data. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

30,011 views • 2 months ago

Robots might learn better from video than from language! 📼 Most Vision-Language-Action (VLA) models learn what to do from text, but still struggle with how things move in the real world. That makes them data-hungry and slow to train. mimic video takes a different route. Instead of grounding robot control in text, it grounds it in video, using large pre-trained video models that already capture physical motion and dynamics. The idea is straightforward: let the video model handle “what will happen next,” and let a smaller control model focus only on turning that visual plan into robot actions. The result is big gains in practice. Robots trained this way need 10× less data, converge twice as fast, and perform better on both simulated benchmarks and real bimanual manipulation tasks. If robots can “imagine” motion using video, control becomes a much simpler problem. Shoutout to Jonas Pai, Liam Achenbach, Oier Mees, Elvis Nava and the rest of the team! Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:47

Robots might learn better from video than from language! 📼 Most Vision-Language-Action (VLA) models learn what to do from text, but still struggle with how things move in the real world. That makes them data-hungry and slow to train. mimic video takes a different route. Instead of grounding robot control in text, it grounds it in video, using large pre-trained video models that already capture physical motion and dynamics. The idea is straightforward: let the video model handle “what will happen next,” and let a smaller control model focus only on turning that visual plan into robot actions. The result is big gains in practice. Robots trained this way need 10× less data, converge twice as fast, and perform better on both simulated benchmarks and real bimanual manipulation tasks. If robots can “imagine” motion using video, control becomes a much simpler problem. Shoutout to Jonas Pai, Liam Achenbach, Oier Mees, Elvis Nava and the rest of the team! Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

50,090 views • 8 months ago

We might be solving the wrong problem in robotics. That’s what this makes clear. UMI → Universal Manipulation Interface A simple $400 gripper that lets you teach robots by demonstration. You hold it like a tool. Show the task. The robot learns. No teleoperation. No expensive hardware. No robot-specific data. Stanford open-sourced everything → hardware, code, datasets. What stands out to me is the bottleneck. Not algorithms. Data. Teleoperation → ~35 demos/hour UMI → ~111 demos/hour And the data transfers across robots → UR5, Franka, others. The design is surprisingly practical: → GoPro fisheye lens (155° FOV) + mirrors for depth → SLAM + IMU for precise 6DoF tracking → latency matching for dynamic tasks → diffusion policies for multimodal actions Then it scales. Cheng Chi takes this further with Sunday Robotics (with Tony Zhao). A $200 glove → deployed in 500+ homes → ~10 million real-world interactions. Not lab data. Real human behavior. Their robot learns dishes, laundry, espresso → with zero robot-specific data. This is where the shift becomes obvious. From training robots in controlled environments → to learning directly from humans at scale So here’s the real question: Will robotics be unlocked by better models… or by unlocking data? #ArtificialIntelligence #Robotics #AI #Innovation #FutureOfWork
0:20

We might be solving the wrong problem in robotics. That’s what this makes clear. UMI → Universal Manipulation Interface A simple $400 gripper that lets you teach robots by demonstration. You hold it like a tool. Show the task. The robot learns. No teleoperation. No expensive hardware. No robot-specific data. Stanford open-sourced everything → hardware, code, datasets. What stands out to me is the bottleneck. Not algorithms. Data. Teleoperation → ~35 demos/hour UMI → ~111 demos/hour And the data transfers across robots → UR5, Franka, others. The design is surprisingly practical: → GoPro fisheye lens (155° FOV) + mirrors for depth → SLAM + IMU for precise 6DoF tracking → latency matching for dynamic tasks → diffusion policies for multimodal actions Then it scales. Cheng Chi takes this further with Sunday Robotics (with Tony Zhao). A $200 glove → deployed in 500+ homes → ~10 million real-world interactions. Not lab data. Real human behavior. Their robot learns dishes, laundry, espresso → with zero robot-specific data. This is where the shift becomes obvious. From training robots in controlled environments → to learning directly from humans at scale So here’s the real question: Will robotics be unlocked by better models… or by unlocking data? #ArtificialIntelligence #Robotics #AI #Innovation #FutureOfWork

Pascal Bornet

186,712 views • 5 months ago

Jason Ma reveals the first true scaling law in robotics: robots trained on 1 million hours of first-person human video predictably get better without ever seeing robot data "Yesterday we announced our new flagship robot foundation model called Dyna-2. It's very significant for the entire field for many different reasons. First of all, it's the first robot foundation model trained on at least one million hours of data. That in itself is a very challenging infrastructure challenge." "What we demonstrated is that even if the one million hours of data is entirely first-person video of humans doing manipulation tasks, we actually see scaling law for transferring to robot embodiments that the model has never seen before." "By training on more human data, we actually see predictable performance improvement on robots. That's a big deal because the biggest challenge facing robot foundation models is that we don't have enough data." "Unlike language models, there are just not enough robotics data out there, and it's very difficult to collect these robot data. Only by passively observing humans doing things can we scale this kind of data, and this is the first time we showed there is a lot of improvement that can transfer." Jason Ma Dyna Robotics
1:14

Jason Ma reveals the first true scaling law in robotics: robots trained on 1 million hours of first-person human video predictably get better without ever seeing robot data "Yesterday we announced our new flagship robot foundation model called Dyna-2. It's very significant for the entire field for many different reasons. First of all, it's the first robot foundation model trained on at least one million hours of data. That in itself is a very challenging infrastructure challenge." "What we demonstrated is that even if the one million hours of data is entirely first-person video of humans doing manipulation tasks, we actually see scaling law for transferring to robot embodiments that the model has never seen before." "By training on more human data, we actually see predictable performance improvement on robots. That's a big deal because the biggest challenge facing robot foundation models is that we don't have enough data." "Unlike language models, there are just not enough robotics data out there, and it's very difficult to collect these robot data. Only by passively observing humans doing things can we scale this kind of data, and this is the first time we showed there is a lot of improvement that can transfer." Jason Ma Dyna Robotics

MTS

17,565 views • 27 days ago

I don't know if you really understand what these people just did... They built an AI that looks at a few casual real-world videos or photos and instantly turns them into a full 3D playground. You can MOVE THE CAMERA HOWEVER YOU WANT, change the lighting, move objects around, and even let physics play out like in the real world. View events from impossible angles because Atlas knows what was there. This is massive! Let's take robotics. Until now training robots meant collecting tons of expensive real-world data. Now a handful of recordings can become thousands of different simulated situations. Robots can practice the same task in new rooms, with different objects and lighting without anyone having to film it all again. For the industry it means we can train robots way faster and cheaper. Home robots, warehouse robots, whatever... they can learn new environments at scale instead of staying stuck in the lab. This is one of the first real bridges between “cool AI video models” and actual physical machines that have to work in the real world. Blog: The team behind World Labs: Fei-Fei Li, Justin Johnson, Ben Mildenhall and Yunzhu Li. The video is from David Pantera. Follow for more insights into robotics and AI. —— Weekly robotics and AI insights. Subscribe free:
0:49

I don't know if you really understand what these people just did... They built an AI that looks at a few casual real-world videos or photos and instantly turns them into a full 3D playground. You can MOVE THE CAMERA HOWEVER YOU WANT, change the lighting, move objects around, and even let physics play out like in the real world. View events from impossible angles because Atlas knows what was there. This is massive! Let's take robotics. Until now training robots meant collecting tons of expensive real-world data. Now a handful of recordings can become thousands of different simulated situations. Robots can practice the same task in new rooms, with different objects and lighting without anyone having to film it all again. For the industry it means we can train robots way faster and cheaper. Home robots, warehouse robots, whatever... they can learn new environments at scale instead of staying stuck in the lab. This is one of the first real bridges between “cool AI video models” and actual physical machines that have to work in the real world. Blog: The team behind World Labs: Fei-Fei Li, Justin Johnson, Ben Mildenhall and Yunzhu Li. The video is from David Pantera. Follow for more insights into robotics and AI. —— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

269,470 views • 6 days ago

This guy connected a computer vision model to dual robotic manipulators on his desk and the system now folds shirts in 47 seconds per garment without any human intervention after loading Automated laundry folding is one of those problems that sounds trivial until you realize fabric has no rigid structure and every wrinkle changes the optimal fold path You need the robot to detect garment boundaries through visual segmentation, identify sleeve edges and collar positions on randomly oriented fabric, generate dynamic reference coordinates that shift with garment size, synchronize two independent robotic arms to pull opposing fabric edges without tearing, and execute all of this without a conveyor belt or fixed staging area Most people assume you need a commercial folding machine or at least a rigid frame to hold clothes in place This guy just bolted two robot arms to a workbench, ran a Flask server with a Laundrobot vision library, and built a preset selection interface that handles nine garment types The setup was minimal: a Python backend processing camera frames, a segmentation model running inference locally, two manipulators with soft grippers, and a heads-up display showing red and blue anchor points overlaid on live fabric The system scans the garment, the vision pipeline outputs coordinates like 284.262 and 965.262, the dashboard waits for a RUN command, and the arms fold the item in two geometric steps The robot picks up shirts, pants, towels, and socks from any position on the desk with zero calibration and zero pre-staging It is the same principle robotic pick-and-place systems use in factories but instead of metal parts it is handling deformable textiles that compress and slide unpredictably The arms have no concept of what clean laundry means to a human They think they are executing waypoint trajectories but the output is getting transformed into neatly stacked garments that take zero cognitive load from the operator If a household generates 14 loads of laundry per month and folding takes eleven minutes per load this is how you reclaim 154 minutes without outsourcing or spending four figures on hardware This is the cleanest domestic automation I have seen: one desk, two arms, one camera, and between them a folding operation that runs while you do anything else
0:51

This guy connected a computer vision model to dual robotic manipulators on his desk and the system now folds shirts in 47 seconds per garment without any human intervention after loading Automated laundry folding is one of those problems that sounds trivial until you realize fabric has no rigid structure and every wrinkle changes the optimal fold path You need the robot to detect garment boundaries through visual segmentation, identify sleeve edges and collar positions on randomly oriented fabric, generate dynamic reference coordinates that shift with garment size, synchronize two independent robotic arms to pull opposing fabric edges without tearing, and execute all of this without a conveyor belt or fixed staging area Most people assume you need a commercial folding machine or at least a rigid frame to hold clothes in place This guy just bolted two robot arms to a workbench, ran a Flask server with a Laundrobot vision library, and built a preset selection interface that handles nine garment types The setup was minimal: a Python backend processing camera frames, a segmentation model running inference locally, two manipulators with soft grippers, and a heads-up display showing red and blue anchor points overlaid on live fabric The system scans the garment, the vision pipeline outputs coordinates like 284.262 and 965.262, the dashboard waits for a RUN command, and the arms fold the item in two geometric steps The robot picks up shirts, pants, towels, and socks from any position on the desk with zero calibration and zero pre-staging It is the same principle robotic pick-and-place systems use in factories but instead of metal parts it is handling deformable textiles that compress and slide unpredictably The arms have no concept of what clean laundry means to a human They think they are executing waypoint trajectories but the output is getting transformed into neatly stacked garments that take zero cognitive load from the operator If a household generates 14 loads of laundry per month and folding takes eleven minutes per load this is how you reclaim 154 minutes without outsourcing or spending four figures on hardware This is the cleanest domestic automation I have seen: one desk, two arms, one camera, and between them a folding operation that runs while you do anything else

Blaze

24,799 views • 3 months ago

This man does house inspections. But, he is not an inspector for the Builders, he is an inspector that the homebuyer hires to be thorough to document damages and deficiencies. He provides the buyer with a detailed report, photographs, and then the buyer forwards it to the builder to have them make the corrections. Check out this house. 🤯 These houses are in Florida. They are probably priced between $400K-$500k and you know they’re going to advertise them as luxury, brand new homes. What a waste of resources and materials. Crazy how terrible new home construction quality is in this country. It’s worth the money to hire a quality inspector of your own before you purchase a house. Have you ever had any nightmare stories when buying a new home? Something you didn’t catch before you bought it?
3:45

This man does house inspections. But, he is not an inspector for the Builders, he is an inspector that the homebuyer hires to be thorough to document damages and deficiencies. He provides the buyer with a detailed report, photographs, and then the buyer forwards it to the builder to have them make the corrections. Check out this house. 🤯 These houses are in Florida. They are probably priced between $400K-$500k and you know they’re going to advertise them as luxury, brand new homes. What a waste of resources and materials. Crazy how terrible new home construction quality is in this country. It’s worth the money to hire a quality inspector of your own before you purchase a house. Have you ever had any nightmare stories when buying a new home? Something you didn’t catch before you bought it?

👉M-Û-R-Č-H👈

210,506 views • 4 months ago

Robotics is entering the mainstream! 👀 Let's accept this fact. Consumptionism – stonks. Possibilities (HW + SW) – stonks. Demographics - not stonks. Modern robots are often designed to interact with our legacy world, whether it's a household, a factory, or a shipyard. That means they often need to work with existing machines, tools, and spaces. In short: retrofitting. Improving old machines with new technologies without major interference in their operation. Modern way of integrating things. You don't have to change the entire environment to deploy a robot. The robot will adapt, just as human would when freshly hired. The promise is to have an army of robots to help with the world designed for us. I also believe that general purpose robots, are not a direct competition for single purpose machines (like a highly efficient specialized packaging machine, for example). It's like adding a robot to this carriage. Specialized machine could be a car ;) ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:59

Robotics is entering the mainstream! 👀 Let's accept this fact. Consumptionism – stonks. Possibilities (HW + SW) – stonks. Demographics - not stonks. Modern robots are often designed to interact with our legacy world, whether it's a household, a factory, or a shipyard. That means they often need to work with existing machines, tools, and spaces. In short: retrofitting. Improving old machines with new technologies without major interference in their operation. Modern way of integrating things. You don't have to change the entire environment to deploy a robot. The robot will adapt, just as human would when freshly hired. The promise is to have an army of robots to help with the world designed for us. I also believe that general purpose robots, are not a direct competition for single purpose machines (like a highly efficient specialized packaging machine, for example). It's like adding a robot to this carriage. Specialized machine could be a car ;) ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

14,396 views • 7 months ago

MIT PhD student Alex Zhang reveals the scaling result where a model trained on short tasks generalizes to problems 100x longer for free: "If you're very clever about the design of your harness or how you use the language model, you can almost get scaling gains for free." "If you train a model naively, there's no tricks. It's just the same way you train a model on these RL environments. You just roll it out, and then you just get some reward." "If you train it on only short tasks, like only tasks that are 10,000 tokens long, and then you were to run it on a similar domain, but at a million tokens, or 10 million tokens, or 100,000 tokens, it generalizes really, really well. If you look at it compared to even the base transformer, you get way better generalization properties." "When the model uses an RLM (Recursive Language Model) after it's trained on these short tasks, it will see some kind of trajectory of actions that it does. Between these two problems of different lengths, the RLM learns to see them as almost the same problem." "Token for token, they're almost the same. You can describe it in code. In one code setting, maybe the for loop is a little bigger, but it's the same kind of code and it derives the constants from the data. There's no hard coding, so they literally look the same." alex zhang
2:41

MIT PhD student Alex Zhang reveals the scaling result where a model trained on short tasks generalizes to problems 100x longer for free: "If you're very clever about the design of your harness or how you use the language model, you can almost get scaling gains for free." "If you train a model naively, there's no tricks. It's just the same way you train a model on these RL environments. You just roll it out, and then you just get some reward." "If you train it on only short tasks, like only tasks that are 10,000 tokens long, and then you were to run it on a similar domain, but at a million tokens, or 10 million tokens, or 100,000 tokens, it generalizes really, really well. If you look at it compared to even the base transformer, you get way better generalization properties." "When the model uses an RLM (Recursive Language Model) after it's trained on these short tasks, it will see some kind of trajectory of actions that it does. Between these two problems of different lengths, the RLM learns to see them as almost the same problem." "Token for token, they're almost the same. You can describe it in code. In one code setting, maybe the for loop is a little bigger, but it's the same kind of code and it derives the constants from the data. There's no hard coding, so they literally look the same." alex zhang

MTS

100,519 views • 1 month ago