Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Robots that actually WORK in real factories. Without endless retraining. > Just 20 minutes of data. > 99.4% success rate. > 108 motors soldered in 5+ hours straight. Sub-0.6 mm precision on messy, deformable (!) cables. This hybrid “learning-augmented” system adds neural brains + 3D safety monitoring to ordinary...

IlirAliu_'s profile picture

Ilir Aliu

53,919 subscribers

16,944 Aufrufe • vor 2 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Generalist AI has just broken the "impossible triangle" of speed, reliability, and intelligence in robotics. They’ve pushed their embodied foundation model forward in a big way: GEN-1 hits “Mastery” on simple physical tasks,99% average success rate, and it can improvise when things go wrong. Smooth, natural, fast(factory owners must be very interested)👇 >Folding boxes: 200 runs at 99% success in ~12 seconds ( ~34s before) >Packing phones, folding T-shirts, servicing robot vacuums,hundreds of reps with almost zero failures > Intelligent improvisation, handling uncertain tasks >Needs only about 1 hour of robot-specific data per task This feels like a real step toward humanoid robots that are actually reliable enough for factories, warehouse or homes. Physical AGI is accelerating
3:03

Generalist AI has just broken the "impossible triangle" of speed, reliability, and intelligence in robotics. They’ve pushed their embodied foundation model forward in a big way: GEN-1 hits “Mastery” on simple physical tasks,99% average success rate, and it can improvise when things go wrong. Smooth, natural, fast(factory owners must be very interested)👇 >Folding boxes: 200 runs at 99% success in ~12 seconds ( ~34s before) >Packing phones, folding T-shirts, servicing robot vacuums,hundreds of reps with almost zero failures > Intelligent improvisation, handling uncertain tasks >Needs only about 1 hour of robot-specific data per task This feels like a real step toward humanoid robots that are actually reliable enough for factories, warehouse or homes. Physical AGI is accelerating

CyberRobo

25,519 Aufrufe • vor 3 Monaten

Experiments in progress. The one on the right has been learning for ~3 hours, the one in the middle for ~1 hour, and the one on the left just started a few minutes ago. The initial motivation for making the physical Atari was just to commit ourselves to a subset of algorithms that can make progress in this setup. This commitment rules out algorithms that require billions of samples to learn (or worse, require multiple environments running in parallel). Atari games are simple enough that we should be able to show learning on them in a short amount of time with no prior knowledge. Since then, I've realized that this setup is also a good way to compare different paradigms in robotics in a principled way. These paradigms are sim2real, learning from tele-operated data, and learning directly on the robots. So far, I have observed that getting sim2real to work reliably is hard. It requires tweaks that don't scale. Policies that can play perfectly in simulation fall apart because of latencies and the messiness of the real world. These aspects could be modeled to improve the simulation, but not without sinking significant human engineering hours. I have higher hopes for learning from tele-operated data, but that requires a human to learn the task first. These experiments are on my to-do list. I have to learn to play some of the games well through the robot. I’m half-decent at playing Pong and Ms Pacman now. Learning directly on robots is looking like the most promising approach. This approach takes away pesky distribution shifts and makes it possible to have algorithms that continually improve with more data and time without any human intervention. It feels great to let experiments run overnight and wake up to find improved policies. With learning on robots, I should, in principle, be able to go on a long vacation and come back to find better policies for complex tasks beyond Atari games. Whether that is possible with current learning algorithms is a different question.
1:05

Experiments in progress. The one on the right has been learning for ~3 hours, the one in the middle for ~1 hour, and the one on the left just started a few minutes ago. The initial motivation for making the physical Atari was just to commit ourselves to a subset of algorithms that can make progress in this setup. This commitment rules out algorithms that require billions of samples to learn (or worse, require multiple environments running in parallel). Atari games are simple enough that we should be able to show learning on them in a short amount of time with no prior knowledge. Since then, I've realized that this setup is also a good way to compare different paradigms in robotics in a principled way. These paradigms are sim2real, learning from tele-operated data, and learning directly on the robots. So far, I have observed that getting sim2real to work reliably is hard. It requires tweaks that don't scale. Policies that can play perfectly in simulation fall apart because of latencies and the messiness of the real world. These aspects could be modeled to improve the simulation, but not without sinking significant human engineering hours. I have higher hopes for learning from tele-operated data, but that requires a human to learn the task first. These experiments are on my to-do list. I have to learn to play some of the games well through the robot. I’m half-decent at playing Pong and Ms Pacman now. Learning directly on robots is looking like the most promising approach. This approach takes away pesky distribution shifts and makes it possible to have algorithms that continually improve with more data and time without any human intervention. It feels great to let experiments run overnight and wake up to find improved policies. With learning on robots, I should, in principle, be able to go on a long vacation and come back to find better policies for complex tasks beyond Atari games. Whether that is possible with current learning algorithms is a different question.

Khurram Javed

52,110 Aufrufe • vor 7 Monaten

Are you kidding me??? It grasps multiple objects with different ways, all at once with… a single hand??? No pauses. 1x speed. GENE-26.5 is Genesis AI’s robotics-native multimodal foundation model. It’s trained on 200,000+ hours of real human hand data (motion, force, touch) and runs on a 54-DoF bimanual system: Scaling that human data 4x lifted real-robot success rates from 16.6% to 65.6% on long-horizon dexterous tasks!! Same model weights, zero fine-tuning for this exact sequence. You know those tiny coordinated movements you do without thinking…? Robots couldn’t reliably do that before. Now they can. Today. This is the video you’ll send to my friends, outside of our bubble, when they say “robots are still just demos.” Congrats to the entire team around Zhou Xian! Credit: Seen at Zu Wang (Zu Wang) Genesis official announcement for the full story + longer demo: ——— Weekly robotics and AI insights. Subscribe free:
0:20

Are you kidding me??? It grasps multiple objects with different ways, all at once with… a single hand??? No pauses. 1x speed. GENE-26.5 is Genesis AI’s robotics-native multimodal foundation model. It’s trained on 200,000+ hours of real human hand data (motion, force, touch) and runs on a 54-DoF bimanual system: Scaling that human data 4x lifted real-robot success rates from 16.6% to 65.6% on long-horizon dexterous tasks!! Same model weights, zero fine-tuning for this exact sequence. You know those tiny coordinated movements you do without thinking…? Robots couldn’t reliably do that before. Now they can. Today. This is the video you’ll send to my friends, outside of our bubble, when they say “robots are still just demos.” Congrats to the entire team around Zhou Xian! Credit: Seen at Zu Wang (Zu Wang) Genesis official announcement for the full story + longer demo: ——— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

203,868 Aufrufe • vor 2 Monaten

Brain-controlled exoskeletons to train humanoid robots! 🧠 Fourier just presented human tele-operators using brain control interfaces and exoskeletal arms to train humanoid robots on home tasks. The brain control interface is the interesting part. Instead of using a controller or joystick to teleoperate, the operator's movements and intentions are captured more naturally through the exoskeleton and BCI. This means the demonstrations are more fluid, more human-like, and better suited for training robots to perform delicate home tasks. Multiple tele-operators are simultaneously generating training data across multiple robots. This is how you build the dataset needed for eventual full autonomy, without waiting years for it to arrive. This might be the bridge between "robots that work in controlled environments" and "robots that work in homes." Not full autonomy right away, but trusted human intelligence operating through a robot body, getting better with every task completed. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:56

Brain-controlled exoskeletons to train humanoid robots! 🧠 Fourier just presented human tele-operators using brain control interfaces and exoskeletal arms to train humanoid robots on home tasks. The brain control interface is the interesting part. Instead of using a controller or joystick to teleoperate, the operator's movements and intentions are captured more naturally through the exoskeleton and BCI. This means the demonstrations are more fluid, more human-like, and better suited for training robots to perform delicate home tasks. Multiple tele-operators are simultaneously generating training data across multiple robots. This is how you build the dataset needed for eventual full autonomy, without waiting years for it to arrive. This might be the bridge between "robots that work in controlled environments" and "robots that work in homes." Not full autonomy right away, but trusted human intelligence operating through a robot body, getting better with every task completed. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

20,898 Aufrufe • vor 5 Monaten

In order for robots to be deployed in the real world, performing tasks of real value, they must be reliable. Unfortunately, even more, most robotic demos work maybe 70-80% of the time at best. The way to get better reliability is to do real-world reinforcement learning: having the robot teach itself how to perform the task up to a high level of success. The key to doing this is to start with a core of expert human data, use that to train a policy then iteratively improve it, until finally finishing with on-policy reinforcement learning. Kun Lei talks through a unified framework for imitation and reinforcement learning based on PPO, which enables this improvement process. In this episode, Kun Lei explains the theory behind his reinforcement learning method and how it allowed his robot to run in a shopping mall juicing oranges for seven hours at a time, among experiments on a wide variety of tasks and embodiments. Watch episode 58 of RoboPapers now, hosted by Michael Cho - Rbt/Acc and Chris Paxton!
1:11:51

In order for robots to be deployed in the real world, performing tasks of real value, they must be reliable. Unfortunately, even more, most robotic demos work maybe 70-80% of the time at best. The way to get better reliability is to do real-world reinforcement learning: having the robot teach itself how to perform the task up to a high level of success. The key to doing this is to start with a core of expert human data, use that to train a policy then iteratively improve it, until finally finishing with on-policy reinforcement learning. Kun Lei talks through a unified framework for imitation and reinforcement learning based on PPO, which enables this improvement process. In this episode, Kun Lei explains the theory behind his reinforcement learning method and how it allowed his robot to run in a shopping mall juicing oranges for seven hours at a time, among experiments on a wide variety of tasks and embodiments. Watch episode 58 of RoboPapers now, hosted by Michael Cho - Rbt/Acc and Chris Paxton!

RoboPapers

18,813 Aufrufe • vor 6 Monaten

Foundation models are enough to solve robotics! Unfortunately, this is not true. We keep hearing that Vision-Language-Action (VLA) models struggle because of the gap between static training and the dynamic real world. A German startup (Sereact) just released a solution that bridges this gap perfectly. They are introducing a new paradigm called Interactive RL Policy Patching. It's a distributed framework that allows robots to self-learn from human corrections without needing full retraining. When a robot fails, a human operator provides a brief "patch" or demonstration. The system then uses online off-policy reinforcement learning to update the behavior instantly. This is powered by a massive foundation model trained on hundreds of millions of interactions from over 100 deployed robot stations. The best part is the distributed parameter synchronization... When one robot learns a fix, the update is published fleet-wide... meaning the entire swarm gets smarter from a single human intervention. They are already proving this on complex manipulation tasks like shoe unboxing and screw sorting, drastically reducing the data needed to handle edge cases. Real-world environments are unforgiving, and I love seeing systems that can actually adapt on the fly! 📍 More info:
0:38

Foundation models are enough to solve robotics! Unfortunately, this is not true. We keep hearing that Vision-Language-Action (VLA) models struggle because of the gap between static training and the dynamic real world. A German startup (Sereact) just released a solution that bridges this gap perfectly. They are introducing a new paradigm called Interactive RL Policy Patching. It's a distributed framework that allows robots to self-learn from human corrections without needing full retraining. When a robot fails, a human operator provides a brief "patch" or demonstration. The system then uses online off-policy reinforcement learning to update the behavior instantly. This is powered by a massive foundation model trained on hundreds of millions of interactions from over 100 deployed robot stations. The best part is the distributed parameter synchronization... When one robot learns a fix, the update is published fleet-wide... meaning the entire swarm gets smarter from a single human intervention. They are already proving this on complex manipulation tasks like shoe unboxing and screw sorting, drastically reducing the data needed to handle edge cases. Real-world environments are unforgiving, and I love seeing systems that can actually adapt on the fly! 📍 More info:

Ilir Aliu

18,210 Aufrufe • vor 5 Monaten

Leju Robotics has launched the upgraded KUAVO 5/5-W humanoid and wheeled robots, designed to meet the rigorous demands of industrial automation. The robots feature a modular design that is key to flexibility: the legs are quickly replaceable with bipedal configurations (for complex terrain) or wheeled setups (for long-distance stability). The hands are also modular, supporting dexterous hands, grippers, or claws. This adaptability, combined with a rotatable and height-adjustable body, allows the robot to handle a vast range of factory tasks. Built for industrial stamina, the KUAVO series supports a 20kg maximum payload and an upper-body dual-arm payload of 10kg. It is engineered for continuous operation, boasting a battery life of over 8 hours. The control system achieves "silky-smooth" precision via doubled joint communication frequency. To drive high generalizability, Leju relies on a data-driven model. It established China's largest data acquisition center in Beijing (referred to as the "largest humanoid robot skill school") to collect over 6 million data points annually from 1:1 replications of real industrial scenes. This data feeds a universal multi-modal dataset, enabling the robot's "intelligent brain" to continuously learn complex tasks through closed-loop feedback in client factory environments.
3:24

Leju Robotics has launched the upgraded KUAVO 5/5-W humanoid and wheeled robots, designed to meet the rigorous demands of industrial automation. The robots feature a modular design that is key to flexibility: the legs are quickly replaceable with bipedal configurations (for complex terrain) or wheeled setups (for long-distance stability). The hands are also modular, supporting dexterous hands, grippers, or claws. This adaptability, combined with a rotatable and height-adjustable body, allows the robot to handle a vast range of factory tasks. Built for industrial stamina, the KUAVO series supports a 20kg maximum payload and an upper-body dual-arm payload of 10kg. It is engineered for continuous operation, boasting a battery life of over 8 hours. The control system achieves "silky-smooth" precision via doubled joint communication frequency. To drive high generalizability, Leju relies on a data-driven model. It established China's largest data acquisition center in Beijing (referred to as the "largest humanoid robot skill school") to collect over 6 million data points annually from 1:1 replications of real industrial scenes. This data feeds a universal multi-modal dataset, enabling the robot's "intelligent brain" to continuously learn complex tasks through closed-loop feedback in client factory environments.

RoboHub🤖

34,676 Aufrufe • vor 8 Monaten

A team tested Pi0, Pi0 Fast, Gr00t, and ACT on real robot arms in manufacturing tasks. (🔖 Bookmark this for later!) The task was precise: place thin rectangular frames from a messy stack into a holder. The team fine-tuned each model on 100 real trajectories and compared training time, inference speed, motion quality, and success rates. ⬇️ Here’s a breakdown of what they found Pi0 (Original) ✅ Strongest overall performance in precise pick-and-place ✅ High success rate even in edge cases ✅ Longest training time (~11 hours, ~$30 per run) ✅ Inference time of 80 ms causes short pauses between actions Despite delays, it handles complex scenarios well… solid for high-precision tasks, but slow to train. Gr00t ✅ Trains fast (~2 hours, ~$5 per run) ✅ Performs almost as well as Pi0 on large-object tasks ✅ Struggles with fine precision; random movement in some trials ✅ More training didn’t fix jitter or random offsets Best suited for tasks where exact precision isn’t critical. Not ready for manufacturing-grade accuracy without more tuning. Pi0 Fast ✅ Promised faster training, but results were underwhelming ✅ Training at 6 hours still showed low success rates ✅ Inference was slower than expected ✅ Not reliable for generalizing even slightly new tasks Currently too unstable for real-world deployment. Doesn’t live up to the “Fast” name yet. ACT (Baseline) ✅ 200MB model—lightweight, but limited ✅ Struggles with stacked objects or ambiguous scenes ✅ Success rates around 70% in best-case setups ✅ Can’t match newer models on precision or generalization Still a solid baseline, but clearly a generation behind in robustness. 🚨 Extra Notes All newer models share a common issue: •Inference takes longer than a frame (80 ms vs 33 ms), so robots “pause” between chunks. •This results in jittery movements, but not a dealbreaker unless tasks are time-sensitive. Language-conditioned tasks also fell short: after training on two labeled tasks, the model couldn’t generalize to a third unseen combination using only text prompts. ✅ The good news? These models adapt well to new robot arms with quick fine-tuning. ❌ The bad news? There’s still no plug-and-play solution for improving performance after deployment. Reinforcement learning or DAgger-style data collection during real-world operation may be the next big step, something many teams in robotics are actively working on.
0:51

A team tested Pi0, Pi0 Fast, Gr00t, and ACT on real robot arms in manufacturing tasks. (🔖 Bookmark this for later!) The task was precise: place thin rectangular frames from a messy stack into a holder. The team fine-tuned each model on 100 real trajectories and compared training time, inference speed, motion quality, and success rates. ⬇️ Here’s a breakdown of what they found Pi0 (Original) ✅ Strongest overall performance in precise pick-and-place ✅ High success rate even in edge cases ✅ Longest training time (~11 hours, ~$30 per run) ✅ Inference time of 80 ms causes short pauses between actions Despite delays, it handles complex scenarios well… solid for high-precision tasks, but slow to train. Gr00t ✅ Trains fast (~2 hours, ~$5 per run) ✅ Performs almost as well as Pi0 on large-object tasks ✅ Struggles with fine precision; random movement in some trials ✅ More training didn’t fix jitter or random offsets Best suited for tasks where exact precision isn’t critical. Not ready for manufacturing-grade accuracy without more tuning. Pi0 Fast ✅ Promised faster training, but results were underwhelming ✅ Training at 6 hours still showed low success rates ✅ Inference was slower than expected ✅ Not reliable for generalizing even slightly new tasks Currently too unstable for real-world deployment. Doesn’t live up to the “Fast” name yet. ACT (Baseline) ✅ 200MB model—lightweight, but limited ✅ Struggles with stacked objects or ambiguous scenes ✅ Success rates around 70% in best-case setups ✅ Can’t match newer models on precision or generalization Still a solid baseline, but clearly a generation behind in robustness. 🚨 Extra Notes All newer models share a common issue: •Inference takes longer than a frame (80 ms vs 33 ms), so robots “pause” between chunks. •This results in jittery movements, but not a dealbreaker unless tasks are time-sensitive. Language-conditioned tasks also fell short: after training on two labeled tasks, the model couldn’t generalize to a third unseen combination using only text prompts. ✅ The good news? These models adapt well to new robot arms with quick fine-tuning. ❌ The bad news? There’s still no plug-and-play solution for improving performance after deployment. Reinforcement learning or DAgger-style data collection during real-world operation may be the next big step, something many teams in robotics are actively working on.

Ilir Aliu

21,844 Aufrufe • vor 1 Jahr

People who've never set foot in a factory will never understand... I watched this three times. For decades, robotics simulation has promised faster deployment. But factories still had to build the real cell to see if it actually worked. Which meant expensive physical prototypes, weeks or months!!! of commissioning, constant surprises between simulation and reality That “sim-to-real gap” has quietly been one of the biggest bottlenecks in manufacturing automation. And it’s exactly what is changing. Today, ABB Robotics announced a partnership with NVIDIA Robotics aimed at closing this gap through the new RobotStudio HyperReality platform: Simulation and real robot behavior can match with near-perfect accuracy. That means manufacturers can design, test, and validate entire production lines before a single robot is installed on the factory floor. The implications are massive: • up to 80% faster setup and commissioning • roughly 40% lower costs by removing physical prototypes • about 50% faster time-to-market for new production lines In other words: Factories can move from trial-and-error engineering to software-driven manufacturing design. Production lines become something you build and validate digitally first. Then deploy physically once everything already works. For an industry that still measures deployment timelines in months or years, this is a major shift. It changes how automation projects are planned, how factories are designed, and how fast manufacturing can adapt to new products. Physical AI actually becomes deployable at an industrial scale. I’ll be at GTC in San Jose next week to see and talk to manufacturers and robotics engineers. If you are into manufacturing like I am, hit me up; my DMs are open!
0:31

People who've never set foot in a factory will never understand... I watched this three times. For decades, robotics simulation has promised faster deployment. But factories still had to build the real cell to see if it actually worked. Which meant expensive physical prototypes, weeks or months!!! of commissioning, constant surprises between simulation and reality That “sim-to-real gap” has quietly been one of the biggest bottlenecks in manufacturing automation. And it’s exactly what is changing. Today, ABB Robotics announced a partnership with NVIDIA Robotics aimed at closing this gap through the new RobotStudio HyperReality platform: Simulation and real robot behavior can match with near-perfect accuracy. That means manufacturers can design, test, and validate entire production lines before a single robot is installed on the factory floor. The implications are massive: • up to 80% faster setup and commissioning • roughly 40% lower costs by removing physical prototypes • about 50% faster time-to-market for new production lines In other words: Factories can move from trial-and-error engineering to software-driven manufacturing design. Production lines become something you build and validate digitally first. Then deploy physically once everything already works. For an industry that still measures deployment timelines in months or years, this is a major shift. It changes how automation projects are planned, how factories are designed, and how fast manufacturing can adapt to new products. Physical AI actually becomes deployable at an industrial scale. I’ll be at GTC in San Jose next week to see and talk to manufacturers and robotics engineers. If you are into manufacturing like I am, hit me up; my DMs are open!

Ilir Aliu

68,927 Aufrufe • vor 4 Monaten

A robotic ballet! 🩰 Coordinating multiple robot arms on a busy factory floor is notoriously complex. Each arm needs to move without colliding with its neighbors or the surrounding equipment, and today that planning is still mostly done by hand, a process that takes specialists hundreds of hours. Researchers at UCL, Google DeepMind, and Intrinsic have introduced RoboBallet, a new AI system that tackles this challenge head-on. Using a combination of graph neural networks and reinforcement learning, RoboBallet learns how to coordinate many robots in real time, generating smooth, collision-free motion plans in seconds instead of days. In tests, the system handled up to 40 tasks with eight arms working together, far beyond the limits of traditional planners. More importantly, it showed strong generalization: RoboBallet could adapt instantly to new factory layouts or recover if one robot failed, something previous methods struggled with. For manufacturers, this could mean faster deployment of automation, less downtime, and the ability to reconfigure production lines on the fly. Applications range from automotive welding to electronics assembly, and even large-scale construction. The current system focuses on reaching tasks, but the team plans to expand it to more complex operations like pick-and-place or painting. Here's the paper:
0:54

A robotic ballet! 🩰 Coordinating multiple robot arms on a busy factory floor is notoriously complex. Each arm needs to move without colliding with its neighbors or the surrounding equipment, and today that planning is still mostly done by hand, a process that takes specialists hundreds of hours. Researchers at UCL, Google DeepMind, and Intrinsic have introduced RoboBallet, a new AI system that tackles this challenge head-on. Using a combination of graph neural networks and reinforcement learning, RoboBallet learns how to coordinate many robots in real time, generating smooth, collision-free motion plans in seconds instead of days. In tests, the system handled up to 40 tasks with eight arms working together, far beyond the limits of traditional planners. More importantly, it showed strong generalization: RoboBallet could adapt instantly to new factory layouts or recover if one robot failed, something previous methods struggled with. For manufacturers, this could mean faster deployment of automation, less downtime, and the ability to reconfigure production lines on the fly. Applications range from automotive welding to electronics assembly, and even large-scale construction. The current system focuses on reaching tasks, but the team plans to expand it to more complex operations like pick-and-place or painting. Here's the paper:

Lukas Ziegler

25,990 Aufrufe • vor 10 Monaten

A new robot policy just cleaned up a kitchen it had never seen before [watch what happens. paper included ⬇️] Pi-0.5 builds on top of Pi-0 and shows how smart co-training with diverse data can unlock real generalization in the home. It doesn’t just learn from one setup but adapts to many, including homes it’s never seen. What it does ✅ Handles new homes without training in them ✅ Follows complex language instructions ✅ Cleans, places dishes, handles spills ✅ Matches in-home training models using cross-embodiment and web data Robots that understand tasks and adapt to new spaces are finally within reach. More in the blog: Read the paper ⬇️ Physical Intelligence, co-founded by UC Berkeley professor Sergey Levine, is a robotics startup developing general-purpose AI foundation models that enable robots to perform a wide variety of real-world tasks with human-like adaptability, recently raising $400 million to advance this vision.
1:22

A new robot policy just cleaned up a kitchen it had never seen before [watch what happens. paper included ⬇️] Pi-0.5 builds on top of Pi-0 and shows how smart co-training with diverse data can unlock real generalization in the home. It doesn’t just learn from one setup but adapts to many, including homes it’s never seen. What it does ✅ Handles new homes without training in them ✅ Follows complex language instructions ✅ Cleans, places dishes, handles spills ✅ Matches in-home training models using cross-embodiment and web data Robots that understand tasks and adapt to new spaces are finally within reach. More in the blog: Read the paper ⬇️ Physical Intelligence, co-founded by UC Berkeley professor Sergey Levine, is a robotics startup developing general-purpose AI foundation models that enable robots to perform a wide variety of real-world tasks with human-like adaptability, recently raising $400 million to advance this vision.

Ilir Aliu - eu/acc

18,120 Aufrufe • vor 1 Jahr

I don’t know if we live in a Matrix, but I know for sure that robots will spend most of their lives in simulation. Let machines train machines. I’m excited to introduce DexMimicGen, a massive-scale synthetic data generator that enables a humanoid robot to learn complex skills from only a handful of human demonstrations. Yes, as few as 5! DexMimicGen addresses the biggest pain point in robotics: where do we get data? Unlike with LLMs, where vast amounts of texts are readily available, you cannot simply download motor control signals from the internet. So researchers teleoperate the robots to collect motion data via XR headsets. They have to repeat the same skill over and over and over again, because neural nets are data hungry. This is a very slow and uncomfortable process. At NVIDIA, we believe the majority of high-quality tokens for robot foundation models will come from simulation. What DexMimicGen does is to trade GPU compute time for human time. It takes one motion trajectory from human, and multiplies into 1000s of new trajectories. A robot brain trained on this augmented dataset will generalize far better in the real world. Think of DexMimicGen as a learning signal amplifier. It maps a small dataset to a large (de facto infinite) dataset, using physics simulation in the loop. In this way, we free humans from babysitting the bots all day. The future of robot data is generative. The future of the entire robot learning pipeline will also be generative. 🧵
0:58

I don’t know if we live in a Matrix, but I know for sure that robots will spend most of their lives in simulation. Let machines train machines. I’m excited to introduce DexMimicGen, a massive-scale synthetic data generator that enables a humanoid robot to learn complex skills from only a handful of human demonstrations. Yes, as few as 5! DexMimicGen addresses the biggest pain point in robotics: where do we get data? Unlike with LLMs, where vast amounts of texts are readily available, you cannot simply download motor control signals from the internet. So researchers teleoperate the robots to collect motion data via XR headsets. They have to repeat the same skill over and over and over again, because neural nets are data hungry. This is a very slow and uncomfortable process. At NVIDIA, we believe the majority of high-quality tokens for robot foundation models will come from simulation. What DexMimicGen does is to trade GPU compute time for human time. It takes one motion trajectory from human, and multiplies into 1000s of new trajectories. A robot brain trained on this augmented dataset will generalize far better in the real world. Think of DexMimicGen as a learning signal amplifier. It maps a small dataset to a large (de facto infinite) dataset, using physics simulation in the loop. In this way, we free humans from babysitting the bots all day. The future of robot data is generative. The future of the entire robot learning pipeline will also be generative. 🧵

Jim Fan

165,246 Aufrufe • vor 1 Jahr

Video: World’s first humanoid robot labor that swaps its own batteries to work endlessly | Jijo Malayil, Interesting Engineering Walker S2 uses dual-battery balancing and standardized modules to boost efficiency and ensure uninterrupted, optimized performance. In a leap for robotics, China’s UBTech has unveiled the Walker S2, the world’s first humanoid robot capable of fully autonomous battery swapping. Designed for non-stop industrial operations, the Walker S2 can replace its own power pack in just three minutes—no human intervention required. Equipped with advanced anthropomorphic bipedal locomotion and a hot-swappable battery system, Walker S2 is built to operate 24/7 across dynamic industrial environments. According to UBTech, the next-generation humanoid robot marks a major milestone in automation, bringing continuous, hands-free performance to the factory floor. In May 2025, UBTech Robotics and Huawei Technologies inked a significant partnership to accelerate the adoption of humanoid robots across China’s factories and households. Uninterrupted robot operations A video posted by the robotics firm opens with the sleek UBTech Walker S2 humanoid robot working in an industrial setting. The highlight, however, is its autonomous battery swap. Walker S2 approaches the charging station, carefully detaches its depleted power pack, and seamlessly installs a fresh one—all within about three minutes—without any human assistance, according to CGTN. The camera captures close-ups of the robot’s articulated limbs and the intelligent battery-handling mechanism, conveying precision and reliability. As the swap completes, Walker S2 resumes its duties, reinforcing the promise of uninterrupted, 24/7 operations in dynamic factory environments. UBTech’s Walker S2 humanoid robot is equipped with advanced dual-battery power balancing technology and uses standardized battery modules to optimize performance, reports CNEVPOST. This dual-battery system allows the robot to automatically switch to a backup battery in case of a main battery failure, ensuring that critical tasks are carried out without interruption. In addition to battery swapping, the robot can intelligently choose between charging and swapping based on task urgency, allowing it to manage energy dynamically and adapt to real-time operational demands. UBTech highlights these features as a step forward in deploying humanoid robots for industrial and domestic applications, combining flexibility, reliability, and autonomy in one intelligent platform. Factory intelligence upgrade Earlier in the year, UBTech unveiled a major advancement in humanoid robot collaboration, claiming the world’s first deployment of multiple humanoids working together across varied industrial tasks. Demonstrated at Zeekr’s 5G-enabled smart factory, the breakthrough centers on UBTech’s “BrainNet” framework, which orchestrates cooperative behavior through a cloud-device intelligence system. BrainNet integrates a “super brain” for high-level decision-making with an “intelligent sub-brain” for distributed multi-robot control. The super brain, powered by a proprietary large-scale multimodal reasoning model, handles complex production-line scheduling and decision-making. Meanwhile, the sub-brain coordinates real-time tasks using cross-field perception and Transformer-based control for dynamic adaptability. Together, they enable the Walker S1 humanoid robots to move beyond isolated operations and perform coordinated tasks with high precision and speed. The system is built on DeepSeek-R1 reasoning technology and trained on real-world data from automotive factory settings. Leveraging Retrieval-Augmented Generation (RAG), the model adapts to specific job functions and improves scalability across workstations. At Zeekr’s facility, dozens of Walker S1s now collaborate on tasks like assembly, inspection, and part handling. Using semantic VSLAM and shared mapping, they coordinate seamlessly via vision-based navigation and agile manipulation. UBTech says this marks a transition to “Practical Training 2.0,” where humanoid robots operate as a swarm, maximizing efficiency and setting the stage for next-generation intelligent manufacturing.
1:04

Video: World’s first humanoid robot labor that swaps its own batteries to work endlessly | Jijo Malayil, Interesting Engineering Walker S2 uses dual-battery balancing and standardized modules to boost efficiency and ensure uninterrupted, optimized performance. In a leap for robotics, China’s UBTech has unveiled the Walker S2, the world’s first humanoid robot capable of fully autonomous battery swapping. Designed for non-stop industrial operations, the Walker S2 can replace its own power pack in just three minutes—no human intervention required. Equipped with advanced anthropomorphic bipedal locomotion and a hot-swappable battery system, Walker S2 is built to operate 24/7 across dynamic industrial environments. According to UBTech, the next-generation humanoid robot marks a major milestone in automation, bringing continuous, hands-free performance to the factory floor. In May 2025, UBTech Robotics and Huawei Technologies inked a significant partnership to accelerate the adoption of humanoid robots across China’s factories and households. Uninterrupted robot operations A video posted by the robotics firm opens with the sleek UBTech Walker S2 humanoid robot working in an industrial setting. The highlight, however, is its autonomous battery swap. Walker S2 approaches the charging station, carefully detaches its depleted power pack, and seamlessly installs a fresh one—all within about three minutes—without any human assistance, according to CGTN. The camera captures close-ups of the robot’s articulated limbs and the intelligent battery-handling mechanism, conveying precision and reliability. As the swap completes, Walker S2 resumes its duties, reinforcing the promise of uninterrupted, 24/7 operations in dynamic factory environments. UBTech’s Walker S2 humanoid robot is equipped with advanced dual-battery power balancing technology and uses standardized battery modules to optimize performance, reports CNEVPOST. This dual-battery system allows the robot to automatically switch to a backup battery in case of a main battery failure, ensuring that critical tasks are carried out without interruption. In addition to battery swapping, the robot can intelligently choose between charging and swapping based on task urgency, allowing it to manage energy dynamically and adapt to real-time operational demands. UBTech highlights these features as a step forward in deploying humanoid robots for industrial and domestic applications, combining flexibility, reliability, and autonomy in one intelligent platform. Factory intelligence upgrade Earlier in the year, UBTech unveiled a major advancement in humanoid robot collaboration, claiming the world’s first deployment of multiple humanoids working together across varied industrial tasks. Demonstrated at Zeekr’s 5G-enabled smart factory, the breakthrough centers on UBTech’s “BrainNet” framework, which orchestrates cooperative behavior through a cloud-device intelligence system. BrainNet integrates a “super brain” for high-level decision-making with an “intelligent sub-brain” for distributed multi-robot control. The super brain, powered by a proprietary large-scale multimodal reasoning model, handles complex production-line scheduling and decision-making. Meanwhile, the sub-brain coordinates real-time tasks using cross-field perception and Transformer-based control for dynamic adaptability. Together, they enable the Walker S1 humanoid robots to move beyond isolated operations and perform coordinated tasks with high precision and speed. The system is built on DeepSeek-R1 reasoning technology and trained on real-world data from automotive factory settings. Leveraging Retrieval-Augmented Generation (RAG), the model adapts to specific job functions and improves scalability across workstations. At Zeekr’s facility, dozens of Walker S1s now collaborate on tasks like assembly, inspection, and part handling. Using semantic VSLAM and shared mapping, they coordinate seamlessly via vision-based navigation and agile manipulation. UBTech says this marks a transition to “Practical Training 2.0,” where humanoid robots operate as a swarm, maximizing efficiency and setting the stage for next-generation intelligent manufacturing.

Owen Gregorian

35,637 Aufrufe • vor 1 Jahr

Robots aren’t just the future — they’re already reshaping our world. At IIT Madras, the new in Robotics, offered under the Department of Engineering Design, is building the brains behind tomorrow’s intelligent machines. From motion planning and control to AI/ML and hands-on labs, this two-year program blends cutting-edge research with real-world industry relevance — powered by a strong robotics faculty team and a legacy of interdisciplinary innovation. Rooted in the success of the Inter-Disciplinary Dual Degree (IDDD) Robotics program, this two-year program brings together expert faculty members and a powerful blend of theory and hands-on learning. From robot design and analysis to motion planning, control systems, and AI/ML, students dive deep into the science and engineering behind next-generation robotic systems. Add immersive lab work and cutting-edge projects, and you have a curriculum that’s as practical as it is pioneering. Manufacturing, healthcare, logistics, and defence — robotics is reshaping them all. This program is about building the minds that will lead to that transformation. If the future runs on robots, it starts here. For more details visit: IIT Madras
2:52

Robots aren’t just the future — they’re already reshaping our world. At IIT Madras, the new in Robotics, offered under the Department of Engineering Design, is building the brains behind tomorrow’s intelligent machines. From motion planning and control to AI/ML and hands-on labs, this two-year program blends cutting-edge research with real-world industry relevance — powered by a strong robotics faculty team and a legacy of interdisciplinary innovation. Rooted in the success of the Inter-Disciplinary Dual Degree (IDDD) Robotics program, this two-year program brings together expert faculty members and a powerful blend of theory and hands-on learning. From robot design and analysis to motion planning, control systems, and AI/ML, students dive deep into the science and engineering behind next-generation robotic systems. Add immersive lab work and cutting-edge projects, and you have a curriculum that’s as practical as it is pioneering. Manufacturing, healthcare, logistics, and defence — robotics is reshaping them all. This program is about building the minds that will lead to that transformation. If the future runs on robots, it starts here. For more details visit: IIT Madras

IIT Madras

22,443 Aufrufe • vor 3 Monaten

Physical Intelligence (Physical Intelligence) is building a foundation model that can control any robot to do any task — what the team describes as the GPT moment for robotics. The company's cross-embodiment approach trains across many different robot platforms, and recent results show tasks being performed zero-shot that last year required hundreds of hours of data collection. In this episode of the Lightcone Podcast , co-founder Quan Vuong (Quan Vuong) sat down with Garry Tan, Jared Friedman, Diana, and Harj Taggar to talk about why robotics is finally ready for its scaling moment, how PI runs its models in the cloud rather than on-device, and the playbook for what Quan sees as a Cambrian explosion of vertical robotics companies. 00:00 — Robotics just got cheaper 00:41 — The GPT moment for robotics 02:24 — Why robots didn’t work before 05:30 — The breakthrough that changed everything 09:12 — The data problem 13:33 — Robots learning without data 15:05 — Robots folding laundry (for real) 22:18 — From engineering problem → ops problem 29:12 — The startup playbook 38:46 — Thousands of robotics startups are coming
49:26

Physical Intelligence (Physical Intelligence) is building a foundation model that can control any robot to do any task — what the team describes as the GPT moment for robotics. The company's cross-embodiment approach trains across many different robot platforms, and recent results show tasks being performed zero-shot that last year required hundreds of hours of data collection. In this episode of the Lightcone Podcast , co-founder Quan Vuong (Quan Vuong) sat down with Garry Tan, Jared Friedman, Diana, and Harj Taggar to talk about why robotics is finally ready for its scaling moment, how PI runs its models in the cloud rather than on-device, and the playbook for what Quan sees as a Cambrian explosion of vertical robotics companies. 00:00 — Robotics just got cheaper 00:41 — The GPT moment for robotics 02:24 — Why robots didn’t work before 05:30 — The breakthrough that changed everything 09:12 — The data problem 13:33 — Robots learning without data 15:05 — Robots folding laundry (for real) 22:18 — From engineering problem → ops problem 29:12 — The startup playbook 38:46 — Thousands of robotics startups are coming

Y Combinator

115,590 Aufrufe • vor 3 Monaten

Japan Just Built a HouseBot You Control Without Speaking and It Changes Everything! Donut Robotics has officially unveiled its first bipedal humanoid, Cinnamon 1, and instead of focusing on louder voices or bigger motors, the company went in the opposite direction. Silence. Cinnamon 1 introduces what Donut Robotics calls Silent Gesture Control, a system that allows the humanoid to be guided using simple hand and finger movements rather than spoken commands. This approach feels especially well suited for real world environments where traditional voice control falls apart. Busy factory floors. Construction sites filled with constant noise. Even quiet indoor settings where voice commands feel awkward or intrusive. It also opens the door for far more accessible human robot interaction, particularly for users with impairments. While the current Cinnamon 1 hardware is built on an OEM platform, the intelligence driving it is where Donut Robotics is placing its long term bet. The team is actively developing custom Vision Language Action AI that allows the robot to interpret what it sees, understand intent, and respond with physical action. The goal is not just smarter robots, but robots that feel more natural. Even more ambitious is the company’s plan for full domestic production. Donut Robotics has stated its intention to localize both manufacturing and AI development in Japan, reinforcing the country’s reputation for precision engineering and thoughtful robotics design. If timelines hold, Cinnamon 1 units are expected to begin deployment in factories and construction environments by the end of 2026. That puts this humanoid squarely in the category of near term reality rather than distant concept. The takeaway is simple but important. As humanoid robots move out of labs and into daily work environments, the winners may not be the loudest or flashiest machines. They may be the ones that understand us without a word being spoken.
0:31

Japan Just Built a HouseBot You Control Without Speaking and It Changes Everything! Donut Robotics has officially unveiled its first bipedal humanoid, Cinnamon 1, and instead of focusing on louder voices or bigger motors, the company went in the opposite direction. Silence. Cinnamon 1 introduces what Donut Robotics calls Silent Gesture Control, a system that allows the humanoid to be guided using simple hand and finger movements rather than spoken commands. This approach feels especially well suited for real world environments where traditional voice control falls apart. Busy factory floors. Construction sites filled with constant noise. Even quiet indoor settings where voice commands feel awkward or intrusive. It also opens the door for far more accessible human robot interaction, particularly for users with impairments. While the current Cinnamon 1 hardware is built on an OEM platform, the intelligence driving it is where Donut Robotics is placing its long term bet. The team is actively developing custom Vision Language Action AI that allows the robot to interpret what it sees, understand intent, and respond with physical action. The goal is not just smarter robots, but robots that feel more natural. Even more ambitious is the company’s plan for full domestic production. Donut Robotics has stated its intention to localize both manufacturing and AI development in Japan, reinforcing the country’s reputation for precision engineering and thoughtful robotics design. If timelines hold, Cinnamon 1 units are expected to begin deployment in factories and construction environments by the end of 2026. That puts this humanoid squarely in the category of near term reality rather than distant concept. The takeaway is simple but important. As humanoid robots move out of labs and into daily work environments, the winners may not be the loudest or flashiest machines. They may be the ones that understand us without a word being spoken.

The AI Robot Guy on X

257,928 Aufrufe • vor 6 Monaten

NVIDIA just announced EgoScale 🤖🧠 NVIDIA Research has uncovered a log-linear scaling law for robot dexterity by pretraining VLA models on over 20,000 hours of egocentric human video This massive dataset is 20 times larger than previous efforts and proves that robot intelligence follows a predictable path: the more human data, the lower the loss The secret is a simple recipe combining large-scale human pretraining with a small amount of aligned human-robot mid-training to bridge the gap In testing, this method boosted the average success rate by 54% on a 22-DoF robotic hand compared to policies built without pretraining EgoScale also enables one-shot task adaptation and works across different hardware, suggesting that human motion is a universal motor prior for robots Website: Paper: Source: NVIDIA Research #Robot #Humanoid #Robotics #AI #EmbodiedAI #PhysicalAI #NVIDIA #EgoScale #GR00T
1:25

NVIDIA just announced EgoScale 🤖🧠 NVIDIA Research has uncovered a log-linear scaling law for robot dexterity by pretraining VLA models on over 20,000 hours of egocentric human video This massive dataset is 20 times larger than previous efforts and proves that robot intelligence follows a predictable path: the more human data, the lower the loss The secret is a simple recipe combining large-scale human pretraining with a small amount of aligned human-robot mid-training to bridge the gap In testing, this method boosted the average success rate by 54% on a 22-DoF robotic hand compared to policies built without pretraining EgoScale also enables one-shot task adaptation and works across different hardware, suggesting that human motion is a universal motor prior for robots Website: Paper: Source: NVIDIA Research #Robot #Humanoid #Robotics #AI #EmbodiedAI #PhysicalAI #NVIDIA #EgoScale #GR00T

RoboHub🤖

43,752 Aufrufe • vor 4 Monaten

🚨 BREAKING: Swiss startup mimic just raised €13.8M to teach robots the one thing they still struggle with human-like dexterity. 🇨🇭 The Zurich-based company is developing physical AI systems that allow robots to learn directly from human demonstrations. Skilled operators wear custom motion-tracking gear on real factory floors, generating data that trains robots to grasp, move, and adapt with human precision. Founded in 2024 as a spin-off from ETH Zurich, mimic pairs AI-driven dexterous robotic hands with standard industrial robot arms, skipping the humanoid form factor in favor of practical, deployable automation. The oversubscribed seed round was led by Elaia with participation from Speedinvest, Founderful, 1st Kind, 10x Founders, 2100 Ventures, and the Sequoia Scout Fund, bringing total funding to over $20M. Their technology is already being piloted with Fortune 500 manufacturers and logistics operators, where robots are learning complex manipulation tasks once reserved for humans. Why it matters: Europe is stepping up in the AI robotics race. By making dexterity scalable, mimic bridges the gap between lab breakthroughs and real factory deployment, where automation still meets its hardest challenges. As CEO Stefan Weirich put it: “We make dexterity deployable at scale, closing the gap between what AI can do in the lab and what factories actually need.” Let's go robotics in Europe! 🔥
0:26

🚨 BREAKING: Swiss startup mimic just raised €13.8M to teach robots the one thing they still struggle with human-like dexterity. 🇨🇭 The Zurich-based company is developing physical AI systems that allow robots to learn directly from human demonstrations. Skilled operators wear custom motion-tracking gear on real factory floors, generating data that trains robots to grasp, move, and adapt with human precision. Founded in 2024 as a spin-off from ETH Zurich, mimic pairs AI-driven dexterous robotic hands with standard industrial robot arms, skipping the humanoid form factor in favor of practical, deployable automation. The oversubscribed seed round was led by Elaia with participation from Speedinvest, Founderful, 1st Kind, 10x Founders, 2100 Ventures, and the Sequoia Scout Fund, bringing total funding to over $20M. Their technology is already being piloted with Fortune 500 manufacturers and logistics operators, where robots are learning complex manipulation tasks once reserved for humans. Why it matters: Europe is stepping up in the AI robotics race. By making dexterity scalable, mimic bridges the gap between lab breakthroughs and real factory deployment, where automation still meets its hardest challenges. As CEO Stefan Weirich put it: “We make dexterity deployable at scale, closing the gap between what AI can do in the lab and what factories actually need.” Let's go robotics in Europe! 🔥

Lukas Ziegler

77,152 Aufrufe • vor 8 Monaten