Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Are you kidding me??? It grasps multiple objects with different ways, all at once with… a single hand??? No pauses. 1x speed. GENE-26.5 is Genesis AI’s robotics-native multimodal foundation model. It’s trained on 200,000+ hours of real human hand data (motion, force, touch) and runs on a 54-DoF bimanual...

IlirAliu_'s profile picture

Ilir Aliu

56,369 subscribers

204,737 Aufrufe • vor 5 Monaten •via X (Twitter)

Wissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

34 Kommentare

Profilbild von Branahar
Branaharvor 5 Monaten

@gs_ai_ This is why these workers are wearing Head Cameras. This footage gets fed into a virtual training environment for the systems that control the arms in real life eventually

Profilbild von Canadian Prepper
Canadian Preppervor 5 Monaten

@gs_ai_ If not teleoperated thats mildly impressive

Profilbild von Nurvai - The Data Layer for Physical AI
Nurvai - The Data Layer for Physical AIvor 5 Monaten

@gs_ai_ This really feels like a data scaling moment for dexterous manipulation. The jump from 16% to 65% without task specific fine tuning is wild, especially on long horizon tasks. How much of this comes from sheer data scale versus the inclusion of force and touch signals?

Profilbild von Dave
Davevor 5 Monaten

@gs_ai_ It's incredibly impressive, but it is still a demo. The video is literally a demo, in a lab environment. There's been lots of progress in robotics in the last couple of years, but breathless hype doesn't help.

Profilbild von Shiyam Kashfiq
Shiyam Kashfiqvor 5 Monaten

@gs_ai_ Impressive leap. Real dexterity unlocks new design and product possibilities

Profilbild von NotAnotherName
NotAnotherNamevor 5 Monaten

@gs_ai_ "It’s trained on 200,000+ hours of real human hand data" Can we just admit that we are entering idiocracy territory? Like 600MB printer drivers?

Profilbild von Tristan Cunha
Tristan Cunhavor 5 Monaten

@gs_ai_ This is something I've been waiting to see. The next I want to see it carry a bunch of dirty dishes to the kitchen, all stacked up on top of each other :)

Profilbild von Larry Panozzo
Larry Panozzovor 5 Monaten

@gs_ai_ Every time a new capability comes out, I’m like: okay, Optimus better be able to do this too!

Profilbild von stripeybeard
stripeybeardvor 5 Monaten

@gs_ai_ When robots are this fast I'll be impressed

Profilbild von Brainstaind Development
Brainstaind Developmentvor 5 Monaten

@gs_ai_ This is great, but the real carrot will be using subsystems to run these general movements then when new movements need to be learned, the separate AI system would need to interpret that and then train that subsystem. Much like how we learn new movements ourselves.

Profilbild von Deeptics x DeepHub
Deeptics x DeepHubvor 5 Monaten

@gs_ai_ Look smooth tbh

Profilbild von Milie Cyrus
Milie Cyrusvor 5 Monaten

@gs_ai_ there's always a non zero chance of catastrophic failure

Profilbild von Ed
Edvor 5 Monaten

@gs_ai_ Wait till they start moving too fast. Then you’ll panic.

Profilbild von Jean Filetonpaire
Jean Filetonpairevor 5 Monaten

@gs_ai_ They also overheat.. Presentations are usually many miles away from real final commercial product

Profilbild von Peter Morris
Peter Morrisvor 5 Monaten

@gs_ai_ Dr. Alan Grant: You're sure the third one's contained? Dr. Ellie Sattler: Yes, unless they figure out how to open doors.

Profilbild von Court Reinland
Court Reinlandvor 5 Monaten

@gs_ai_ Low key I can’t even do that with my own human hand like… 🤦‍♂️

Profilbild von dbc00per
dbc00pervor 5 Monaten

@gs_ai_ I'm sorry when I see videos like this and I still hear people bashing on Tesla and Elon that failure is inevitable ...it baffles me

Profilbild von Jacksonville
Jacksonvillevor 5 Monaten

@gs_ai_ Cant wait for anime girl robot 😀👌

Profilbild von Félix GARCIA
Félix GARCIAvor 5 Monaten

@gs_ai_ 😁

Profilbild von neetnite
neetnitevor 5 Monaten

@gs_ai_ 動かし続けるのにどのくらいエネルギーが必要なんだろうな。

Profilbild von Jay Shah
Jay Shahvor 5 Monaten

@gs_ai_ This is mind boggling 🤯🤯

Profilbild von Dysputant
Dysputantvor 5 Monaten

@gs_ai_ Can i get one attached to my deck in home ? I will train it myself... i have good reason to keep it private tho.

Profilbild von PublicAI
PublicAIvor 5 Monaten

@gs_ai_ Robots finally doing those tiny coordinated movements we take for granted?

Profilbild von Andre William Duval
Andre William Duvalvor 5 Monaten

@gs_ai_ I'm not going to be celebrating.

Profilbild von Eragon
Eragonvor 5 Monaten

@gs_ai_ Question: why are we using hands and fingers? Can't we come up with a better design?

Profilbild von Maxorama
Maxoramavor 5 Monaten

@gs_ai_ It's going to look so silly to be impressed by a robot awkwardly grabbing stuff when @Tesla_Optimus is ready for customers

Profilbild von Brice Gramm
Brice Grammvor 5 Monaten

@gs_ai_ "One trip or die trying." This robot is just like me.

Profilbild von bobupandown
bobupandownvor 5 Monaten

@gs_ai_ yep, we're making humanoid robots, with a lot of our similarities, but they don't need to have all the same limitations as us :)

Profilbild von 2ndClassCitizen
2ndClassCitizenvor 5 Monaten

@gs_ai_ Ya but im certain this is teleoperated.

Profilbild von Daniel L.
Daniel L.vor 5 Monaten

@gs_ai_ this is better that the tape one, still looks like the bot is grossed out having to touch human stuffs

Profilbild von Robb Hays
Robb Haysvor 5 Monaten

@gs_ai_ This is mesmerizing.

Profilbild von Janitor Bob
Janitor Bobvor 5 Monaten

@gs_ai_ My two year old can do this better and faster and with more accuracy…

Profilbild von G Adam
G Adamvor 5 Monaten

@gs_ai_ surreal, seems like watching real human hand

Profilbild von general bork 🐇
general bork 🐇vor 5 Monaten

@gs_ai_ Fingertips can be modified to spin so that hands can be used to tighten screws or ratchet nuts and bolts. The second finger can be needle nose pliers or a tweezer tool. Another finger can employ air, another a vacuum. The palm, a hammer, a thumb can be a pry tool. Gadget hands.

Ähnliche Videos

Happy to share what I’ve been working on since joining Genesis! GENE-26.5 is a one-of-a-kind, robotics-native multimodal foundation model that learns from diverse, in-the-wild data across modalities and outputs actions enabling a 54-DoF robot system to perform the most dexterous, long-horizon manipulation tasks to date—approaching human-level capability. This is the result of innovations across the full stack—data collection and processing, robot systems, model architecture, training strategies, and scalable evaluation infrastructure.
2:23

Happy to share what I’ve been working on since joining Genesis! GENE-26.5 is a one-of-a-kind, robotics-native multimodal foundation model that learns from diverse, in-the-wild data across modalities and outputs actions enabling a 54-DoF robot system to perform the most dexterous, long-horizon manipulation tasks to date—approaching human-level capability. This is the result of innovations across the full stack—data collection and processing, robot systems, model architecture, training strategies, and scalable evaluation infrastructure.

Zu

20,454 Aufrufe • vor 5 Monaten

We are back. After one year of quiet building. Introducing GENE-26.5, our first robotic brain that takes a major step toward human-level capability. For years, robotics has struggled to learn from the world’s largest and valuable data source: Humans. Solving it means rethinking the whole stack from the ground up: - A robotics-native foundation model. - A 1:1 human-like robotic hand. - A noninvasive data collection glove for motion, force, and touch. - A simulator that turns weeks of experiments into minutes. GENE-26.5 is trained across language, vision, proprioception, tactile, and action. We designed a set of tasks to test how far we can go with this new paradigm. Fully autonomous, 1x speed, one model, same weights. (Enjoy with sound on) We are approaching the endgame for robotics. And this is just a beginning.
3:05

We are back. After one year of quiet building. Introducing GENE-26.5, our first robotic brain that takes a major step toward human-level capability. For years, robotics has struggled to learn from the world’s largest and valuable data source: Humans. Solving it means rethinking the whole stack from the ground up: - A robotics-native foundation model. - A 1:1 human-like robotic hand. - A noninvasive data collection glove for motion, force, and touch. - A simulator that turns weeks of experiments into minutes. GENE-26.5 is trained across language, vision, proprioception, tactile, and action. We designed a set of tasks to test how far we can go with this new paradigm. Fully autonomous, 1x speed, one model, same weights. (Enjoy with sound on) We are approaching the endgame for robotics. And this is just a beginning.

Genesis AI

2,745,994 Aufrufe • vor 5 Monaten

Impressive on every dimension! Genesis AI has announced GENE-26.5, its first robotic foundation model, aimed at achieving human-level dexterous manipulation: - Single model, shared weights, handles egg cracking, lab pipetting, bimanual Rubik's Cube, smoothie making, and wire harnessing. Most tasks: under 1 hour of task-specific data, 1x real-world speed. - Genesis Hand 1.0: human-size, 20 active DoF, soft-contact skin. Paired glove gives a 1:1:1 mapping (glove, human hand, robot hand). 100x cheaper than teleop, 5x more data-efficient internally. - Data engine pulls from three sources: glove data, egocentric (head-cam) video, and large-scale internet video. The 1:1 hand-to-human match closes the embodiment gap, letting Genesis use video data more effectively than rivals. - Flow matching across vision, tactile, proprioception, and language inputs. Per Genesis, scaling data and compute directly improves zero-shot
3:55

Impressive on every dimension! Genesis AI has announced GENE-26.5, its first robotic foundation model, aimed at achieving human-level dexterous manipulation: - Single model, shared weights, handles egg cracking, lab pipetting, bimanual Rubik's Cube, smoothie making, and wire harnessing. Most tasks: under 1 hour of task-specific data, 1x real-world speed. - Genesis Hand 1.0: human-size, 20 active DoF, soft-contact skin. Paired glove gives a 1:1:1 mapping (glove, human hand, robot hand). 100x cheaper than teleop, 5x more data-efficient internally. - Data engine pulls from three sources: glove data, egocentric (head-cam) video, and large-scale internet video. The 1:1 hand-to-human match closes the embodiment gap, letting Genesis use video data more effectively than rivals. - Flow matching across vision, tactile, proprioception, and language inputs. Per Genesis, scaling data and compute directly improves zero-shot

The Humanoid Hub

95,894 Aufrufe • vor 5 Monaten

Jason Ma reveals the first true scaling law in robotics: robots trained on 1 million hours of first-person human video predictably get better without ever seeing robot data "Yesterday we announced our new flagship robot foundation model called Dyna-2. It's very significant for the entire field for many different reasons. First of all, it's the first robot foundation model trained on at least one million hours of data. That in itself is a very challenging infrastructure challenge." "What we demonstrated is that even if the one million hours of data is entirely first-person video of humans doing manipulation tasks, we actually see scaling law for transferring to robot embodiments that the model has never seen before." "By training on more human data, we actually see predictable performance improvement on robots. That's a big deal because the biggest challenge facing robot foundation models is that we don't have enough data." "Unlike language models, there are just not enough robotics data out there, and it's very difficult to collect these robot data. Only by passively observing humans doing things can we scale this kind of data, and this is the first time we showed there is a lot of improvement that can transfer." Jason Ma Dyna Robotics
1:14

Jason Ma reveals the first true scaling law in robotics: robots trained on 1 million hours of first-person human video predictably get better without ever seeing robot data "Yesterday we announced our new flagship robot foundation model called Dyna-2. It's very significant for the entire field for many different reasons. First of all, it's the first robot foundation model trained on at least one million hours of data. That in itself is a very challenging infrastructure challenge." "What we demonstrated is that even if the one million hours of data is entirely first-person video of humans doing manipulation tasks, we actually see scaling law for transferring to robot embodiments that the model has never seen before." "By training on more human data, we actually see predictable performance improvement on robots. That's a big deal because the biggest challenge facing robot foundation models is that we don't have enough data." "Unlike language models, there are just not enough robotics data out there, and it's very difficult to collect these robot data. Only by passively observing humans doing things can we scale this kind of data, and this is the first time we showed there is a lot of improvement that can transfer." Jason Ma Dyna Robotics

MTS

17,740 Aufrufe • vor 1 Monat

Tired of teleoperation? One human video → 1,000s of robot demos. (📍GitHub ) Scaling Robot Data Without Dynamics Simulation or Robot Hardware Real2Render2Real (R2R2R) is a new way to scale robot data without physics simulation or hardware. You take a phone scan + a single monocular human demo. It tracks the motion, renders photorealistic scenes, and generates diverse, robot-agnostic trajectories ready for training. > No teleop, no sim, no robot, just a phone and a video > Train VLA models and diffusion policies directly on the output > Supports multiple robot embodiments with kinematic consistency > 1000s of demos in 1/27 the time of real-world collection Thank you, Max Fu, for sharing!! Project: Paper: Code coming soon: It shows that with the right pipeline, you can scale robot learning data without touching a robot. One of the most interesting directions in scalable robotics today. —— Weekly robotics and AI insights. Subscribe free:
0:29

Tired of teleoperation? One human video → 1,000s of robot demos. (📍GitHub ) Scaling Robot Data Without Dynamics Simulation or Robot Hardware Real2Render2Real (R2R2R) is a new way to scale robot data without physics simulation or hardware. You take a phone scan + a single monocular human demo. It tracks the motion, renders photorealistic scenes, and generates diverse, robot-agnostic trajectories ready for training. > No teleop, no sim, no robot, just a phone and a video > Train VLA models and diffusion policies directly on the output > Supports multiple robot embodiments with kinematic consistency > 1000s of demos in 1/27 the time of real-world collection Thank you, Max Fu, for sharing!! Project: Paper: Code coming soon: It shows that with the right pipeline, you can scale robot learning data without touching a robot. One of the most interesting directions in scalable robotics today. —— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

42,864 Aufrufe • vor 8 Monaten

JUST IN: Dyna Robotics just published one of the most important research papers in robotics this year. It could fundamentally change how robot foundation models are trained. A scaling law that transfers from human video to robot performance. Dyna-2 is out and it's 🔥 Here's what that means in plain terms. Dyna-2 was pre-trained on ONE MILLION hours of egocentric human video, 170 years of continuous human experience, cooking, folding, assembling, cleaning. And as that human data scaled, robot performance improved. Predictably. Monotonically. Across 39 tasks on two different robot embodiments the model had never seen. → 1,000 hours pre-training → 20% normalised task performance → 10,000 hours → 28% → 100,000 hours → 45% → 1,000,000 hours → 53% Human video exists at effectively unlimited scale. Every cook, every factory worker, every craftsperson wearing a camera is generating training data for future robots. But the finding that stunned even the researchers, world modeling is what makes the transfer work. A model trained to predict future video AND actions massively outperforms one trained on actions alone. Video is the new scaling axis for robotics. One more jaw-dropping data point. 13 minutes of teleoperation data was enough to fine-tune Dyna-2 to open a bottle cap using two five-fingered robot hands. The robots are coming, and they're learning from us directly :D Read more here: Congrats Jason Ma and team! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
1:35

JUST IN: Dyna Robotics just published one of the most important research papers in robotics this year. It could fundamentally change how robot foundation models are trained. A scaling law that transfers from human video to robot performance. Dyna-2 is out and it's 🔥 Here's what that means in plain terms. Dyna-2 was pre-trained on ONE MILLION hours of egocentric human video, 170 years of continuous human experience, cooking, folding, assembling, cleaning. And as that human data scaled, robot performance improved. Predictably. Monotonically. Across 39 tasks on two different robot embodiments the model had never seen. → 1,000 hours pre-training → 20% normalised task performance → 10,000 hours → 28% → 100,000 hours → 45% → 1,000,000 hours → 53% Human video exists at effectively unlimited scale. Every cook, every factory worker, every craftsperson wearing a camera is generating training data for future robots. But the finding that stunned even the researchers, world modeling is what makes the transfer work. A model trained to predict future video AND actions massively outperforms one trained on actions alone. Video is the new scaling axis for robotics. One more jaw-dropping data point. 13 minutes of teleoperation data was enough to fine-tune Dyna-2 to open a bottle cap using two five-fingered robot hands. The robots are coming, and they're learning from us directly :D Read more here: Congrats Jason Ma and team! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

23,681 Aufrufe • vor 2 Monaten

Robots are getting smarter, but most still fail the same way. They don’t learn from their own mistakes. A new paper proposes something different: a way for robots to self-improve directly from their failures in the real world. It’s called PLD (Probe, Learn, Distill). The idea: instead of collecting endless human demos, let the robot figure out where it fails, learn how to recover, and then distill that knowledge back into its main model. Key takeaways from the research: ✅ Uses residual reinforcement learning to recover from policy failures ✅ Achieves 99% success on LIBERO and 100% on real Franka and YAM arms ✅ Runs hour-long manipulation tasks without human resets ✅ Builds a feedback loop between real-world data and model adaptation Unlike supervised fine-tuning, which relies on humans, PLD learns from the robot’s own experience. By training on its own failure distribution, the model becomes both more efficient and more aligned with the real world. It’s not just a technical shift, it’s a step toward robots that improve themselves through real-world practice. Thanks for sharing, Wenli Xiao !! Paper and demos: —- Weekly robotics and AI insights. Subscribe free:
0:47

Robots are getting smarter, but most still fail the same way. They don’t learn from their own mistakes. A new paper proposes something different: a way for robots to self-improve directly from their failures in the real world. It’s called PLD (Probe, Learn, Distill). The idea: instead of collecting endless human demos, let the robot figure out where it fails, learn how to recover, and then distill that knowledge back into its main model. Key takeaways from the research: ✅ Uses residual reinforcement learning to recover from policy failures ✅ Achieves 99% success on LIBERO and 100% on real Franka and YAM arms ✅ Runs hour-long manipulation tasks without human resets ✅ Builds a feedback loop between real-world data and model adaptation Unlike supervised fine-tuning, which relies on humans, PLD learns from the robot’s own experience. By training on its own failure distribution, the model becomes both more efficient and more aligned with the real world. It’s not just a technical shift, it’s a step toward robots that improve themselves through real-world practice. Thanks for sharing, Wenli Xiao !! Paper and demos: —- Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

22,891 Aufrufe • vor 11 Monaten

Robotics is almost solved! Pun intended. Sunday published a "Solve" standard. They declared the scope (garment types, lighting, surfaces, starting configurations) and adaptation cost (zero—no fine-tuning per home) before evaluating. The same model weights run everywhere. This might be the differentiation between a good demo and reliable work of robots. They presented ACT-2, a robot foundation model that folds laundry at 99.1% success across unseen homes. Different houses, lighting, bed types, garment sizes. According to them scaling pre-training closes the generalization gap. Train on massive, high-quality human data. When you do that right, what you learn in-house actually transfers to unseen homes. Even wilder is that the model learns new folding techniques from a single example and generalizes them to new environments. Memo goes to homes later this year. Would you adopt this cutie? 🥹 Read more here: Great work Tony Zhao and team! 🧡 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
1:21

Robotics is almost solved! Pun intended. Sunday published a "Solve" standard. They declared the scope (garment types, lighting, surfaces, starting configurations) and adaptation cost (zero—no fine-tuning per home) before evaluating. The same model weights run everywhere. This might be the differentiation between a good demo and reliable work of robots. They presented ACT-2, a robot foundation model that folds laundry at 99.1% success across unseen homes. Different houses, lighting, bed types, garment sizes. According to them scaling pre-training closes the generalization gap. Train on massive, high-quality human data. When you do that right, what you learn in-house actually transfers to unseen homes. Even wilder is that the model learns new folding techniques from a single example and generalizes them to new environments. Memo goes to homes later this year. Would you adopt this cutie? 🥹 Read more here: Great work Tony Zhao and team! 🧡 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

37,023 Aufrufe • vor 2 Monaten

We trained a humanoid with 22-DoF dexterous hands to assemble model cars, operate syringes, sort poker cards, fold/roll shirts, all learned primarily from 20,000+ hours of egocentric human video with no robot in the loop. Humans are the most scalable embodiment on the planet. We discovered a near-perfect log-linear scaling law (R² = 0.998) between human video volume and action prediction loss, and this loss directly predicts real-robot success rate. Humanoid robots will be the end game, because they are the practical form factor with minimal embodiment gap from humans. Call it the Bitter Lesson of robot hardware: the kinematic similarity lets us simply retarget human finger motion onto dexterous robot hand joints. No learned embeddings, no fancy transfer algorithms needed. Relative wrist motion + retargeted 22-DoF finger actions serve as a unified action space that carries through from pre-training to robot execution. Our recipe is called "EgoScale": - Pre-train GR00T N1.5 on 20K hours of human video, mid-train with only 4 hours (!) of robot play data with Sharpa hands. 54% gains over training from scratch across 5 highly dexterous tasks. - Most surprising result: a *single* teleop demo is sufficient to learn a never-before-seen task. Our recipe enables extreme data efficiency. - Although we pre-train in 22-DoF hand joint space, the policy transfers to a Unitree G1 with 7-DoF tri-finger hands. 30%+ gains over training on G1 data alone. The scalable path to robot dexterity was never more robots. It was always us. Deep dives in thread:
1:17

We trained a humanoid with 22-DoF dexterous hands to assemble model cars, operate syringes, sort poker cards, fold/roll shirts, all learned primarily from 20,000+ hours of egocentric human video with no robot in the loop. Humans are the most scalable embodiment on the planet. We discovered a near-perfect log-linear scaling law (R² = 0.998) between human video volume and action prediction loss, and this loss directly predicts real-robot success rate. Humanoid robots will be the end game, because they are the practical form factor with minimal embodiment gap from humans. Call it the Bitter Lesson of robot hardware: the kinematic similarity lets us simply retarget human finger motion onto dexterous robot hand joints. No learned embeddings, no fancy transfer algorithms needed. Relative wrist motion + retargeted 22-DoF finger actions serve as a unified action space that carries through from pre-training to robot execution. Our recipe is called "EgoScale": - Pre-train GR00T N1.5 on 20K hours of human video, mid-train with only 4 hours (!) of robot play data with Sharpa hands. 54% gains over training from scratch across 5 highly dexterous tasks. - Most surprising result: a *single* teleop demo is sufficient to learn a never-before-seen task. Our recipe enables extreme data efficiency. - Although we pre-train in 22-DoF hand joint space, the policy transfers to a Unitree G1 with 7-DoF tri-finger hands. 30%+ gains over training on G1 data alone. The scalable path to robot dexterity was never more robots. It was always us. Deep dives in thread:

Jim Fan

302,186 Aufrufe • vor 7 Monaten

.Jason Ma on how Dyna-2 learned to untwist a real water bottle cap out of the box from just 13 minutes of dexterous hand data because the robot hand looks like a human's: "We got a new pair of dexterous hand. Most of our robots in the office have a gripper-like hand, so the gap between that versus human is actually quite large." "We thought, if we have a robot that has hands that look like human, wouldn't the transfer be greater? Right before the release, they were able to collect just 13 minutes of data." "They collected only 13 minutes of data and then post-trained the best Dyna model that trained on one million hours of data. The model is just able to, out of the box, start opening bottle caps on real water bottles." "This is very surprising because typically post-training a robot would take at least several hours of data. For a dexterous hand that's much more complex than a gripper, it would actually be much harder to train. But the experimental results we saw was the opposite. Perhaps because the hand looks more like the human, the transfer was easier." Dyna Robotics
1:16

.Jason Ma on how Dyna-2 learned to untwist a real water bottle cap out of the box from just 13 minutes of dexterous hand data because the robot hand looks like a human's: "We got a new pair of dexterous hand. Most of our robots in the office have a gripper-like hand, so the gap between that versus human is actually quite large." "We thought, if we have a robot that has hands that look like human, wouldn't the transfer be greater? Right before the release, they were able to collect just 13 minutes of data." "They collected only 13 minutes of data and then post-trained the best Dyna model that trained on one million hours of data. The model is just able to, out of the box, start opening bottle caps on real water bottles." "This is very surprising because typically post-training a robot would take at least several hours of data. For a dexterous hand that's much more complex than a gripper, it would actually be much harder to train. But the experimental results we saw was the opposite. Perhaps because the hand looks more like the human, the transfer was easier." Dyna Robotics

MTS

13,743 Aufrufe • vor 1 Monat

Training humanoid robots on teleoperation alone won’t scale, says Rhoda AI CEO Jagdeep Singh. Unlike self-driving cars - which basically have four actuators (left, right, speed up, and slow down) and operate in a single environment (the road) - humanoid robots are completely different: "You're dealing with the full dexterity of a human hand - 20 degrees of freedom per hand. Every object is different. Every type of task is different." The problem isn't just the quantity of data - the bigger issue is diversity in the data, and it's why many humanoid robot demos will struggle to adapt to the real world: "If all the data you have is data that you've intentionally collected, then you almost by definition haven't seen the corner cases. You haven't seen all those edge scenarios that cause failure." Jagdeep says teleoperation is useful for fine-tuning robot behavior, but for pretraining, it's completely inadequate.
2:46

Training humanoid robots on teleoperation alone won’t scale, says Rhoda AI CEO Jagdeep Singh. Unlike self-driving cars - which basically have four actuators (left, right, speed up, and slow down) and operate in a single environment (the road) - humanoid robots are completely different: "You're dealing with the full dexterity of a human hand - 20 degrees of freedom per hand. Every object is different. Every type of task is different." The problem isn't just the quantity of data - the bigger issue is diversity in the data, and it's why many humanoid robot demos will struggle to adapt to the real world: "If all the data you have is data that you've intentionally collected, then you almost by definition haven't seen the corner cases. You haven't seen all those edge scenarios that cause failure." Jagdeep says teleoperation is useful for fine-tuning robot behavior, but for pretraining, it's completely inadequate.

TBPN

19,218 Aufrufe • vor 7 Monaten

This giant free dataset could make helper robots way smarter, way faster: An open-source robotics stack from Berkeley AI researchers featuring the largest teleoperation dataset released to date with over 3,500 hours of bimanual manipulation data across 200 tasks. The video showcases autonomous bimanual robot performance on dexterous tasks including box folding, Lego sorting, AirPod insertion, t-shirt folding, backpack packing, and box unlocking using learned policies. Sim-to-real correlations, training insights like flow loss predicting real-world success, lightweight infrastructure for DAgger interventions Thank you for sharing, Ritvik Singh, and everyone else who contributed to this! Links to the paper plus dataset at under permissive licensing. ——- Weekly robotics and AI insights. Subscribe free:
0:38

This giant free dataset could make helper robots way smarter, way faster: An open-source robotics stack from Berkeley AI researchers featuring the largest teleoperation dataset released to date with over 3,500 hours of bimanual manipulation data across 200 tasks. The video showcases autonomous bimanual robot performance on dexterous tasks including box folding, Lego sorting, AirPod insertion, t-shirt folding, backpack packing, and box unlocking using learned policies. Sim-to-real correlations, training insights like flow loss predicting real-world success, lightweight infrastructure for DAgger interventions Thank you for sharing, Ritvik Singh, and everyone else who contributed to this! Links to the paper plus dataset at under permissive licensing. ——- Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

13,264 Aufrufe • vor 3 Monaten

I don't know if you really understand what these people just did... They built an AI that looks at a few casual real-world videos or photos and instantly turns them into a full 3D playground. You can MOVE THE CAMERA HOWEVER YOU WANT, change the lighting, move objects around, and even let physics play out like in the real world. View events from impossible angles because Atlas knows what was there. This is massive! Let's take robotics. Until now training robots meant collecting tons of expensive real-world data. Now a handful of recordings can become thousands of different simulated situations. Robots can practice the same task in new rooms, with different objects and lighting without anyone having to film it all again. For the industry it means we can train robots way faster and cheaper. Home robots, warehouse robots, whatever... they can learn new environments at scale instead of staying stuck in the lab. This is one of the first real bridges between “cool AI video models” and actual physical machines that have to work in the real world. Blog: The team behind World Labs: Fei-Fei Li, Justin Johnson, Ben Mildenhall and Yunzhu Li. The video is from David Pantera. Follow for more insights into robotics and AI. —— Weekly robotics and AI insights. Subscribe free:
0:49

I don't know if you really understand what these people just did... They built an AI that looks at a few casual real-world videos or photos and instantly turns them into a full 3D playground. You can MOVE THE CAMERA HOWEVER YOU WANT, change the lighting, move objects around, and even let physics play out like in the real world. View events from impossible angles because Atlas knows what was there. This is massive! Let's take robotics. Until now training robots meant collecting tons of expensive real-world data. Now a handful of recordings can become thousands of different simulated situations. Robots can practice the same task in new rooms, with different objects and lighting without anyone having to film it all again. For the industry it means we can train robots way faster and cheaper. Home robots, warehouse robots, whatever... they can learn new environments at scale instead of staying stuck in the lab. This is one of the first real bridges between “cool AI video models” and actual physical machines that have to work in the real world. Blog: The team behind World Labs: Fei-Fei Li, Justin Johnson, Ben Mildenhall and Yunzhu Li. The video is from David Pantera. Follow for more insights into robotics and AI. —— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

273,520 Aufrufe • vor 1 Monat

Robot trained entirely in simulation! 🤯 Sudo AI just released #sudo R1. This could be the moment the data bottleneck in robotics finally breaks, a major step forward for getting simulation-trained robots to actually work in the real world. #sudo R1 is a manipulation foundation model that reliably picks objects it has never seen: glass, fabric, metal, irregular shapes. All with zero real-world training data. No tele-op. No demos. No manual labeling. Pure simulation. And picking isn't just any skill, it's the foundation. Almost everything we want robots to do starts with being able to reliably pick something up. Data collection is the bottleneck holding the whole field back. Every new task means hours of tele-op and armies of labelers. If simulation alone can actually deliver production-grade picking, that bottleneck starts to disappear. Really exciting to see! If the results hold, the path to general-purpose robots just got a whole lot shorter. 👇 Read more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:59

Robot trained entirely in simulation! 🤯 Sudo AI just released #sudo R1. This could be the moment the data bottleneck in robotics finally breaks, a major step forward for getting simulation-trained robots to actually work in the real world. #sudo R1 is a manipulation foundation model that reliably picks objects it has never seen: glass, fabric, metal, irregular shapes. All with zero real-world training data. No tele-op. No demos. No manual labeling. Pure simulation. And picking isn't just any skill, it's the foundation. Almost everything we want robots to do starts with being able to reliably pick something up. Data collection is the bottleneck holding the whole field back. Every new task means hours of tele-op and armies of labelers. If simulation alone can actually deliver production-grade picking, that bottleneck starts to disappear. Really exciting to see! If the results hold, the path to general-purpose robots just got a whole lot shorter. 👇 Read more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

25,901 Aufrufe • vor 5 Monaten

A simple idea. Let robots collect the data that current foundation models are missing. A robot that gets better by doing real work in the real world. For two weeks in the Stanford East Asia Library, Scanford scanned shelves, helped librarians, and improved the vision language model it depends on. The idea is very simple: Robots do useful work. They gather the real world data foundation models never see online. They fine tune their own model They go back out stronger A full loop. What they found in deployment: ✅ 2103 shelves scanned with multilingual, faded, occluded book spines ✅ 18.7 hours of librarian time saved ✅ Book ID accuracy jumped from 32.0 percent to 71.8 percent ✅ English OCR improved from 24.8 percent to 46.6 percent ✅ Chinese OCR improved from 30.8 percent to 38.0 percent The most interesting part is the shift. Robots do not only consume foundation models. They create the data these models are missing. A clean robot powered data flywheel. Work. Collect. Fine tune. Repeat. Thanks for sharing, Jenn Grannen! If you want the full write up: 📍Website: Paper: —- Weekly robotics and AI insights. Subscribe free:
0:44

A simple idea. Let robots collect the data that current foundation models are missing. A robot that gets better by doing real work in the real world. For two weeks in the Stanford East Asia Library, Scanford scanned shelves, helped librarians, and improved the vision language model it depends on. The idea is very simple: Robots do useful work. They gather the real world data foundation models never see online. They fine tune their own model They go back out stronger A full loop. What they found in deployment: ✅ 2103 shelves scanned with multilingual, faded, occluded book spines ✅ 18.7 hours of librarian time saved ✅ Book ID accuracy jumped from 32.0 percent to 71.8 percent ✅ English OCR improved from 24.8 percent to 46.6 percent ✅ Chinese OCR improved from 30.8 percent to 38.0 percent The most interesting part is the shift. Robots do not only consume foundation models. They create the data these models are missing. A clean robot powered data flywheel. Work. Collect. Fine tune. Repeat. Thanks for sharing, Jenn Grannen! If you want the full write up: 📍Website: Paper: —- Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

44,698 Aufrufe • vor 10 Monaten

What if a dexterous robot could learn a 20+ step chemistry experiment without a single on-robot training demo? Meet TwinDEX: a pair of co-designed, three-finger, nine-DoF dexterous manipulation interface: one wearable for data collection, one for robot deployment. The twinned design shares identical kinematics, contact surfaces, visual appearance, and sensors across collection and deployment — keeping observations and actions aligned end to end. Trained from scratch on only a few hundred wearable demonstrations - with zero on-robot training or intervention data - TwinDEX completed a standardized chemistry experiment involving tool switches, fine force control, and bimanual coordination. Robot-free data showed comparable learning efficiency on the multi-task evaluation, TwinDEX delivered 5.3 times effective throughput than on-robot teleoperation. TwinDEX demonstrates that high-quality robot-free data can fully substitute for on-robot teleoperation data on challenging dexterous tasks — removing the dependency on real-robot hardware that has been the central bottleneck to scaling dexterous manipulation data. This was the proof-it phase. Now comes scale: what emerges at tens of thousands, or millions, of episodes? Watch the demo and read the technical blog: #TwinDEX #Robotics #EmbodiedAI #DexterousManipulation
4:31

What if a dexterous robot could learn a 20+ step chemistry experiment without a single on-robot training demo? Meet TwinDEX: a pair of co-designed, three-finger, nine-DoF dexterous manipulation interface: one wearable for data collection, one for robot deployment. The twinned design shares identical kinematics, contact surfaces, visual appearance, and sensors across collection and deployment — keeping observations and actions aligned end to end. Trained from scratch on only a few hundred wearable demonstrations - with zero on-robot training or intervention data - TwinDEX completed a standardized chemistry experiment involving tool switches, fine force control, and bimanual coordination. Robot-free data showed comparable learning efficiency on the multi-task evaluation, TwinDEX delivered 5.3 times effective throughput than on-robot teleoperation. TwinDEX demonstrates that high-quality robot-free data can fully substitute for on-robot teleoperation data on challenging dexterous tasks — removing the dependency on real-robot hardware that has been the central bottleneck to scaling dexterous manipulation data. This was the proof-it phase. Now comes scale: what emerges at tens of thousands, or millions, of episodes? Watch the demo and read the technical blog: #TwinDEX #Robotics #EmbodiedAI #DexterousManipulation

X Square Robot

1,346,470 Aufrufe • vor 1 Monat

Most robot demos are scripted. Generalist's GEN-1 is not. > GEN-1 was doing a task > Mid-task, an extra object was thrown into the bin > GEN-1 quickly adapted to the new environment > Still completed the task smoothly This is the difference between a scripted policy (seen in viral launch videos) and a real foundation model. GEN-1 was trained on 500,000 hours of proprietary, real-world dexterous manipulation data. It has NEVER seen that exact scenario before. This was the coolest demo at Automate Show Generalist Flexiv Robotics
0:53

Most robot demos are scripted. Generalist's GEN-1 is not. > GEN-1 was doing a task > Mid-task, an extra object was thrown into the bin > GEN-1 quickly adapted to the new environment > Still completed the task smoothly This is the difference between a scripted policy (seen in viral launch videos) and a real foundation model. GEN-1 was trained on 500,000 hours of proprietary, real-world dexterous manipulation data. It has NEVER seen that exact scenario before. This was the coolest demo at Automate Show Generalist Flexiv Robotics

mete

11,651 Aufrufe • vor 3 Monaten

15–30 minutes of real-world robot data. That's now enough to go from sim-to-real failure to working robot. Let’s see… You train a robot in simulation. You deploy it in the real world. It fails. The physics don't match. So you try to fine-tune it with real data, but… you never have enough real data, and the fine-tuning breaks everything the simulation taught it. SimDist fixes this with one key decision: don't transfer the policy. Transfer the world model. Keep the reward and value knowledge from simulation frozen. Only update the part that's actually wrong, how the robot predicts physics. Now the robot doesn't have to relearn the entire task in the real world. It already knows what success looks like. It just needs to correct its understanding of how the real world moves. The part that makes this work: they also trained on failures and recoveries; not just perfect demonstrations. Without that, the planner finds the gaps and exploits them. With it, the robot can tell a good future from a bad one. That's all it needs. Results on peg insertion, table leg assembly, locomotion on slippery and uneven surfaces. Tasks that require precision, force, and quick reaction. Thanks for sharing, Tyler Westenbroek ([Tyler Westenbroek]. Interactive visualization + paper: ——- Weekly robotics and AI insights. Subscribe free:
0:41

15–30 minutes of real-world robot data. That's now enough to go from sim-to-real failure to working robot. Let’s see… You train a robot in simulation. You deploy it in the real world. It fails. The physics don't match. So you try to fine-tune it with real data, but… you never have enough real data, and the fine-tuning breaks everything the simulation taught it. SimDist fixes this with one key decision: don't transfer the policy. Transfer the world model. Keep the reward and value knowledge from simulation frozen. Only update the part that's actually wrong, how the robot predicts physics. Now the robot doesn't have to relearn the entire task in the real world. It already knows what success looks like. It just needs to correct its understanding of how the real world moves. The part that makes this work: they also trained on failures and recoveries; not just perfect demonstrations. Without that, the planner finds the gaps and exploits them. With it, the robot can tell a good future from a bad one. That's all it needs. Results on peg insertion, table leg assembly, locomotion on slippery and uneven surfaces. Tasks that require precision, force, and quick reaction. Thanks for sharing, Tyler Westenbroek ([Tyler Westenbroek]. Interactive visualization + paper: ——- Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

14,222 Aufrufe • vor 4 Monaten

Turning video into humanoid robot motion! 🤳🏼 Training humanoid robots needs huge amounts of motion data, but real-world capture doesn’t scale. Mocap is expensive, dangerous edge cases are rare, and you can’t ask humans to repeatedly fall or crash. Video2Robot tackles this by converting videos into physics-grounded humanoid simulations. Motion is generated to respect balance, inertia, ground contact, and joint limits, then directly retargeted to robot simulators. One prompt can generate a full humanoid motion sequence, including multi-agent interactions and failure cases like falls or collisions, scenarios that are hard or impossible to capture safely in the real world. The pipeline is model-agnostic and works with existing video generators, making it a practical way to scale data for robots. If robots are going to operate in the real world, they need to be trained on the failures too, not just the perfect demos. Here's the GitHub: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:26

Turning video into humanoid robot motion! 🤳🏼 Training humanoid robots needs huge amounts of motion data, but real-world capture doesn’t scale. Mocap is expensive, dangerous edge cases are rare, and you can’t ask humans to repeatedly fall or crash. Video2Robot tackles this by converting videos into physics-grounded humanoid simulations. Motion is generated to respect balance, inertia, ground contact, and joint limits, then directly retargeted to robot simulators. One prompt can generate a full humanoid motion sequence, including multi-agent interactions and failure cases like falls or collisions, scenarios that are hard or impossible to capture safely in the real world. The pipeline is model-agnostic and works with existing video generators, making it a practical way to scale data for robots. If robots are going to operate in the real world, they need to be trained on the failures too, not just the perfect demos. Here's the GitHub: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

59,835 Aufrufe • vor 9 Monaten