Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Robots assembling robot brain -- imagine this kind of robustness on every precision manufacturing line! Live demo of GPU rack assembly at #NVIDIAGTC: - end-to-end neural network (Skild Brain) finetuned with little data - memory to perform long horizon task (placing jigs, 16 screwes, removing jigs) - robust to... show more

Deepak Pathak

29,231 subscribers

46,024 views • 4 months ago •via X (Twitter)

Science & Technology #NVIDIAGTC

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Excited to announce that Skild AI has completed the acquisition of Zebra Technologies’ robotics arm (formerly Fetch Robotics). By combining Zebra's human-robot orchestration platform with omnibodied Skild Brain, we plan to turn warehouses everywhere into hubs of hyper-efficiency. Imagine a single platform, single brain optimizing every movement of robots as well as human workers in warehouses. Many of us in the robotics community have used Fetch Robots in the past and have rooted for them over the years, so this acquisition is special for us in many ways.

Excited to announce that Skild AI has completed the acquisition of Zebra Technologies’ robotics arm (formerly Fetch Robotics). By combining Zebra's human-robot orchestration platform with omnibodied Skild Brain, we plan to turn warehouses everywhere into hubs of hyper-efficiency. Imagine a single platform, single brain optimizing every movement of robots as well as human workers in warehouses. Many of us in the robotics community have used Fetch Robots in the past and have rooted for them over the years, so this acquisition is special for us in many ways.

Deepak Pathak

79,465 views • 4 months ago

Brain-controlled exoskeletons to train humanoid robots! 🧠 Fourier just presented human tele-operators using brain control interfaces and exoskeletal arms to train humanoid robots on home tasks. The brain control interface is the interesting part. Instead of using a controller or joystick to teleoperate, the operator's movements and intentions are captured more naturally through the exoskeleton and BCI. This means the demonstrations are more fluid, more human-like, and better suited for training robots to perform delicate home tasks. Multiple tele-operators are simultaneously generating training data across multiple robots. This is how you build the dataset needed for eventual full autonomy, without waiting years for it to arrive. This might be the bridge between "robots that work in controlled environments" and "robots that work in homes." Not full autonomy right away, but trusted human intelligence operating through a robot body, getting better with every task completed. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Brain-controlled exoskeletons to train humanoid robots! 🧠 Fourier just presented human tele-operators using brain control interfaces and exoskeletal arms to train humanoid robots on home tasks. The brain control interface is the interesting part. Instead of using a controller or joystick to teleoperate, the operator's movements and intentions are captured more naturally through the exoskeleton and BCI. This means the demonstrations are more fluid, more human-like, and better suited for training robots to perform delicate home tasks. Multiple tele-operators are simultaneously generating training data across multiple robots. This is how you build the dataset needed for eventual full autonomy, without waiting years for it to arrive. This might be the bridge between "robots that work in controlled environments" and "robots that work in homes." Not full autonomy right away, but trusted human intelligence operating through a robot body, getting better with every task completed. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

20,898 views • 6 months ago

Truly general-purpose robots must be able to navigate spaces they have never seen before. ⦿ Skild Brain enables end-to-end autonomous locomotion from raw vision and joint inputs, without mapping or pre-planning. ⦿ The model adapts in real time to new terrain such as stairs, gaps, and clutter, reacting instinctively like a human. There is no “stair mode” or “step-over mode”: the transition between walking behaviors is continuous and instinctive. ⦿ A single neural policy supports a wide range of locomotion tasks and can transfer across different robot platforms.

Truly general-purpose robots must be able to navigate spaces they have never seen before. ⦿ Skild Brain enables end-to-end autonomous locomotion from raw vision and joint inputs, without mapping or pre-planning. ⦿ The model adapts in real time to new terrain such as stairs, gaps, and clutter, reacting instinctively like a human. There is no “stair mode” or “step-over mode”: the transition between walking behaviors is continuous and instinctive. ⦿ A single neural policy supports a wide range of locomotion tasks and can transfer across different robot platforms.

The Humanoid Hub

28,439 views • 1 year ago

NEWS: Humanoid robotics company Figure has released Helix 02, what they claim in their most capable humanoid model yet. "A single neural system that controls the full body directly from pixels, enabling dexterous, long horizon autonomy across an entire room: • Autonomous, long‑horizon loco-manipulation: Helix 02 unloads and reloads a dishwasher across a full-sized kitchen - a four-minute, end-to-end autonomous task that integrates walking, manipulation, and balance with no resets and no human intervention. We believe this is the longest horizon, most complex task completed autonomously by a humanoid robot to date. • All sensors in. All actuators out: Helix 02 connects every onboard sensor - vision, touch, and proprioception - directly to every actuator through a single unified visuomotor neural network. • Human-like whole body control from human data: All results are enabled by System 0, a learned whole‑body controller trained on over 1,000 hours of human motion data and sim‑to‑real reinforcement learning. System 0 replaces 109,504 lines of hand‑engineered C++ with a single neural prior for stable, natural motion. • New classes of dexterity: With Figure 03’s embedded tactile sensing and palm cameras, Helix 02 performs manipulation that was previously out of reach: extracting individual pills, dispensing precise syringe volumes, and singulating small, irregular objects from clutter despite self‑occlusion. Helix 02 is trained on over 1,000 hours of human motion data and integrates vision, touch, and proprioception."

NEWS: Humanoid robotics company Figure has released Helix 02, what they claim in their most capable humanoid model yet. "A single neural system that controls the full body directly from pixels, enabling dexterous, long horizon autonomy across an entire room: • Autonomous, long‑horizon loco-manipulation: Helix 02 unloads and reloads a dishwasher across a full-sized kitchen - a four-minute, end-to-end autonomous task that integrates walking, manipulation, and balance with no resets and no human intervention. We believe this is the longest horizon, most complex task completed autonomously by a humanoid robot to date. • All sensors in. All actuators out: Helix 02 connects every onboard sensor - vision, touch, and proprioception - directly to every actuator through a single unified visuomotor neural network. • Human-like whole body control from human data: All results are enabled by System 0, a learned whole‑body controller trained on over 1,000 hours of human motion data and sim‑to‑real reinforcement learning. System 0 replaces 109,504 lines of hand‑engineered C++ with a single neural prior for stable, natural motion. • New classes of dexterity: With Figure 03’s embedded tactile sensing and palm cameras, Helix 02 performs manipulation that was previously out of reach: extracting individual pills, dispensing precise syringe volumes, and singulating small, irregular objects from clutter despite self‑occlusion. Helix 02 is trained on over 1,000 hours of human motion data and integrates vision, touch, and proprioception."

Sawyer Merritt

624,770 views • 6 months ago

Excited to announce GR00T N1, the world’s first open foundation model for humanoid robots! We are on a mission to democratize Physical AI. The power of general robot brain, in the palm of your hand - with only 2B parameters, N1 learns from the most diverse physical action dataset ever compiled and punches above its weight: - Real humanoid teleoperation data. - Large-scale simulation data: we are open-sourcing 300K+ trajectories! - Neural trajectories: we apply SOTA video generation models to “hallucinate” new synthetic data that features accurate physics in pixels. Using Jensen’s words, “systematically infinite data”! - Latent actions: we develop novel algorithms to extract action tokens from in-the-wild human videos and neural generated videos. GR00T N1 is a single end-to-end neural net, from photons to actions: - Vision-Language Model (System 2) that interprets the physical world through vision and language instructions, enabling robots to reason about their environment and instructions, and plan the right actions. - Diffusion Transformer (System 1) that “renders” smooth and precise motor actions at 120 Hz, executing the latent plan made by System 2. We deploy N1 on GR1 robot, 1X Neo robot, and a large collection of simulation benchmarks. N1 achieves up to +30% boost in diverse manipulation tasks for household and industrial settings. While humanoid robots are the main focus of N1, our model also supports cross-embodiment. We finetune it to work on the $110 HuggingFace LeRobot SO100 robot arm! Open robot brain runs on open hardware. Sounds just right. Let’s solve robotics, together, one token at a time. Links to our Whitepaper, Github repo, HuggingFace model, and open dataset page in the thread: 🧵

Excited to announce GR00T N1, the world’s first open foundation model for humanoid robots! We are on a mission to democratize Physical AI. The power of general robot brain, in the palm of your hand - with only 2B parameters, N1 learns from the most diverse physical action dataset ever compiled and punches above its weight: - Real humanoid teleoperation data. - Large-scale simulation data: we are open-sourcing 300K+ trajectories! - Neural trajectories: we apply SOTA video generation models to “hallucinate” new synthetic data that features accurate physics in pixels. Using Jensen’s words, “systematically infinite data”! - Latent actions: we develop novel algorithms to extract action tokens from in-the-wild human videos and neural generated videos. GR00T N1 is a single end-to-end neural net, from photons to actions: - Vision-Language Model (System 2) that interprets the physical world through vision and language instructions, enabling robots to reason about their environment and instructions, and plan the right actions. - Diffusion Transformer (System 1) that “renders” smooth and precise motor actions at 120 Hz, executing the latent plan made by System 2. We deploy N1 on GR1 robot, 1X Neo robot, and a large collection of simulation benchmarks. N1 achieves up to +30% boost in diverse manipulation tasks for household and industrial settings. While humanoid robots are the main focus of N1, our model also supports cross-embodiment. We finetune it to work on the $110 HuggingFace LeRobot SO100 robot arm! Open robot brain runs on open hardware. Sounds just right. Let’s solve robotics, together, one token at a time. Links to our Whitepaper, Github repo, HuggingFace model, and open dataset page in the thread: 🧵

Jim Fan

466,442 views • 1 year ago

Skild has been quiet since emerging from stealth in July 2024. They just shared their journey so far, showcasing early milestones. Skild is building toward a single general-purpose, “omni-bodied” robotics foundation model: One Brain – any task, any robot. The Skild Brain can control humanoids, quadrupeds, or manipulators using a unified architecture trained on large-scale action datasets, including internet videos, simulation, and real-world data. Founded by CMU professors in 2023, the company has a strong group of researchers and engineers who have made some of the most seminal contributions to robotics research in the past decade. Now, they’re set to take it from the lab to the real world.

Skild has been quiet since emerging from stealth in July 2024. They just shared their journey so far, showcasing early milestones. Skild is building toward a single general-purpose, “omni-bodied” robotics foundation model: One Brain – any task, any robot. The Skild Brain can control humanoids, quadrupeds, or manipulators using a unified architecture trained on large-scale action datasets, including internet videos, simulation, and real-world data. Founded by CMU professors in 2023, the company has a strong group of researchers and engineers who have made some of the most seminal contributions to robotics research in the past decade. Now, they’re set to take it from the lab to the real world.

The Humanoid Hub

62,424 views • 1 year ago

A humanoid robot just unloaded a dishwasher for 67 hours straight. By end of 2026, the same robot will perform surgery. That's not a prediction from a sci-fi writer. That's Brett Adcock. CEO of Figure AI. Said it on camera this month. Here's what makes this insane. Two years ago Figure's robot put a Keurig cup in a coffee maker. That was the breakthrough moment. The whole team celebrated. A coffee cup. Today that same robot runs 67 consecutive hours in a BMW factory. Grabbing packages. Finding barcodes. Placing them. One operation every second. Just a neural network that learned by watching. And Brett just said the hands that do that the same fingers, the same sensors, the same neural net are already capable of surgical precision from a hardware standpoint. "From a hardware perspective in 2026 we'll be able to do what surgeons can do." The AI just has to catch up to the hands. Two years ago: a coffee cup. This year: a factory. Next: the operating table. The robot didn't change, the learning did and it's not stopping.

A humanoid robot just unloaded a dishwasher for 67 hours straight. By end of 2026, the same robot will perform surgery. That's not a prediction from a sci-fi writer. That's Brett Adcock. CEO of Figure AI. Said it on camera this month. Here's what makes this insane. Two years ago Figure's robot put a Keurig cup in a coffee maker. That was the breakthrough moment. The whole team celebrated. A coffee cup. Today that same robot runs 67 consecutive hours in a BMW factory. Grabbing packages. Finding barcodes. Placing them. One operation every second. Just a neural network that learned by watching. And Brett just said the hands that do that the same fingers, the same sensors, the same neural net are already capable of surgical precision from a hardware standpoint. "From a hardware perspective in 2026 we'll be able to do what surgeons can do." The AI just has to catch up to the hands. Two years ago: a coffee cup. This year: a factory. Next: the operating table. The robot didn't change, the learning did and it's not stopping.

Shruti

46,761 views • 3 months ago

China's robots just started building other robots on a factory floor. 44 seconds of footage, no theatrics this time. The G1 is assembling precision motor components on a real production line, running on a new embodied AI model called UnifoLM-X1-0. This isn't a stunt. It's the same playbook every frontier AI lab uses, just with hardware attached. China's robots are running on their own assembly line specifically to generate the motion data needed to train the next generation, a closed loop where the robot's work becomes its own training set. The timing tells you what this is really for. The company behind this is heading toward a mid-2026 IPO, and until now almost every public G1 appearance has been a gala dance routine or a boxing demo. A robot doing repetitive, unglamorous assembly work is a far stronger data point for investors than another choreographed performance. The CEO has been explicit about the bar he's measuring against, what he calls the 80/80 goal, a robot completing 80% of tasks across 80% of real-world environments. One in-house factory line doesn't clear that bar on its own, but it's the first public sign anyone is building toward it instead of performing for cameras.

China's robots just started building other robots on a factory floor. 44 seconds of footage, no theatrics this time. The G1 is assembling precision motor components on a real production line, running on a new embodied AI model called UnifoLM-X1-0. This isn't a stunt. It's the same playbook every frontier AI lab uses, just with hardware attached. China's robots are running on their own assembly line specifically to generate the motion data needed to train the next generation, a closed loop where the robot's work becomes its own training set. The timing tells you what this is really for. The company behind this is heading toward a mid-2026 IPO, and until now almost every public G1 appearance has been a gala dance routine or a boxing demo. A robot doing repetitive, unglamorous assembly work is a far stronger data point for investors than another choreographed performance. The CEO has been explicit about the bar he's measuring against, what he calls the 80/80 goal, a robot completing 80% of tasks across 80% of real-world environments. One in-house factory line doesn't clear that bar on its own, but it's the first public sign anyone is building toward it instead of performing for cameras.

Shruti

26,154 views • 1 month ago

🚨🇺🇸FIGURE ROBOT LEARNS TO WALK IN HOURS Turns out you can teach a robot to walk—if you’ve got a few years to burn in a physics simulator (or a few hours of GPU time). Figure’s team trained a neural network using reinforcement learning to mimic natural human locomotion, and the wild part is it worked on the first try with real hardware. No tuning. No fiddling. Just plug and strut. Thanks to sim-to-real transfer and some sneaky domain randomization, the robot didn’t just wobble out of the lab—it walked like it had somewhere to be. Next up: running. Not terrifying at all. Source: Figure

🚨🇺🇸FIGURE ROBOT LEARNS TO WALK IN HOURS Turns out you can teach a robot to walk—if you’ve got a few years to burn in a physics simulator (or a few hours of GPU time). Figure’s team trained a neural network using reinforcement learning to mimic natural human locomotion, and the wild part is it worked on the first try with real hardware. No tuning. No fiddling. Just plug and strut. Thanks to sim-to-real transfer and some sneaky domain randomization, the robot didn’t just wobble out of the lab—it walked like it had somewhere to be. Next up: running. Not terrifying at all. Source: Figure

Mario Nawfal

117,866 views • 1 year ago

Introducing FLUX-mimic, a next-generation Video-Action Model for general purpose dexterity, developed in partnership with Black Forest Labs. Late last year we published mimic-video and introduced Video-Action Models (VAM): a new family of robotics foundation models built on top of video generation models. We showed that robot control reduces to visual prediction, and that robot capability is downstream of improvements in video modeling accuracy. The obvious implication was that advances in the video modeling frontier would directly translate to increased capabilities in end-to-end robot learning. FLUX-mimic is that thesis at frontier scale: We've applied our VAM architecture to the strongest video backbone available today, FLUX 3 from Black Forest Labs, and trained it on data from our own robots and wearables. General-purpose dexterity, running on a single GPU on premises. Because the model already understands world dynamics, it needs far fewer demonstrations to learn a new task. This is game-changing for our mission to deploy robots to factory floors, where industrial robot data is scarce and expensive to collect. We're now testing and deploying FLUX-mimic with manufacturing leaders like Audi USA, on complex, multi-step manipulation long considered impossible for conventional automation.

Introducing FLUX-mimic, a next-generation Video-Action Model for general purpose dexterity, developed in partnership with Black Forest Labs. Late last year we published mimic-video and introduced Video-Action Models (VAM): a new family of robotics foundation models built on top of video generation models. We showed that robot control reduces to visual prediction, and that robot capability is downstream of improvements in video modeling accuracy. The obvious implication was that advances in the video modeling frontier would directly translate to increased capabilities in end-to-end robot learning. FLUX-mimic is that thesis at frontier scale: We've applied our VAM architecture to the strongest video backbone available today, FLUX 3 from Black Forest Labs, and trained it on data from our own robots and wearables. General-purpose dexterity, running on a single GPU on premises. Because the model already understands world dynamics, it needs far fewer demonstrations to learn a new task. This is game-changing for our mission to deploy robots to factory floors, where industrial robot data is scarce and expensive to collect. We're now testing and deploying FLUX-mimic with manufacturing leaders like Audi USA, on complex, multi-step manipulation long considered impossible for conventional automation.

mimic

116,758 views • 25 days ago

Kelly Oubre Jr. was asked about so many Knicks fans being in Philadelphia tonight: "I could say something that could get clickbaited, but I'm not. At the end of the day, we're the show on the court. We're not necessarily focused on the crowd, the things like that. Obviously, we need it. We love it and we love our fans. But at the end of the day, we have to lock in on our task. We have to figure out our gameplan, just have a tight huddle. No matter what, it's loud. It's kind of the same no matter who the crowd is cheering for. It's loud. We have to be focused on the task at hand and just kind of have a short-term memory when it comes to things like that. But at the end of the day, we are home. This is the court that we practice on, we shootaround on and we're comfortable here. We just got to go out there and just perform."

Kelly Oubre Jr. was asked about so many Knicks fans being in Philadelphia tonight: "I could say something that could get clickbaited, but I'm not. At the end of the day, we're the show on the court. We're not necessarily focused on the crowd, the things like that. Obviously, we need it. We love it and we love our fans. But at the end of the day, we have to lock in on our task. We have to figure out our gameplan, just have a tight huddle. No matter what, it's loud. It's kind of the same no matter who the crowd is cheering for. It's loud. We have to be focused on the task at hand and just kind of have a short-term memory when it comes to things like that. But at the end of the day, we are home. This is the court that we practice on, we shootaround on and we're comfortable here. We just got to go out there and just perform."

Knicks Videos

81,963 views • 3 months ago

Robotics has changed dramatically over the last eight years. Ted Xiao has been involved in the cutting edge of robot learning through this period, spending those eight years at Google Brain/Google Deepmind. And he’s identified three eras of robot learning. These eras are: - The Era of Existence Proofs - trying different methods like QT-Opt, on-robot RL - The Era of Foundation Models - transitioning to data collection and clean objectives (i.e. supervised learning) - The Era of Scaling - orders of magnitude more data and larger models, enabling reasoning, long-horizon actions, and cross-embodiment transfer Watch Episode 78 of RoboPapers, with Michael Cho - Rbt/Acc and Jiafei Duan to learn more!

Robotics has changed dramatically over the last eight years. Ted Xiao has been involved in the cutting edge of robot learning through this period, spending those eight years at Google Brain/Google Deepmind. And he’s identified three eras of robot learning. These eras are: - The Era of Existence Proofs - trying different methods like QT-Opt, on-robot RL - The Era of Foundation Models - transitioning to data collection and clean objectives (i.e. supervised learning) - The Era of Scaling - orders of magnitude more data and larger models, enabling reasoning, long-horizon actions, and cross-embodiment transfer Watch Episode 78 of RoboPapers, with Michael Cho - Rbt/Acc and Jiafei Duan to learn more!

RoboPapers

36,732 views • 3 months ago

Here’s the windmill assembly demo we showed at CES 2026 — the one no one saw coming. North executes a fully autonomous, long-horizon dexterous sequence with sustained hand–eye–tactile coordination and assembly-level precision enabled by tactile feedback. It’s also robust to disturbance: you can reposition the objects, and North will still identify them and recover the task. This is powered by CraftNet (VTLA) — using tactile feedback to continuously fine-tune the last-millimeter interaction, enabling reliable execution across 30+ steps. Read more about CraftNet: #Sharpa #SharpaWave #SharpaNorth #CraftNet #System0 #CES2026

Here’s the windmill assembly demo we showed at CES 2026 — the one no one saw coming. North executes a fully autonomous, long-horizon dexterous sequence with sustained hand–eye–tactile coordination and assembly-level precision enabled by tactile feedback. It’s also robust to disturbance: you can reposition the objects, and North will still identify them and recover the task. This is powered by CraftNet (VTLA) — using tactile feedback to continuously fine-tune the last-millimeter interaction, enabling reliable execution across 30+ steps. Read more about CraftNet: #Sharpa #SharpaWave #SharpaNorth #CraftNet #System0 #CES2026

Sharpa

87,951 views • 7 months ago

I don’t have my action cam rigged up right now because I’m with people, but had to pull this and share it. FSD V14.2 will literally drive you off of a completely unmapped construction site using cameras and neural nets. Understand that this is a big grey block of nothing on the map and the car did not have any routing path on the GPS until we made it out to the road at the end. Do you understand the difference yet? Are you getting it? Tesla already ships robots to consumers.

I don’t have my action cam rigged up right now because I’m with people, but had to pull this and share it. FSD V14.2 will literally drive you off of a completely unmapped construction site using cameras and neural nets. Understand that this is a big grey block of nothing on the map and the car did not have any routing path on the GPS until we made it out to the road at the end. Do you understand the difference yet? Are you getting it? Tesla already ships robots to consumers.

Mike P

20,935 views • 7 months ago

Here is a human assembling a BMW engine by hand. Hundreds of components. Micron tolerances. Dozens of hours. So what's better here—a human or a robot❓ 🤖 Robots win at: - Repeatability. Same torque, same angle, every time. - Speed on defined tasks. Honda automates piston installation at 9,000/day. - No fatigue. Shift 47 is identical to shift 1. 👨‍🏭 Humans win at: - Feeling what they can't see. Half of engine assembly is blind. - Force intuition. Knowing "seated" from "about to crack." - Compliant manipulation. That instinctive wiggle to get a part to drop in. - Handling variance. Mercedes pulled robots off the S-Class line because they couldn't adapt to option variability. - Deformables. Wiring harnesses, gaskets, hoses—nothing predictable. - Recovery. When something's wrong, humans adapt. Robots halt. ✅ Right now, the answer is both. Robots handle the repetitive subassemblies. Humans handle everything that requires judgment, feeling, and adaptation. The day a humanoid can do this end-to-end is the day manipulation is solved.

Here is a human assembling a BMW engine by hand. Hundreds of components. Micron tolerances. Dozens of hours. So what's better here—a human or a robot❓ 🤖 Robots win at: - Repeatability. Same torque, same angle, every time. - Speed on defined tasks. Honda automates piston installation at 9,000/day. - No fatigue. Shift 47 is identical to shift 1. 👨‍🏭 Humans win at: - Feeling what they can't see. Half of engine assembly is blind. - Force intuition. Knowing "seated" from "about to crack." - Compliant manipulation. That instinctive wiggle to get a part to drop in. - Handling variance. Mercedes pulled robots off the S-Class line because they couldn't adapt to option variability. - Deformables. Wiring harnesses, gaskets, hoses—nothing predictable. - Recovery. When something's wrong, humans adapt. Robots halt. ✅ Right now, the answer is both. Robots handle the repetitive subassemblies. Humans handle everything that requires judgment, feeling, and adaptation. The day a humanoid can do this end-to-end is the day manipulation is solved.

Jack 🤖

379,855 views • 8 months ago

We are publishing our first deep dive on what we believe is one of the most challenging layers in egocentric data - SLAM and VIO in the context of long-horizon state tracking. We break down how SLAM and VIO fail in egocentric settings - visual features vanish at close range, depth sensors saturate, fast head motion blurs frames, and these failures don't always occur in isolation. They hit at the exact same moment, leading to compounding errors and making the downstream data unusable. We believe the foundation for high-quality egocentric data demands sub-centimeter precision over long episodes ranging from a few minutes to up to an hour.

We are publishing our first deep dive on what we believe is one of the most challenging layers in egocentric data - SLAM and VIO in the context of long-horizon state tracking. We break down how SLAM and VIO fail in egocentric settings - visual features vanish at close range, depth sensors saturate, fast head motion blurs frames, and these failures don't always occur in isolation. They hit at the exact same moment, leading to compounding errors and making the downstream data unusable. We believe the foundation for high-quality egocentric data demands sub-centimeter precision over long episodes ranging from a few minutes to up to an hour.

FPV Labs

41,955 views • 4 months ago

Okay, this is genuinely impressive. 🤯 Oli just worked through a roomful of household chores — no teleop, no cuts, one continuous take. The brain is LimX COSA 0.5, a three-layer stack coordinating reasoning (Sys 2), skill execution (Sys 1), and motion control (Sys 0), along with memory, task scheduling, and whole-body coordination. What matters isn’t one polished demo trick. It’s that the robot stayed coherent across an entire long-horizon mobile manipulation sequence — on real hardware, in one take.

Okay, this is genuinely impressive. 🤯 Oli just worked through a roomful of household chores — no teleop, no cuts, one continuous take. The brain is LimX COSA 0.5, a three-layer stack coordinating reasoning (Sys 2), skill execution (Sys 1), and motion control (Sys 0), along with memory, task scheduling, and whole-body coordination. What matters isn’t one polished demo trick. It’s that the robot stayed coherent across an entire long-horizon mobile manipulation sequence — on real hardware, in one take.

RoboHub🤖

33,607 views • 1 month ago

Modern AI is confined to the digital world. At Skild AI, we are building towards AGI for the real world, unconstrained by robot type or task — a single, omni-bodied brain. Today, we are sharing our journey, starting with early milestones, with more to come in the weeks ahead. Our Mission: Artificial General Intelligence grounded in the physical world. We believe AGI that can truly understand and reason in the real world can only be built through grounding in the physical world. Our Vision: Any robot, Any task, One brain. We tackle robotics in its full generality – building a continually improving, omni-bodied brain that can control any hardware for any task. Who are we? A passionate group of scientists & engineers driven by our shared vision. We have been researching AI and robotics for more than a decade. Our team includes pioneers of self-supervised learning, curiosity-driven exploration, end-to-end sim2real for visual locomotion, dexterous manipulation, learning from human videos, robot parkour, and many more. Many of these works have won awards at top-tier AI and Robotics conferences. Our team has also built production-ready systems at Anduril, Tesla, Nvidia, Meta, Kitty Hawk, Google, Everyday Robotics, and Amazon. Join us in our mission to build the robot brains of tomorrow.

Modern AI is confined to the digital world. At Skild AI, we are building towards AGI for the real world, unconstrained by robot type or task — a single, omni-bodied brain. Today, we are sharing our journey, starting with early milestones, with more to come in the weeks ahead. Our Mission: Artificial General Intelligence grounded in the physical world. We believe AGI that can truly understand and reason in the real world can only be built through grounding in the physical world. Our Vision: Any robot, Any task, One brain. We tackle robotics in its full generality – building a continually improving, omni-bodied brain that can control any hardware for any task. Who are we? A passionate group of scientists & engineers driven by our shared vision. We have been researching AI and robotics for more than a decade. Our team includes pioneers of self-supervised learning, curiosity-driven exploration, end-to-end sim2real for visual locomotion, dexterous manipulation, learning from human videos, robot parkour, and many more. Many of these works have won awards at top-tier AI and Robotics conferences. Our team has also built production-ready systems at Anduril, Tesla, Nvidia, Meta, Kitty Hawk, Google, Everyday Robotics, and Amazon. Join us in our mission to build the robot brains of tomorrow.

Skild AI

383,478 views • 1 year ago