Loading video...

Video Failed to Load

Go Home

SkildAI, which is developing a foundational AI model for robots, has released a new video of their humanoid robot walking over objects and exploring environments it had never seen before. The robot is using vision & adapts in real time. SkildAI: "From raw images and joint feedback, the model...

SawyerMerritt's profile picture

Sawyer Merritt

1,030,701 subscribers

69,297 views • 10 months ago •via X (Twitter)

Science & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Truly general-purpose robots must be able to navigate spaces they have never seen before. ⦿ Skild Brain enables end-to-end autonomous locomotion from raw vision and joint inputs, without mapping or pre-planning. ⦿ The model adapts in real time to new terrain such as stairs, gaps, and clutter, reacting instinctively like a human. There is no “stair mode” or “step-over mode”: the transition between walking behaviors is continuous and instinctive. ⦿ A single neural policy supports a wide range of locomotion tasks and can transfer across different robot platforms.
4:37

Truly general-purpose robots must be able to navigate spaces they have never seen before. ⦿ Skild Brain enables end-to-end autonomous locomotion from raw vision and joint inputs, without mapping or pre-planning. ⦿ The model adapts in real time to new terrain such as stairs, gaps, and clutter, reacting instinctively like a human. There is no “stair mode” or “step-over mode”: the transition between walking behaviors is continuous and instinctive. ⦿ A single neural policy supports a wide range of locomotion tasks and can transfer across different robot platforms.

The Humanoid Hub

28,171 views • 10 months ago

We’ve all seen humanoid robots doing backflips and dance routines for years. But if you ask them to climb a few stairs in the real world, they stumble! We took our robot on a walk around town to environments that it hadn’t seen before. Here’s how it works🧵⬇️
2:53

We’ve all seen humanoid robots doing backflips and dance routines for years. But if you ask them to climb a few stairs in the real world, they stumble! We took our robot on a walk around town to environments that it hadn’t seen before. Here’s how it works🧵⬇️

Skild AI

270,422 views • 10 months ago

NEWS: Humanoid robot startup Figure announced Helix today, their "in-house AI that reasons like a human." "Our robots equipped with Helix can now pick up virtually any household object without any code or prior training. Helix uses a single set of neural network weights to learn all behaviors." "We're introducing Helix, a generalist Vision-Language-Action (VLA) model that unifies perception, language understanding, and learned control to overcome multiple longstanding challenges in robotics."
2:15

NEWS: Humanoid robot startup Figure announced Helix today, their "in-house AI that reasons like a human." "Our robots equipped with Helix can now pick up virtually any household object without any code or prior training. Helix uses a single set of neural network weights to learn all behaviors." "We're introducing Helix, a generalist Vision-Language-Action (VLA) model that unifies perception, language understanding, and learned control to overcome multiple longstanding challenges in robotics."

Sawyer Merritt

181,177 views • 1 year ago

We asked Angus about the future of robotics and AI training. “I built an industrial-grade kinematic solver for 6 degrees of freedom motion, with full path planning and joint control." "You can stream AI model outputs into it, or run it like a traditional industrial robot." "The benefit of that is all of that information you can stream and record from those joints… you can use that as the training data." "Frankly, moving a robot with a lever is really crap data for training robots. But this gives you smooth, high-quality motion, without needing two robots.”
2:16

We asked Angus about the future of robotics and AI training. “I built an industrial-grade kinematic solver for 6 degrees of freedom motion, with full path planning and joint control." "You can stream AI model outputs into it, or run it like a traditional industrial robot." "The benefit of that is all of that information you can stream and record from those joints… you can use that as the training data." "Frankly, moving a robot with a lever is really crap data for training robots. But this gives you smooth, high-quality motion, without needing two robots.”

TBPN

17,077 views • 11 months ago

Figure says it has increased humanoid robot production from one robot per day to one robot per hour in just 120 days. The robots undergo intensive testing, including repeated squats and jogging movements. Figure also demonstrated the robot's ability to climb stairs and navigate complex terrain using vision-based control.
0:22

Figure says it has increased humanoid robot production from one robot per day to one robot per hour in just 120 days. The robots undergo intensive testing, including repeated squats and jogging movements. Figure also demonstrated the robot's ability to climb stairs and navigate complex terrain using vision-based control.

Space and Technology

529,016 views • 4 days ago

Climbing stairs is one of the biggest challenges for humanoid robots, but PNDBotics Adam is now doing it with ease. In a latest demo, the robot smoothly climbed real-world outdoor stairs without any support, even on uneven steps. The robot stays balanced and moves naturally after being trained to quickly adapt to different surfaces.
0:24

Climbing stairs is one of the biggest challenges for humanoid robots, but PNDBotics Adam is now doing it with ease. In a latest demo, the robot smoothly climbed real-world outdoor stairs without any support, even on uneven steps. The robot stays balanced and moves naturally after being trained to quickly adapt to different surfaces.

Space and Technology

73,426 views • 21 days ago

Vision-language models can control robots, but what if the prompt is too complex for the robot to follow directly? We developed a way to get robots to “think through” complex instructions, feedback, and interjections. We call it the Hierarchical Interactive Robot (Hi Robot).
3:10

Vision-language models can control robots, but what if the prompt is too complex for the robot to follow directly? We developed a way to get robots to “think through” complex instructions, feedback, and interjections. We call it the Hierarchical Interactive Robot (Hi Robot).

Physical Intelligence

116,845 views • 1 year ago

A new humanoid robot Spirit AI from China releases a new generation of wheeled humanoid robot Moz1 It is the first embodied intelligent robot with high-precision force control of the whole body, with 26 degrees of freedom, built based on the world's highest power density integrated force control joint. It takes speed, precision and safety to a higher level. It is worth mentioning that Moz1 is driven by SpiritAI's latest OneTwoVLA. It only needs one model to think and operate at the same time, and correct errors autonomously, just like humans, without separating the two systems of "thinking planning" and "coordinated execution". One system is seamlessly connected, which is conducive to dealing with complex, personalized, and immediate tasks, especially in home and care applications.
1:00

A new humanoid robot Spirit AI from China releases a new generation of wheeled humanoid robot Moz1 It is the first embodied intelligent robot with high-precision force control of the whole body, with 26 degrees of freedom, built based on the world's highest power density integrated force control joint. It takes speed, precision and safety to a higher level. It is worth mentioning that Moz1 is driven by SpiritAI's latest OneTwoVLA. It only needs one model to think and operate at the same time, and correct errors autonomously, just like humans, without separating the two systems of "thinking planning" and "coordinated execution". One system is seamlessly connected, which is conducive to dealing with complex, personalized, and immediate tasks, especially in home and care applications.

CyberRobo

26,755 views • 11 months ago

Turning video into humanoid robot motion! 🤳🏼 Training humanoid robots needs huge amounts of motion data, but real-world capture doesn’t scale. Mocap is expensive, dangerous edge cases are rare, and you can’t ask humans to repeatedly fall or crash. Video2Robot tackles this by converting videos into physics-grounded humanoid simulations. Motion is generated to respect balance, inertia, ground contact, and joint limits, then directly retargeted to robot simulators. One prompt can generate a full humanoid motion sequence, including multi-agent interactions and failure cases like falls or collisions, scenarios that are hard or impossible to capture safely in the real world. The pipeline is model-agnostic and works with existing video generators, making it a practical way to scale data for robots. If robots are going to operate in the real world, they need to be trained on the failures too, not just the perfect demos. Here's the GitHub: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:26

Turning video into humanoid robot motion! 🤳🏼 Training humanoid robots needs huge amounts of motion data, but real-world capture doesn’t scale. Mocap is expensive, dangerous edge cases are rare, and you can’t ask humans to repeatedly fall or crash. Video2Robot tackles this by converting videos into physics-grounded humanoid simulations. Motion is generated to respect balance, inertia, ground contact, and joint limits, then directly retargeted to robot simulators. One prompt can generate a full humanoid motion sequence, including multi-agent interactions and failure cases like falls or collisions, scenarios that are hard or impossible to capture safely in the real world. The pipeline is model-agnostic and works with existing video generators, making it a practical way to scale data for robots. If robots are going to operate in the real world, they need to be trained on the failures too, not just the perfect demos. Here's the GitHub: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

59,645 views • 5 months ago

LimX Dynamics unveiled COSA, a unified brain and body OS for humanoid robots. It lets their OLI robot think and act in real time from walking to manipulating objects using natural language. Cognition and control, fused.
1:18

LimX Dynamics unveiled COSA, a unified brain and body OS for humanoid robots. It lets their OLI robot think and act in real time from walking to manipulating objects using natural language. Cognition and control, fused.

XMAQUINA

15,054 views • 4 months ago

Kinetix AI has teased KAI, its new humanoid robot -engineered with 36 degrees of freedom, more than any previous model, a hybrid dexterous hand, and 18,000 sensors embedded across a soft, flexible body-positioning it as the most human-like robotic system to date. Getting closer to real humanoid robots each day.
0:41

Kinetix AI has teased KAI, its new humanoid robot -engineered with 36 degrees of freedom, more than any previous model, a hybrid dexterous hand, and 18,000 sensors embedded across a soft, flexible body-positioning it as the most human-like robotic system to date. Getting closer to real humanoid robots each day.

Chubby♨️

22,473 views • 1 month ago

Scientists developed HumanX, a system that lets humanoid robots learn new skills by watching just one short human video. It learns directly from demonstrations instead of large datasets or complex training rewards. Using this, the Unitree G1 humanoid robot learned 10 different real-world skills without extra training.
0:34

Scientists developed HumanX, a system that lets humanoid robots learn new skills by watching just one short human video. It learns directly from demonstrations instead of large datasets or complex training rewards. Using this, the Unitree G1 humanoid robot learned 10 different real-world skills without extra training.

Space and Technology

27,686 views • 1 month ago

🎉🎉🎉Super excited to announce that we launched a joint lab of Embodied AI and Humanoid Robot between UniTree and BIGAI! I will direct the lab to foster the research in integrating the 3D scene understanding capability to Humanoid robot. Hope to see more generalist Humanoid robots in our home very soon😁
0:58

🎉🎉🎉Super excited to announce that we launched a joint lab of Embodied AI and Humanoid Robot between UniTree and BIGAI! I will direct the lab to foster the research in integrating the 3D scene understanding capability to Humanoid robot. Hope to see more generalist Humanoid robots in our home very soon😁

Siyuan Huang

42,117 views • 1 year ago

The World Model as NEO's Cognitive Core 1X has revealed a major AI development where the NEO humanoid can translate any natural language prompt into robotic action. It demonstrates this capability even for novel tasks, objects, and environments not found in its robot dataset. - the 1X World Model is trained on internet-scale human interaction videos and fine-tuned with robot data to ground its understanding in physics and in NEO's embodiment - from a simple voice or text prompt, the world model generates a visualization of future actions - a built-in inverse dynamics model then translates these into precise motor movements for NEO
1:02

The World Model as NEO's Cognitive Core 1X has revealed a major AI development where the NEO humanoid can translate any natural language prompt into robotic action. It demonstrates this capability even for novel tasks, objects, and environments not found in its robot dataset. - the 1X World Model is trained on internet-scale human interaction videos and fine-tuned with robot data to ground its understanding in physics and in NEO's embodiment - from a simple voice or text prompt, the world model generates a visualization of future actions - a built-in inverse dynamics model then translates these into precise motor movements for NEO

The Humanoid Hub

68,453 views • 4 months ago

1958, The Robot Guest. This Robbie The Robot influenced many ideas of how we see and react to robots even today. It is also one reason anthropomorphic bipedal humanoid robots are easier psychologically.
0:36

1958, The Robot Guest. This Robbie The Robot influenced many ideas of how we see and react to robots even today. It is also one reason anthropomorphic bipedal humanoid robots are easier psychologically.

Brian Roemmele

19,785 views • 6 months ago

Wouldn't it be great if we could train robots without any teleoperation! In our latest paper, we train robots to mimic a human video of the task by simply matching the object features using RL. We only need one video and under an hour of robot training.
0:22

Wouldn't it be great if we could train robots without any teleoperation! In our latest paper, we train robots to mimic a human video of the task by simply matching the object features using RL. We only need one video and under an hour of robot training.

Lerrel Pinto

46,197 views • 1 year ago

NVIDIA has published a paper on DREAMGEN – a powerful 4-step pipeline for generating synthetic data for humanoids that enables task and environment generalization. - Step 1: Fine-tune a video generation model using a small number of human teleoperation videos - Step 2: Prompt the fine-tuned model to turn a single real image into new AI-imagined videos - Step 3: Automatically label actions in the generated videos - Step 4: Train a robot AI model with the labeled synthetic dataset This enabled humanoid robots to perform 22 novel behaviors – such as pouring, opening/closing articulated objects, and manipulating a variety of tools. The original teleoperation dataset only included pick-and-place tasks. This takes task extensibility to another level without requiring human teleoperation for every single task. The pipeline will be made open-source soon. Project page:
0:37

NVIDIA has published a paper on DREAMGEN – a powerful 4-step pipeline for generating synthetic data for humanoids that enables task and environment generalization. - Step 1: Fine-tune a video generation model using a small number of human teleoperation videos - Step 2: Prompt the fine-tuned model to turn a single real image into new AI-imagined videos - Step 3: Automatically label actions in the generated videos - Step 4: Train a robot AI model with the labeled synthetic dataset This enabled humanoid robots to perform 22 novel behaviors – such as pouring, opening/closing articulated objects, and manipulating a variety of tools. The original teleoperation dataset only included pick-and-place tasks. This takes task extensibility to another level without requiring human teleoperation for every single task. The pipeline will be made open-source soon. Project page:

The Humanoid Hub

12,074 views • 1 year ago

Excited to announce GR00T N1, the world’s first open foundation model for humanoid robots! We are on a mission to democratize Physical AI. The power of general robot brain, in the palm of your hand - with only 2B parameters, N1 learns from the most diverse physical action dataset ever compiled and punches above its weight: - Real humanoid teleoperation data. - Large-scale simulation data: we are open-sourcing 300K+ trajectories! - Neural trajectories: we apply SOTA video generation models to “hallucinate” new synthetic data that features accurate physics in pixels. Using Jensen’s words, “systematically infinite data”! - Latent actions: we develop novel algorithms to extract action tokens from in-the-wild human videos and neural generated videos. GR00T N1 is a single end-to-end neural net, from photons to actions: - Vision-Language Model (System 2) that interprets the physical world through vision and language instructions, enabling robots to reason about their environment and instructions, and plan the right actions. - Diffusion Transformer (System 1) that “renders” smooth and precise motor actions at 120 Hz, executing the latent plan made by System 2. We deploy N1 on GR1 robot, 1X Neo robot, and a large collection of simulation benchmarks. N1 achieves up to +30% boost in diverse manipulation tasks for household and industrial settings. While humanoid robots are the main focus of N1, our model also supports cross-embodiment. We finetune it to work on the $110 HuggingFace LeRobot SO100 robot arm! Open robot brain runs on open hardware. Sounds just right. Let’s solve robotics, together, one token at a time. Links to our Whitepaper, Github repo, HuggingFace model, and open dataset page in the thread: 🧵
2:21

Excited to announce GR00T N1, the world’s first open foundation model for humanoid robots! We are on a mission to democratize Physical AI. The power of general robot brain, in the palm of your hand - with only 2B parameters, N1 learns from the most diverse physical action dataset ever compiled and punches above its weight: - Real humanoid teleoperation data. - Large-scale simulation data: we are open-sourcing 300K+ trajectories! - Neural trajectories: we apply SOTA video generation models to “hallucinate” new synthetic data that features accurate physics in pixels. Using Jensen’s words, “systematically infinite data”! - Latent actions: we develop novel algorithms to extract action tokens from in-the-wild human videos and neural generated videos. GR00T N1 is a single end-to-end neural net, from photons to actions: - Vision-Language Model (System 2) that interprets the physical world through vision and language instructions, enabling robots to reason about their environment and instructions, and plan the right actions. - Diffusion Transformer (System 1) that “renders” smooth and precise motor actions at 120 Hz, executing the latent plan made by System 2. We deploy N1 on GR1 robot, 1X Neo robot, and a large collection of simulation benchmarks. N1 achieves up to +30% boost in diverse manipulation tasks for household and industrial settings. While humanoid robots are the main focus of N1, our model also supports cross-embodiment. We finetune it to work on the $110 HuggingFace LeRobot SO100 robot arm! Open robot brain runs on open hardware. Sounds just right. Let’s solve robotics, together, one token at a time. Links to our Whitepaper, Github repo, HuggingFace model, and open dataset page in the thread: 🧵

Jim Fan

465,559 views • 1 year ago

🚨 Apple joins the robotics race! Researchers from Carnegie Mellon University and Apple have developed a robot collision avoidance system. They called it ARMOR and they implemented it on the Fourier GR-1 robot. What is ARMOR? 👘 ARMOR is a system that helps humanoid robots "see" their surroundings better by using small, smart depth sensors placed on their arms. It solves the problem of blind spots and occlusions in traditional robot perception, making robots much safer and more efficient. It uses Time-of-Flight (ToF) sensors to detect obstacles, providing a near-complete view of the robot’s environment. 🔭 A smart software powered by transformer-based AI learns from human movements to help robots plan their actions dynamically. ARMOR reduces collisions by an impressive 63.7%, making robots significantly better at navigating crowded or complex spaces. The system is fast as well! 💨 ARMOR-Policy cuts computational time by 26× compared to traditional planning methods, ensuring robots can act quickly. P.S. Thoughts on this? The research paper is in the comments! ~~~ ♻️ RT to help 1 robot find a new workplace.
1:31

🚨 Apple joins the robotics race! Researchers from Carnegie Mellon University and Apple have developed a robot collision avoidance system. They called it ARMOR and they implemented it on the Fourier GR-1 robot. What is ARMOR? 👘 ARMOR is a system that helps humanoid robots "see" their surroundings better by using small, smart depth sensors placed on their arms. It solves the problem of blind spots and occlusions in traditional robot perception, making robots much safer and more efficient. It uses Time-of-Flight (ToF) sensors to detect obstacles, providing a near-complete view of the robot’s environment. 🔭 A smart software powered by transformer-based AI learns from human movements to help robots plan their actions dynamically. ARMOR reduces collisions by an impressive 63.7%, making robots significantly better at navigating crowded or complex spaces. The system is fast as well! 💨 ARMOR-Policy cuts computational time by 26× compared to traditional planning methods, ensuring robots can act quickly. P.S. Thoughts on this? The research paper is in the comments! ~~~ ♻️ RT to help 1 robot find a new workplace.

Lukas Ziegler

169,366 views • 1 year ago