Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Agility Robotics has developed a whole-body control foundation model for their humanoid robot, Digit, acting like a "motor cortex" to ensure safe, stable performance in diverse tasks. This small neural network (<1M parameters) is trained in NVIDIA's Isaac Sim for simulated decades over 3-4 days, transferring zero-shot to the... show more

The Humanoid Hub

65,769 subscribers

17,537 Aufrufe • vor 11 Monaten •via X (Twitter)

Wissenschaft & Technologie Bildung

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Training a Whole-Body Control Foundation Model -- new work from my team at Agility Robotics A neural network for controlling our humanoid robots which is robust to disturbances, can handle heavy objects, and is a powerful platform for learning new whole-body skills learn more in our blog post ->

Training a Whole-Body Control Foundation Model -- new work from my team at Agility Robotics A neural network for controlling our humanoid robots which is robust to disturbances, can handle heavy objects, and is a powerful platform for learning new whole-body skills learn more in our blog post ->

Chris Paxton

45,068 Aufrufe • vor 11 Monaten

Chinese humanoid robotics company LimX Dynamics has unveiled COSA (Cognitive Operating System of Agents). COSA is described as a unified "brain-body" architecture that allows the robot to think and act simultaneously in the real world. It integrates: - high-level cognition (reasoning, planning, adaptation) - and whole-body motion control (low-latency dynamic locomotion, manipulation) It enables the Oli robot to act on natural language instructions and perform tasks that involve both walking and manipulation while being adaptive to interruptions.

Chinese humanoid robotics company LimX Dynamics has unveiled COSA (Cognitive Operating System of Agents). COSA is described as a unified "brain-body" architecture that allows the robot to think and act simultaneously in the real world. It integrates: - high-level cognition (reasoning, planning, adaptation) - and whole-body motion control (low-latency dynamic locomotion, manipulation) It enables the Oli robot to act on natural language instructions and perform tasks that involve both walking and manipulation while being adaptive to interruptions.

The Humanoid Hub

71,168 Aufrufe • vor 7 Monaten

In just ~3 months, as a solo founder with no prior robotics experience, General Trajectory trained a foundation model for dexterous manipulation that lets humanoid robots pick up unseen objects and perform real-world work. It generalizes to novel objects and scenes, including cases where prior SoTA models achieve 0% success. Congrats on the launch Joshua!

In just ~3 months, as a solo founder with no prior robotics experience, General Trajectory trained a foundation model for dexterous manipulation that lets humanoid robots pick up unseen objects and perform real-world work. It generalizes to novel objects and scenes, including cases where prior SoTA models achieve 0% success. Congrats on the launch Joshua!

Y Combinator

68,639 Aufrufe • vor 7 Monaten

SkildAI, which is developing a foundational AI model for robots, has released a new video of their humanoid robot walking over objects and exploring environments it had never seen before. The robot is using vision & adapts in real time. SkildAI: "From raw images and joint feedback, the model directly outputs low-level motor commands. This single neural network enables humanoid robots to seamlessly walk across flat ground, climb stairs, and step over obstacles without any planning, mapping, or manual switching between behaviors. For all of our testing in this video, we deployed the robot in each new environment without any prior planning or mapping. We took off the humanoid’s shoes so you can hear it.

SkildAI, which is developing a foundational AI model for robots, has released a new video of their humanoid robot walking over objects and exploring environments it had never seen before. The robot is using vision & adapts in real time. SkildAI: "From raw images and joint feedback, the model directly outputs low-level motor commands. This single neural network enables humanoid robots to seamlessly walk across flat ground, climb stairs, and step over obstacles without any planning, mapping, or manual switching between behaviors. For all of our testing in this video, we deployed the robot in each new environment without any prior planning or mapping. We took off the humanoid’s shoes so you can hear it.

Sawyer Merritt

69,381 Aufrufe • vor 1 Jahr

Humanoids finally move like humans… and can do more than copy. [Details + demos in thread 👇] A new framework, BeyondMimic, shows how to learn naturalistic whole-body control from human motion. But then goes further by composing those skills into versatile, zero-shot policies. Two key pieces make it work: •Motion tracking pipeline: robustly turns human mocap into dynamic robot motions (jump spins, sprinting, cartwheels) on real hardware •Guided diffusion policy: distills motion primitives and enables zero-shot downstream tasks with simple cost functions The result: ✅ State-of-the-art motion quality from mocap tracking ✅ Versatile task execution; waypoint navigation, joystick teleop, obstacle avoidance ✅ Stable sim-to-real transfer for diverse humanoid skills Thank you for sharing, Qiayuan Liao! 📍 Paper: Video:

Humanoids finally move like humans… and can do more than copy. [Details + demos in thread 👇] A new framework, BeyondMimic, shows how to learn naturalistic whole-body control from human motion. But then goes further by composing those skills into versatile, zero-shot policies. Two key pieces make it work: •Motion tracking pipeline: robustly turns human mocap into dynamic robot motions (jump spins, sprinting, cartwheels) on real hardware •Guided diffusion policy: distills motion primitives and enables zero-shot downstream tasks with simple cost functions The result: ✅ State-of-the-art motion quality from mocap tracking ✅ Versatile task execution; waypoint navigation, joystick teleop, obstacle avoidance ✅ Stable sim-to-real transfer for diverse humanoid skills Thank you for sharing, Qiayuan Liao! 📍 Paper: Video:

Ilir Aliu - eu/acc

72,522 Aufrufe • vor 1 Jahr

Humanoid robots are cool. But most of them aren’t ready for real-world work. X-Humanoid just launched Embodied Tien Kung 3.0 - a full-size humanoid robot built to actually operate in industrial and commercial environments. What makes it different? • Strong, high-torque joints for heavy tasks • Can move dynamically and stay stable • Handles complex motions (even over obstacles) • Millimeter-level precision for detailed work It runs on the Wise KaiWu AI platform, which allows the robot to see, think, and act in a continuous loop with less human control and support for multi-robot collaboration. It also supports ROS2, MQTT, and TCP/IP, and offers more open hardware + software interfaces to make development easier for teams. The goal is simple: make humanoid robots practical, easier to build on, and ready for real-world use. Visit: Check out the official launch video below to see what it can do! 👇 #Robotics #HumanoidRobot #AI

Humanoid robots are cool. But most of them aren’t ready for real-world work. X-Humanoid just launched Embodied Tien Kung 3.0 - a full-size humanoid robot built to actually operate in industrial and commercial environments. What makes it different? • Strong, high-torque joints for heavy tasks • Can move dynamically and stay stable • Handles complex motions (even over obstacles) • Millimeter-level precision for detailed work It runs on the Wise KaiWu AI platform, which allows the robot to see, think, and act in a continuous loop with less human control and support for multi-robot collaboration. It also supports ROS2, MQTT, and TCP/IP, and offers more open hardware + software interfaces to make development easier for teams. The goal is simple: make humanoid robots practical, easier to build on, and ready for real-world use. Visit: Check out the official launch video below to see what it can do! 👇 #Robotics #HumanoidRobot #AI

Chidanand Tripathi

69,604 Aufrufe • vor 5 Monaten

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:

RoboHub🤖

61,378 Aufrufe • vor 11 Monaten

A new member joins the European humanoid robot team. German company Agile Robotics has launched its first industrial humanoid robot, Agile One, featuring intuitive human-robot interaction, dexterous hands (for grasping small screws and touching the screen), and AI-driven operation trained in the real world. It performs tasks such as material collection, handling, picking and placing, loading and unloading machine tools, tool handling, and precision operations. The emergence of humanoid robots by industrial robot companies is a natural progression; they are designed for areas inaccessible to traditional robotic arms and industrial robots, extending operational systems and enhancing business collaboration capabilities. Agile One will be manufactured in Germany in early 2026 and deployed for on-site training at customers to enhance its AI model capabilities. Soon, Europe will enter its second wave of automation driven by intelligent technology.

A new member joins the European humanoid robot team. German company Agile Robotics has launched its first industrial humanoid robot, Agile One, featuring intuitive human-robot interaction, dexterous hands (for grasping small screws and touching the screen), and AI-driven operation trained in the real world. It performs tasks such as material collection, handling, picking and placing, loading and unloading machine tools, tool handling, and precision operations. The emergence of humanoid robots by industrial robot companies is a natural progression; they are designed for areas inaccessible to traditional robotic arms and industrial robots, extending operational systems and enhancing business collaboration capabilities. Agile One will be manufactured in Germany in early 2026 and deployed for on-site training at customers to enhance its AI model capabilities. Soon, Europe will enter its second wave of automation driven by intelligent technology.

CyberRobo

72,567 Aufrufe • vor 9 Monaten

NEWS: Humanoid robotics company Figure has released Helix 02, what they claim in their most capable humanoid model yet. "A single neural system that controls the full body directly from pixels, enabling dexterous, long horizon autonomy across an entire room: • Autonomous, long‑horizon loco-manipulation: Helix 02 unloads and reloads a dishwasher across a full-sized kitchen - a four-minute, end-to-end autonomous task that integrates walking, manipulation, and balance with no resets and no human intervention. We believe this is the longest horizon, most complex task completed autonomously by a humanoid robot to date. • All sensors in. All actuators out: Helix 02 connects every onboard sensor - vision, touch, and proprioception - directly to every actuator through a single unified visuomotor neural network. • Human-like whole body control from human data: All results are enabled by System 0, a learned whole‑body controller trained on over 1,000 hours of human motion data and sim‑to‑real reinforcement learning. System 0 replaces 109,504 lines of hand‑engineered C++ with a single neural prior for stable, natural motion. • New classes of dexterity: With Figure 03’s embedded tactile sensing and palm cameras, Helix 02 performs manipulation that was previously out of reach: extracting individual pills, dispensing precise syringe volumes, and singulating small, irregular objects from clutter despite self‑occlusion. Helix 02 is trained on over 1,000 hours of human motion data and integrates vision, touch, and proprioception."

NEWS: Humanoid robotics company Figure has released Helix 02, what they claim in their most capable humanoid model yet. "A single neural system that controls the full body directly from pixels, enabling dexterous, long horizon autonomy across an entire room: • Autonomous, long‑horizon loco-manipulation: Helix 02 unloads and reloads a dishwasher across a full-sized kitchen - a four-minute, end-to-end autonomous task that integrates walking, manipulation, and balance with no resets and no human intervention. We believe this is the longest horizon, most complex task completed autonomously by a humanoid robot to date. • All sensors in. All actuators out: Helix 02 connects every onboard sensor - vision, touch, and proprioception - directly to every actuator through a single unified visuomotor neural network. • Human-like whole body control from human data: All results are enabled by System 0, a learned whole‑body controller trained on over 1,000 hours of human motion data and sim‑to‑real reinforcement learning. System 0 replaces 109,504 lines of hand‑engineered C++ with a single neural prior for stable, natural motion. • New classes of dexterity: With Figure 03’s embedded tactile sensing and palm cameras, Helix 02 performs manipulation that was previously out of reach: extracting individual pills, dispensing precise syringe volumes, and singulating small, irregular objects from clutter despite self‑occlusion. Helix 02 is trained on over 1,000 hours of human motion data and integrates vision, touch, and proprioception."

Sawyer Merritt

624,770 Aufrufe • vor 6 Monaten

The power of generative models — now embodied in humanoids. Announcing DreamControl –– After a year-long research effort at General Robotics — we present a scalable framework for whole-body humanoid control that fuses diffusion priors with reinforcement learning to unlock real-world scene interaction. Diffusion + RL → natural whole-body skills on real robots. DreamControl enables humanoids to move beyond locomotion demos → performing natural, human-like skills such as –– Picking & lifting objects, Opening drawers & doors, Precise punching, kicking, and jumping, Bimanual manipulation tasks Our key innovation: a diffusion prior over human motion that guides RL, eliminating the need for massive teleoperation datasets, and producing motions that look human while transferring to real hardware. Trained purely in simulation, deployed on the Unitree G1 humanoid, DreamControl policies run in real time, bridging sim-to-real with unprecedented naturalness. We leverage a novel hybrid edge + cloud infrastructure that runs RL-trained policies on the edge backed by powerful AI models running in the cloud This is the next step in General Robotics’ journey toward general-purpose humanoid assistants that interact, adapt, and assist autonomously. Paper: Blog: 1/n

The power of generative models — now embodied in humanoids. Announcing DreamControl –– After a year-long research effort at General Robotics — we present a scalable framework for whole-body humanoid control that fuses diffusion priors with reinforcement learning to unlock real-world scene interaction. Diffusion + RL → natural whole-body skills on real robots. DreamControl enables humanoids to move beyond locomotion demos → performing natural, human-like skills such as –– Picking & lifting objects, Opening drawers & doors, Precise punching, kicking, and jumping, Bimanual manipulation tasks Our key innovation: a diffusion prior over human motion that guides RL, eliminating the need for massive teleoperation datasets, and producing motions that look human while transferring to real hardware. Trained purely in simulation, deployed on the Unitree G1 humanoid, DreamControl policies run in real time, bridging sim-to-real with unprecedented naturalness. We leverage a novel hybrid edge + cloud infrastructure that runs RL-trained policies on the edge backed by powerful AI models running in the cloud This is the next step in General Robotics’ journey toward general-purpose humanoid assistants that interact, adapt, and assist autonomously. Paper: Blog: 1/n

Ashish Kapoor

118,133 Aufrufe • vor 11 Monaten

Boston Dynamics has demonstrated its new Atlas humanoid robot lifting and carrying a 50-pound fridge. The robot uses its whole body to balance and move the heavy object in a natural, human-like way. Before doing it in the real world, Atlas practiced the task for millions of hours in a virtual simulation.

Boston Dynamics has demonstrated its new Atlas humanoid robot lifting and carrying a 50-pound fridge. The robot uses its whole body to balance and move the heavy object in a natural, human-like way. Before doing it in the real world, Atlas practiced the task for millions of hours in a virtual simulation.

Space and Technology

180,505 Aufrufe • vor 2 Monaten

Build a humanoid robot yourself! 🪚 OpenArm is an open-source humanoid robot. It comes with full CAD, control code, firmware, and simulation tools, everything needed to build, modify, and operate it. The arms are designed to be compliant and backdrivable. Teleoperation is supported, with force feedback and real-time gravity compensation so operators can guide the arm naturally. Super important, on the simulation side, OpenArm works with platforms like MuJoCo and Isaac Sim, letting developers test policies in virtual environments before running on hardware. Assemble it yourself from a kit or get it prebuilt, the goal is accessibility for research labs, small teams, and enthusiasts. The project is run by Enactic in Tokyo, Japan, and aims to lower the barrier for experimenting with dexterous manipulation. Let's put robotics in mainstream! 🔥🔥 P.S. I put the project page in the comments!

Build a humanoid robot yourself! 🪚 OpenArm is an open-source humanoid robot. It comes with full CAD, control code, firmware, and simulation tools, everything needed to build, modify, and operate it. The arms are designed to be compliant and backdrivable. Teleoperation is supported, with force feedback and real-time gravity compensation so operators can guide the arm naturally. Super important, on the simulation side, OpenArm works with platforms like MuJoCo and Isaac Sim, letting developers test policies in virtual environments before running on hardware. Assemble it yourself from a kit or get it prebuilt, the goal is accessibility for research labs, small teams, and enthusiasts. The project is run by Enactic in Tokyo, Japan, and aims to lower the barrier for experimenting with dexterous manipulation. Let's put robotics in mainstream! 🔥🔥 P.S. I put the project page in the comments!

Lukas Ziegler

233,121 Aufrufe • vor 10 Monaten

NVIDIA MotionBricks brings humanoid robots closer to natural, fluid movement The system combines a modular latent generative model with Smart Primitives, packing more than 350,000 motion skills into a single backbone. It runs in real time at up to 15,000 FPS with just 2ms latency. Navigation, object interaction, sitting, jumping, obstacle crossing, and even different movement styles can be composed zero-shot, like reusable motion modules. It is already being used for whole-body control on the Unitree G1 and serves as the motion layer for NVIDIA GR00T Whole-Body Control. What makes this interesting is the move from training individual behaviors toward building a shared library of motion capabilities. If that approach scales, robot movement could become more modular, transferable, and easier to deploy across different tasks and environments.

NVIDIA MotionBricks brings humanoid robots closer to natural, fluid movement The system combines a modular latent generative model with Smart Primitives, packing more than 350,000 motion skills into a single backbone. It runs in real time at up to 15,000 FPS with just 2ms latency. Navigation, object interaction, sitting, jumping, obstacle crossing, and even different movement styles can be composed zero-shot, like reusable motion modules. It is already being used for whole-body control on the Unitree G1 and serves as the motion layer for NVIDIA GR00T Whole-Body Control. What makes this interesting is the move from training individual behaviors toward building a shared library of motion capabilities. If that approach scales, robot movement could become more modular, transferable, and easier to deploy across different tasks and environments.

CyberRobo

11,089 Aufrufe • vor 2 Monaten

DOBOT robotics' humanoid robot is making a big leap in industrial applications, achieving cross-scenario, multi-task generalization. This is thanks to two major breakthroughs: efficient human-to-robot motion mapping and knowledge-driven generative VLA tech. ► The robot handles complex tasks like precision assembly and can work reliably in temperatures over 50°C (122°F). ► It excels at multi-robot collaborative tasks and can adaptively grasp soft or irregularly shaped objects. With a repeatability of ±0.05mm, this model demonstrates strong adaptability and reliability in dynamic industrial settings. It's now being applied in warehouse anomaly handling and quality inspection.

DOBOT robotics' humanoid robot is making a big leap in industrial applications, achieving cross-scenario, multi-task generalization. This is thanks to two major breakthroughs: efficient human-to-robot motion mapping and knowledge-driven generative VLA tech. ► The robot handles complex tasks like precision assembly and can work reliably in temperatures over 50°C (122°F). ► It excels at multi-robot collaborative tasks and can adaptively grasp soft or irregularly shaped objects. With a repeatability of ±0.05mm, this model demonstrates strong adaptability and reliability in dynamic industrial settings. It's now being applied in warehouse anomaly handling and quality inspection.

RoboHub🤖

93,862 Aufrufe • vor 11 Monaten

Six months later, Vietnamese robotics company VinMotion has launched Motion 2, a general-purpose humanoid robot. Compared to Motion 1, Motion 2 features a more natural gait, faster walking speed, and greater agility, and can carry a load of 40kg. It can also recover from falls independently, and features autonomous charging and battery swapping. Currently, this humanoid robot is being tested in industrial logistics scenarios, with the goal of integrating it into business systems to achieve intelligent automation of tasks in factories and warehouses. It also integrates multi-language interaction capabilities (Vietnamese, English, etc.), laying the foundation for future service-oriented applications. BTW, VinMotion will showcase its progress at CES 2026.

Six months later, Vietnamese robotics company VinMotion has launched Motion 2, a general-purpose humanoid robot. Compared to Motion 1, Motion 2 features a more natural gait, faster walking speed, and greater agility, and can carry a load of 40kg. It can also recover from falls independently, and features autonomous charging and battery swapping. Currently, this humanoid robot is being tested in industrial logistics scenarios, with the goal of integrating it into business systems to achieve intelligent automation of tasks in factories and warehouses. It also integrates multi-language interaction capabilities (Vietnamese, English, etc.), laying the foundation for future service-oriented applications. BTW, VinMotion will showcase its progress at CES 2026.

CyberRobo

60,689 Aufrufe • vor 7 Monaten

Italy's IIT really has so many humanoid gems. Came across their 2018 Centauro--a centaur-like disaster response robot that combines a quadruped lower body with a humanoid torso and arms. Built for harsh settings like rubble fields or disaster zones, it needs both stable movement over uneven ground and the strength to use human tools for forceful tasks such as breaching doors or clearing obstacles. The four legs deliver terrain-following locomotion and stair climbing, while the upper body handles dexterous, high-force manipulation. The robot blends full-body teleoperation--mapping an operator’s movements directly to the machine, with local autonomous modules for motion and impedance control, supporting supervised or higher-level autonomy when useful. At 1.5m tall and 93kg, it carries roughly 11kg payload per arm with impact-resilient actuators. Battery life is about 2.5 hours. Its hybrid wheeled-legged legs (6 DoF each, with wheels at the ankles acting like rolling hooves) provide better stability than pure bipeds while keeping tool use intuitive. This focus on matching robot morphology to real task demands, rather than defaulting to a standard humanoid form, remains a useful reference. Curious what others think:could hybrid centaur-style platforms play a larger role in future rescue or specialized operations?

Italy's IIT really has so many humanoid gems. Came across their 2018 Centauro--a centaur-like disaster response robot that combines a quadruped lower body with a humanoid torso and arms. Built for harsh settings like rubble fields or disaster zones, it needs both stable movement over uneven ground and the strength to use human tools for forceful tasks such as breaching doors or clearing obstacles. The four legs deliver terrain-following locomotion and stair climbing, while the upper body handles dexterous, high-force manipulation. The robot blends full-body teleoperation--mapping an operator’s movements directly to the machine, with local autonomous modules for motion and impedance control, supporting supervised or higher-level autonomy when useful. At 1.5m tall and 93kg, it carries roughly 11kg payload per arm with impact-resilient actuators. Battery life is about 2.5 hours. Its hybrid wheeled-legged legs (6 DoF each, with wheels at the ankles acting like rolling hooves) provide better stability than pure bipeds while keeping tool use intuitive. This focus on matching robot morphology to real task demands, rather than defaulting to a standard humanoid form, remains a useful reference. Curious what others think:could hybrid centaur-style platforms play a larger role in future rescue or specialized operations?

CyberRobo

41,894 Aufrufe • vor 1 Monat

A planetary roller screw looks simple, but it’s one of the key enablers for humanoid robots. It converts rotational motion into precise linear motion with high efficiency, high load capacity, and extremely smooth control. In humanoid robots, this is exactly what you need for: joint actuation linear actuators in arms/legs high-force, high-precision movement under continuous cycles Compared to ball screws, it offers better durability and load distribution—critical for robots that must operate 24/7 in the real world. Small component, huge impact. This is the kind of “hidden hardware” that makes humanoid robotics actually work.

A planetary roller screw looks simple, but it’s one of the key enablers for humanoid robots. It converts rotational motion into precise linear motion with high efficiency, high load capacity, and extremely smooth control. In humanoid robots, this is exactly what you need for: joint actuation linear actuators in arms/legs high-force, high-precision movement under continuous cycles Compared to ball screws, it offers better durability and load distribution—critical for robots that must operate 24/7 in the real world. Small component, huge impact. This is the kind of “hidden hardware” that makes humanoid robotics actually work.

Steven Cheng

69,970 Aufrufe • vor 1 Monat

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥

Zhengyi “Zen” Luo

62,326 Aufrufe • vor 9 Monaten

Tomorrow’s Science, Today’s Robot A humanoid robot is a type of robot designed to look and act like a human being. It usually has a body structure with a head, torso, arms, and legs, and may be programmed to walk, talk, or perform tasks similar to humans. Some humanoid robots are made mainly for research and testing, while others are used in healthcare, customer service, education, or entertainment. Advanced ones even use artificial intelligence (AI) to recognise speech, facial expressions, and interact naturally with people.

Tomorrow’s Science, Today’s Robot A humanoid robot is a type of robot designed to look and act like a human being. It usually has a body structure with a head, torso, arms, and legs, and may be programmed to walk, talk, or perform tasks similar to humans. Some humanoid robots are made mainly for research and testing, while others are used in healthcare, customer service, education, or entertainment. Advanced ones even use artificial intelligence (AI) to recognise speech, facial expressions, and interact naturally with people.

NTANetwork

349,326 Aufrufe • vor 10 Monaten

Shanghai MATRIX ROBOTICS has released a video of its new generation general-purpose humanoid robot: MATRIX-3. Much more compact than the first generation, without a protruding "rear end," it features an impressive futuristic design, 27-DOF dexterous hand with tendon-driven joints, 3D soft fabric bionic skin (claimed to have tactile sensing), and incorporates a new neural network that allows for zero-shot learning, enabling it to perform tasks in complex environments. It is planned for use in general scenarios such as manufacturing plants, logistics warehouses, and retail supermarkets. However, this is currently just a video, and its actual performance remains to be seen, especially the rapid, sensitive, and free movements of the hands as shown in the video: this would truly be a huge breakthrough.

Shanghai MATRIX ROBOTICS has released a video of its new generation general-purpose humanoid robot: MATRIX-3. Much more compact than the first generation, without a protruding "rear end," it features an impressive futuristic design, 27-DOF dexterous hand with tendon-driven joints, 3D soft fabric bionic skin (claimed to have tactile sensing), and incorporates a new neural network that allows for zero-shot learning, enabling it to perform tasks in complex environments. It is planned for use in general scenarios such as manufacturing plants, logistics warehouses, and retail supermarkets. However, this is currently just a video, and its actual performance remains to be seen, especially the rapid, sensitive, and free movements of the hands as shown in the video: this would truly be a huge breakthrough.

CyberRobo

192,751 Aufrufe • vor 7 Monaten