Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

🚀 Introducing SoftMimic: Compliant humanoids for an interactive future — bringing humanoids into the real world 🤝 🔗 Current humanoids collapse when they touch the world — they can’t handle contact or deviation from their reference motion 😭 😎SoftMimic learns to deviate gracefully from motion references. It natively embraces... show more

Pulkit Agrawal

17,530 subscribers

40,286 Aufrufe • vor 10 Monaten •via X (Twitter)

Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

19 Kommentare

Profilbild von Pieter Abbeel

Pieter Abbeelvor 10 Monaten

impressive

Profilbild von Pulkit Agrawal

Pulkit Agrawalvor 10 Monaten

😍Unlike today's stiff humanoids, soft mimic is robust to unexpected collisions 🔗

Profilbild von Pulkit Agrawal

Pulkit Agrawalvor 10 Monaten

🤩Using the same motion reference, soft mimic picks up boxes of different sizes -- free generalization! 🔗

Profilbild von Pulkit Agrawal

Pulkit Agrawalvor 10 Monaten

🙀🤯Soft mimic is extremely robust while still being safe and doing what you want the robot to do. 🔗

Profilbild von Pulkit Agrawal

Pulkit Agrawalvor 10 Monaten

🥳Soft mimic is compliant enabling gentle interactions 🔗

Profilbild von Pulkit Agrawal

Pulkit Agrawalvor 10 Monaten

🤯🤩Soft mimic can be quickly programmed for new tasks, zero-shot 🔗

Profilbild von James

Jamesvor 10 Monaten

It has invisible lats syndrome

Profilbild von Mengdi Xu

Mengdi Xuvor 10 Monaten

Very cool results. Congrats!

Profilbild von Sunil Gora

Sunil Goravor 10 Monaten

Impressive work! Isn't it learning the 'admittance control'?

Profilbild von Pulkit Agrawal

Pulkit Agrawalvor 10 Monaten

yes

Profilbild von czr

czrvor 10 Monaten

cool！

Profilbild von Sammy

Sammyvor 10 Monaten

Amazing

Profilbild von ζ Pedram ζ

ζ Pedram ζvor 10 Monaten

Would love to see code on this, but this is the most practical way to real scalability. Also minimum requirements for Kung Fu

Profilbild von Kaival Shah 🤔

Kaival Shah 🤔vor 10 Monaten

Super cool!

Profilbild von ζ Pedram ζ

ζ Pedram ζvor 10 Monaten

So nice

Profilbild von Michal Nauman

Michal Naumanvor 10 Monaten

Awesome work 🦾

Profilbild von Carlos DP 🤖🇺🇸

Carlos DP 🤖🇺🇸vor 10 Monaten

Very cool work! Similar to the goals of FALCON, but within a motion tracking context, I like it

Profilbild von Sarika saah🇺🇸

Sarika saah🇺🇸vor 6 Monaten

In the real world, true success lies in not falling over from bumps and touches, and SoftMimic has nailed this point. How easy is it to deploy this framework on robots like Unitree or Digit? 😌

Profilbild von Priyanka Agrawal

Priyanka Agrawalvor 9 Monaten

The future depends on robots.

Ähnliche Videos

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥

Zhengyi “Zen” Luo

62,624 Aufrufe • vor 10 Monaten

Humanoid robots shouldn't just follow pre-defined movements—they should perform! 🤖✨ Introducing UniAct: A unified model for multimodal motion generation and action streaming. Most humanoids are limited to pre-designed moves. UniAct changes the game by allowing robots to generate live action sequences from: 📝 Text instructions 🎶 Music rhythms 📉 Spatial trajectories 🔄 Cross-modal signals Whether it’s dancing to a beat or following a complex path, UniAct brings humanoid robots to life in real-time. 🚀 🔗 Project: 📄 Paper:

Humanoid robots shouldn't just follow pre-defined movements—they should perform! 🤖✨ Introducing UniAct: A unified model for multimodal motion generation and action streaming. Most humanoids are limited to pre-designed moves. UniAct changes the game by allowing robots to generate live action sequences from: 📝 Text instructions 🎶 Music rhythms 📉 Spatial trajectories 🔄 Cross-modal signals Whether it’s dancing to a beat or following a complex path, UniAct brings humanoid robots to life in real-time. 🚀 🔗 Project: 📄 Paper:

Siyuan Huang

10,665 Aufrufe • vor 8 Monaten

X-Humanoid unveiled TG-VLA, which it calls the world's first whole-body VLA framework for full-size humanoid robots. The goal: move humanoids past "mobile dual-arm systems" to human-like, whole-body coordinated operation. Built on three technologies: - HEX: an open-source full-size humanoid VLA that learns across embodiments and coordinates the whole body. Claimed SOTA on real-world whole-body manipulation - HAF-VLA: hierarchical action flow that decomposes whole-body motion into subtasks. Best or joint-best on 6 benchmarks - DSRL-DCT: online RL for high-DoF humanoids in a compressed latent space. 100% success on mobile manipulation HEX is open-source.

X-Humanoid unveiled TG-VLA, which it calls the world's first whole-body VLA framework for full-size humanoid robots. The goal: move humanoids past "mobile dual-arm systems" to human-like, whole-body coordinated operation. Built on three technologies: - HEX: an open-source full-size humanoid VLA that learns across embodiments and coordinates the whole body. Claimed SOTA on real-world whole-body manipulation - HAF-VLA: hierarchical action flow that decomposes whole-body motion into subtasks. Best or joint-best on 6 benchmarks - DSRL-DCT: online RL for high-DoF humanoids in a compressed latent space. 100% success on mobile manipulation HEX is open-source.

The Humanoid Hub

19,563 Aufrufe • vor 2 Monaten

Turning video into humanoid robot motion! 🤳🏼 Training humanoid robots needs huge amounts of motion data, but real-world capture doesn’t scale. Mocap is expensive, dangerous edge cases are rare, and you can’t ask humans to repeatedly fall or crash. Video2Robot tackles this by converting videos into physics-grounded humanoid simulations. Motion is generated to respect balance, inertia, ground contact, and joint limits, then directly retargeted to robot simulators. One prompt can generate a full humanoid motion sequence, including multi-agent interactions and failure cases like falls or collisions, scenarios that are hard or impossible to capture safely in the real world. The pipeline is model-agnostic and works with existing video generators, making it a practical way to scale data for robots. If robots are going to operate in the real world, they need to be trained on the failures too, not just the perfect demos. Here's the GitHub: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Turning video into humanoid robot motion! 🤳🏼 Training humanoid robots needs huge amounts of motion data, but real-world capture doesn’t scale. Mocap is expensive, dangerous edge cases are rare, and you can’t ask humans to repeatedly fall or crash. Video2Robot tackles this by converting videos into physics-grounded humanoid simulations. Motion is generated to respect balance, inertia, ground contact, and joint limits, then directly retargeted to robot simulators. One prompt can generate a full humanoid motion sequence, including multi-agent interactions and failure cases like falls or collisions, scenarios that are hard or impossible to capture safely in the real world. The pipeline is model-agnostic and works with existing video generators, making it a practical way to scale data for robots. If robots are going to operate in the real world, they need to be trained on the failures too, not just the perfect demos. Here's the GitHub: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

59,835 Aufrufe • vor 8 Monaten

Should humanoids have tails? Current legged robots struggle with center of mass control and quick stabilization. Adding more DOF to legs gets complicated fast. Nature already solved this: Cheetahs, kangaroos, dinosaurs – they use tails for dynamic balance, sharp turns, and recovery from unexpected shifts. The robotics insight? Let the tail handle it. Virginia Tech built serpentine tails that compensate in real-time – so bipeds and quadrupeds can handle ledges, lateral shifts, and turns without rewriting their entire gait. Simple solution. Obvious in hindsight. 🦖🤖

Should humanoids have tails? Current legged robots struggle with center of mass control and quick stabilization. Adding more DOF to legs gets complicated fast. Nature already solved this: Cheetahs, kangaroos, dinosaurs – they use tails for dynamic balance, sharp turns, and recovery from unexpected shifts. The robotics insight? Let the tail handle it. Virginia Tech built serpentine tails that compensate in real-time – so bipeds and quadrupeds can handle ledges, lateral shifts, and turns without rewriting their entire gait. Simple solution. Obvious in hindsight. 🦖🤖

Jack 🤖

277,790 Aufrufe • vor 10 Monaten

ELON: AGI IS LIKELY TO EMERGE FROM OUR AUTONOMOUS CARS AND HUMANOIDS “We're not actually specifically focused on AGI. I'm simply saying that AGI seems likely to be an emergent property of what we're doing, because we're creating all these autonomous cars and autonomous humanoids that are actually a truly gigantic data stream that's coming in and being processed. It's by far the most amount of real-world data, and data you can't get by just searching the Internet, because you have to be out there in the world and interacting with people and interacting with the roads. Earth is a big place, and reality is messy and complicated. If you've got tens or hundreds of millions of autonomous vehicles and maybe even a comparable number of humanoids, maybe more than that, on the humanoid front, well, that's just the most amount of data. And if that video is being processed, it just seems likely that the cars will definitely get way better than human drivers, and the humanoid robots will become increasingly indistinguishable from humans, perhaps. And so then, like you said, you have this emergent property of AGI.” Source: Tesla AI Day, September 2022

ELON: AGI IS LIKELY TO EMERGE FROM OUR AUTONOMOUS CARS AND HUMANOIDS “We're not actually specifically focused on AGI. I'm simply saying that AGI seems likely to be an emergent property of what we're doing, because we're creating all these autonomous cars and autonomous humanoids that are actually a truly gigantic data stream that's coming in and being processed. It's by far the most amount of real-world data, and data you can't get by just searching the Internet, because you have to be out there in the world and interacting with people and interacting with the roads. Earth is a big place, and reality is messy and complicated. If you've got tens or hundreds of millions of autonomous vehicles and maybe even a comparable number of humanoids, maybe more than that, on the humanoid front, well, that's just the most amount of data. And if that video is being processed, it just seems likely that the cars will definitely get way better than human drivers, and the humanoid robots will become increasingly indistinguishable from humans, perhaps. And so then, like you said, you have this emergent property of AGI.” Source: Tesla AI Day, September 2022

Mario Nawfal

2,628,293 Aufrufe • vor 1 Jahr

Elon Musk on how AGI might actually emerge: “We’re not actually specifically focused on AGI. I’m simply saying that AGI seems likely to be an emergent property of what we’re doing” The reason is the massive real-world data Tesla is generating from autonomous cars and humanoid robots This is not internet data. This is real-world interaction driving on messy roads, navigating unpredictable environments, and interacting with people With tens or hundreds of millions of autonomous vehicles and potentially even more humanoids, the amount of real-world video and data being processed will be enormous From this, cars will become far better than human drivers, and humanoid robots will become increasingly indistinguishable from humans AGI might not come from a lab trying to build it directly. It may simply emerge from building useful robots at massive scale

Elon Musk on how AGI might actually emerge: “We’re not actually specifically focused on AGI. I’m simply saying that AGI seems likely to be an emergent property of what we’re doing” The reason is the massive real-world data Tesla is generating from autonomous cars and humanoid robots This is not internet data. This is real-world interaction driving on messy roads, navigating unpredictable environments, and interacting with people With tens or hundreds of millions of autonomous vehicles and potentially even more humanoids, the amount of real-world video and data being processed will be enormous From this, cars will become far better than human drivers, and humanoid robots will become increasingly indistinguishable from humans AGI might not come from a lab trying to build it directly. It may simply emerge from building useful robots at massive scale

X Freeze

21,256 Aufrufe • vor 3 Monaten

Teaching robots real dexterity has always been a challenge. But what if they could handle tools like a human? DexterityGen (DexGen) is a new system that helps robots use their hands better. It improves how they grip, move, and handle objects… from holding a pen to using a screwdriver. DexGen learns in simulation and refines its skills in the real world, making robotic hands much more useful. What makes DexGen special? ✅ Smarter movements that refine rough actions into precise skills ✅ Trained on a massive collection of dexterous tasks for better learning ✅ Better teleoperation that makes robotic hand control easier and safer ✅ Handles real-world challenges like small objects, tricky angles, and gravity This moves robots closer to real dexterity. It makes tool use more natural, improves stability, and brings robotic hands one step closer to human-level skill. Seen at Zhao-Heng Yin 🫶 Github: Paper:

Teaching robots real dexterity has always been a challenge. But what if they could handle tools like a human? DexterityGen (DexGen) is a new system that helps robots use their hands better. It improves how they grip, move, and handle objects… from holding a pen to using a screwdriver. DexGen learns in simulation and refines its skills in the real world, making robotic hands much more useful. What makes DexGen special? ✅ Smarter movements that refine rough actions into precise skills ✅ Trained on a massive collection of dexterous tasks for better learning ✅ Better teleoperation that makes robotic hand control easier and safer ✅ Handles real-world challenges like small objects, tricky angles, and gravity This moves robots closer to real dexterity. It makes tool use more natural, improves stability, and brings robotic hands one step closer to human-level skill. Seen at Zhao-Heng Yin 🫶 Github: Paper:

Ilir Aliu

51,526 Aufrufe • vor 1 Jahr

For robots to be useful, they can’t just dance — they must be able to physically interact with the world around them. Unfortunately, the sorts of motion tracking policies you see performing dancing or martial arts are not really capable of the kind of precise, forceful interaction needed to perform useful interactions with the world. Siheng Zhao and Yanjie Ze join us to talk about ResMimic, their new paper which takes a general-purpose human motion-tracking policy and improves it with a residual policy to reliably interact with objects To learn more, watch Episode #47 of RoboPapers, hosted by Michael Cho - Rbt/Acc and Chris Paxton, today!

For robots to be useful, they can’t just dance — they must be able to physically interact with the world around them. Unfortunately, the sorts of motion tracking policies you see performing dancing or martial arts are not really capable of the kind of precise, forceful interaction needed to perform useful interactions with the world. Siheng Zhao and Yanjie Ze join us to talk about ResMimic, their new paper which takes a general-purpose human motion-tracking policy and improves it with a residual policy to reliably interact with objects To learn more, watch Episode #47 of RoboPapers, hosted by Michael Cho - Rbt/Acc and Chris Paxton, today!

RoboPapers

11,399 Aufrufe • vor 9 Monaten

🚀🚀🚀Introducing HY World 1.5 (WorldPlay)! We have now open-sourced the most systemized, comprehensive real-time world model framework in the industry. In HY World 1.5, we develop WorldPlay, a streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency, resolving the trade-off between speed and memory that limits current methods. You can generate and explore 3D worlds simply by inputting text or images. Walk, look around, and interact like you're playing a game. Highlights: 🔹Real-Time: Generates long-horizon streaming video at 24 FPS with superior consistency. 🔹Geometric Consistency: Achieved using a Reconstituted Context Memory mechanism to dynamically rebuild context from past frames to alleviate memory attenuation 🔹Robust Control: Uses a Dual Action Representation for robust response to user keyboard and mouse inputs. 🔹Versatile Applications: Supports both first-person and third-person perspectives, enabling applications like promptable events and infinite world extension. 👉🏻Try it now: 🌐Project Page: 🔗Github: 🤗Hugging Face: 📄Technical Report:

🚀🚀🚀Introducing HY World 1.5 (WorldPlay)! We have now open-sourced the most systemized, comprehensive real-time world model framework in the industry. In HY World 1.5, we develop WorldPlay, a streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency, resolving the trade-off between speed and memory that limits current methods. You can generate and explore 3D worlds simply by inputting text or images. Walk, look around, and interact like you're playing a game. Highlights: 🔹Real-Time: Generates long-horizon streaming video at 24 FPS with superior consistency. 🔹Geometric Consistency: Achieved using a Reconstituted Context Memory mechanism to dynamically rebuild context from past frames to alleviate memory attenuation 🔹Robust Control: Uses a Dual Action Representation for robust response to user keyboard and mouse inputs. 🔹Versatile Applications: Supports both first-person and third-person perspectives, enabling applications like promptable events and infinite world extension. 👉🏻Try it now: 🌐Project Page: 🔗Github: 🤗Hugging Face: 📄Technical Report:

Tencent Hy

189,802 Aufrufe • vor 9 Monaten

𝗖𝗵𝗶𝗻𝗮 𝗶𝘀 𝗳𝗶𝗻𝗶𝘀𝗵𝗶𝗻𝗴 𝘁𝗵𝗲 𝗵𝘂𝗺𝗮𝗻𝗼𝗶𝗱 𝗿𝗼𝗯𝗼𝘁 𝗿𝗮𝗰𝗲 𝗯𝗲𝗳𝗼𝗿𝗲 𝗺𝗼𝘀𝘁 𝗼𝗳 𝘁𝗵𝗲 𝗪𝗲𝘀𝘁 𝗿𝗲𝗮𝗹𝗶𝘇𝗲𝘀 𝗶𝘁 𝗵𝗮𝘀 𝘀𝘁𝗮𝗿𝘁𝗲𝗱. AGIBOT held its Partner Conference in Shanghai last week. The real headline wasn't the new hardware. It was their CTO standing on stage, telling investors that humanoid R&D season is over. 2026, he said, is "Deployment Year One." Not research. Not demos. Deployment into real factories, real warehouses, real stores. The manufacturing ramp is getting faster. 1,000 humanoid robots in the first 2 years. Another 4,000 in the next 12 months. Another 5,000 in just 3 months after that. AGIBOT is now shipping more humanoids per quarter than most US robotics companies have built in their entire existence. Then came the announcements the industry will spend the rest of the year reacting to. AIMA. The first full-stack open architecture for embodied AI. A unified robot operating system called Link-U, three dev platforms for motion, interaction, and task creation, plus an open agent framework. Any developer can build on top of it. This is the Android play for humanoids. GO-2. A vision-language-action foundation model with Action Chain-of-Thought reasoning. Planning and execution collapsed into one model. GE-2. A world model for simulation, strategy testing, and sim-to-real transfer. AGIBOT WORLD 2026. An open-source, production-grade real-world dataset pulled from actual industrial, logistics, hotel, and commercial sites. Seven standardized "productivity packages" covering logistics sorting, retail service, security patrol, commercial cleaning, and more. Plug, deploy, bill. A 5-year, $280 million commitment to seed a global developer and partner ecosystem. Now look at the competition. Boston Dynamics has been building humanoids since 1992. Tesla's Optimus is still climbing its own hype curve. Apptronik and Agility are well-funded but pre-scale on real deployments. AGIBOT has pulled all of this off in three years, with no acquisitions, no legacy platform, and no IPO distractions. While the West is still asking when humanoids will scale, China is already shipping them by the thousand.

𝗖𝗵𝗶𝗻𝗮 𝗶𝘀 𝗳𝗶𝗻𝗶𝘀𝗵𝗶𝗻𝗴 𝘁𝗵𝗲 𝗵𝘂𝗺𝗮𝗻𝗼𝗶𝗱 𝗿𝗼𝗯𝗼𝘁 𝗿𝗮𝗰𝗲 𝗯𝗲𝗳𝗼𝗿𝗲 𝗺𝗼𝘀𝘁 𝗼𝗳 𝘁𝗵𝗲 𝗪𝗲𝘀𝘁 𝗿𝗲𝗮𝗹𝗶𝘇𝗲𝘀 𝗶𝘁 𝗵𝗮𝘀 𝘀𝘁𝗮𝗿𝘁𝗲𝗱. AGIBOT held its Partner Conference in Shanghai last week. The real headline wasn't the new hardware. It was their CTO standing on stage, telling investors that humanoid R&D season is over. 2026, he said, is "Deployment Year One." Not research. Not demos. Deployment into real factories, real warehouses, real stores. The manufacturing ramp is getting faster. 1,000 humanoid robots in the first 2 years. Another 4,000 in the next 12 months. Another 5,000 in just 3 months after that. AGIBOT is now shipping more humanoids per quarter than most US robotics companies have built in their entire existence. Then came the announcements the industry will spend the rest of the year reacting to. AIMA. The first full-stack open architecture for embodied AI. A unified robot operating system called Link-U, three dev platforms for motion, interaction, and task creation, plus an open agent framework. Any developer can build on top of it. This is the Android play for humanoids. GO-2. A vision-language-action foundation model with Action Chain-of-Thought reasoning. Planning and execution collapsed into one model. GE-2. A world model for simulation, strategy testing, and sim-to-real transfer. AGIBOT WORLD 2026. An open-source, production-grade real-world dataset pulled from actual industrial, logistics, hotel, and commercial sites. Seven standardized "productivity packages" covering logistics sorting, retail service, security patrol, commercial cleaning, and more. Plug, deploy, bill. A 5-year, $280 million commitment to seed a global developer and partner ecosystem. Now look at the competition. Boston Dynamics has been building humanoids since 1992. Tesla's Optimus is still climbing its own hype curve. Apptronik and Agility are well-funded but pre-scale on real deployments. AGIBOT has pulled all of this off in three years, with no acquisitions, no legacy platform, and no IPO distractions. While the West is still asking when humanoids will scale, China is already shipping them by the thousand.

Shruti

214,939 Aufrufe • vor 4 Monaten

Who can say no to a humanoid robot that can actually feel a hug? 🤖 JQ Industries just built a fabric-based electronic skin for Unitree G1 — covering the torso, hands, and feet. This is not about appearance. It’s about giving robots real tactile sensing and pressure feedback. According to the company, the system includes tactile gloves, upper-body skin, and foot sensors. That means the robot can feel contact through its hands, detect pressure across its body, and use foot feedback to adjust balance. This is the missing layer in most humanoids. Vision alone can’t handle physical interaction. Robots need touch to grip safely, react to humans, and stay stable in real-world environments. JQ says its fiber sensors can detect forces as low as 0.01N, handle up to 3500kPa, and bend below 0.1mm radius. The system can also integrate with Isaac Sim, making tactile data usable for training and deployment. Unitree G1 is already built for manipulation and control — this adds the sensing layer it lacked. JQ says it’s now working with multiple humanoid companies, with some systems already shipping at scale. This is what happens when robots stop just seeing the world — and start physically feeling it.

Who can say no to a humanoid robot that can actually feel a hug? 🤖 JQ Industries just built a fabric-based electronic skin for Unitree G1 — covering the torso, hands, and feet. This is not about appearance. It’s about giving robots real tactile sensing and pressure feedback. According to the company, the system includes tactile gloves, upper-body skin, and foot sensors. That means the robot can feel contact through its hands, detect pressure across its body, and use foot feedback to adjust balance. This is the missing layer in most humanoids. Vision alone can’t handle physical interaction. Robots need touch to grip safely, react to humans, and stay stable in real-world environments. JQ says its fiber sensors can detect forces as low as 0.01N, handle up to 3500kPa, and bend below 0.1mm radius. The system can also integrate with Isaac Sim, making tactile data usable for training and deployment. Unitree G1 is already built for manipulation and control — this adds the sensing layer it lacked. JQ says it’s now working with multiple humanoid companies, with some systems already shipping at scale. This is what happens when robots stop just seeing the world — and start physically feeling it.

RoboHub🤖

10,952 Aufrufe • vor 5 Monaten

Humanoids are finally getting a sense of touch that actually feels... human. 🤖 As third-gen bots like Optimus, XPENG, and Figure move from labs to the real world, the focus is shifting from just "walking" to "feeling." We are seeing a move toward tactile fabrics that can be literally tailored to a robot's frame like a custom suit. This isn't just about simple pressure sensors; it's about a full electronic skin with a folding radius under 0.2mm. That means a bot can detect a gram-level touch, sense textures, or even feel the slight slip of an object before it drops. The industrial impact is massive—the global market for these flexible sensors is projected to hit 27.4 billion RMB (approx. $3.98B) by 2030. Beyond just picking up boxes, this tech allows robots to sense the warmth and pressure of a hug or adjust balance through foot sensors. High-density arrays with dozens of sensors per square centimeter are becoming the new baseline for dexterity. By turning physical contact into high-fidelity data, these skins are the final key to making robots safe for our homes and hospitals. The future of robotics is looking a lot more flexible and a lot more sensitive.

Humanoids are finally getting a sense of touch that actually feels... human. 🤖 As third-gen bots like Optimus, XPENG, and Figure move from labs to the real world, the focus is shifting from just "walking" to "feeling." We are seeing a move toward tactile fabrics that can be literally tailored to a robot's frame like a custom suit. This isn't just about simple pressure sensors; it's about a full electronic skin with a folding radius under 0.2mm. That means a bot can detect a gram-level touch, sense textures, or even feel the slight slip of an object before it drops. The industrial impact is massive—the global market for these flexible sensors is projected to hit 27.4 billion RMB (approx. $3.98B) by 2030. Beyond just picking up boxes, this tech allows robots to sense the warmth and pressure of a hug or adjust balance through foot sensors. High-density arrays with dozens of sensors per square centimeter are becoming the new baseline for dexterity. By turning physical contact into high-fidelity data, these skins are the final key to making robots safe for our homes and hospitals. The future of robotics is looking a lot more flexible and a lot more sensitive.

RoboHub🤖

72,367 Aufrufe • vor 5 Monaten

Robots are getting smarter, but most still fail the same way. They don’t learn from their own mistakes. A new paper proposes something different: a way for robots to self-improve directly from their failures in the real world. It’s called PLD (Probe, Learn, Distill). The idea: instead of collecting endless human demos, let the robot figure out where it fails, learn how to recover, and then distill that knowledge back into its main model. Key takeaways from the research: ✅ Uses residual reinforcement learning to recover from policy failures ✅ Achieves 99% success on LIBERO and 100% on real Franka and YAM arms ✅ Runs hour-long manipulation tasks without human resets ✅ Builds a feedback loop between real-world data and model adaptation Unlike supervised fine-tuning, which relies on humans, PLD learns from the robot’s own experience. By training on its own failure distribution, the model becomes both more efficient and more aligned with the real world. It’s not just a technical shift, it’s a step toward robots that improve themselves through real-world practice. Thanks for sharing, Wenli Xiao !! Paper and demos: —- Weekly robotics and AI insights. Subscribe free:

Robots are getting smarter, but most still fail the same way. They don’t learn from their own mistakes. A new paper proposes something different: a way for robots to self-improve directly from their failures in the real world. It’s called PLD (Probe, Learn, Distill). The idea: instead of collecting endless human demos, let the robot figure out where it fails, learn how to recover, and then distill that knowledge back into its main model. Key takeaways from the research: ✅ Uses residual reinforcement learning to recover from policy failures ✅ Achieves 99% success on LIBERO and 100% on real Franka and YAM arms ✅ Runs hour-long manipulation tasks without human resets ✅ Builds a feedback loop between real-world data and model adaptation Unlike supervised fine-tuning, which relies on humans, PLD learns from the robot’s own experience. By training on its own failure distribution, the model becomes both more efficient and more aligned with the real world. It’s not just a technical shift, it’s a step toward robots that improve themselves through real-world practice. Thanks for sharing, Wenli Xiao !! Paper and demos: —- Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

22,881 Aufrufe • vor 10 Monaten

⚠️ THE ROBOT DIDN’T ENTER A ROBOT TESTING LAB. IT ENTERED A CITY. A humanoid robot is moving through a real urban environment with pedestrians, traffic and constantly changing space around it. There’s no empty runway and no perfectly controlled path - the machine has to keep moving while the world around it does whatever it wants. That makes a few seconds of walking far more interesting than another polished stage demo. A city is one of the hardest places to test a humanoid because nothing stays predictable for long. People stop, cars move, distances change and obstacles appear without warning, while the robot still has to maintain balance and choose where to step next. The challenge isn't simply walking anymore - it's understanding how to move through a world that wasn't designed for robots. And that's the real milestone here. Humanoids don't need to look perfectly human to change the world; they need to become capable of functioning in spaces already built for us. The closer they get to doing that reliably, the less important the laboratory demos become. The future won't feel futuristic because robots look human. It will feel futuristic when robots can move through our world like they belong there.

⚠️ THE ROBOT DIDN’T ENTER A ROBOT TESTING LAB. IT ENTERED A CITY. A humanoid robot is moving through a real urban environment with pedestrians, traffic and constantly changing space around it. There’s no empty runway and no perfectly controlled path - the machine has to keep moving while the world around it does whatever it wants. That makes a few seconds of walking far more interesting than another polished stage demo. A city is one of the hardest places to test a humanoid because nothing stays predictable for long. People stop, cars move, distances change and obstacles appear without warning, while the robot still has to maintain balance and choose where to step next. The challenge isn't simply walking anymore - it's understanding how to move through a world that wasn't designed for robots. And that's the real milestone here. Humanoids don't need to look perfectly human to change the world; they need to become capable of functioning in spaces already built for us. The closer they get to doing that reliably, the less important the laboratory demos become. The future won't feel futuristic because robots look human. It will feel futuristic when robots can move through our world like they belong there.

Future Memo

10,138 Aufrufe • vor 1 Monat

Not a preplanned motion sequence. A robot deciding mid-jump what to do next. [📍 paper + demo] Researchers just showed a humanoid doing real parkour using only onboard perception. No motion script, no fixed obstacle layout. The system is called Perceptive Humanoid Parkour (PHP). Instead of memorizing a path, the robot reads depth from its cameras and continuously chooses actions. Step, vault, climb, or roll depending on what geometry appears in front of it. To make that possible, they combine three ideas: First, they stitch together human motion clips into long movement references so the robot learns fluid transitions instead of isolated tricks. Second, they train tracking policies with reinforcement learning so contacts land at the right time and the robot keeps balance during dynamic moves. Finally, everything is distilled into one perception policy that runs directly from depth input to action selection. The result on a Unitree G1: about 3 m/s vaults wall climbs up to 1.25 m nearly one minute continuous obstacle traversal adapting when obstacles move What matters is not the tricks. It is the shift in capability. Earlier humanoids executed motions. This one navigates situations. Once robots react to geometry instead of replaying trajectories, environments stop needing to be predictable. Warehouses, homes, and outdoors suddenly become the same problem. Thanks for sharing, Zhen Wu! Paper + demo: ——— Weekly robotics and AI insights. Subscribe free:

Not a preplanned motion sequence. A robot deciding mid-jump what to do next. [📍 paper + demo] Researchers just showed a humanoid doing real parkour using only onboard perception. No motion script, no fixed obstacle layout. The system is called Perceptive Humanoid Parkour (PHP). Instead of memorizing a path, the robot reads depth from its cameras and continuously chooses actions. Step, vault, climb, or roll depending on what geometry appears in front of it. To make that possible, they combine three ideas: First, they stitch together human motion clips into long movement references so the robot learns fluid transitions instead of isolated tricks. Second, they train tracking policies with reinforcement learning so contacts land at the right time and the robot keeps balance during dynamic moves. Finally, everything is distilled into one perception policy that runs directly from depth input to action selection. The result on a Unitree G1: about 3 m/s vaults wall climbs up to 1.25 m nearly one minute continuous obstacle traversal adapting when obstacles move What matters is not the tricks. It is the shift in capability. Earlier humanoids executed motions. This one navigates situations. Once robots react to geometry instead of replaying trajectories, environments stop needing to be predictable. Warehouses, homes, and outdoors suddenly become the same problem. Thanks for sharing, Zhen Wu! Paper + demo: ——— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

22,127 Aufrufe • vor 6 Monaten

Fei-Fei Li ( Fei-Fei Li ) beautifully explains Robotics. She defines robotics not by form, like humanoids or cars, but by function: they are any "embodied machines" that must perceive, understand, and act within a physical, 3D space. This core requirement is "spatial intelligence," the unifying principle of all robotics, allowing them to perform tasks and even collaborate with humans. Throughout all of human history, we have been confined to a single, shared reality: the "physical Earth 3D world." This singularity has been our only playground. However, new technologies that combine 3D generation and reconstruction are shattering this limitation. We can now create "infinite universes"—a multiverse of digital worlds for countless purposes, from training robots to enabling creativity, travel, and storytelling. This leap from one physical world to an infinite multiverse unlocks boundless possibilities for human imagination and interaction. Video from a16z

Fei-Fei Li ( Fei-Fei Li ) beautifully explains Robotics. She defines robotics not by form, like humanoids or cars, but by function: they are any "embodied machines" that must perceive, understand, and act within a physical, 3D space. This core requirement is "spatial intelligence," the unifying principle of all robotics, allowing them to perform tasks and even collaborate with humans. Throughout all of human history, we have been confined to a single, shared reality: the "physical Earth 3D world." This singularity has been our only playground. However, new technologies that combine 3D generation and reconstruction are shattering this limitation. We can now create "infinite universes"—a multiverse of digital worlds for countless purposes, from training robots to enabling creativity, travel, and storytelling. This leap from one physical world to an infinite multiverse unlocks boundless possibilities for human imagination and interaction. Video from a16z

Rohan Paul

51,174 Aufrufe • vor 4 Monaten

Fei-Fei Li ( Fei-Fei Li ) beautifully explains Robotics. She defines robotics not by form, like humanoids or cars, but by function: they are any "embodied machines" that must perceive, understand, and act within a physical, 3D space. This core requirement is "spatial intelligence," the unifying principle of all robotics, allowing them to perform tasks and even collaborate with humans. Throughout all of human history, we have been confined to a single, shared reality: the "physical Earth 3D world." This singularity has been our only playground. However, new technologies that combine 3D generation and reconstruction are shattering this limitation. We can now create "infinite universes"—a multiverse of digital worlds for countless purposes, from training robots to enabling creativity, travel, and storytelling. This leap from one physical world to an infinite multiverse unlocks boundless possibilities for human imagination and interaction. Video from a16z

Fei-Fei Li ( Fei-Fei Li ) beautifully explains Robotics. She defines robotics not by form, like humanoids or cars, but by function: they are any "embodied machines" that must perceive, understand, and act within a physical, 3D space. This core requirement is "spatial intelligence," the unifying principle of all robotics, allowing them to perform tasks and even collaborate with humans. Throughout all of human history, we have been confined to a single, shared reality: the "physical Earth 3D world." This singularity has been our only playground. However, new technologies that combine 3D generation and reconstruction are shattering this limitation. We can now create "infinite universes"—a multiverse of digital worlds for countless purposes, from training robots to enabling creativity, travel, and storytelling. This leap from one physical world to an infinite multiverse unlocks boundless possibilities for human imagination and interaction. Video from a16z

Rohan Paul

41,441 Aufrufe • vor 8 Monaten