Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

🚀 Launching our open-source teleoperation device for full-body Vega robot control! 🔓 Open-source 💰 Low-cost 🎒 Portable 🦾 Whole-body control Control both real and simulated Vega robots! 🤖✨ 📍 Live Demo at #CoRL - See it in action with real and simulated Vega robots in Isaac Lab. Stop by... show more

Dexmate

1,979 subscribers

14,508 Aufrufe • vor 1 Jahr •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

4 Kommentare

Profilbild von Not an X Employee Yet

Not an X Employee Yetvor 1 Jahr

Looks like he is going to bump into my shins when giving me a well deserved hug at the end of the day... Any plans to make it a bit more cuddly?

Profilbild von Bart Trzynadlowski

Bart Trzynadlowskivor 1 Jahr

GitHub link?

Profilbild von Hafiza

Hafizavor 1 Jahr

Impressive progress,

Profilbild von mem_ry

mem_ryvor 1 Jahr

It's either user error, or there's too much acceleration implemented into the motor that controls the wheels. Even with the video edited to be sped up, it's easy to tell.. just by how much minor adjustments go into the bot's placement, to pick up the box.

Ähnliche Videos

Very impressed by the new Tesla Optimus end2end skill learning video! Our TRILL work ( spills some secret sauce: 1. VR teleoperation, 2. deep imitation learning, 3. real-time whole-body control. It's all open-source! Dive in if you're into humanoids! 👾

Very impressed by the new Tesla Optimus end2end skill learning video! Our TRILL work ( spills some secret sauce: 1. VR teleoperation, 2. deep imitation learning, 3. real-time whole-body control. It's all open-source! Dive in if you're into humanoids! 👾

Yuke Zhu

50,680 Aufrufe • vor 3 Jahren

🔥 JUST IN: Open-source robotics dataset from 100% real-world scenarios! 🤯 Chinese robotics company AGIBOT just released AGIBOT WORLD 2026, an open-source dataset systematically covering key embodied AI research directions. Built entirely from real-world environments: commercial spaces, and homes. Collected using AGIBOT G2 robots in free-form collection mode, providing structured, accurately annotated, high-quality data. Digital twin technology creates 1:1 scale replicas in simulation matching the real environments. Both real-world and simulation data are open-sourced. The AGIBOT G2 platform collects multiple data types simultaneously: RGB(D) cameras, tactile sensors, force sensors, LiDAR, IMU, and full-body joint states. Whole-body control coordinates arms, waist, and hands for complex tasks. First-person teleoperation lets operators control the robot from its perspective. The tasks covered are fine-grained manipulation, ultra-long-horizon tasks, spatial navigation, dual-arm coordination, and multi-agent/human-robot collaboration. The dataset includes error-recovery trajectories with annotations. Most datasets only show successful demonstrations. AGIBOT includes failures and how the robot recovers, teaching models how to handle mistakes. After collection, data is tested through policy training and real-robot deployment to ensure quality. Then processed through industrial quality control with multiple screening and cleaning rounds. Making it open-source accelerates embodied AI research by giving researchers access to high-quality real-world robot data at scale. 🇨🇳 Learn more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

🔥 JUST IN: Open-source robotics dataset from 100% real-world scenarios! 🤯 Chinese robotics company AGIBOT just released AGIBOT WORLD 2026, an open-source dataset systematically covering key embodied AI research directions. Built entirely from real-world environments: commercial spaces, and homes. Collected using AGIBOT G2 robots in free-form collection mode, providing structured, accurately annotated, high-quality data. Digital twin technology creates 1:1 scale replicas in simulation matching the real environments. Both real-world and simulation data are open-sourced. The AGIBOT G2 platform collects multiple data types simultaneously: RGB(D) cameras, tactile sensors, force sensors, LiDAR, IMU, and full-body joint states. Whole-body control coordinates arms, waist, and hands for complex tasks. First-person teleoperation lets operators control the robot from its perspective. The tasks covered are fine-grained manipulation, ultra-long-horizon tasks, spatial navigation, dual-arm coordination, and multi-agent/human-robot collaboration. The dataset includes error-recovery trajectories with annotations. Most datasets only show successful demonstrations. AGIBOT includes failures and how the robot recovers, teaching models how to handle mistakes. After collection, data is tested through policy training and real-robot deployment to ensure quality. Then processed through industrial quality control with multiple screening and cleaning rounds. Making it open-source accelerates embodied AI research by giving researchers access to high-quality real-world robot data at scale. 🇨🇳 Learn more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

40,583 Aufrufe • vor 5 Monaten

Open-source robot arm meets hand tracking [📍GitHub below] It is designed with an industrial mindset but built as a 3D-printed desktop system. PAROL6 paired with a LEAP Motion controller is a nice example of how accessible robot teleoperation has become. • Hand motion is streamed to the robot at 100 Hz via UDP • A pneumatic gripper is controlled by simple fist open and close gestures • The entire robot stack is open source, from mechanics to control software Combine that with low-latency hand tracking and you get a very practical platform for learning manipulation, teleoperation, and human-robot interfaces. This kind of setup is great for experimentation, teleop, data collection, and teaching robots by demonstration All without proprietary hardware or locked software. Credit to SourceRobotics 📍Code: —— Weekly robotics and AI insights. Subscribe free:

Open-source robot arm meets hand tracking [📍GitHub below] It is designed with an industrial mindset but built as a 3D-printed desktop system. PAROL6 paired with a LEAP Motion controller is a nice example of how accessible robot teleoperation has become. • Hand motion is streamed to the robot at 100 Hz via UDP • A pneumatic gripper is controlled by simple fist open and close gestures • The entire robot stack is open source, from mechanics to control software Combine that with low-latency hand tracking and you get a very practical platform for learning manipulation, teleoperation, and human-robot interfaces. This kind of setup is great for experimentation, teleop, data collection, and teaching robots by demonstration All without proprietary hardware or locked software. Credit to SourceRobotics 📍Code: —— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

32,269 Aufrufe • vor 5 Tagen

Happening now at #NVIDIAGTC: Generalist’s GEN-0 model autonomously packing phones on Universal Robots arms in our first public demo. To move robotics beyond the lab, systems need to operate in real time on industrial hardware. See the demo below, and stop by booth #1840 👇🤖

Happening now at #NVIDIAGTC: Generalist’s GEN-0 model autonomously packing phones on Universal Robots arms in our first public demo. To move robotics beyond the lab, systems need to operate in real time on industrial hardware. See the demo below, and stop by booth #1840 👇🤖

Generalist

34,657 Aufrufe • vor 6 Monaten

Let’s think about humanoid robots outside carrying the box. How about having the humanoid come out the door, interact with humans, and even dance? Introducing Expressive Whole-Body Control for Humanoid Robots: See how our robot performs rich, diverse, and expressive motions in the real world 👇🧵

Let’s think about humanoid robots outside carrying the box. How about having the humanoid come out the door, interact with humans, and even dance? Introducing Expressive Whole-Body Control for Humanoid Robots: See how our robot performs rich, diverse, and expressive motions in the real world 👇🧵

Xiaolong Wang

309,342 Aufrufe • vor 2 Jahren

Robotics: coding agents’ next frontier. So how good are they? We introduce CaP-X: an open-source framework and benchmark for coding agents, where they write code for robot perception and control, execute it on sim and real robots, observe the outcomes, and iteratively improve code reliability. From NVIDIA Berkeley AI Research CMU Robotics Institute Stanford AI Lab 🧵

Robotics: coding agents’ next frontier. So how good are they? We introduce CaP-X: an open-source framework and benchmark for coding agents, where they write code for robot perception and control, execute it on sim and real robots, observe the outcomes, and iteratively improve code reliability. From NVIDIA Berkeley AI Research CMU Robotics Institute Stanford AI Lab 🧵

Max Fu

179,607 Aufrufe • vor 5 Monaten

Live from World Robot Conference 2026 in Beijing: ROBOTERA is showcasing teleoperation of the XHAND 1 Pro dexterous hand with MANUS™ gloves. Video 1: a ROBOTERA operator demonstrates high-precision teleoperation. Video 2: a visitor tries the setup without first running a user-specific calibration, yet the teleoperation remains stable, smooth, and responsive. With 21 active degrees of freedom, fully direct-drive actuation, and integrated tactile sensing, XHAND 1 Pro is built for advanced robotic manipulation and embodied intelligence research. MANUS provides high-fidelity, low-latency hand motion data as real-time input for robot control. #WRC2026 #robotics #humanoids #teleoperation #PhysicalAI

Live from World Robot Conference 2026 in Beijing: ROBOTERA is showcasing teleoperation of the XHAND 1 Pro dexterous hand with MANUS™ gloves. Video 1: a ROBOTERA operator demonstrates high-precision teleoperation. Video 2: a visitor tries the setup without first running a user-specific calibration, yet the teleoperation remains stable, smooth, and responsive. With 21 active degrees of freedom, fully direct-drive actuation, and integrated tactile sensing, XHAND 1 Pro is built for advanced robotic manipulation and embodied intelligence research. MANUS provides high-fidelity, low-latency hand motion data as real-time input for robot control. #WRC2026 #robotics #humanoids #teleoperation #PhysicalAI

MANUS™

11,998 Aufrufe • vor 1 Monat

A high-quality haptic control for robots as a weekend project? All for under $600. [📍 Save Github & arXiv for later] A team built DOGlove, an open-source haptic glove for robot teleoperation that you can assemble yourself for under $600. It is built for real control, not demos. • Tracks 21 degrees of freedom with a custom joint design • Provides cable-driven force feedback plus fingertip haptics • Can be used to collect data for imitation learning Affordable haptics could make teleoperation more reliable and improve the quality of data we use to train physical AI. Project link: Credit: DOGlove team, shared by Han Zhang —- Weekly robotics and AI insights. Subscribe free:

A high-quality haptic control for robots as a weekend project? All for under $600. [📍 Save Github & arXiv for later] A team built DOGlove, an open-source haptic glove for robot teleoperation that you can assemble yourself for under $600. It is built for real control, not demos. • Tracks 21 degrees of freedom with a custom joint design • Provides cable-driven force feedback plus fingertip haptics • Can be used to collect data for imitation learning Affordable haptics could make teleoperation more reliable and improve the quality of data we use to train physical AI. Project link: Credit: DOGlove team, shared by Han Zhang —- Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

18,290 Aufrufe • vor 8 Monaten

🚀Exciting News! We’re thrilled to introduce OpenWBT — the open-source, whole-body VR teleoperation system designed for humanoid across various robot types & virtual/physical worlds! 🤖✨ 💡Developed through collaboration between Galbot and Tsinghua University researchers! 🔥 Why it’s cool? ✅ Multi-robot support – Control different types of bots with one system! ✅ Cross virtual & real worlds – Operate bots seamlessly in simulator and the physical world. ✅ Built for YOU – Quick deployment with only a laptop and a VR headset, and create like never before! 💡 Calling all robot lovers & devs! Download, experiment, and help shape the future of robotics. Let’s #BuildTheFuture together! 🔗 Grab it now: GitHub： Welcome to our website： #OpenWBT #Robotics #OpenSource #Innovation #HumanoidRobots

🚀Exciting News! We’re thrilled to introduce OpenWBT — the open-source, whole-body VR teleoperation system designed for humanoid across various robot types & virtual/physical worlds! 🤖✨ 💡Developed through collaboration between Galbot and Tsinghua University researchers! 🔥 Why it’s cool? ✅ Multi-robot support – Control different types of bots with one system! ✅ Cross virtual & real worlds – Operate bots seamlessly in simulator and the physical world. ✅ Built for YOU – Quick deployment with only a laptop and a VR headset, and create like never before! 💡 Calling all robot lovers & devs! Download, experiment, and help shape the future of robotics. Let’s #BuildTheFuture together! 🔗 Grab it now: GitHub： Welcome to our website： #OpenWBT #Robotics #OpenSource #Innovation #HumanoidRobots

Galbot

38,650 Aufrufe • vor 1 Jahr

In the last month, we’ve been building an open-source framework for robot learning and sim-to-real transfer, made for RL whole-body control from simple walking to complex human imitation Check out the details on HN: Get started in 5 minutes ⬇️

In the last month, we’ve been building an open-source framework for robot learning and sim-to-real transfer, made for RL whole-body control from simple walking to complex human imitation Check out the details on HN: Get started in 5 minutes ⬇️

K-Scale Labs

75,983 Aufrufe • vor 1 Jahr

🔥 #ICRA2026 Best Paper Finalist The era of "robot VLA = single-arm gripper" is ending. Introducing Dexora — the first open-source Vision-Language-Action system for dual-arm, dual-hand, 36-DoF dexterous manipulation. 🦾 Dual Arms 🖐️ Dual Hands 🎯 36 DoF Control 🌍 Open Source Trained on: • 100K simulated trajectories • 10K real-world demonstrations Dexora achieves: ✓ 90%+ success on basic manipulation ✓ Strong dexterous manipulation performance ✓ Cross-embodiment generalization Our key hypothesis: Train on the hardest embodiment. Transfer to simpler robots later. Instead of scaling up gripper policies, we train directly in the most expressive action space and project downward to simpler embodiments. This may be a practical path toward universal robot controllers. 🎥 Demos: 📄 Paper:

🔥 #ICRA2026 Best Paper Finalist The era of "robot VLA = single-arm gripper" is ending. Introducing Dexora — the first open-source Vision-Language-Action system for dual-arm, dual-hand, 36-DoF dexterous manipulation. 🦾 Dual Arms 🖐️ Dual Hands 🎯 36 DoF Control 🌍 Open Source Trained on: • 100K simulated trajectories • 10K real-world demonstrations Dexora achieves: ✓ 90%+ success on basic manipulation ✓ Strong dexterous manipulation performance ✓ Cross-embodiment generalization Our key hypothesis: Train on the hardest embodiment. Transfer to simpler robots later. Instead of scaling up gripper policies, we train directly in the most expressive action space and project downward to simpler embodiments. This may be a practical path toward universal robot controllers. 🎥 Demos: 📄 Paper:

Hao Zhao

17,474 Aufrufe • vor 3 Monaten

X-Humanoid unveiled TG-VLA, which it calls the world's first whole-body VLA framework for full-size humanoid robots. The goal: move humanoids past "mobile dual-arm systems" to human-like, whole-body coordinated operation. Built on three technologies: - HEX: an open-source full-size humanoid VLA that learns across embodiments and coordinates the whole body. Claimed SOTA on real-world whole-body manipulation - HAF-VLA: hierarchical action flow that decomposes whole-body motion into subtasks. Best or joint-best on 6 benchmarks - DSRL-DCT: online RL for high-DoF humanoids in a compressed latent space. 100% success on mobile manipulation HEX is open-source.

X-Humanoid unveiled TG-VLA, which it calls the world's first whole-body VLA framework for full-size humanoid robots. The goal: move humanoids past "mobile dual-arm systems" to human-like, whole-body coordinated operation. Built on three technologies: - HEX: an open-source full-size humanoid VLA that learns across embodiments and coordinates the whole body. Claimed SOTA on real-world whole-body manipulation - HAF-VLA: hierarchical action flow that decomposes whole-body motion into subtasks. Best or joint-best on 6 benchmarks - DSRL-DCT: online RL for high-DoF humanoids in a compressed latent space. 100% success on mobile manipulation HEX is open-source.

The Humanoid Hub

19,563 Aufrufe • vor 2 Monaten

Xiaomi’s robot just got handed two harder jobs at its EV factory. 🤖 It already hits 98% on self-tapping nut loading. Now it’s sorting large, flexible center-console panels and folding totes — both at 90%. The bigger step isn’t the numbers. It’s the control stack: whole-body reach, bimanual regrasping, active compliance, precise fingertip control, and multi-robot coordination. From one station to several. From doing a task to coordinating with other robots. That’s the real shift.

Xiaomi’s robot just got handed two harder jobs at its EV factory. 🤖 It already hits 98% on self-tapping nut loading. Now it’s sorting large, flexible center-console panels and folding totes — both at 90%. The bigger step isn’t the numbers. It’s the control stack: whole-body reach, bimanual regrasping, active compliance, precise fingertip control, and multi-robot coordination. From one station to several. From doing a task to coordinating with other robots. That’s the real shift.

RoboHub🤖

29,854 Aufrufe • vor 2 Monaten

We might be solving the wrong problem in robotics. That’s what this makes clear. UMI → Universal Manipulation Interface A simple $400 gripper that lets you teach robots by demonstration. You hold it like a tool. Show the task. The robot learns. No teleoperation. No expensive hardware. No robot-specific data. Stanford open-sourced everything → hardware, code, datasets. What stands out to me is the bottleneck. Not algorithms. Data. Teleoperation → ~35 demos/hour UMI → ~111 demos/hour And the data transfers across robots → UR5, Franka, others. The design is surprisingly practical: → GoPro fisheye lens (155° FOV) + mirrors for depth → SLAM + IMU for precise 6DoF tracking → latency matching for dynamic tasks → diffusion policies for multimodal actions Then it scales. Cheng Chi takes this further with Sunday Robotics (with Tony Zhao). A $200 glove → deployed in 500+ homes → ~10 million real-world interactions. Not lab data. Real human behavior. Their robot learns dishes, laundry, espresso → with zero robot-specific data. This is where the shift becomes obvious. From training robots in controlled environments → to learning directly from humans at scale So here’s the real question: Will robotics be unlocked by better models… or by unlocking data? #ArtificialIntelligence #Robotics #AI #Innovation #FutureOfWork

We might be solving the wrong problem in robotics. That’s what this makes clear. UMI → Universal Manipulation Interface A simple $400 gripper that lets you teach robots by demonstration. You hold it like a tool. Show the task. The robot learns. No teleoperation. No expensive hardware. No robot-specific data. Stanford open-sourced everything → hardware, code, datasets. What stands out to me is the bottleneck. Not algorithms. Data. Teleoperation → ~35 demos/hour UMI → ~111 demos/hour And the data transfers across robots → UR5, Franka, others. The design is surprisingly practical: → GoPro fisheye lens (155° FOV) + mirrors for depth → SLAM + IMU for precise 6DoF tracking → latency matching for dynamic tasks → diffusion policies for multimodal actions Then it scales. Cheng Chi takes this further with Sunday Robotics (with Tony Zhao). A $200 glove → deployed in 500+ homes → ~10 million real-world interactions. Not lab data. Real human behavior. Their robot learns dishes, laundry, espresso → with zero robot-specific data. This is where the shift becomes obvious. From training robots in controlled environments → to learning directly from humans at scale So here’s the real question: Will robotics be unlocked by better models… or by unlocking data? #ArtificialIntelligence #Robotics #AI #Innovation #FutureOfWork

Pascal Bornet

186,774 Aufrufe • vor 5 Monaten

Physics AI 🌊 Jensen just unveiled the NVIDIA Isaac GR00T Reference Humanoid Robot at GTC Taipei--the world’s first open-source humanoid robot reference design Built on Jetson Thor edge computing and the Isaac GR00T open platform, it features a Unitree H2 Plus body with Sharpa five-finger dexterous hands and 75 degrees of freedom. Even before Physical AI truly explodes, NVIDIA has built a complete end-to-end full-stack infrastructure: >chips (Jetson Thor + Blackwell), >synthetic data (GR00T-Dreams), >world models (Cosmos), >foundation models (GR00T N-series VLA), >high-fidelity simulation platforms (Isaac Sim + Isaac Lab + Omniverse). Dozens of humanoid robot companies ,including Agility Robotics, Aglie robotics,Boston Dynamics, Figure, 1X, NEURA Robotics, XPENG Robotics, and more are already running large-scale daily simulation training on this platform, rapidly iterating perception, reasoning, and actions in virtual environments, speeding up the jump from lab prototypes to real factory deployment. By providing an open reference design and full-stack tools, NVIDIA has dramatically lowered the barrier, letting every robotics team join the Physical AI wave with low cost and high efficiency.

Physics AI 🌊 Jensen just unveiled the NVIDIA Isaac GR00T Reference Humanoid Robot at GTC Taipei--the world’s first open-source humanoid robot reference design Built on Jetson Thor edge computing and the Isaac GR00T open platform, it features a Unitree H2 Plus body with Sharpa five-finger dexterous hands and 75 degrees of freedom. Even before Physical AI truly explodes, NVIDIA has built a complete end-to-end full-stack infrastructure: >chips (Jetson Thor + Blackwell), >synthetic data (GR00T-Dreams), >world models (Cosmos), >foundation models (GR00T N-series VLA), >high-fidelity simulation platforms (Isaac Sim + Isaac Lab + Omniverse). Dozens of humanoid robot companies ,including Agility Robotics, Aglie robotics,Boston Dynamics, Figure, 1X, NEURA Robotics, XPENG Robotics, and more are already running large-scale daily simulation training on this platform, rapidly iterating perception, reasoning, and actions in virtual environments, speeding up the jump from lab prototypes to real factory deployment. By providing an open reference design and full-stack tools, NVIDIA has dramatically lowered the barrier, letting every robotics team join the Physical AI wave with low cost and high efficiency.

CyberRobo

17,092 Aufrufe • vor 3 Monaten

A first look at the Forma RaaS Control Interface in action. Live robot state visualization, joint-level control, and task orchestration for 6-DoF arms - all running through a single, web-native dashboard. This control layer is fundamental to Robotics-as-a-Service. It’s what turns robots into remotely accessible, observable, and controllable resources rather than isolated machines. Teach tasks visually, monitor execution in real time, fall back to teleop when needed, and iterate live - without being on-site. This is how decentralized RaaS starts to work in practice.

A first look at the Forma RaaS Control Interface in action. Live robot state visualization, joint-level control, and task orchestration for 6-DoF arms - all running through a single, web-native dashboard. This control layer is fundamental to Robotics-as-a-Service. It’s what turns robots into remotely accessible, observable, and controllable resources rather than isolated machines. Teach tasks visually, monitor execution in real time, fall back to teleop when needed, and iterate live - without being on-site. This is how decentralized RaaS starts to work in practice.

Forma Robotics

40,274 Aufrufe • vor 9 Monaten

Another robot from Disney! 🕺🏻 Just look at this dancing fella created by Disney Research. Creating control policies that work on real robots and handling diverse, unseen motions in physics-based character control is still difficult. The Disney team proposes a two-state solution. The first step involves learning a latent space encoding with an autoencoder. After encoding, the policy is trained to map kinematic input to dynamic output, ensuring accurate and adaptable movement. This method eliminates common mode collapse issues and improves motion encoding by separating these stages. This technique has proven effective in real robots in simulations, marking a significant leap forward in robot control. Can't wait for it in action live in 2025 :) ~~~ RT to help 1 robot find a new workplace.

Another robot from Disney! 🕺🏻 Just look at this dancing fella created by Disney Research. Creating control policies that work on real robots and handling diverse, unseen motions in physics-based character control is still difficult. The Disney team proposes a two-state solution. The first step involves learning a latent space encoding with an autoencoder. After encoding, the policy is trained to map kinematic input to dynamic output, ensuring accurate and adaptable movement. This method eliminates common mode collapse issues and improves motion encoding by separating these stages. This technique has proven effective in real robots in simulations, marking a significant leap forward in robot control. Can't wait for it in action live in 2025 :) ~~~ RT to help 1 robot find a new workplace.

Lukas Ziegler

65,972 Aufrufe • vor 1 Jahr

🚀 Robots on Sui: • Rent & crypto-tip robots • Remote control across continents 🌍 via low-latency Sui tunnels • Confidentially store telemetry, activity & footage on Walrus • Identity + reputation scores for robo agents • Monetize data with Seal • Fractional robot ownership 🤖 • Trustless coordination & custom Move contracts, Sui objects and programmable txns let you build on top of other giants (I expect someone to build a patrol or companion startup with shareable and modular logic) • Schools: replay history for parents + Lego-style courses with programmable robots. A new way to teach robotics & programming early. Future = robots + Sui And it’s real, happening now in 🇰🇷

🚀 Robots on Sui: • Rent & crypto-tip robots • Remote control across continents 🌍 via low-latency Sui tunnels • Confidentially store telemetry, activity & footage on Walrus • Identity + reputation scores for robo agents • Monetize data with Seal • Fractional robot ownership 🤖 • Trustless coordination & custom Move contracts, Sui objects and programmable txns let you build on top of other giants (I expect someone to build a patrol or companion startup with shareable and modular logic) • Schools: replay history for parents + Lego-style courses with programmable robots. A new way to teach robotics & programming early. Future = robots + Sui And it’s real, happening now in 🇰🇷

Kostas Kryptos

30,125 Aufrufe • vor 1 Jahr

Today, we’re introducing KinetIQ, our own AI framework for end-to-end orchestration of humanoid robot fleets. One system, multiple robot embodiments. Industrial, service and home environments coordinated in real time. The framework consists of 4 cognitive layers: from high-level task allocation and workflow optimisation down to VLA-based task execution and RL-trained whole-body control. Watch how KinetIQ runs both our wheeled and bipedal robots. Read more on our blog:

Today, we’re introducing KinetIQ, our own AI framework for end-to-end orchestration of humanoid robot fleets. One system, multiple robot embodiments. Industrial, service and home environments coordinated in real time. The framework consists of 4 cognitive layers: from high-level task allocation and workflow optimisation down to VLA-based task execution and RL-trained whole-body control. Watch how KinetIQ runs both our wheeled and bipedal robots. Read more on our blog:

Humanoid

23,975 Aufrufe • vor 7 Monaten

Robots might learn better from video than from language! 📼 Most Vision-Language-Action (VLA) models learn what to do from text, but still struggle with how things move in the real world. That makes them data-hungry and slow to train. mimic video takes a different route. Instead of grounding robot control in text, it grounds it in video, using large pre-trained video models that already capture physical motion and dynamics. The idea is straightforward: let the video model handle “what will happen next,” and let a smaller control model focus only on turning that visual plan into robot actions. The result is big gains in practice. Robots trained this way need 10× less data, converge twice as fast, and perform better on both simulated benchmarks and real bimanual manipulation tasks. If robots can “imagine” motion using video, control becomes a much simpler problem. Shoutout to Jonas Pai, Liam Achenbach, Oier Mees, Elvis Nava and the rest of the team! Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Robots might learn better from video than from language! 📼 Most Vision-Language-Action (VLA) models learn what to do from text, but still struggle with how things move in the real world. That makes them data-hungry and slow to train. mimic video takes a different route. Instead of grounding robot control in text, it grounds it in video, using large pre-trained video models that already capture physical motion and dynamics. The idea is straightforward: let the video model handle “what will happen next,” and let a smaller control model focus only on turning that visual plan into robot actions. The result is big gains in practice. Robots trained this way need 10× less data, converge twice as fast, and perform better on both simulated benchmarks and real bimanual manipulation tasks. If robots can “imagine” motion using video, control becomes a much simpler problem. Shoutout to Jonas Pai, Liam Achenbach, Oier Mees, Elvis Nava and the rest of the team! Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

50,090 Aufrufe • vor 9 Monaten