正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Robots struggle with strict action rules…memory and symbols help them learn fast. [Project + Full video link ⬇️] Robots struggle when tasks require specific steps in a fixed order. What if memory helped them think symbolically and learn faster? Solving tasks like unlocking a door then opening it is... hard for deep RL. But by learning constraint relationships and storing them in memory, robots can solve these tasks much faster; with fewer trials and less training. Why it works ✅ Learns symbolic rules about action constraints ✅ Uses memory to transfer what it learned across tasks ✅ Handles real-world exploration with just 30 minutes of data ✅ Needs 10x fewer episodes than deep RL approaches This memory-based method shows a promising path forward for robots learning structured, real-world tasks. Full video: Paper: Thank you, Mrinal Verghese for sharing this amazing work! 🙏show more

Ilir Aliu - eu/acc

6,378 subscribers

10,241 次观看 • 1 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Can robots learn without training❓ [𝗜𝘁'𝘀 𝗼𝗽𝗲𝗻 𝘀𝗼𝘂𝗿𝗰𝗲𝗱 ⬇ ] Teaching robots to do complex tasks WITHOUT spending hours training them. Sounds cool, right? That's exactly what DIAL-MPC does! The first training-free method for whole-body torque control using full-order dynamics: ✅ Instantly checks if a robot's moves are right or wrong ✅ Adapts quickly to new tasks without needing extra training ✅ Could work hand-in-hand with other robot learning methods Robots are getting smarter AND faster without the need for long training sessions. Website: Paper: Code: Saw this first Haoru Xue ✈️ CVPR 🙏

Can robots learn without training❓ [𝗜𝘁'𝘀 𝗼𝗽𝗲𝗻 𝘀𝗼𝘂𝗿𝗰𝗲𝗱 ⬇ ] Teaching robots to do complex tasks WITHOUT spending hours training them. Sounds cool, right? That's exactly what DIAL-MPC does! The first training-free method for whole-body torque control using full-order dynamics: ✅ Instantly checks if a robot's moves are right or wrong ✅ Adapts quickly to new tasks without needing extra training ✅ Could work hand-in-hand with other robot learning methods Robots are getting smarter AND faster without the need for long training sessions. Website: Paper: Code: Saw this first Haoru Xue ✈️ CVPR 🙏

Ilir Aliu

71,502 次观看 • 1 年前

Robotics keeps hitting the same wall. Single task RL works, but... it does not scale to hundreds of tasks or new embodiments. This new paper looks like a real step toward fixing that. The team introduces MMBench, a benchmark with 200 tasks across many domains and robots, and Newt, a language conditioned world model trained online across all 200 tasks at once. The simple idea behind Newt: The model learns from demos to get the right priors It trains across many tasks through online interaction It uses language to ground the goal It adapts fast when a new task shows up What stood out to me: ✅ One model trained on 200 tasks at the same time ✅ Language conditioned control for both states and RGB ✅ Better data efficiency than strong baselines ✅ Strong open loop control ✅ Fast adaptation to new tasks and embodiments ✅ Full release of 200 checkpoints, 4000 demos, code, and benchmark This is a good push toward general control instead of one model per task. If you want the full paper: Project page: —- Weekly robotics and AI insights. Subscribe free:

Robotics keeps hitting the same wall. Single task RL works, but... it does not scale to hundreds of tasks or new embodiments. This new paper looks like a real step toward fixing that. The team introduces MMBench, a benchmark with 200 tasks across many domains and robots, and Newt, a language conditioned world model trained online across all 200 tasks at once. The simple idea behind Newt: The model learns from demos to get the right priors It trains across many tasks through online interaction It uses language to ground the goal It adapts fast when a new task shows up What stood out to me: ✅ One model trained on 200 tasks at the same time ✅ Language conditioned control for both states and RGB ✅ Better data efficiency than strong baselines ✅ Strong open loop control ✅ Fast adaptation to new tasks and embodiments ✅ Full release of 200 checkpoints, 4000 demos, code, and benchmark This is a good push toward general control instead of one model per task. If you want the full paper: Project page: —- Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

70,090 次观看 • 7 个月前

How can non-experts quickly teach robots a variety of tasks? Introducing HAND ✋, a simple, time-efficient method of training robots! Using just a **single hand demo**, HAND learns manipulation tasks in under **4 minutes**! 🧵

How can non-experts quickly teach robots a variety of tasks? Introducing HAND ✋, a simple, time-efficient method of training robots! Using just a single hand demo, HAND learns manipulation tasks in under 4 minutes! 🧵

Jesse Zhang

31,995 次观看 • 1 年前

How can robots reliably place objects in diverse real-world tasks? 🤖🔍 Placement is tough—objects vary in shape and placement modes (such as stacking, hanging, and insertion), making it a challenging problem. We introduce AnyPlace, a two-stage method trained purely on synthetic data to predict diverse placement poses of unseen objects for real-world tasks. Read on for more👇

How can robots reliably place objects in diverse real-world tasks? 🤖🔍 Placement is tough—objects vary in shape and placement modes (such as stacking, hanging, and insertion), making it a challenging problem. We introduce AnyPlace, a two-stage method trained purely on synthetic data to predict diverse placement poses of unseen objects for real-world tasks. Read on for more👇

Animesh Garg

25,378 次观看 • 1 年前

Introducing CQN: Coarse-to-fine Q-Network, a value-based RL algorithm for continuous control🦾Initialized with 20~50 demonstrations, it learns to solve real-world robotic tasks within 10 mins of training, without any pre-training and shaped rewards! (1/4)

Introducing CQN: Coarse-to-fine Q-Network, a value-based RL algorithm for continuous control🦾Initialized with 20~50 demonstrations, it learns to solve real-world robotic tasks within 10 mins of training, without any pre-training and shaped rewards! (1/4)

Younggyo Seo

16,413 次观看 • 2 年前

RL is back! But is it always the best choice? In a new paper, we investigate under what circumstances neuroevolution outperforms RL in transfer learning tasks. See more details in the thread below 🧵 While NE performs best in simpler domains, it will be interesting to see if the lessons learned here can also be applied to more complex systems/tasks (LLMs?).

RL is back! But is it always the best choice? In a new paper, we investigate under what circumstances neuroevolution outperforms RL in transfer learning tasks. See more details in the thread below 🧵 While NE performs best in simpler domains, it will be interesting to see if the lessons learned here can also be applied to more complex systems/tasks (LLMs?).

Sebastian Risi

11,130 次观看 • 11 个月前

Spatial AI ( is building large real-world datasets to teach robots how to navigate the world and complete tasks. Their first open source dataset, SEA (Spatial Everyday Activities), is the largest curated egocentric dataset of people carrying out real tasks, with 10,000 hours of data.

Spatial AI ( is building large real-world datasets to teach robots how to navigate the world and complete tasks. Their first open source dataset, SEA (Spatial Everyday Activities), is the largest curated egocentric dataset of people carrying out real tasks, with 10,000 hours of data.

Y Combinator

20,944 次观看 • 7 个月前

Memo is a robot that uses AI to perform household tasks effectively. Today Sunday announced its Series B, and we’re proud to be investors. Training robots for the home is hard — the environment is messy, dynamic, and full of edge cases. So Sunday is training robots directly on real households. Founders Tony Zhao and Cheng Chi built a glove-based system that lets hundreds of contributors record everyday tasks in their own homes, creating high-fidelity demonstrations that feed directly into robot learning. Home robotics will be defined by the companies that learn fastest from real homes. Sunday is building that loop. More here: Aaref Hilaly Amanda Huang

Memo is a robot that uses AI to perform household tasks effectively. Today Sunday announced its Series B, and we’re proud to be investors. Training robots for the home is hard — the environment is messy, dynamic, and full of edge cases. So Sunday is training robots directly on real households. Founders Tony Zhao and Cheng Chi built a glove-based system that lets hundreds of contributors record everyday tasks in their own homes, creating high-fidelity demonstrations that feed directly into robot learning. Home robotics will be defined by the companies that learn fastest from real homes. Sunday is building that loop. More here: Aaref Hilaly Amanda Huang

Bain Capital Ventures

21,327 次观看 • 3 个月前

Congratulations also to Patrick 👍 for his #ICLR paper on Temporal Difference (TD) learning , in it We solve the decades-old puzzle of why TD can solve complex RL tasks that Gradient Descent cannot.

Congratulations also to Patrick 👍 for his #ICLR paper on Temporal Difference (TD) learning , in it We solve the decades-old puzzle of why TD can solve complex RL tasks that Gradient Descent cannot.

Thuerey Group at TUM

22,074 次观看 • 1 年前

Humanoid Robots finally stopped “turning around and forgetting everything” 🧠🤖 Alibaba DAMO Academy today open-sourced RynnBrain:the world's first truly embodied brain model with spatiotemporal memory. Interrupted tasks? Even after being interrupted, it can accurately recall where things were moved, predict trajectories… /🧵

Humanoid Robots finally stopped “turning around and forgetting everything” 🧠🤖 Alibaba DAMO Academy today open-sourced RynnBrain:the world's first truly embodied brain model with spatiotemporal memory. Interrupted tasks? Even after being interrupted, it can accurately recall where things were moved, predict trajectories… /🧵

CyberRobo

11,638 次观看 • 4 个月前

Turns out the "IDE but for notes and tasks" is also becoming my... IDE! More and more I just make notes and boards with specs of what needs to be built, connect a bunch of code agents to thymer all working in parallel, have them pick up open tasks, build it and update progress back in the notes.

Turns out the "IDE but for notes and tasks" is also becoming my... IDE! More and more I just make notes and boards with specs of what needs to be built, connect a bunch of code agents to thymer all working in parallel, have them pick up open tasks, build it and update progress back in the notes.

Wim Cools

28,299 次观看 • 4 个月前

Stop endless app switching. You can now ask Gemini to complete complex tasks for you across two apps - with one prompt. Look up a location on Maps AND text it to a friend. Ask a question about a video AND save it to notes. What two-in-one tasks will you be asking Gemini?

Stop endless app switching. You can now ask Gemini to complete complex tasks for you across two apps - with one prompt. Look up a location on Maps AND text it to a friend. Ask a question about a video AND save it to notes. What two-in-one tasks will you be asking Gemini?

Android

183,847 次观看 • 1 年前

System ID for legged robots is hard: (1) Discontinuous dynamics and (2) many parameters to identify and hard to "excite" them. SPI-Active is a general tool for legged robot system ID. Key ideas: (1) massively parallel sampling-based optimization, (2) structured parameter space, and (3) active exploration based on Fisher Information to collect the most informative data in real. SPI-Active provides an accurate robot model and effectively reduces the sim2real gap. In sim2real policy learning setting, it outperforms baselines by 42-63% in various quadruped & humanoid tasks. Led by Nikhil Sobanbabu Guanqi He

System ID for legged robots is hard: (1) Discontinuous dynamics and (2) many parameters to identify and hard to "excite" them. SPI-Active is a general tool for legged robot system ID. Key ideas: (1) massively parallel sampling-based optimization, (2) structured parameter space, and (3) active exploration based on Fisher Information to collect the most informative data in real. SPI-Active provides an accurate robot model and effectively reduces the sim2real gap. In sim2real policy learning setting, it outperforms baselines by 42-63% in various quadruped & humanoid tasks. Led by Nikhil Sobanbabu Guanqi He

Guanya Shi

21,442 次观看 • 1 年前

RoboBallet: End of Manual Robot Programming Google DeepMind/Intrinsic/UCL just cracked multi-robot coordination. Published in Science Robotics. 🤖What it does: – 8 robots, 40 tasks, zero collisions - all planned in seconds – 25% better motion plans than expert-designed solutions – 60% faster task completion when scaling from 4 to 8 robots – Works on factory layouts, it's never seen 👩‍💻 The tech: – Graph Neural Networks map robots/obstacles as connected nodes – Reinforcement learning trains on millions of scenarios – No manual programming required - just give it CAD files and tasks ❓Question: The bottleneck to robot collaboration has always been manual prototyping. Now that we can automate the automation what will this unlock?

RoboBallet: End of Manual Robot Programming Google DeepMind/Intrinsic/UCL just cracked multi-robot coordination. Published in Science Robotics. 🤖What it does: – 8 robots, 40 tasks, zero collisions - all planned in seconds – 25% better motion plans than expert-designed solutions – 60% faster task completion when scaling from 4 to 8 robots – Works on factory layouts, it's never seen 👩‍💻 The tech: – Graph Neural Networks map robots/obstacles as connected nodes – Reinforcement learning trains on millions of scenarios – No manual programming required - just give it CAD files and tasks ❓Question: The bottleneck to robot collaboration has always been manual prototyping. Now that we can automate the automation what will this unlock?

Jack 🤖

41,633 次观看 • 10 个月前