正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

We present ClutterGen that tackles two important research problems in robotics: 1) how to generate physically compliant cluttered scene for robot learning? 2) how to stably place objects instead of the current "pick and drop" paradigm? Our key idea is to formulate physically compliant cluttered scene generation as a... sequential object placement problem, such that we can look at scene generation as a reinforcement learning problem. The learned environment generator can be easily applied to solve truly "pick and place" tasks. Our robot can figure out how to place an object in a stable manner into a cluttered environment. Please check out our project website with video, code, and paper to learn more! Great work done w/ Yinsen Jia at Duke General Robotics Lab (show more

Boyuan Chen

2,185 subscribers

20,715 次观看 • 2 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Robot AI brains, aka Vision-Language-Action models, cannot adapt to new tasks as easily as LLMs like Gemini, ChatGPT, or Grok. LLMs can adapt quickly with their in-context learning (ICL) capabilities. But can we inject ICL abilities into a pre-trained VLA like pi0? Yes! Introducing RICL (Retraining for In-Context Learning), our Conference on Robot Learning (CoRL) 2025 paper. Our RICL-pi0 model can adapt to unseen objects, novel motions, and new scenes with just ICL and RAG (retrieval-augmented generation). RICL-pi0 also boosts performance on the long-tail of tasks. A quick 1 minute video summary:

Robot AI brains, aka Vision-Language-Action models, cannot adapt to new tasks as easily as LLMs like Gemini, ChatGPT, or Grok. LLMs can adapt quickly with their in-context learning (ICL) capabilities. But can we inject ICL abilities into a pre-trained VLA like pi0? Yes! Introducing RICL (Retraining for In-Context Learning), our Conference on Robot Learning (CoRL) 2025 paper. Our RICL-pi0 model can adapt to unseen objects, novel motions, and new scenes with just ICL and RAG (retrieval-augmented generation). RICL-pi0 also boosts performance on the long-tail of tasks. A quick 1 minute video summary:

Kaustubh Sridhar

52,897 次观看 • 1 年前

We open-source Action Images — a new representation that translates 7-DoF robot actions into interpretable images. Video models are emerging as powerful robotic foundation models, but a key challenge remains: how can we seamlessly integrate robot policies into video models? Instead of representing actions as low-dimensional control tokens, Action Images provide a pixel-grounded action representation, reframing policy learning as a visual tracking problem! By unifying observations and actions in the same video space, Action Images enable a unified robotics world model that supports video-action joint generation, action-conditioned video generation, and action labeling! Code: Paper:

We open-source Action Images — a new representation that translates 7-DoF robot actions into interpretable images. Video models are emerging as powerful robotic foundation models, but a key challenge remains: how can we seamlessly integrate robot policies into video models? Instead of representing actions as low-dimensional control tokens, Action Images provide a pixel-grounded action representation, reframing policy learning as a visual tracking problem! By unifying observations and actions in the same video space, Action Images enable a unified robotics world model that supports video-action joint generation, action-conditioned video generation, and action labeling! Code: Paper:

Chuang Gan

21,317 次观看 • 4 个月前

Alert🚨 This could be by far the most impressive video about 4D human motion generation! 🔥🔥🔥 We present TRUMANS, a pioneering and solid effort that scales up 4D human-scene interactions with both static and dynamic objects. With our model, we could eventually generate diverse and physically plausible human motions of any length in the physical 3D world. Cannot stop to wonder how TRUMANS could be adapted to the humanoid robot. Let me know if you are interested! Our paper has been accepted by CVPR24; check our code, demo, and more details in

Alert🚨 This could be by far the most impressive video about 4D human motion generation! 🔥🔥🔥 We present TRUMANS, a pioneering and solid effort that scales up 4D human-scene interactions with both static and dynamic objects. With our model, we could eventually generate diverse and physically plausible human motions of any length in the physical 3D world. Cannot stop to wonder how TRUMANS could be adapted to the humanoid robot. Let me know if you are interested! Our paper has been accepted by CVPR24; check our code, demo, and more details in

Siyuan Huang

13,689 次观看 • 2 年前

Excitement about world-action models and robot learning has never been higher — they promise a way to use human egocentric data to train massive robotics models which can provide the “GPT” moment for robotics and unlock general-purpose embodied intelligence. And yet there’s been little concrete demonstration of scaling in robot learning. Dyna Robotics aims to change that, with an in-depth look at how scaling works as they approach 1 million hours of training data. Jason Ma Tianyu Li Anh-Quan Pham and Chet Bhateja joined us to tell us more. They show that as the amount of data they use in pretraining increased, they saw predictable, statistically significant gains on accuracy metrics on held-out data (data not seen during training). They go on to talk about what they learned, and show how this can be applied to many different problems. Watch Episode #99 of RoboPapers, with Michael Cho - Rbt/Acc Chris Paxton Jiafei Duan today to learn more!

Excitement about world-action models and robot learning has never been higher — they promise a way to use human egocentric data to train massive robotics models which can provide the “GPT” moment for robotics and unlock general-purpose embodied intelligence. And yet there’s been little concrete demonstration of scaling in robot learning. Dyna Robotics aims to change that, with an in-depth look at how scaling works as they approach 1 million hours of training data. Jason Ma Tianyu Li Anh-Quan Pham and Chet Bhateja joined us to tell us more. They show that as the amount of data they use in pretraining increased, they saw predictable, statistically significant gains on accuracy metrics on held-out data (data not seen during training). They go on to talk about what they learned, and show how this can be applied to many different problems. Watch Episode #99 of RoboPapers, with Michael Cho - Rbt/Acc Chris Paxton Jiafei Duan today to learn more!

RoboPapers

26,249 次观看 • 2 个月前

A few months ago we set out to understand exactly how our models can be used to accelerate progress in robotics and other AI systems that don’t just represent the world, but are actually able to interact with it. We’ve been collaborating with leading companies in the space and we’ve developed an initial approach that we're now opening up to accelerate development across the industry. Our fifth announcement is GWM Robotics. GWM Robotics is a learned simulator that generates synthetic data for scalable robot training and policy evaluation, removing the bottlenecks of physical hardware.

A few months ago we set out to understand exactly how our models can be used to accelerate progress in robotics and other AI systems that don’t just represent the world, but are actually able to interact with it. We’ve been collaborating with leading companies in the space and we’ve developed an initial approach that we're now opening up to accelerate development across the industry. Our fifth announcement is GWM Robotics. GWM Robotics is a learned simulator that generates synthetic data for scalable robot training and policy evaluation, removing the bottlenecks of physical hardware.

Runway

35,040 次观看 • 10 个月前

Excited to finally share Generative Value Learning (GVL), my Google DeepMind project on extracting universal value functions from long-context VLMs via in-context learning! We discovered a simple method to generate zero-shot and few-shot values for 300+ robot tasks and 50+ datasets using SOTA VLMs like Gemini (Try out the demo on our website on your robot video today!) I worked a lot on leveraging foundation models as guidance for robots in my PhD, and to me, this result forges a new frontier in how we can use foundation models for robot learning, given its broad applicability independent of embodiment and task types. Quite excited about how we can build on this work as a community!

Excited to finally share Generative Value Learning (GVL), my Google DeepMind project on extracting universal value functions from long-context VLMs via in-context learning! We discovered a simple method to generate zero-shot and few-shot values for 300+ robot tasks and 50+ datasets using SOTA VLMs like Gemini (Try out the demo on our website on your robot video today!) I worked a lot on leveraging foundation models as guidance for robots in my PhD, and to me, this result forges a new frontier in how we can use foundation models for robot learning, given its broad applicability independent of embodiment and task types. Quite excited about how we can build on this work as a community!

Jason Ma

98,270 次观看 • 1 年前

Modern AI is confined to the digital world. At Skild AI, we are building towards AGI for the real world, unconstrained by robot type or task — a single, omni-bodied brain. Today, we are sharing our journey, starting with early milestones, with more to come in the weeks ahead. Our Mission: Artificial General Intelligence grounded in the physical world. We believe AGI that can truly understand and reason in the real world can only be built through grounding in the physical world. Our Vision: Any robot, Any task, One brain. We tackle robotics in its full generality – building a continually improving, omni-bodied brain that can control any hardware for any task. Who are we? A passionate group of scientists & engineers driven by our shared vision. We have been researching AI and robotics for more than a decade. Our team includes pioneers of self-supervised learning, curiosity-driven exploration, end-to-end sim2real for visual locomotion, dexterous manipulation, learning from human videos, robot parkour, and many more. Many of these works have won awards at top-tier AI and Robotics conferences. Our team has also built production-ready systems at Anduril, Tesla, Nvidia, Meta, Kitty Hawk, Google, Everyday Robotics, and Amazon. Join us in our mission to build the robot brains of tomorrow.

Modern AI is confined to the digital world. At Skild AI, we are building towards AGI for the real world, unconstrained by robot type or task — a single, omni-bodied brain. Today, we are sharing our journey, starting with early milestones, with more to come in the weeks ahead. Our Mission: Artificial General Intelligence grounded in the physical world. We believe AGI that can truly understand and reason in the real world can only be built through grounding in the physical world. Our Vision: Any robot, Any task, One brain. We tackle robotics in its full generality – building a continually improving, omni-bodied brain that can control any hardware for any task. Who are we? A passionate group of scientists & engineers driven by our shared vision. We have been researching AI and robotics for more than a decade. Our team includes pioneers of self-supervised learning, curiosity-driven exploration, end-to-end sim2real for visual locomotion, dexterous manipulation, learning from human videos, robot parkour, and many more. Many of these works have won awards at top-tier AI and Robotics conferences. Our team has also built production-ready systems at Anduril, Tesla, Nvidia, Meta, Kitty Hawk, Google, Everyday Robotics, and Amazon. Join us in our mission to build the robot brains of tomorrow.

Skild AI

386,992 次观看 • 1 年前

Reinforcement learning has unlocked tremendous gains in broader AI and humanoid robot whole body control, but still has yet to deliver strong results for robot manipulation due to the difficulty of capturing tasks in an accurate simulation; one way to fix this is to create complex environments with learned world models. But learning fully within world models is often intractable as powerful world models are computationally too expensive. Instead, Joseph Amigo and Rooholla Khorrambakht propose to break the problem down: into a large-scale world model that can generate forward trajectories, and a lightweight, low-dimensional latent-space model which can approximate local dynamics of a problem, without needing to back-propagate through a heavy global model. What this means: you can do reinforcement learning in this coupled local-global world model, and learn contact rich skills for a robot. To learn more, watch Episode #101 of RoboPapers, with Michael Cho - Rbt/Acc and Jiafei Duan!

Reinforcement learning has unlocked tremendous gains in broader AI and humanoid robot whole body control, but still has yet to deliver strong results for robot manipulation due to the difficulty of capturing tasks in an accurate simulation; one way to fix this is to create complex environments with learned world models. But learning fully within world models is often intractable as powerful world models are computationally too expensive. Instead, Joseph Amigo and Rooholla Khorrambakht propose to break the problem down: into a large-scale world model that can generate forward trajectories, and a lightweight, low-dimensional latent-space model which can approximate local dynamics of a problem, without needing to back-propagate through a heavy global model. What this means: you can do reinforcement learning in this coupled local-global world model, and learn contact rich skills for a robot. To learn more, watch Episode #101 of RoboPapers, with Michael Cho - Rbt/Acc and Jiafei Duan!

RoboPapers

16,866 次观看 • 1 个月前

The holy grail of robotics is to be able to perform previously-unseen, out-of-distribution manipulation tasks “zero shot” in a new environment. NovaFlow proposes an approach which (1) generates a video, (2) computes predicted flow — how points move through the scene — and (3) uses this flow as an objective to generate a motion. Using this procedure, NovaFlow generates motions in unseen scenes, for unseen tasks, and can transfer across embodiments. To learn more, we are joined by Hongyu Li and Jiahui Fu from RAI. Watch Episode #63 of RoboPapers with Chris Paxton and Michael Cho - Rbt/Acc now to learn more!

The holy grail of robotics is to be able to perform previously-unseen, out-of-distribution manipulation tasks “zero shot” in a new environment. NovaFlow proposes an approach which (1) generates a video, (2) computes predicted flow — how points move through the scene — and (3) uses this flow as an objective to generate a motion. Using this procedure, NovaFlow generates motions in unseen scenes, for unseen tasks, and can transfer across embodiments. To learn more, we are joined by Hongyu Li and Jiahui Fu from RAI. Watch Episode #63 of RoboPapers with Chris Paxton and Michael Cho - Rbt/Acc now to learn more!

RoboPapers

21,434 次观看 • 8 个月前

Education is one of the most crucial pillars of our THEMES+ agenda. It is not just a priority for our administration, it is a passion of mine. Education lays the foundation for the future of our children and, ultimately, the growth and development of our society. That’s why we are committed to renovating and reconstructing our schools to meet global standards. We want our educational institutions to be places where children can thrive, learn, and be inspired. Every child deserves access to a conducive learning environment, equipped with the necessary resources to help them excel academically and personally. Together, we are building a brighter future for the next generation, and I am excited to see our children flourish in an environment that encourages learning and innovation.

Education is one of the most crucial pillars of our THEMES+ agenda. It is not just a priority for our administration, it is a passion of mine. Education lays the foundation for the future of our children and, ultimately, the growth and development of our society. That’s why we are committed to renovating and reconstructing our schools to meet global standards. We want our educational institutions to be places where children can thrive, learn, and be inspired. Every child deserves access to a conducive learning environment, equipped with the necessary resources to help them excel academically and personally. Together, we are building a brighter future for the next generation, and I am excited to see our children flourish in an environment that encourages learning and innovation.

Babajide Sanwo-Olu

20,595 次观看 • 1 年前

For decades, we’ve dreamed of robots that can seamlessly step into our world and lend a hand. Today, we take a major stride toward making that dream a reality: Introducing Gemini Robotics 2 from Google DeepMind, the intelligence layer powering the next generation of truly adaptable robots. This major advance unlocks intelligent whole-body control, advanced dexterity, and even multi-robot collaboration 🤯. Ok but... how does a robot actually "think"? Real-world tasks take time and planning. To manage that complexity, our new embodied reasoning model, Gemini Robotics ER 2, acts as the robot’s high-level brain, enhancing the robot’s capabilities to: — Observe the environment — Reason about the actions needed to complete the task — Coordinate with the vision-language-action model to carry out actions — Track progress until the job is done This setup allows robots to execute complex multi-step workflows, self-correct if a step fails, and adapt to completely novel situations. Learn more about Gemini Robotics ER 2 (and our two other brand new models) here:

Google AI

789,272 次观看 • 2 个月前

Human skin plays an important role in how we interact with the world and robustly manipulate objects. It’s not just important when we can’t see things with out eyes, but when we want to pick up something heavy, or apply a very specific amount of force. So, it makes sense to want to give robots skin. Enter DexSkin: a soft, deformable electronic skin which can be applied across different surfaces and used to cover robot hands or fingers. Suzannah Wistreich and Baiyu Shi talk to us about their work building DexSkin, showing how it’s useful for policy learning, including online reinforcement learning, and how it' can be calibrated and policies transferred across sensors. They also open sourced their code and methods for building the sensors. To learn more, watch Episode #88 of RoboPapers now, hosted by Chris Paxton and Jiafei Duan!

Human skin plays an important role in how we interact with the world and robustly manipulate objects. It’s not just important when we can’t see things with out eyes, but when we want to pick up something heavy, or apply a very specific amount of force. So, it makes sense to want to give robots skin. Enter DexSkin: a soft, deformable electronic skin which can be applied across different surfaces and used to cover robot hands or fingers. Suzannah Wistreich and Baiyu Shi talk to us about their work building DexSkin, showing how it’s useful for policy learning, including online reinforcement learning, and how it' can be calibrated and policies transferred across sensors. They also open sourced their code and methods for building the sensors. To learn more, watch Episode #88 of RoboPapers now, hosted by Chris Paxton and Jiafei Duan!

RoboPapers

21,053 次观看 • 3 个月前

What does it take to build a humanoid robot for heavy industrial work? In this interview, KV Thanjavur Bhaaskar, Director of Robotics at AMD, speaks with Sankaet Pathak, CEO of Foundation Robotics, about building robots that can operate reliably in demanding environments and learn in the field. Watch to learn how the broad AMD portfolio can support Foundation’s vision for its next generation of robots:

What does it take to build a humanoid robot for heavy industrial work? In this interview, KV Thanjavur Bhaaskar, Director of Robotics at AMD, speaks with Sankaet Pathak, CEO of Foundation Robotics, about building robots that can operate reliably in demanding environments and learn in the field. Watch to learn how the broad AMD portfolio can support Foundation’s vision for its next generation of robots:

AMD

20,927 次观看 • 11 天前

A flying robot that moves like a snake in the air. 🐍🤖 This multi-jointed aerial robot can bend its body mid-flight and grasp objects with precision. A new generation of drones is going beyond flying they’re learning how to interact with the world. 🎥 Media: JSK Lab at The University of Tokyo ⚠️ This content is shared for informational purposes only. CTO Robotics Media is a media platform and does not own or develop the technology shown. Credit belongs to the original creators. #Robotics #Engineering #Drone #AI

A flying robot that moves like a snake in the air. 🐍🤖 This multi-jointed aerial robot can bend its body mid-flight and grasp objects with precision. A new generation of drones is going beyond flying they’re learning how to interact with the world. 🎥 Media: JSK Lab at The University of Tokyo ⚠️ This content is shared for informational purposes only. CTO Robotics Media is a media platform and does not own or develop the technology shown. Credit belongs to the original creators. #Robotics #Engineering #Drone #AI

CTO ROBOTICS Media

197,980 次观看 • 3 个月前

NEW AXIS TASK GUIDE 👇 Task: Franka, Put the Charger into the Upper Drawer of the Cabinet. Home – Variant A The goal is simple: Open both cabinet drawers, pick up the charger and place it inside the upper drawer. First, pull both drawers completely open so the robot has enough access to the cabinet. Then identify and grab the charger carefully. After that, move the charger toward the upper drawer, not the lower one. Finally, place the charger inside the drawer and complete the task. 🔌 What makes this interesting is that the robot isn’t just moving an object from A to B. It has to understand the environment, drawer positions, object location and the final target before completing the action. This is actually similar to something we do every day opening a drawer, grabbing a charger and putting it away without even thinking about the steps. For a robot, these small actions require learning how different objects interact and how movements need to change depending on the environment. I also like that this task involves multiple actions in sequence, rather than one simple movement. That kind of sequential interaction can be important for robots operating in homes, offices and other real world environments. For me, this is where Axis Robotics becomes interesting, turning everyday human actions into structured robotic training data. Simple household task → complex robotic learning.

NEW AXIS TASK GUIDE 👇 Task: Franka, Put the Charger into the Upper Drawer of the Cabinet. Home – Variant A The goal is simple: Open both cabinet drawers, pick up the charger and place it inside the upper drawer. First, pull both drawers completely open so the robot has enough access to the cabinet. Then identify and grab the charger carefully. After that, move the charger toward the upper drawer, not the lower one. Finally, place the charger inside the drawer and complete the task. 🔌 What makes this interesting is that the robot isn’t just moving an object from A to B. It has to understand the environment, drawer positions, object location and the final target before completing the action. This is actually similar to something we do every day opening a drawer, grabbing a charger and putting it away without even thinking about the steps. For a robot, these small actions require learning how different objects interact and how movements need to change depending on the environment. I also like that this task involves multiple actions in sequence, rather than one simple movement. That kind of sequential interaction can be important for robots operating in homes, offices and other real world environments. For me, this is where Axis Robotics becomes interesting, turning everyday human actions into structured robotic training data. Simple household task → complex robotic learning.

SufianXFN

57,551 次观看 • 1 个月前

Robots can already fold laundry, make espresso, clean kitchens, and assemble things. The harder problem is getting them to do those tasks reliably, for long periods of time, without a human babysitting them. At Startup School 2026, Physical Intelligence cofounder Chelsea Finn explains what it takes to build general-purpose robots that work in the real world. She shares how reinforcement learning pushed robot throughput up 2x, how their systems can run autonomously for hours, and why she believes robotics is entering its GPT era: moving from specialized models toward general-purpose systems that can work across tasks, robots, and environments. 00:00 — The State of Physical Intelligence 01:23 — What It Takes to Make Robots Useful 05:11 — The Reliability Problem 07:43 — Reinforcement Learning for Robotics 09:35 — Learning From Failures 12:43 — Training Robots to Improve Themselves 14:21 — Can a Robot Work for 13 Hours Straight? 17:36 — Why Robots Need Memory 21:22 — Building a General-Purpose Robot 25:02 — From Fine-Tuning to Out-of-the-Box Models 27:35 — Training on All the Data 30:20 — One Model That Beats the Specialists 31:21 — Compositional Generalization 37:49 — The GPT Era of Robotics 39:49 — Q&A

Robots can already fold laundry, make espresso, clean kitchens, and assemble things. The harder problem is getting them to do those tasks reliably, for long periods of time, without a human babysitting them. At Startup School 2026, Physical Intelligence cofounder Chelsea Finn explains what it takes to build general-purpose robots that work in the real world. She shares how reinforcement learning pushed robot throughput up 2x, how their systems can run autonomously for hours, and why she believes robotics is entering its GPT era: moving from specialized models toward general-purpose systems that can work across tasks, robots, and environments. 00:00 — The State of Physical Intelligence 01:23 — What It Takes to Make Robots Useful 05:11 — The Reliability Problem 07:43 — Reinforcement Learning for Robotics 09:35 — Learning From Failures 12:43 — Training Robots to Improve Themselves 14:21 — Can a Robot Work for 13 Hours Straight? 17:36 — Why Robots Need Memory 21:22 — Building a General-Purpose Robot 25:02 — From Fine-Tuning to Out-of-the-Box Models 27:35 — Training on All the Data 30:20 — One Model That Beats the Specialists 31:21 — Compositional Generalization 37:49 — The GPT Era of Robotics 39:49 — Q&A

Y Combinator

113,693 次观看 • 2 个月前

“Data in robotics versus data in LLMs has a very different alpha decay problem.” — Tarun Chitra, Managing Partner Robot Ventures Much of what LLMs learn can carry across contexts. Robotics data is far more conditional: what works depends heavily on the robot, the objects, and the environment. As robots move into more complex, real-world settings, previously collected data can become less relevant much faster. For builders and investors, that shifts the question from “How much data do you have” to “How quickly can you close the loop between deployment, new data, and adaptation”. From The Convergence: Bhutan by YZi Labs.

“Data in robotics versus data in LLMs has a very different alpha decay problem.” — Tarun Chitra, Managing Partner Robot Ventures Much of what LLMs learn can carry across contexts. Robotics data is far more conditional: what works depends heavily on the robot, the objects, and the environment. As robots move into more complex, real-world settings, previously collected data can become less relevant much faster. For builders and investors, that shifts the question from “How much data do you have” to “How quickly can you close the loop between deployment, new data, and adaptation”. From The Convergence: Bhutan by YZi Labs.

YZi Labs

26,762 次观看 • 1 个月前

Tesla's Chief Designer Franz on Optimus: "It's going to be huge piece of Tesla, a huge piece in our world, as we look into the future, the ability to take menial tasks and things that you don't necessarily want to do and have them uploaded to somebody, a human, that can do that. We've been designing the robot that really looks at how humans work in the world. This world is designed around humans, and so I think having a robot that can do the things that humans can do can really start to take those menial tasks away and enrich in our lives, make our lives better we get to spend more time doing the things that we love. It's been incredibly fast paced, but the progress is, like, unbelievable in the short amount of time that the team has been working on it, and we've been growing the team and building the project the same time. I think we're breaking ground in this space everyday. The team is really energized and fired out. Elon Musk is incredibly involved in this. It's a great project to be a part of, and seeing where the future is gonna go and how it's going to enrich our lives is super exciting."

Tesla's Chief Designer Franz on Optimus: "It's going to be huge piece of Tesla, a huge piece in our world, as we look into the future, the ability to take menial tasks and things that you don't necessarily want to do and have them uploaded to somebody, a human, that can do that. We've been designing the robot that really looks at how humans work in the world. This world is designed around humans, and so I think having a robot that can do the things that humans can do can really start to take those menial tasks away and enrich in our lives, make our lives better we get to spend more time doing the things that we love. It's been incredibly fast paced, but the progress is, like, unbelievable in the short amount of time that the team has been working on it, and we've been growing the team and building the project the same time. I think we're breaking ground in this space everyday. The team is really energized and fired out. Elon Musk is incredibly involved in this. It's a great project to be a part of, and seeing where the future is gonna go and how it's going to enrich our lives is super exciting."

DogeDesigner

202,945 次观看 • 1 年前

The robot is learning several novel tasks instantly, after just ONE demonstration each... Instant Policy makes it possible: no extra training, no weight updates, just pure in-context learning. It just got accepted at ICLR 2025, and it’s changing how robots learn. With just a single demo, a robot can pick up a new task and start performing it right away. Why this is a big deal: ✅ Learns tasks instantly with just one or a few demonstrations ✅ Improves over time as more demonstrations are given ✅ Uses simulation-based training with “pseudo-demonstrations” for scalability ✅ Can transfer skills across different robots and even follow language-defined tasks It brings in-context learning to robotics, opening up new possibilities for flexible, real-world automation. You can try it yourself: code and weights are available at • • • • Thank you to Edward Johns, Director of the Robot Learning Lab at Imperial College for sharing their work! 🙏

The robot is learning several novel tasks instantly, after just ONE demonstration each... Instant Policy makes it possible: no extra training, no weight updates, just pure in-context learning. It just got accepted at ICLR 2025, and it’s changing how robots learn. With just a single demo, a robot can pick up a new task and start performing it right away. Why this is a big deal: ✅ Learns tasks instantly with just one or a few demonstrations ✅ Improves over time as more demonstrations are given ✅ Uses simulation-based training with “pseudo-demonstrations” for scalability ✅ Can transfer skills across different robots and even follow language-defined tasks It brings in-context learning to robotics, opening up new possibilities for flexible, real-world automation. You can try it yourself: code and weights are available at • • • • Thank you to Edward Johns, Director of the Robot Learning Lab at Imperial College for sharing their work! 🙏

Ilir Aliu

46,285 次观看 • 1 年前

Large-scale 3D Scene Generation (all scenes are real-time rendered)!! Physically-grounded generative data without hallucinations is the missing link for robot learning and testing at scale. We introduce a method that directly generates large-scale 3D driving scenes with accurate geometry, allowing for causal view synthesis and generation with object permanence and explicit 3D geometry. This also allows for extreme trajectory extrapolation without failure! We also show that we can build fully data-driven simulators for end-to-end learning with this approach. Project: with the amazing team of Julian Ost, Amogh Joshi , Andrea Ramazzina, Maximilian Bömer, Mario Bijelic.

Large-scale 3D Scene Generation (all scenes are real-time rendered)!! Physically-grounded generative data without hallucinations is the missing link for robot learning and testing at scale. We introduce a method that directly generates large-scale 3D driving scenes with accurate geometry, allowing for causal view synthesis and generation with object permanence and explicit 3D geometry. This also allows for extreme trajectory extrapolation without failure! We also show that we can build fully data-driven simulators for end-to-end learning with this approach. Project: with the amazing team of Julian Ost, Amogh Joshi , Andrea Ramazzina, Maximilian Bömer, Mario Bijelic.

Felix Heide

27,850 次观看 • 1 年前