Загрузка видео...

Не удалось загрузить видео

На главную

The robot is learning several novel tasks instantly, after just ONE demonstration each... Instant Policy makes it possible: no extra training, no weight updates, just pure in-context learning. It just got accepted at ICLR 2025, and it’s changing how robots learn. With just a single demo, a robot can...

IlirAliu_'s profile picture

Ilir Aliu

49,464 subscribers

46,285 просмотров • 1 год назад •via X (Twitter)

ОбразованиеНаука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 6

Фото профиля Mark Ruby
Mark Ruby1 год назад

I'm waiting for the robot to become sentient, then impatient, and slap him.

Фото профиля Luke Liem
Luke Liem1 год назад

This combines imitation learning and graph representation. Apparently a transformer is also involved in the architecture - to learn context?

Фото профиля The Rundown AI
The Rundown AI1 год назад

If you're not learning AI in 2025, you're falling behind. Join 1,000,000+ early adopters reading and learn AI in just 5 minutes a day (for free).

Фото профиля Dayder
Dayder1 год назад

Dum-E from Iron Man is so close😁 Amazing progress.

Фото профиля Jamal Jalal
Jamal Jalal1 год назад

يتعلم ذراع الروبوت من توجيه واحد فقط ولايتأثر بتغير البيئه , اعتقد انهم اقتربوا من صناعة هواتف الموبايل بالروبوتات ,حيث كان الهدف قبل سنوات ان ينفذ الروبوت ما يراه اي يتم تعليمه كما يتعلم البشر من النظر,كان ينبغي على الدول العربيه السير بهذا الطريق وهو مربح للغايه ايضا

Фото профиля Renato Pudo
Renato Pudo1 год назад

🤯

Похожие видео

Vision-language models perform diverse tasks via in-context learning. Time for robots to do the same! Introducing In-Context Robot Transformer (ICRT): a robot policy that learns new tasks by prompting with robot trajectories, without any fine-tuning. [1/N]
0:25

Vision-language models perform diverse tasks via in-context learning. Time for robots to do the same! Introducing In-Context Robot Transformer (ICRT): a robot policy that learns new tasks by prompting with robot trajectories, without any fine-tuning. [1/N]

Max Fu

40,466 просмотров • 2 лет назад

Today we’re out of stealth, and we’ve raised a $40m seed round co-led by Creandum and USV, to bring Instant Robot Learning to life. For the past few months, we‘ve been busy building a new company. Machenta. This follows results from a new kind of robot foundation model we’ve built, which I’m so excited to share with you today! Usually, it takes hours/days of data collection and training to teach a robot. We’ve built a model that learns tasks instantly: one demonstration, no further training. A model trained entirely in simulation, without a single pixel of real-world data. A model where teaching robots is so quick and easy, it feels like physical vibe coding. A model for robots that learn like humans do, from someone like you. Welcome to the era of Instant Robot Learning. Thank you Katharina Wilhelm, Rebecca Kaden, Hussein Kanji, Jonno Evans and all of our angels for your support! Machenta Learn more: See below for what you can do with Instant Robot Learning!
1:21

Today we’re out of stealth, and we’ve raised a $40m seed round co-led by Creandum and USV, to bring Instant Robot Learning to life. For the past few months, we‘ve been busy building a new company. Machenta. This follows results from a new kind of robot foundation model we’ve built, which I’m so excited to share with you today! Usually, it takes hours/days of data collection and training to teach a robot. We’ve built a model that learns tasks instantly: one demonstration, no further training. A model trained entirely in simulation, without a single pixel of real-world data. A model where teaching robots is so quick and easy, it feels like physical vibe coding. A model for robots that learn like humans do, from someone like you. Welcome to the era of Instant Robot Learning. Thank you Katharina Wilhelm, Rebecca Kaden, Hussein Kanji, Jonno Evans and all of our angels for your support! Machenta Learn more: See below for what you can do with Instant Robot Learning!

Edward Johns

269,818 просмотров • 11 дней назад

Robot AI brains, aka Vision-Language-Action models, cannot adapt to new tasks as easily as LLMs like Gemini, ChatGPT, or Grok. LLMs can adapt quickly with their in-context learning (ICL) capabilities. But can we inject ICL abilities into a pre-trained VLA like pi0? Yes! Introducing RICL (Retraining for In-Context Learning), our Conference on Robot Learning (CoRL) 2025 paper. Our RICL-pi0 model can adapt to unseen objects, novel motions, and new scenes with just ICL and RAG (retrieval-augmented generation). RICL-pi0 also boosts performance on the long-tail of tasks. A quick 1 minute video summary:
1:03

Robot AI brains, aka Vision-Language-Action models, cannot adapt to new tasks as easily as LLMs like Gemini, ChatGPT, or Grok. LLMs can adapt quickly with their in-context learning (ICL) capabilities. But can we inject ICL abilities into a pre-trained VLA like pi0? Yes! Introducing RICL (Retraining for In-Context Learning), our Conference on Robot Learning (CoRL) 2025 paper. Our RICL-pi0 model can adapt to unseen objects, novel motions, and new scenes with just ICL and RAG (retrieval-augmented generation). RICL-pi0 also boosts performance on the long-tail of tasks. A quick 1 minute video summary:

Kaustubh Sridhar

52,897 просмотров • 1 год назад

Tired of teleoperation? One human video → 1,000s of robot demos. (📍GitHub ) Scaling Robot Data Without Dynamics Simulation or Robot Hardware Real2Render2Real (R2R2R) is a new way to scale robot data without physics simulation or hardware. You take a phone scan + a single monocular human demo. It tracks the motion, renders photorealistic scenes, and generates diverse, robot-agnostic trajectories ready for training. > No teleop, no sim, no robot, just a phone and a video > Train VLA models and diffusion policies directly on the output > Supports multiple robot embodiments with kinematic consistency > 1000s of demos in 1/27 the time of real-world collection Thank you, Max Fu, for sharing!! Project: Paper: Code coming soon: It shows that with the right pipeline, you can scale robot learning data without touching a robot. One of the most interesting directions in scalable robotics today. —— Weekly robotics and AI insights. Subscribe free:
0:29

Tired of teleoperation? One human video → 1,000s of robot demos. (📍GitHub ) Scaling Robot Data Without Dynamics Simulation or Robot Hardware Real2Render2Real (R2R2R) is a new way to scale robot data without physics simulation or hardware. You take a phone scan + a single monocular human demo. It tracks the motion, renders photorealistic scenes, and generates diverse, robot-agnostic trajectories ready for training. > No teleop, no sim, no robot, just a phone and a video > Train VLA models and diffusion policies directly on the output > Supports multiple robot embodiments with kinematic consistency > 1000s of demos in 1/27 the time of real-world collection Thank you, Max Fu, for sharing!! Project: Paper: Code coming soon: It shows that with the right pipeline, you can scale robot learning data without touching a robot. One of the most interesting directions in scalable robotics today. —— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

42,864 просмотров • 9 месяцев назад

How precise can a robot get… without ever seeing the object move? Turns out, just a geometric model is enough. A robot hit 73 precise 3D goals in a row, using only a geometric model. No demonstrations. No imitation learning. No fancy vision models. The secret? Sample where the robot could make contact. Let local contact-implicit control take over from there. That’s it. ✅ Real-time performance ✅ Natural contact making and breaking ✅ Works on tricky tasks like pushing and rotating This approach mixes global planning with local MPC. Fast. Accurate. Sample-efficient. Thanks for sharing, Michael Posa ! 📍Watch it in action: Paper:
0:46

How precise can a robot get… without ever seeing the object move? Turns out, just a geometric model is enough. A robot hit 73 precise 3D goals in a row, using only a geometric model. No demonstrations. No imitation learning. No fancy vision models. The secret? Sample where the robot could make contact. Let local contact-implicit control take over from there. That’s it. ✅ Real-time performance ✅ Natural contact making and breaking ✅ Works on tricky tasks like pushing and rotating This approach mixes global planning with local MPC. Fast. Accurate. Sample-efficient. Thanks for sharing, Michael Posa ! 📍Watch it in action: Paper:

Ilir Aliu

19,012 просмотров • 1 год назад

Introducing RoboCat, a new AI model designed to operate multiple robots. 🤖 It learns to solve new tasks on different robotic arms with as few as 100 demonstrations - and improves skills from self-generated training data. Find out more:
0:52

Introducing RoboCat, a new AI model designed to operate multiple robots. 🤖 It learns to solve new tasks on different robotic arms with as few as 100 demonstrations - and improves skills from self-generated training data. Find out more:

Google DeepMind

410,466 просмотров • 3 лет назад

Scientists developed HumanX, a system that lets humanoid robots learn new skills by watching just one short human video. It learns directly from demonstrations instead of large datasets or complex training rewards. Using this, the Unitree G1 humanoid robot learned 10 different real-world skills without extra training.
0:34

Scientists developed HumanX, a system that lets humanoid robots learn new skills by watching just one short human video. It learns directly from demonstrations instead of large datasets or complex training rewards. Using this, the Unitree G1 humanoid robot learned 10 different real-world skills without extra training.

Space and Technology

28,956 просмотров • 6 месяцев назад

🚀 We just shipped a big upgrade to our imitation-learning-in-simulation playground in LeRobot, built together with Lightwheel ! You can now teleoperate robots in sim (keyboard or real robot) and collect training demos instantly. This makes it possible to run real IL research on harder, more realistic manipulation tasks, even if you don’t have hardware. New tasks: 🟠 pick orange to the plate 🧺 fold cloth (yes!) 📦 pick 2 “e” toys to the box 🔴 lift red cube Through our partnership with Lightwheel, LeIsaac was integrated into EnvHub on day one, a best-practice integration that strengthens both ecosystems and pushes simulation-first robotics forward. 👉 Load a task via EnvHub, start teleop-ing, record your demo, upload the data on the hub and you’re ready to train or test.
0:22

🚀 We just shipped a big upgrade to our imitation-learning-in-simulation playground in LeRobot, built together with Lightwheel ! You can now teleoperate robots in sim (keyboard or real robot) and collect training demos instantly. This makes it possible to run real IL research on harder, more realistic manipulation tasks, even if you don’t have hardware. New tasks: 🟠 pick orange to the plate 🧺 fold cloth (yes!) 📦 pick 2 “e” toys to the box 🔴 lift red cube Through our partnership with Lightwheel, LeIsaac was integrated into EnvHub on day one, a best-practice integration that strengthens both ecosystems and pushes simulation-first robotics forward. 👉 Load a task via EnvHub, start teleop-ing, record your demo, upload the data on the hub and you’re ready to train or test.

LeRobot

44,896 просмотров • 11 месяцев назад

Researchers have developed Humanoid-GPT, a new AI system that helps humanoid robots perform complex movements and tasks. Tested on the Unitree G1 robot, it enables real-time whole-body control and can perform new actions without special training. During demonstrations, the robot successfully carried out a variety of movements and tasks, showing strong potential for real-world applications.
0:28

Researchers have developed Humanoid-GPT, a new AI system that helps humanoid robots perform complex movements and tasks. Tested on the Unitree G1 robot, it enables real-time whole-body control and can perform new actions without special training. During demonstrations, the robot successfully carried out a variety of movements and tasks, showing strong potential for real-world applications.

Space and Technology

22,330 просмотров • 4 месяцев назад

Practice makes perfect. A truly agentic robot shouldn’t just know what to do. It should also figure out how to get better. What if a robot could watch a demonstration, figure out what it needs to practice, and learn how to get better through practice? Introducing RPG: Guided Self-Improvement for Embodied Agents, a real-to-sim-to-real pipeline that turns real-world demonstrations into targeted practice. RPG reconstructs practice tasks from demonstrations, uses demo videos to guide skill improvement, and continually updates a shared skill system from failures. On real robots, RPG achieves 30/30 successes across 3 tasks. In simulation, it reaches 95.0% success across 22 manipulation tasks after 15 rounds of self-improvement. Demo → Reconstruct → Guided Practice → Self-Improve → Go Real
1:43

Practice makes perfect. A truly agentic robot shouldn’t just know what to do. It should also figure out how to get better. What if a robot could watch a demonstration, figure out what it needs to practice, and learn how to get better through practice? Introducing RPG: Guided Self-Improvement for Embodied Agents, a real-to-sim-to-real pipeline that turns real-world demonstrations into targeted practice. RPG reconstructs practice tasks from demonstrations, uses demo videos to guide skill improvement, and continually updates a shared skill system from failures. On real robots, RPG achieves 30/30 successes across 3 tasks. In simulation, it reaches 95.0% success across 22 manipulation tasks after 15 rounds of self-improvement. Demo → Reconstruct → Guided Practice → Self-Improve → Go Real

Yen-Jen Wang ✈️ CoRL

166,820 просмотров • 1 месяц назад

🚨🇺🇸FIGURE ROBOT LEARNS TO WALK IN HOURS Turns out you can teach a robot to walk—if you’ve got a few years to burn in a physics simulator (or a few hours of GPU time). Figure’s team trained a neural network using reinforcement learning to mimic natural human locomotion, and the wild part is it worked on the first try with real hardware. No tuning. No fiddling. Just plug and strut. Thanks to sim-to-real transfer and some sneaky domain randomization, the robot didn’t just wobble out of the lab—it walked like it had somewhere to be. Next up: running. Not terrifying at all. Source: Figure
0:54

🚨🇺🇸FIGURE ROBOT LEARNS TO WALK IN HOURS Turns out you can teach a robot to walk—if you’ve got a few years to burn in a physics simulator (or a few hours of GPU time). Figure’s team trained a neural network using reinforcement learning to mimic natural human locomotion, and the wild part is it worked on the first try with real hardware. No tuning. No fiddling. Just plug and strut. Thanks to sim-to-real transfer and some sneaky domain randomization, the robot didn’t just wobble out of the lab—it walked like it had somewhere to be. Next up: running. Not terrifying at all. Source: Figure

Mario Nawfal

117,866 просмотров • 1 год назад

Force is arguably the most overlooked ingredient in modern robot learning. Introducing FACTR 2: it turns *any* commodity robot into a force-aware system with no force sensors required. Train a tiny force network in <1min with <10mins of data and drop it into any existing teleop pipelines: ✅ Free force sensing for both the robot and the operator arm ✅ Makes demos higher-quality → fewer of them needed. ✅ A new force-aware learning algorithm (FIRST) uses those recovered forces to figure out which parts of a demo actually matter, making learning data-efficient. ✅ Strong performance on complex tasks with fewer demos and even no pretraining! More details below.
0:40

Force is arguably the most overlooked ingredient in modern robot learning. Introducing FACTR 2: it turns *any* commodity robot into a force-aware system with no force sensors required. Train a tiny force network in <1min with <10mins of data and drop it into any existing teleop pipelines: ✅ Free force sensing for both the robot and the operator arm ✅ Makes demos higher-quality → fewer of them needed. ✅ A new force-aware learning algorithm (FIRST) uses those recovered forces to figure out which parts of a demo actually matter, making learning data-efficient. ✅ Strong performance on complex tasks with fewer demos and even no pretraining! More details below.

Deepak Pathak

41,156 просмотров • 4 месяцев назад

Physical AI is moving beyond robots trained for one narrow task. LiberAI’s Liber-0 achieved 36.0% overall success across 60 GPT-6-proposed tasks and 600 trials, without training on robot demonstrations collected specifically for those tasks. By combining human video, motion recorded with LiberSense Glove and embodiment alignment, Liber-0 helps turn human experience into transferable robot skills. A step toward building new robot capabilities with fewer task-specific robot demonstrations. LiberAI
0:34

Physical AI is moving beyond robots trained for one narrow task. LiberAI’s Liber-0 achieved 36.0% overall success across 60 GPT-6-proposed tasks and 600 trials, without training on robot demonstrations collected specifically for those tasks. By combining human video, motion recorded with LiberSense Glove and embodiment alignment, Liber-0 helps turn human experience into transferable robot skills. A step toward building new robot capabilities with fewer task-specific robot demonstrations. LiberAI

Fathela Esq

49,894 просмотров • 4 дней назад

Disney made a real-life WALL-E Disney Research just revealed a new robot at #IROS2023, it uses reinforcement learning to walk and can even socially interact.
1:00

Disney made a real-life WALL-E Disney Research just revealed a new robot at #IROS2023, it uses reinforcement learning to walk and can even socially interact.

Product Hunt 😸

20,513 просмотров • 3 лет назад