正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

See our robot open doors, water plants, assemble a box, and more by learning from watching humans. Using <1hr of robot data.

Skild AI

15,651 subscribers

36,080 次观看 • 7 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Imagine robots learning new skills—without any robot data. Today, we're excited to release EgoZero: our first steps in training robot policies that operate in unseen environments, solely from data collected through humans wearing Aria smart glasses. 🧵👇

Imagine robots learning new skills—without any robot data. Today, we're excited to release EgoZero: our first steps in training robot policies that operate in unseen environments, solely from data collected through humans wearing Aria smart glasses. 🧵👇

Lerrel Pinto

42,576 次观看 • 1 年前

1/ 🧠Humans are the best robot data source! 2/ 👓Human egocentric video is rich in quantity, but poor in quality. 3/ Beyond scaling data, smarter representation and architecture matter just as much. 4/ Want an open-source framework to train your own learn-from-human-data robot policy? 🚀We introduce HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Robot-Data-Free ✦ Just 30 min of data per task ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Easy-to-Implement Let's squeeze every bit of signal out of human data! 🌐 Website: 📄 Paper: 💻 Code: 📹 Video: 🧵 1/n

1/ 🧠Humans are the best robot data source! 2/ 👓Human egocentric video is rich in quantity, but poor in quality. 3/ Beyond scaling data, smarter representation and architecture matter just as much. 4/ Want an open-source framework to train your own learn-from-human-data robot policy? 🚀We introduce HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Robot-Data-Free ✦ Just 30 min of data per task ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Easy-to-Implement Let's squeeze every bit of signal out of human data! 🌐 Website: 📄 Paper: 💻 Code: 📹 Video: 🧵 1/n

Zhi (Leo) Wang

110,230 次观看 • 2 个月前

Introduce HumanPlus - Autonomous Skills part Humanoids are born for using human data. Imitating humans, our humanoid learns: - fold sweatshirts - unload objects from warehouse racks - diverse locomotion skills (squatting, jumping, standing) - greet another robot Open-sourced!

Introduce HumanPlus - Autonomous Skills part Humanoids are born for using human data. Imitating humans, our humanoid learns: - fold sweatshirts - unload objects from warehouse racks - diverse locomotion skills (squatting, jumping, standing) - greet another robot Open-sourced!

Zipeng Fu

158,237 次观看 • 2 年前

China is turning humans, drones, and robot dogs into a single, coordinated system guided by live aerial data.

China is turning humans, drones, and robot dogs into a single, coordinated system guided by live aerial data.

Massimo

67,305 次观看 • 4 个月前

Robot-free demos can be collected through our VR interface, inspected, trained, and evaluated in a closed loop. Cool thing is that a small amount of real-robot data mixed with large-scale robot-free data can reach comparable performance, while reducing real-robot data needs by up to 20x. Code: Paper:

Robot-free demos can be collected through our VR interface, inspected, trained, and evaluated in a closed loop. Cool thing is that a small amount of real-robot data mixed with large-scale robot-free data can reach comparable performance, while reducing real-robot data needs by up to 20x. Code: Paper:

X Square Robot

175,588 次观看 • 2 个月前

Helix is now learning directly from human video data We have already trained on data collected in the real world, including Brookfield residential units To our knowledge, this is the first instance of a humanoid robot learning navigation end-to-end using only human video

Helix is now learning directly from human video data We have already trained on data collected in the real world, including Brookfield residential units To our knowledge, this is the first instance of a humanoid robot learning navigation end-to-end using only human video

Figure

46,041 次观看 • 10 个月前

🚨Is it possible to devise an intuitive approach for crowdsourcing trainable data for robots without requiring a physical robot🤖? Can we democratize robot learning for all?🧑‍🤝‍🧑 Check out our latest #CoRL2023 paper-> AR2-D2: Training a Robot Without a Robot

🚨Is it possible to devise an intuitive approach for crowdsourcing trainable data for robots without requiring a physical robot🤖? Can we democratize robot learning for all?🧑‍🤝‍🧑 Check out our latest #CoRL2023 paper-> AR2-D2: Training a Robot Without a Robot

Jiafei Duan

38,871 次观看 • 2 年前

If you see this, post a robot. Or a video of you controlling a robot using a Steam Deck 🤘 (Using #ROS and Foxglove - blog coming soon)

If you see this, post a robot. Or a video of you controlling a robot using a Steam Deck 🤘 (Using #ROS and Foxglove - blog coming soon)

Aditya Kamath

24,195 次观看 • 2 年前

The Memo robot by Sunday Robotics autonomously stacks and folds socks into a tucked bundle. The robot is operated by the ACT-1 foundation model built in-house at Sunday. It learns from data captured by humans wearing gloves that match Memo's hands.

The Memo robot by Sunday Robotics autonomously stacks and folds socks into a tucked bundle. The robot is operated by the ACT-1 foundation model built in-house at Sunday. It learns from data captured by humans wearing gloves that match Memo's hands.

The Humanoid Hub

66,547 次观看 • 8 个月前

Want a robot that learns household tasks by watching you? EquiBot is a ✨ generalizable and 🚰 data-efficient method for visuomotor policy learning, robust to changes in object shapes, lighting, and scene makeup, even from just 5 mins of human videos. 🧵↓

Want a robot that learns household tasks by watching you? EquiBot is a ✨ generalizable and 🚰 data-efficient method for visuomotor policy learning, robust to changes in object shapes, lighting, and scene makeup, even from just 5 mins of human videos. 🧵↓

Jingyun Yang

88,399 次观看 • 2 年前

Mecka is excited to power EgoVerse: a growing ecosystem for robot learning from egocentric human data Proven across 4 leading research labs, EgoVerse data consistently boosts robot performance We release the tools for anyone to collect data, inference/train, and contribute! 🧵

Mecka is excited to power EgoVerse: a growing ecosystem for robot learning from egocentric human data Proven across 4 leading research labs, EgoVerse data consistently boosts robot performance We release the tools for anyone to collect data, inference/train, and contribute! 🧵

Josh

103,304 次观看 • 4 个月前

What happens when a robot drinks an energy drink made for humans? The process and experience of using Dreamina AI Octa powered by Dreamina Seedance 2.0. #DreaminaOcto #DreaminaSeedance2 #DreaminaOctoVibeCreate #DreaminaAI #DreaminaCPP I turned that idea into a full cinematic commercial featuring: • A tired office worker • A hyperactive robot coworker • Maximum productivity • Total robot meltdown And yes... the robot explodes.

What happens when a robot drinks an energy drink made for humans? The process and experience of using Dreamina AI Octa powered by Dreamina Seedance 2.0. #DreaminaOcto #DreaminaSeedance2 #DreaminaOctoVibeCreate #DreaminaAI #DreaminaCPP I turned that idea into a full cinematic commercial featuring: • A tired office worker • A hyperactive robot coworker • Maximum productivity • Total robot meltdown And yes... the robot explodes.

Sharon Riley

134,515 次观看 • 2 个月前

What if robots could learn real-world tasks from your perspective… without ever touching a robot? This is a system that trains robot policies using nothing but human-first, egocentric video data from smart glasses. No robots, no teleop, no sensors, just humans doing real tasks in the real world. Why it matters ✅ Learns robot policies from 20 minutes of human video; zero robot demos ✅ Generalizes to new objects, views, and even robot morphologies ✅ Uses 3D points for interpretable, spatially grounded learning ✅ Deploys directly to real-world robots with strong zero-shot success Thank you, Vincent Liu, for sharing!!! Learn more here: 🔗 Paper: 🌐 Website: 📍 BOOKMARK FOR LATER

What if robots could learn real-world tasks from your perspective… without ever touching a robot? This is a system that trains robot policies using nothing but human-first, egocentric video data from smart glasses. No robots, no teleop, no sensors, just humans doing real tasks in the real world. Why it matters ✅ Learns robot policies from 20 minutes of human video; zero robot demos ✅ Generalizes to new objects, views, and even robot morphologies ✅ Uses 3D points for interpretable, spatially grounded learning ✅ Deploys directly to real-world robots with strong zero-shot success Thank you, Vincent Liu, for sharing!!! Learn more here: 🔗 Paper: 🌐 Website: 📍 BOOKMARK FOR LATER

Ilir Aliu - eu/acc

10,509 次观看 • 1 年前

Humans grasp objects with a purpose! Web2Grasp enables such functional grasping for dexterous robot hands via hand-object reconstruction from web images - without *any* robot teleop data collection 1/n

Humans grasp objects with a purpose! Web2Grasp enables such functional grasping for dexterous robot hands via hand-object reconstruction from web images - without any robot teleop data collection 1/n

Homanga Bharadhwaj @ CVPR

28,408 次观看 • 1 年前

We got a robot to clean up homes that were never seen in its training data! Our new model, π-0.5, aims to tackle open-world generalization. We took our robot into homes that were not in the training data and asked it to clean kitchens and bedrooms. More below⤵️

We got a robot to clean up homes that were never seen in its training data! Our new model, π-0.5, aims to tackle open-world generalization. We took our robot into homes that were not in the training data and asked it to clean kitchens and bedrooms. More below⤵️

Physical Intelligence

491,659 次观看 • 1 年前

Humans use pointing to communicate plans intuitively. Compared to language, pointing gives more precise guidance to robot behaviors. Can we teach a robot how to point like humans? Introducing RoboPoint 🤖👉, an open-source VLM instruction-tuned to point. Check out our new work:

Humans use pointing to communicate plans intuitively. Compared to language, pointing gives more precise guidance to robot behaviors. Can we teach a robot how to point like humans? Introducing RoboPoint 🤖👉, an open-source VLM instruction-tuned to point. Check out our new work:

Jiafei Duan

64,511 次观看 • 2 年前

.Skild AI AI CEO Deepak Pathak discusses how the startup is building a robot “brain” that learns from watching humans and practicing itself

.Skild AI AI CEO Deepak Pathak discusses how the startup is building a robot “brain” that learns from watching humans and practicing itself

Bloomberg TV

62,851 次观看 • 7 个月前

This week on Training Data: robots! I really admire @Physical_int for their open publishing spirit. Karol Hausman and Tobias Springenberg joined me and Alfred Lin to chat about pi*0.6, learning from experience, long-horizon robot performance, and more.

This week on Training Data: robots! I really admire @Physical_int for their open publishing spirit. Karol Hausman and Tobias Springenberg joined me and Alfred Lin to chat about pi*0.6, learning from experience, long-horizon robot performance, and more.

Sonya Huang 🐥

12,093 次观看 • 7 个月前

Learn more about the Aramco Geophysical Robot, a fully automated drone that utilizes machine learning to optimize geophysical data acquisition #aramco

Learn more about the Aramco Geophysical Robot, a fully automated drone that utilizes machine learning to optimize geophysical data acquisition #aramco

aramco

4,552,277 次观看 • 1 年前