Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

See our robot open doors, water plants, assemble a box, and more by learning from watching humans. Using <1hr of robot data.

SkildAI's profile picture

Skild AI

15,651 subscribers

36,080 Aufrufe • vor 7 Monaten •via X (Twitter)

Wissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Imagine robots learning new skills—without any robot data. Today, we're excited to release EgoZero: our first steps in training robot policies that operate in unseen environments, solely from data collected through humans wearing Aria smart glasses. 🧵👇
1:24

Imagine robots learning new skills—without any robot data. Today, we're excited to release EgoZero: our first steps in training robot policies that operate in unseen environments, solely from data collected through humans wearing Aria smart glasses. 🧵👇

Lerrel Pinto

42,576 Aufrufe • vor 1 Jahr

1/ 🧠Humans are the best robot data source! 2/ 👓Human egocentric video is rich in quantity, but poor in quality. 3/ Beyond scaling data, smarter representation and architecture matter just as much. 4/ Want an open-source framework to train your own learn-from-human-data robot policy? 🚀We introduce HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Robot-Data-Free ✦ Just 30 min of data per task ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Easy-to-Implement Let's squeeze every bit of signal out of human data! 🌐 Website: 📄 Paper: 💻 Code: 📹 Video: 🧵 1/n
1:28

1/ 🧠Humans are the best robot data source! 2/ 👓Human egocentric video is rich in quantity, but poor in quality. 3/ Beyond scaling data, smarter representation and architecture matter just as much. 4/ Want an open-source framework to train your own learn-from-human-data robot policy? 🚀We introduce HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos⬇️ ✦ Zero-Shot Human-to-Robot Transfer ✦ Robot-Data-Free ✦ Just 30 min of data per task ✦ Collect by Anyone, Anytime, Anywhere ✦ Deploy on Any Robot, Any Camera, Any Environment ✦ Open-Source & Easy-to-Implement Let's squeeze every bit of signal out of human data! 🌐 Website: 📄 Paper: 💻 Code: 📹 Video: 🧵 1/n

Zhi (Leo) Wang

110,230 Aufrufe • vor 3 Monaten

Introduce HumanPlus - Autonomous Skills part Humanoids are born for using human data. Imitating humans, our humanoid learns: - fold sweatshirts - unload objects from warehouse racks - diverse locomotion skills (squatting, jumping, standing) - greet another robot Open-sourced!
0:46

Introduce HumanPlus - Autonomous Skills part Humanoids are born for using human data. Imitating humans, our humanoid learns: - fold sweatshirts - unload objects from warehouse racks - diverse locomotion skills (squatting, jumping, standing) - greet another robot Open-sourced!

Zipeng Fu

158,237 Aufrufe • vor 2 Jahren

China is turning humans, drones, and robot dogs into a single, coordinated system guided by live aerial data.
0:32

China is turning humans, drones, and robot dogs into a single, coordinated system guided by live aerial data.

Massimo

67,305 Aufrufe • vor 4 Monaten

Robot-free demos can be collected through our VR interface, inspected, trained, and evaluated in a closed loop. Cool thing is that a small amount of real-robot data mixed with large-scale robot-free data can reach comparable performance, while reducing real-robot data needs by up to 20x. Code: Paper:
0:21

Robot-free demos can be collected through our VR interface, inspected, trained, and evaluated in a closed loop. Cool thing is that a small amount of real-robot data mixed with large-scale robot-free data can reach comparable performance, while reducing real-robot data needs by up to 20x. Code: Paper:

X Square Robot

175,588 Aufrufe • vor 2 Monaten

Helix is now learning directly from human video data We have already trained on data collected in the real world, including Brookfield residential units To our knowledge, this is the first instance of a humanoid robot learning navigation end-to-end using only human video
0:24

Helix is now learning directly from human video data We have already trained on data collected in the real world, including Brookfield residential units To our knowledge, this is the first instance of a humanoid robot learning navigation end-to-end using only human video

Figure

46,041 Aufrufe • vor 11 Monaten

🚨Is it possible to devise an intuitive approach for crowdsourcing trainable data for robots without requiring a physical robot🤖? Can we democratize robot learning for all?🧑‍🤝‍🧑 Check out our latest #CoRL2023 paper-&gt; AR2-D2: Training a Robot Without a Robot
0:31

🚨Is it possible to devise an intuitive approach for crowdsourcing trainable data for robots without requiring a physical robot🤖? Can we democratize robot learning for all?🧑‍🤝‍🧑 Check out our latest #CoRL2023 paper-&gt; AR2-D2: Training a Robot Without a Robot

Jiafei Duan

38,894 Aufrufe • vor 3 Jahren

If you see this, post a robot. Or a video of you controlling a robot using a Steam Deck 🤘 (Using #ROS and Foxglove - blog coming soon)
0:45

If you see this, post a robot. Or a video of you controlling a robot using a Steam Deck 🤘 (Using #ROS and Foxglove - blog coming soon)

Aditya Kamath

24,195 Aufrufe • vor 2 Jahren

The Memo robot by Sunday Robotics autonomously stacks and folds socks into a tucked bundle. The robot is operated by the ACT-1 foundation model built in-house at Sunday. It learns from data captured by humans wearing gloves that match Memo's hands.
0:48

The Memo robot by Sunday Robotics autonomously stacks and folds socks into a tucked bundle. The robot is operated by the ACT-1 foundation model built in-house at Sunday. It learns from data captured by humans wearing gloves that match Memo's hands.

The Humanoid Hub

66,547 Aufrufe • vor 9 Monaten

Want a robot that learns household tasks by watching you? EquiBot is a ✨ generalizable and 🚰 data-efficient method for visuomotor policy learning, robust to changes in object shapes, lighting, and scene makeup, even from just 5 mins of human videos. 🧵↓
0:31

Want a robot that learns household tasks by watching you? EquiBot is a ✨ generalizable and 🚰 data-efficient method for visuomotor policy learning, robust to changes in object shapes, lighting, and scene makeup, even from just 5 mins of human videos. 🧵↓

Jingyun Yang

88,405 Aufrufe • vor 2 Jahren

Mecka is excited to power EgoVerse: a growing ecosystem for robot learning from egocentric human data Proven across 4 leading research labs, EgoVerse data consistently boosts robot performance We release the tools for anyone to collect data, inference/train, and contribute! 🧵
0:56

Mecka is excited to power EgoVerse: a growing ecosystem for robot learning from egocentric human data Proven across 4 leading research labs, EgoVerse data consistently boosts robot performance We release the tools for anyone to collect data, inference/train, and contribute! 🧵

Josh

103,412 Aufrufe • vor 5 Monaten

What happens when a robot drinks an energy drink made for humans? The process and experience of using Dreamina AI Octa powered by Dreamina Seedance 2.0. #DreaminaOcto #DreaminaSeedance2 #DreaminaOctoVibeCreate #DreaminaAI #DreaminaCPP I turned that idea into a full cinematic commercial featuring: • A tired office worker • A hyperactive robot coworker • Maximum productivity • Total robot meltdown And yes... the robot explodes.
1:06

What happens when a robot drinks an energy drink made for humans? The process and experience of using Dreamina AI Octa powered by Dreamina Seedance 2.0. #DreaminaOcto #DreaminaSeedance2 #DreaminaOctoVibeCreate #DreaminaAI #DreaminaCPP I turned that idea into a full cinematic commercial featuring: • A tired office worker • A hyperactive robot coworker • Maximum productivity • Total robot meltdown And yes... the robot explodes.

Sharon Riley

134,515 Aufrufe • vor 2 Monaten

What if robots could learn real-world tasks from your perspective… without ever touching a robot? This is a system that trains robot policies using nothing but human-first, egocentric video data from smart glasses. No robots, no teleop, no sensors, just humans doing real tasks in the real world. Why it matters ✅ Learns robot policies from 20 minutes of human video; zero robot demos ✅ Generalizes to new objects, views, and even robot morphologies ✅ Uses 3D points for interpretable, spatially grounded learning ✅ Deploys directly to real-world robots with strong zero-shot success Thank you, Vincent Liu, for sharing!!! Learn more here: 🔗 Paper: 🌐 Website: 📍 BOOKMARK FOR LATER
0:30

What if robots could learn real-world tasks from your perspective… without ever touching a robot? This is a system that trains robot policies using nothing but human-first, egocentric video data from smart glasses. No robots, no teleop, no sensors, just humans doing real tasks in the real world. Why it matters ✅ Learns robot policies from 20 minutes of human video; zero robot demos ✅ Generalizes to new objects, views, and even robot morphologies ✅ Uses 3D points for interpretable, spatially grounded learning ✅ Deploys directly to real-world robots with strong zero-shot success Thank you, Vincent Liu, for sharing!!! Learn more here: 🔗 Paper: 🌐 Website: 📍 BOOKMARK FOR LATER

Ilir Aliu - eu/acc

10,509 Aufrufe • vor 1 Jahr

Humans grasp objects with a purpose! Web2Grasp enables such functional grasping for dexterous robot hands via hand-object reconstruction from web images - without *any* robot teleop data collection 1/n
0:49

Humans grasp objects with a purpose! Web2Grasp enables such functional grasping for dexterous robot hands via hand-object reconstruction from web images - without *any* robot teleop data collection 1/n

Homanga Bharadhwaj @ CVPR

28,408 Aufrufe • vor 1 Jahr

We got a robot to clean up homes that were never seen in its training data! Our new model, π-0.5, aims to tackle open-world generalization. We took our robot into homes that were not in the training data and asked it to clean kitchens and bedrooms. More below⤵️
3:09

We got a robot to clean up homes that were never seen in its training data! Our new model, π-0.5, aims to tackle open-world generalization. We took our robot into homes that were not in the training data and asked it to clean kitchens and bedrooms. More below⤵️

Physical Intelligence

492,430 Aufrufe • vor 1 Jahr

Humans use pointing to communicate plans intuitively. Compared to language, pointing gives more precise guidance to robot behaviors. Can we teach a robot how to point like humans? Introducing RoboPoint 🤖👉, an open-source VLM instruction-tuned to point. Check out our new work:
1:24

Humans use pointing to communicate plans intuitively. Compared to language, pointing gives more precise guidance to robot behaviors. Can we teach a robot how to point like humans? Introducing RoboPoint 🤖👉, an open-source VLM instruction-tuned to point. Check out our new work:

Jiafei Duan

64,511 Aufrufe • vor 2 Jahren

This week on Training Data: robots! I really admire @Physical_int for their open publishing spirit. Karol Hausman and Tobias Springenberg joined me and Alfred Lin to chat about pi*0.6, learning from experience, long-horizon robot performance, and more.
1:19

This week on Training Data: robots! I really admire @Physical_int for their open publishing spirit. Karol Hausman and Tobias Springenberg joined me and Alfred Lin to chat about pi*0.6, learning from experience, long-horizon robot performance, and more.

Sonya Huang 🐥

12,093 Aufrufe • vor 7 Monaten

.Skild AI AI CEO Deepak Pathak discusses how the startup is building a robot “brain” that learns from watching humans and practicing itself
1:52

.Skild AI AI CEO Deepak Pathak discusses how the startup is building a robot “brain” that learns from watching humans and practicing itself

Bloomberg TV

62,851 Aufrufe • vor 7 Monaten

Learn more about the Aramco Geophysical Robot, a fully automated drone that utilizes machine learning to optimize geophysical data acquisition #aramco
1:15

Learn more about the Aramco Geophysical Robot, a fully automated drone that utilizes machine learning to optimize geophysical data acquisition #aramco

aramco

4,552,277 Aufrufe • vor 1 Jahr