Загрузка видео...

Не удалось загрузить видео

На главную

1/ We just released π0.7 — a steerable generalist robot model with emergent capabilities. I want to share a bit of the backstory, because π0.7 taught me something surprising about where robot learning is heading. A thread on bittersweet lessons 🧵

lucy_x_shi's profile picture

Lucy Shi

3,769 subscribers

86,358 просмотров • 2 месяцев назад •via X (Twitter)

ОбразованиеЗдоровье и велнесНаука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

We finished evaluating π0.7, our new model at Physical Intelligence. What I'm most excited about with π0.7 is that it's starting to show some surprising emergent compositional generalization, being able to both perform complex tasks and learn new tasks just from instructions.
1:07

We finished evaluating π0.7, our new model at Physical Intelligence. What I'm most excited about with π0.7 is that it's starting to show some surprising emergent compositional generalization, being able to both perform complex tasks and learn new tasks just from instructions.

Sergey Levine

60,336 просмотров • 2 месяцев назад

I trained a humanoid robot to play famous anime openings on the piano with reinforcement learning (Attack on Titan, Evangelion, SAO, and more) how I did it + surprising discoveries in thread🧵
0:36

I trained a humanoid robot to play famous anime openings on the piano with reinforcement learning (Attack on Titan, Evangelion, SAO, and more) how I did it + surprising discoveries in thread🧵

anandmaj

24,589 просмотров • 1 год назад

📢 First contact between a frontier model and robots! Gemini Robotics is a SOTA generalist Vision-Language-Action model bringing frontier model intelligence to the physical world. It's an extremely capable model enabling dexterous, steerable, and general robot control. 🧵⬇️
0:31

📢 First contact between a frontier model and robots! Gemini Robotics is a SOTA generalist Vision-Language-Action model bringing frontier model intelligence to the physical world. It's an extremely capable model enabling dexterous, steerable, and general robot control. 🧵⬇️

Ted Xiao

152,413 просмотров • 1 год назад

YouTube is a LARGE dataset of demonstration videos to train Generalist robot agents, but lacks action data. How can we learn DEXTEROUS skills from them? In #CoRL2024, we explore the problem of learning a Generalist Piano Playing agent from YouTube videos.
0:29

YouTube is a LARGE dataset of demonstration videos to train Generalist robot agents, but lacks action data. How can we learn DEXTEROUS skills from them? In #CoRL2024, we explore the problem of learning a Generalist Piano Playing agent from YouTube videos.

Julen Urain

42,434 просмотров • 1 год назад

Generalist robots don’t fail due to a lack of generality. They fail due to a lack of proficiency where it matters. We introduce SOP, enabling generalist policies to improve from real-world experience across distributed robot fleets, without sacrificing generality. 🧵
3:32

Generalist robots don’t fail due to a lack of generality. They fail due to a lack of proficiency where it matters. We introduce SOP, enabling generalist policies to improve from real-world experience across distributed robot fleets, without sacrificing generality. 🧵

Jianlan Luo

1,724,368 просмотров • 5 месяцев назад

Thrilled to announce Octo 🐙, an open-source robot foundation model! Octo is a sota generalist robot policy based on transformer+diffusion. Most importantly, you can finetune Octo *today* with flexible observation and action spaces on your robot setup!
0:38

Thrilled to announce Octo 🐙, an open-source robot foundation model! Octo is a sota generalist robot policy based on transformer+diffusion. Most importantly, you can finetune Octo *today* with flexible observation and action spaces on your robot setup!

Oier Mees

44,944 просмотров • 2 лет назад

3 mo. ago we released the Open X-Embodiment dataset, today we’re doing the next step: Introducing Octo 🐙, a generalist robot policy, trained on 800k robot trajectories, stronger than RT-1X, flexible observation + action spaces, fully open source! 💻: /🧵
0:38

3 mo. ago we released the Open X-Embodiment dataset, today we’re doing the next step: Introducing Octo 🐙, a generalist robot policy, trained on 800k robot trajectories, stronger than RT-1X, flexible observation + action spaces, fully open source! 💻: /🧵

Karl Pertsch

126,658 просмотров • 2 лет назад

We are still discovering what π0.7 can do. It's fun to play with and the results so far have been quite surprising!
1:42

We are still discovering what π0.7 can do. It's fun to play with and the results so far have been quite surprising!

Physical Intelligence

16,461 просмотров • 2 месяцев назад

Excited to share a new humanoid robot platform we’ve been working on. Berkeley Humanoid is a reliable and low-cost mid-scale research platform for learning-based control. We demonstrate the robot walking on various terrains and dynamic hopping with a simple RL controller.
0:49

Excited to share a new humanoid robot platform we’ve been working on. Berkeley Humanoid is a reliable and low-cost mid-scale research platform for learning-based control. We demonstrate the robot walking on various terrains and dynamic hopping with a simple RL controller.

Qiayuan Liao

80,294 просмотров • 1 год назад

The wait is finally over!!! 😁 We just dropped an in-depth tutorial on how to build your own robot! Teach it new skills by showing it a few moves with just a laptop. Then watch your homemade robot act autonomously 🤯 1/🧵👇
1:10

The wait is finally over!!! 😁 We just dropped an in-depth tutorial on how to build your own robot! Teach it new skills by showing it a few moves with just a laptop. Then watch your homemade robot act autonomously 🤯 1/🧵👇

Remi Cadene

400,136 просмотров • 1 год назад

Robot Learning from a Physical World Model
0:50

Robot Learning from a Physical World Model

AK

34,340 просмотров • 7 месяцев назад

Nvidia presents DreamDojo A Generalist Robot World Model from Large-Scale Human Videos
1:21

Nvidia presents DreamDojo A Generalist Robot World Model from Large-Scale Human Videos

AK

38,690 просмотров • 4 месяцев назад

A few examples of π0.7 in action Turn the shirt right-side out and fold it:
1:22

A few examples of π0.7 in action Turn the shirt right-side out and fold it:

Karol Hausman

22,841 просмотров • 2 месяцев назад

Are you living in the future? My robot drove me to dinner. A robot made me dinner. Now the robot is driving me to a robot party. I am. :-)
1:35

Are you living in the future? My robot drove me to dinner. A robot made me dinner. Now the robot is driving me to a robot party. I am. :-)

Robert Scoble

21,133 просмотров • 1 год назад

🚀 We’re excited to announce LingBot-VA, a new state-of-the-art robot policy model from Robbyant ! LingBot-VA is built on a causal, autoregressive video-action world model for generalist robot control. Highlights: (1) First unified autoregressive video-action world model for robot control (2) Low-latency inference with a new asynchronous execution pipeline (3) SOTA on RoboTwin (92.9%, firstever > 90%) and LIBERO (98.5%) (4) +20% over π0.5 on challenging real-world long-horizon & high-precision tasks
1:51

🚀 We’re excited to announce LingBot-VA, a new state-of-the-art robot policy model from Robbyant ! LingBot-VA is built on a causal, autoregressive video-action world model for generalist robot control. Highlights: (1) First unified autoregressive video-action world model for robot control (2) Low-latency inference with a new asynchronous execution pipeline (3) SOTA on RoboTwin (92.9%, firstever > 90%) and LIBERO (98.5%) (4) +20% over π0.5 on challenging real-world long-horizon & high-precision tasks

Yinghao Xu

46,380 просмотров • 4 месяцев назад

Scientists have taught a humanoid robot to play tennis using just 5 hours of motion capture data. After training, the robot is capable of sustaining long rallies with a human and returning balls at speeds exceeding 15 m/s with an accuracy of about 90%.
1:29

Scientists have taught a humanoid robot to play tennis using just 5 hours of motion capture data. After training, the robot is capable of sustaining long rallies with a human and returning balls at speeds exceeding 15 m/s with an accuracy of about 90%.

Massimo

49,108 просмотров • 2 месяцев назад

Today, we present a step-change in robotic AI Sunday. Introducing ACT-1: A frontier robot foundation model trained on zero robot data. - Ultra long-horizon tasks - Zero-shot generalization - Advanced dexterity 🧵->
4:09

Today, we present a step-change in robotic AI Sunday. Introducing ACT-1: A frontier robot foundation model trained on zero robot data. - Ultra long-horizon tasks - Zero-shot generalization - Advanced dexterity 🧵->

Tony Zhao

2,043,852 просмотров • 7 месяцев назад

One of my favorite works in the "robot learning from human videos" space that I have seen lately. This is because it offers a really coherent and unique way to represent robot skills without a lot of the downsides we see from estimation-based approaches.
0:22

One of my favorite works in the "robot learning from human videos" space that I have seen lately. This is because it offers a really coherent and unique way to represent robot skills without a lot of the downsides we see from estimation-based approaches.

Chris Paxton

78,416 просмотров • 8 месяцев назад

Researchers just taught a robot to play tennis. From just clips of a few amateur players performing basic forehands, backhands, and shuffles... ...a robot learned one of the fastest, most coordinated physical skills there is. Insane!
1:09

Researchers just taught a robot to play tennis. From just clips of a few amateur players performing basic forehands, backhands, and shuffles... ...a robot learned one of the fastest, most coordinated physical skills there is. Insane!

Rowan Cheung

39,063 просмотров • 2 месяцев назад

Watching Generalist AI demonstrate real-time intuition is incredible! 🤖✨ Check out this "Physical Commonsense" in action: the robot flips a washer, picks it up and then double-nudges it perfectly into a tight foam slot. This isn't a scripted motion; it’s an emergent behavior from a model trained on 270,000+ hours of real-world interaction. We are seeing the era where robots are starting to intuit and react to physics.
0:32

Watching Generalist AI demonstrate real-time intuition is incredible! 🤖✨ Check out this "Physical Commonsense" in action: the robot flips a washer, picks it up and then double-nudges it perfectly into a tight foam slot. This isn't a scripted motion; it’s an emergent behavior from a model trained on 270,000+ hours of real-world interaction. We are seeing the era where robots are starting to intuit and react to physics.

Humanoids daily

14,762 просмотров • 4 месяцев назад