正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Introducing an approach to directly ground video generation models to policy execution without needing any action labels! Our approach uses a generic goal-conditioned exploration procedure to learn a policy that works across robots / embodiments!

Yilun Du

12,410 subscribers

21,409 次观看 • 1 年前 •via X (Twitter)

教育科学技术健康养生

Anya Rossi• Live Now

Private livecam show

2 条评论

sonu 的头像

sonu1 年前

Great work 👍

Yilun Du 的头像

Yilun Du1 年前

Ohh haven't created an account there yet -- didn't realize lots of people were moving over.

相关视频

The most frustrating part of imitation learning is collecting huge amounts of teleop data. But why teleop robots when robots can learn by watching us? Introducing Point Policy, a novel framework that enables robots to learn from human videos without any teleop, sim2real, or RL.

The most frustrating part of imitation learning is collecting huge amounts of teleop data. But why teleop robots when robots can learn by watching us? Introducing Point Policy, a novel framework that enables robots to learn from human videos without any teleop, sim2real, or RL.

Siddhant Haldar

69,056 次观看 • 1 年前

By unifying prediction and control, NavWAM acts as a closed-loop policy out of the box. In evaluations, it outperforms planning-based world models without needing test-time action search, matches a much larger 7B VLA policy, and transfers successfully to real mobile robots.

By unifying prediction and control, NavWAM acts as a closed-loop policy out of the box. In evaluations, it outperforms planning-based world models without needing test-time action search, matches a much larger 7B VLA policy, and transfers successfully to real mobile robots.

Robots Digest 🤖

11,076 次观看 • 3 个月前

Respect the call. Introducing a stronger policy to protect our referees. Learn More >

Respect the call. Introducing a stronger policy to protect our referees. Learn More >

U.S. Soccer

15,977 次观看 • 1 年前

Vision-language models perform diverse tasks via in-context learning. Time for robots to do the same! Introducing In-Context Robot Transformer (ICRT): a robot policy that learns new tasks by prompting with robot trajectories, without any fine-tuning. [1/N]

Vision-language models perform diverse tasks via in-context learning. Time for robots to do the same! Introducing In-Context Robot Transformer (ICRT): a robot policy that learns new tasks by prompting with robot trajectories, without any fine-tuning. [1/N]

Max Fu

40,466 次观看 • 2 年前

How to teach robots to perform long-horizon tasks efficiently and robustly🦾? Introducing MimicPlay - an imitation learning algorithm that uses "cheap human play data". Our approach unlocks both real-time planning through raw perception and strong robustness to disturbances!🧵👇

How to teach robots to perform long-horizon tasks efficiently and robustly🦾? Introducing MimicPlay - an imitation learning algorithm that uses "cheap human play data". Our approach unlocks both real-time planning through raw perception and strong robustness to disturbances!🧵👇

Chen Wang

288,716 次观看 • 3 年前

Long-horizon visual goals remain surprisingly hard for robot manipulation. We introduce Act2Goal, a goal-conditioned policy that uses a visual world model to reason about progress toward a goal, and practice it autonomously in the real world.

Long-horizon visual goals remain surprisingly hard for robot manipulation. We introduce Act2Goal, a goal-conditioned policy that uses a visual world model to reason about progress toward a goal, and practice it autonomously in the real world.

Jianlan Luo

95,100 次观看 • 8 个月前

A credible, clear and effective development policy is key to delivering a world free from poverty on a liveable planet. Today we’re launching a Development Review to help in that mission. With an approach based on respect, genuine partnership and evidence of what works.

A credible, clear and effective development policy is key to delivering a world free from poverty on a liveable planet. Today we’re launching a Development Review to help in that mission. With an approach based on respect, genuine partnership and evidence of what works.

Anneliese Dodds

35,622 次观看 • 2 年前

Presenting DemoDiffusion: An extremely simple approach enabling a pre-trained 'generalist' diffusion policy to follow a human-demonstration for a novel task during inference One-shot human imitation *without* requiring any paired human-robot data or online RL 🙂 1/n

Presenting DemoDiffusion: An extremely simple approach enabling a pre-trained 'generalist' diffusion policy to follow a human-demonstration for a novel task during inference One-shot human imitation without requiring any paired human-robot data or online RL 🙂 1/n

Homanga Bharadhwaj

32,919 次观看 • 1 年前

We’re bringing powerful AI directly onto robots with Gemini Robotics On-Device. 🤖 It’s our first vision-language-action model to help make robots faster, highly efficient, and adaptable to new tasks and environments - without needing a constant internet connection. 🧵

We’re bringing powerful AI directly onto robots with Gemini Robotics On-Device. 🤖 It’s our first vision-language-action model to help make robots faster, highly efficient, and adaptable to new tasks and environments - without needing a constant internet connection. 🧵

Google DeepMind

819,894 次观看 • 1 年前

🤔 Can we train one VLA policy to control multi-robot teams without any explicit communication? ✨ Introducing CHORUS: a single policy for decentralized, multi-embodiment collaboration 🧵⬇️

🤔 Can we train one VLA policy to control multi-robot teams without any explicit communication? ✨ Introducing CHORUS: a single policy for decentralized, multi-embodiment collaboration 🧵⬇️

Ria Doshi

60,387 次观看 • 3 个月前

#ICC Office of the Prosecutor launched its Policy on Gender-based Crimes. #ASP22 Prosecutor Karim A. A. Khan KC: I have emphasised that we need to do better in relation to gender crimes & crimes against children. This Policy is a fundamental revision of our approach to gender crimes.

#ICC Office of the Prosecutor launched its Policy on Gender-based Crimes. #ASP22 Prosecutor Karim A. A. Khan KC: I have emphasised that we need to do better in relation to gender crimes & crimes against children. This Policy is a fundamental revision of our approach to gender crimes.

Int'l Criminal Court

28,449 次观看 • 2 年前

Industrial policy is back and greener than ever. Green industrial policy is how countries can continue to grow, while tackling the climate crisis head on. Open Society’s Luis Godoy explains how it is also an opportunity to build a fairer, cleaner, and stronger economy that benefits everyone—especially countries in the Global South. Learn more about our approach to economic and climate prosperity:

Industrial policy is back and greener than ever. Green industrial policy is how countries can continue to grow, while tackling the climate crisis head on. Open Society’s Luis Godoy explains how it is also an opportunity to build a fairer, cleaner, and stronger economy that benefits everyone—especially countries in the Global South. Learn more about our approach to economic and climate prosperity:

Open Society Foundations

14,699 次观看 • 9 个月前

Testified at the Senate of Canada this morning, explaining to Senators why our current carbon pricing approach is flawed policy — and why the Grocery Code of Conduct is sound policy. Have a listen.

Testified at the Senate of Canada this morning, explaining to Senators why our current carbon pricing approach is flawed policy — and why the Grocery Code of Conduct is sound policy. Have a listen.

The Food Professor

21,806 次观看 • 7 个月前

We open-source Action Images — a new representation that translates 7-DoF robot actions into interpretable images. Video models are emerging as powerful robotic foundation models, but a key challenge remains: how can we seamlessly integrate robot policies into video models? Instead of representing actions as low-dimensional control tokens, Action Images provide a pixel-grounded action representation, reframing policy learning as a visual tracking problem! By unifying observations and actions in the same video space, Action Images enable a unified robotics world model that supports video-action joint generation, action-conditioned video generation, and action labeling! Code: Paper:

We open-source Action Images — a new representation that translates 7-DoF robot actions into interpretable images. Video models are emerging as powerful robotic foundation models, but a key challenge remains: how can we seamlessly integrate robot policies into video models? Instead of representing actions as low-dimensional control tokens, Action Images provide a pixel-grounded action representation, reframing policy learning as a visual tracking problem! By unifying observations and actions in the same video space, Action Images enable a unified robotics world model that supports video-action joint generation, action-conditioned video generation, and action labeling! Code: Paper:

Chuang Gan

20,281 次观看 • 2 个月前

The holy grail of robotics is to be able to perform previously-unseen, out-of-distribution manipulation tasks “zero shot” in a new environment. NovaFlow proposes an approach which (1) generates a video, (2) computes predicted flow — how points move through the scene — and (3) uses this flow as an objective to generate a motion. Using this procedure, NovaFlow generates motions in unseen scenes, for unseen tasks, and can transfer across embodiments. To learn more, we are joined by Hongyu Li and Jiahui Fu from RAI. Watch Episode #63 of RoboPapers with Chris Paxton and Michael Cho - Rbt/Acc now to learn more!

The holy grail of robotics is to be able to perform previously-unseen, out-of-distribution manipulation tasks “zero shot” in a new environment. NovaFlow proposes an approach which (1) generates a video, (2) computes predicted flow — how points move through the scene — and (3) uses this flow as an objective to generate a motion. Using this procedure, NovaFlow generates motions in unseen scenes, for unseen tasks, and can transfer across embodiments. To learn more, we are joined by Hongyu Li and Jiahui Fu from RAI. Watch Episode #63 of RoboPapers with Chris Paxton and Michael Cho - Rbt/Acc now to learn more!

RoboPapers

21,434 次观看 • 6 个月前

Meet Microsoft Scout. An always-on agent that keeps work moving, taking action without needing to be prompted each time. As Microsoft’s first Autopilot agent, Microsoft Scout works across Teams, Outlook, OneDrive, and more—taking action within the controls your organization sets. Learn more:

Meet Microsoft Scout. An always-on agent that keeps work moving, taking action without needing to be prompted each time. As Microsoft’s first Autopilot agent, Microsoft Scout works across Teams, Outlook, OneDrive, and more—taking action within the controls your organization sets. Learn more:

Microsoft 365

448,662 次观看 • 3 个月前