Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Introducing Mobi-π: Mobilizing Your Robot Learning Policy. Our method: ✈️ enables flexible mobile skill chaining 🪶 without requiring additional policy training data 🏠 while scaling to unseen scenes 🧵↓

59,304 Aufrufe • vor 1 Jahr •via X (Twitter)

11 Kommentare

Profilbild von Jingyun Yang
Jingyun Yangvor 1 Jahr

We introduce the "policy mobilization" problem. Given a manipulation policy trained on data collected from limited viewpoints, policy mobilization aims to find an optimal robot pose in an unseen environment to successfully execute this policy on a mobile platform. 1/6

Profilbild von Jingyun Yang
Jingyun Yangvor 1 Jahr

What makes a good policy mobilization method? We propose a new method consisting of four simple steps: 1️⃣ Capture the test-time scene 2️⃣ Create a 3D Gaussian Splat 3️⃣ Compute hybrid scores of rendered views 4️⃣ Optimize! 2/6

Profilbild von Jingyun Yang
Jingyun Yangvor 1 Jahr

We show in simulated and real-world experiments that our policy mobilization method is 💡 more data-efficient than an end-to-end mobile manipulation policy 💡 more robust than naive object navigation methods 3/6

Profilbild von Jingyun Yang
Jingyun Yangvor 1 Jahr

We demonstrate that policy mobilization enables flexible deployment of locally-trained policies on a mobile platform in the real world, including: ✅ scaling to large scenes ✅ generalization to unseen room layouts and object positions ✅ composition of atomic skills 4/6

Profilbild von Jingyun Yang
Jingyun Yangvor 1 Jahr

To effectively study policy mobilization, we develop the Mobi-π framework, which includes a simulated task suite, mobilization feasibility metrics, baselines, and visualization tools. 5/6

Profilbild von Jingyun Yang
Jingyun Yangvor 1 Jahr

Want to learn more? Website: Code: arXiv: Team: @yjy0625, Isabella Huang, @brandontvu, Max Bajracharya, @contactrika, @leto__jean Collaboration between @ToyotaResearch and @StanfordIPRL 6/6

Profilbild von Yunfan Jiang
Yunfan Jiangvor 1 Jahr

Great work! Congrats Jingyun and the team!!!👏

Profilbild von Jingyun Yang
Jingyun Yangvor 1 Jahr

Thanks Yunfan!

Profilbild von Erika S
Erika Svor 1 Jahr

Mobi-π's ability to scale to unseen scenes without additional training data is what excites me most! This could really push mobile robotics forward. ✈️

Profilbild von JJ Walker
JJ Walkervor 1 Jahr

Love how Mobi-π ditches constant retraining—huge for real-world robotics! Can totally picture these skills in action in kitchens or hospitals. What’s the next space you’re targeting? 👏

Profilbild von Blueblauw
Blueblauwvor 1 Jahr

@Rollup_News rollup

Ähnliche Videos