Norman Di Palo's banner

Norman Di Palo

@normandipalo • 1,518 subscribers

deep learning + robots @ deepmind

Shorts

The future of robotics is in your hands. Literally. Excited to announce our new paper,✨R+X✨. A person records everyday activities while wearing a camera.A robot passively learns those skills. No labels, no training. Here's how. 👇

The future of robotics is in your hands. Literally. Excited to announce our new paper,✨R+X✨. A person records everyday activities while wearing a camera.A robot passively learns those skills. No labels, no training. Here's how. 👇

59,211 Aufrufe

we open sourced the code to transform human videos into robot trajectories, so you can train robots with your hands 👐🏻 we used it in our recent paper R+X: Retrieval and Execution from Everyday Human Videos (ICRA 2025 🇺🇸) link and details in thread 🧵

we open sourced the code to transform human videos into robot trajectories, so you can train robots with your hands 👐🏻 we used it in our recent paper R+X: Retrieval and Execution from Everyday Human Videos (ICRA 2025 🇺🇸) link and details in thread 🧵

10,578 Aufrufe

Excited to introduce Diffusion Augmented Agents (DAAGs)✨. We give an agent control of a diffusion model, so it can create its own *synthetic experience*.🪄 The result is a lifelong agent that can learn new reward detectors and policies, much more efficiently. Here's how. 👇

Excited to introduce Diffusion Augmented Agents (DAAGs)✨. We give an agent control of a diffusion model, so it can create its own synthetic experience.🪄 The result is a lifelong agent that can learn new reward detectors and policies, much more efficiently. Here's how. 👇

12,874 Aufrufe

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

Last month we announced Gemini Robotics (GR) and Gemini Robotics-ER (GR-ER). GR-ER is a powerful VLM specialised for spatial understanding, including detecting object poses in 2D/3D, pointing, and even *predicting grasp poses*. Take a look at this demo. Details below. 🧵

Last month we announced Gemini Robotics (GR) and Gemini Robotics-ER (GR-ER). GR-ER is a powerful VLM specialised for spatial understanding, including detecting object poses in 2D/3D, pointing, and even predicting grasp poses. Take a look at this demo. Details below. 🧵

56,437 Aufrufe • vor 1 Jahr

✨ Introducing Keypoint Action Tokens. 🤖 We translate visual observations and robot actions into a "language" that off-the-shelf LLMs can ingest and output. This transforms LLMs into *in-context, low-level imitation learning machines*. 🚀 Let me explain. 👇🧵

✨ Introducing Keypoint Action Tokens. 🤖 We translate visual observations and robot actions into a "language" that off-the-shelf LLMs can ingest and output. This transforms LLMs into in-context, low-level imitation learning machines. 🚀 Let me explain. 👇🧵

23,088 Aufrufe • vor 2 Jahren

Keine weiteren Inhalte verfügbar