Max Fu
@letian_fu • 1,799 subscribers
scaling robotics @GoogleDeepMind. prev phd @UCBerkeley @berkeley_ai @NVIDIA @Apple @autodesk
Videos
Robotics: coding agents’ next frontier. So how good are they? We introduce CaP-X: an open-source framework and benchmark for coding agents, where they write code for robot perception and control, execute it on sim and real robots, observe the outcomes, and iteratively improve code reliability. From NVIDIA Berkeley AI Research CMU Robotics Institute Stanford AI Lab 🧵
Max Fu179,196 görüntüleme • 5 ay önce
In-context learning is the holy grail of robot learning. It is challenging because: 1. long-context training and infra (ICL can easily max out disk I/O) 2. need model to follow multimodal (sensorimotor) condition 3. data collection strategy and how to pair data Tried to get it work in 2024, where we proposed in-context robot transformer, an autoregressive formulation: Congrats on the launch! Looking forward to seeing few-shot improvement via in-context learning in the future!
Max Fu10,235 görüntüleme • 1 ay önce
Tired of teleoperating your robots? We built a way to scale robot datasets without teleop, dynamic simulation, or even robot hardware. Just one smartphone scan + one human hand demo video → thousands of diverse robot trajectories. Trainable by diffusion policy and VLA models as-is. Introducing: Real2Render2Real 👉
Max Fu69,381 görüntüleme • 1 yıl önce
![Vision-language models perform diverse tasks via in-context learning. Time for robots to do the same! Introducing In-Context Robot Transformer (ICRT): a robot policy that learns new tasks by prompting with robot trajectories, without any fine-tuning. [1/N]](https://image.24vids.com/tw-1829235845985120618/ext_tw_video_thumb/1829235028871598081/pu/img/cVtUH50d7Q4sFesK.jpg)
Daha fazla içerik yok.