Loading video...
Video Failed to Load
Diffusion and flow matching-based robot planners are slow and generate noisy and jerky trajectories. Delighted to share our ICRA 2026 paper, which leverages IMLE to improve planning frequency 19-fold from 4.3 Hz to 83 Hz and reduces jerk by 38% relative to flow matching. Joint work w/ Grayson Lee,... show more
102,877 views • 4 months ago •via X (Twitter)
16 Comments

Generative models, such as diffusion models and flow matching, are widely used for robot planning. The goal is to model the probability distribution over plausible future trajectories conditioned on the initial state. (2/7)

Our method uses Implicit Maximum Likelihood Estimation (IMLE) to train a one-step generative model on trajectories of varying quality. IMLE works by having each trajectory in the training dataset pull the closest generated trajectory towards it. (3/7)

Vanilla IMLE treats all trajectories in the training dataset equally despite their varying quality. Since our goal is to generate trajectories of high quality, we propose reward-weighted IMLE, which emphasizes trajectories with high reward more than those with low reward. (4/7)

We demonstrate on offline reinforcement learning tasks that our IMLE model runs in real time on both the CPU and GPU and achieves an order-of-magnitude speedup relative to diffusion models. (5/7)

We deploy our planner onboard a mobile robot and demonstrate real-time navigation in dynamic multi-agent environments. (6/7)

For more details, see: - Project website: - Paper: - Code: If you are at ICRA, come check out Poster 301 on Tuesday afternoon! (7/7)

Bruh diffusion models are really bad at generalizing in real-time , learnt a lot from your paper and I think I will find myself always going back to this. Who would have thought that the denoising process is the root cause. My initial thoughts were that without the de-noisers generalizations wouldn’t work or be optimal. This is great works and it is real time.

This is so nice ! 👏👏👏

This is really cool! Are you looking for employees? Not for the salary I just like to play with things like this 🙃

Lil bro playing crossing road.

really cool

boids demo?

Felt nostalgic. 2018, I was trying something like IMLE in the other KL direction, and was trying to find a way to prevent collapse. Then I stumbled upon IMLE. Cool idea! Will check this out.

Cool

This is good it didn’t stop at all butterfly find a way while moving

looks like how the military would operate if the soldiers were cats
