Introducing Generative Omnimatte: A method for decomposing a video into complete layers, including objects and their associated effects (e.g., shadows, reflections). It enables many cool applications, such as video stylization, compositions, moment retiming, and object removal.

Watch the explainer video to learn more! I experimented with new editing styles for this video and had a lot of fun making it. I hope you like it.

Check out the project website for many more examples and comparisons.

Brought to you by the amazing @YaoChihLee and friends. Check out Yao-Chih's post for a more detailed breakdown of this exciting work.

So cool! Will you be releasing the code?

Cool. Is that open source?

Rotoscoping made easier

AD and marketing industry seems to be its biggest consumer

This is such a huge game changer for video editing.

Beautiful and awesome video. Hopefully I can give it a spin one day 👌

Cool idea!