正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Introducing Generative Omnimatte: A method for decomposing a video into complete layers, including objects and their associated effects (e.g., shadows, reflections). It enables many cool applications, such as video stylization, compositions, moment retiming, and object removal.

Jia-Bin Huang

78,959 subscribers

81,723 次观看 • 1 年前 •via X (Twitter)

科学技术教育

Anya Rossi• Live Now

Private livecam show

10 条评论

Jia-Bin Huang 的头像

Jia-Bin Huang1 年前

Watch the explainer video to learn more! I experimented with new editing styles for this video and had a lot of fun making it. I hope you like it.

Jia-Bin Huang 的头像

Jia-Bin Huang1 年前

Check out the project website for many more examples and comparisons.

Jia-Bin Huang 的头像

Jia-Bin Huang1 年前

Brought to you by the amazing @YaoChihLee and friends. Check out Yao-Chih's post for a more detailed breakdown of this exciting work.

Dan Benyamin (Æ) 的头像

Dan Benyamin (Æ)1 年前

So cool! Will you be releasing the code?

FunTresting Things :) 的头像

FunTresting Things :)1 年前

Cool. Is that open source?

Walker Hawker 🦎🦅🔜 IWAG 的头像

Walker Hawker 🦎🦅🔜 IWAG1 年前

Rotoscoping made easier

Divyansh Tripathi 的头像

Divyansh Tripathi1 年前

AD and marketing industry seems to be its biggest consumer

Designer J 的头像

Designer J1 年前

This is such a huge game changer for video editing.

Alexandre Morgand 的头像

Alexandre Morgand1 年前

Beautiful and awesome video. Hopefully I can give it a spin one day 👌

Andu 🇺🇦🇪🇺 的头像

Andu 🇺🇦🇪🇺1 年前

Cool idea!

相关视频

🚀🚨🤖Adobe revealed the integration of four innovative generative AI features: Object Addition, Object Removal, Generative Extend, and Text Video Supporting an AI open ecosystem for third-party plugins, such as OpenAI Pika and Runway Highlighting commitment to responsible AI, focusing on ethically guided training for commercial applications. Video: Adobe Creative Cloud

🚀🚨🤖Adobe revealed the integration of four innovative generative AI features: Object Addition, Object Removal, Generative Extend, and Text Video Supporting an AI open ecosystem for third-party plugins, such as OpenAI Pika and Runway Highlighting commitment to responsible AI, focusing on ethically guided training for commercial applications. Video: Adobe Creative Cloud

Teodora P L

13,659 次观看 • 2 年前

"ROSE: Remove Objects with Side Effects in Videos" TL;DR: Diffusion transformer; five common cases: shadows, reflections, light, translucency and mirror as video side effects to remove

"ROSE: Remove Objects with Side Effects in Videos" TL;DR: Diffusion transformer; five common cases: shadows, reflections, light, translucency and mirror as video side effects to remove

Alexandre Morgand

85,858 次观看 • 9 个月前

🚀 Introducing DiffusionRenderer, a neural rendering engine powered by video diffusion models. 🎥 Estimates high-quality geometry and materials from videos, synthesizes photorealistic light transport, enables relighting and material editing with realistic shadows and reflections

🚀 Introducing DiffusionRenderer, a neural rendering engine powered by video diffusion models. 🎥 Estimates high-quality geometry and materials from videos, synthesizes photorealistic light transport, enables relighting and material editing with realistic shadows and reflections

Zian Wang

125,348 次观看 • 1 年前

A paper in Nature Communications describes a detachable robotic hand that can crawl and grab objects. The design enables tasks such as retrieving objects beyond normal reach and performing multi-object handling.

A paper in Nature Communications describes a detachable robotic hand that can crawl and grab objects. The design enables tasks such as retrieving objects beyond normal reach and performing multi-object handling.

Nature Portfolio

28,358 次观看 • 4 个月前

Introducing 3D Projections & Noise Effects - Wrap layers into 3D objects - Perspective and lighting - Noise Glass + Distortion Available on Spline Hana now.

Introducing 3D Projections & Noise Effects - Wrap layers into 3D objects - Perspective and lighting - Noise Glass + Distortion Available on Spline Hana now.

Spline

63,222 次观看 • 10 个月前

Track Anything: Segment Anything Meets Videos Track-Anything is a flexible and interactive tool for video object tracking and segmentation suitable for: - Video object tracking and segmentation with shot changes. - Visualized development and data annnotation for video object tracking and segmentation. - Object-centric downstream video tasks, such as video inpainting and editing. abs: github:

Track Anything: Segment Anything Meets Videos Track-Anything is a flexible and interactive tool for video object tracking and segmentation suitable for: - Video object tracking and segmentation with shot changes. - Visualized development and data annnotation for video object tracking and segmentation. - Object-centric downstream video tasks, such as video inpainting and editing. abs: github:

AK

578,577 次观看 • 3 年前

Introducing HO-Cap: A Capture System and Dataset for 3D Reconstruction and Pose Tracking of Hand-Object Interaction. We built a multi-camera system and a semi-automatic method for annotating the shape and pose of hands and objects Project page:

Introducing HO-Cap: A Capture System and Dataset for 3D Reconstruction and Pose Tracking of Hand-Object Interaction. We built a multi-camera system and a semi-automatic method for annotating the shape and pose of hands and objects Project page:

Yu Xiang

57,228 次观看 • 1 年前

We're thrilled to announce breakthrough #GenerativeAI features powered by the new #AdobeFirefly video model. Take a sneak peek at Object Addition, Object Removal and Generative Extend. All coming soon to #PremierePro! 💥

We're thrilled to announce breakthrough #GenerativeAI features powered by the new #AdobeFirefly video model. Take a sneak peek at Object Addition, Object Removal and Generative Extend. All coming soon to #PremierePro! 💥

Adobe

624,528 次观看 • 2 年前

OmnimatteZero. Training-free video editing. Pulls foreground objects (shadows/reflections) and reconstructs backgrounds in real-time. - LTX-Video/Wan2.1, ~24fps on an A100. Finally, clean background without manual rotoscoping.

OmnimatteZero. Training-free video editing. Pulls foreground objects (shadows/reflections) and reconstructs backgrounds in real-time. - LTX-Video/Wan2.1, ~24fps on an A100. Finally, clean background without manual rotoscoping.

Wildminder

38,917 次观看 • 4 个月前

Introducing Runway Aleph, a new way to edit, transform and generate video. Aleph is a state-of-the-art in-context video model, setting a new frontier for multi-task visual generation, with the ability to perform a wide range of edits on an input video such as adding, removing and transforming objects, getting new angles of a scene and modifying style and lighting, among many other tasks.

Introducing Runway Aleph, a new way to edit, transform and generate video. Aleph is a state-of-the-art in-context video model, setting a new frontier for multi-task visual generation, with the ability to perform a wide range of edits on an input video such as adding, removing and transforming objects, getting new angles of a scene and modifying style and lighting, among many other tasks.

Runway

646,324 次观看 • 10 个月前

$Spatial AI is increasingly important, and the newest papers from #NVIDIAResearch, 3DGRT and 3DGUT, represent significant advancements in enabling researchers and developers to explore and innovate with 3D Gaussian Splatting techniques. 💎 3DGRT (Gaussian Ray Tracing) ➡️ - Enables secondary lighting effects such as refractions, shadows, depth of field, and mirrors. - Provides a foundation for further research in ray tracing-based rendering of Gaussian representations. - Achieves real-time rendering performance on modern GPUs. ✨ 3DGUT (Gaussain Unscented Transform) ➡️ - Support for distorted camera models and time-dependent effects like rolling shutter. - Enables phenomena such as reflections and refractions while retaining real-time efficiency. 📥 Code:$

Spatial AI is increasingly important, and the newest papers from #NVIDIAResearch, 3DGRT and 3DGUT, represent significant advancements in enabling researchers and developers to explore and innovate with 3D Gaussian Splatting techniques. 💎 3DGRT (Gaussian Ray Tracing) ➡️ - Enables secondary lighting effects such as refractions, shadows, depth of field, and mirrors. - Provides a foundation for further research in ray tracing-based rendering of Gaussian representations. - Achieves real-time rendering performance on modern GPUs. ✨ 3DGUT (Gaussain Unscented Transform) ➡️ - Support for distorted camera models and time-dependent effects like rolling shutter. - Enables phenomena such as reflections and refractions while retaining real-time efficiency. 📥 Code:

NVIDIA AI Developer

27,724 次观看 • 1 年前

ObjectClear can remove objects from images while also getting rid of shadows and reflections

ObjectClear can remove objects from images while also getting rid of shadows and reflections

Dreaming Tulpa 🥓👑

26,692 次观看 • 1 年前

Introducing UWPSpy, an inspection tool for UWP applications that enables to view and manipulate UI elements and their properties in real time! Download: Source code:

Introducing UWPSpy, an inspection tool for UWP applications that enables to view and manipulate UI elements and their properties in real time! Download: Source code:

Michael Maltsev

23,018 次观看 • 2 年前

The Google Research team has unveiled a new method that lets one turn a still photo into a looping video or interact with objects in the image. Details: #google #googleresearch #research #model #generative #generativetech #generativetechnology #ai

The Google Research team has unveiled a new method that lets one turn a still photo into a looping video or interact with objects in the image. Details: #google #googleresearch #research #model #generative #generativetech #generativetechnology #ai

80 LEVEL

77,008 次观看 • 2 年前

Introducing 𝐒𝐀𝐑𝟑𝐃, which tokenizes 3D objects into multiscale tokens and generates 3D objects by autoregressive next-scale prediction. 𝐒𝐀𝐑𝟑𝐃 enables fast 3D generation and comprehensive 3D understanding. arXiv: Project:

Introducing 𝐒𝐀𝐑𝟑𝐃, which tokenizes 3D objects into multiscale tokens and generates 3D objects by autoregressive next-scale prediction. 𝐒𝐀𝐑𝟑𝐃 enables fast 3D generation and comprehensive 3D understanding. arXiv: Project:

Xingang Pan

28,248 次观看 • 1 年前

adobe is cooking a new inpainting method that understands context extremely well! ELI5: it can insert stuff with the correct perspective and add/remove connected reflections/shadows 👀

adobe is cooking a new inpainting method that understands context extremely well! ELI5: it can insert stuff with the correct perspective and add/remove connected reflections/shadows 👀

Dreaming Tulpa 🥓👑

58,637 次观看 • 1 年前

Introducing TAPIR & RoboTAP, our latest research from Google DeepMind. It focuses on spatial intelligence via point tracking, outlining how it enables applications from robotics to video generation to augmented reality, and more!

Introducing TAPIR & RoboTAP, our latest research from Google DeepMind. It focuses on spatial intelligence via point tracking, outlining how it enables applications from robotics to video generation to augmented reality, and more!

Carl Doersch

47,833 次观看 • 2 年前

and just for fun. heres one of the effects layers for this video that i thought looked really cool. basically i set the shutter in blender to 4 (max is usually 1) and it looked really fucked up.

and just for fun. heres one of the effects layers for this video that i thought looked really cool. basically i set the shutter in blender to 4 (max is usually 1) and it looked really fucked up.

Sparky1j

24,439 次观看 • 11 个月前

I'm excited to share our new work Diffusion as Shader (DaS), a versatile controllable video generation method for various tasks: object manipulation, camera control, mesh-to-video, and motion transfer. Project page: Github:

I'm excited to share our new work Diffusion as Shader (DaS), a versatile controllable video generation method for various tasks: object manipulation, camera control, mesh-to-video, and motion transfer. Project page: Github:

Yuan Liu

33,363 次观看 • 1 年前

Humans grasp objects with a purpose! Web2Grasp enables such functional grasping for dexterous robot hands via hand-object reconstruction from web images - without *any* robot teleop data collection 1/n

Humans grasp objects with a purpose! Web2Grasp enables such functional grasping for dexterous robot hands via hand-object reconstruction from web images - without any robot teleop data collection 1/n

Homanga Bharadhwaj @ CVPR

28,408 次观看 • 1 年前