Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

FramePainter Endowing Interactive Image Editing with Video Diffusion Priors

_akhaliq's profile picture

AK

505,323 subscribers

32,228 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

😀 ToonCrafter: Generative Cartoon Interpolation 🔆 Can interpolate two cartoon images by leveraging the pre-trained image-to-video diffusion priors. Model on 🤗👇
0:10

😀 ToonCrafter: Generative Cartoon Interpolation 🔆 Can interpolate two cartoon images by leveraging the pre-trained image-to-video diffusion priors. Model on 🤗👇

Gradio

93,074 Aufrufe • vor 2 Jahren

🚨 Real-time image-to-image editing drops on fal! 🎨 10+ FPS for instant results for FLUX.2 Klein ✨ Low latency, production-ready 💰 Hand-tuned kernels for real-time execution 🎬 Image editing at interactive speeds
0:19

🚨 Real-time image-to-image editing drops on fal! 🎨 10+ FPS for instant results for FLUX.2 Klein ✨ Low latency, production-ready 💰 Hand-tuned kernels for real-time execution 🎬 Image editing at interactive speeds

fal

35,880 Aufrufe • vor 4 Monaten

Playing with the early access to Kling 3.0!! 15s video, image to video or video editing. First test with image to video, looks very promising! Kling AI
0:15

Playing with the early access to Kling 3.0!! 15s video, image to video or video editing. First test with image to video, looks very promising! Kling AI

James Yeung

24,243 Aufrufe • vor 4 Monaten

🤯 𝐒𝐥𝐢𝐜𝐞𝐝𝐢𝐭 : A revolutionary approach to zero-shot video editing✏️🎥 using text-to-image diffusion models 🎞️Slicedit achieves great temporal consistency by leveraging spatio-temporal "slices"🔀
0:10

🤯 𝐒𝐥𝐢𝐜𝐞𝐝𝐢𝐭 : A revolutionary approach to zero-shot video editing✏️🎥 using text-to-image diffusion models 🎞️Slicedit achieves great temporal consistency by leveraging spatio-temporal "slices"🔀

Gradio

19,584 Aufrufe • vor 2 Jahren

So many styles and tools available with Grok Imagine! I make videos for the children at home, and now they ask me for them every day.🥰 Image + image editing + video editing + video extension: All of this is available with grok
0:16

So many styles and tools available with Grok Imagine! I make videos for the children at home, and now they ask me for them every day.🥰 Image + image editing + video editing + video extension: All of this is available with grok

Déborah

7,217,526 Aufrufe • vor 3 Monaten

DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion abs: project page: github:
0:16

DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion abs: project page: github:

AK

152,818 Aufrufe • vor 3 Jahren

🔹Balloons at Sunset🔹 Workflow: • Image - Midjourney • Animation - #Gen2 • Video Editing - Runway • Audio created with @mytracksy
0:14

🔹Balloons at Sunset🔹 Workflow: • Image - Midjourney • Animation - #Gen2 • Video Editing - Runway • Audio created with @mytracksy

Heather Cooper

13,224 Aufrufe • vor 2 Jahren

Diffusion models have amazing image creation abilities. But how well does their generative knowledge transfer to discriminative tasks? We present Diffusion Classifier: strong classification results with pretrained conditional diffusion models, *with no additional training*! 1/9
0:13

Diffusion models have amazing image creation abilities. But how well does their generative knowledge transfer to discriminative tasks? We present Diffusion Classifier: strong classification results with pretrained conditional diffusion models, *with no additional training*! 1/9

Alex Li

95,304 Aufrufe • vor 2 Jahren

I'm still alive. So does the parrot. Made with : Pika (animation) Stable Diffusion (original frames) Adobe Photoshop (editing) Wondershare Filmora Video Editor (compositing) (voice) - Pixabay (sounds effects)
0:19

I'm still alive. So does the parrot. Made with : Pika (animation) Stable Diffusion (original frames) Adobe Photoshop (editing) Wondershare Filmora Video Editor (compositing) (voice) - Pixabay (sounds effects)

Stelfie the Time Traveller

17,932 Aufrufe • vor 2 Jahren

🆕 Image super-resolution model just dropped! Superior results even with a single sampling step. 🔥InvSR: Arbitrary-steps Image Super-resolution via Diffusion Inversion.
0:12

🆕 Image super-resolution model just dropped! Superior results even with a single sampling step. 🔥InvSR: Arbitrary-steps Image Super-resolution via Diffusion Inversion.

Gradio

53,331 Aufrufe • vor 1 Jahr

We introduce TurboEdit -- simple text-based image editing in 1/2 sec! We leverage few-step diffusion models, mapping real images into noise with an encoder. Please see our #ECCV2024 paper: Work w/ Zongze Wu, Nick Kolkin, Jon Brandt, Eli Shechtman 1/
0:15

We introduce TurboEdit -- simple text-based image editing in 1/2 sec! We leverage few-step diffusion models, mapping real images into noise with an encoder. Please see our #ECCV2024 paper: Work w/ Zongze Wu, Nick Kolkin, Jon Brandt, Eli Shechtman 1/

Richard Zhang

39,306 Aufrufe • vor 1 Jahr

Image editing as video gen, Let you see the "chain-of-thoughts" of these AI models doing image editing! Super cool! Huge code drop! Everything is open-source now! Check it out 🔥
0:13

Image editing as video gen, Let you see the "chain-of-thoughts" of these AI models doing image editing! Super cool! Huge code drop! Everything is open-source now! Check it out 🔥

Ruilong Li

13,450 Aufrufe • vor 7 Monaten

Got carried away with this interactive module for breaking down the CSS mask-image property
0:16

Got carried away with this interactive module for breaking down the CSS mask-image property

rauno

30,879 Aufrufe • vor 10 Monaten

BREAKING: Grok introduces a new image editing feature – edit images with just a description.
0:11

BREAKING: Grok introduces a new image editing feature – edit images with just a description.

DogeDesigner

110,114 Aufrufe • vor 1 Jahr

MMaDA-Parallel Multimodal Large Diffusion Language Models for Thinking-Aware Editing and Generation
0:16

MMaDA-Parallel Multimodal Large Diffusion Language Models for Thinking-Aware Editing and Generation

AK

66,111 Aufrufe • vor 7 Monaten

MaskINT: Video Editing via Interpolative Non-autoregressive Masked Transformers paper page: Recent advances in generative AI have significantly enhanced image and video editing, particularly in the context of text prompt control. State-of-the-art approaches predominantly rely on diffusion models to accomplish these tasks. However, the computational demands of diffusion-based methods are substantial, often necessitating large-scale paired datasets for training, and therefore challenging the deployment in practical applications. This study addresses this challenge by breaking down the text-based video editing process into two separate stages. In the first stage, we leverage an existing text-to-image diffusion model to simultaneously edit a few keyframes without additional fine-tuning. In the second stage, we introduce an efficient model called MaskINT, which is built on non-autoregressive masked generative transformers and specializes in frame interpolation between the keyframes, benefiting from structural guidance provided by intermediate frames. Our comprehensive set of experiments illustrates the efficacy and efficiency of MaskINT when compared to other diffusion-based methodologies. This research offers a practical solution for text-based video editing and showcases the potential of non-autoregressive masked generative transformers in this domain.
0:19

MaskINT: Video Editing via Interpolative Non-autoregressive Masked Transformers paper page: Recent advances in generative AI have significantly enhanced image and video editing, particularly in the context of text prompt control. State-of-the-art approaches predominantly rely on diffusion models to accomplish these tasks. However, the computational demands of diffusion-based methods are substantial, often necessitating large-scale paired datasets for training, and therefore challenging the deployment in practical applications. This study addresses this challenge by breaking down the text-based video editing process into two separate stages. In the first stage, we leverage an existing text-to-image diffusion model to simultaneously edit a few keyframes without additional fine-tuning. In the second stage, we introduce an efficient model called MaskINT, which is built on non-autoregressive masked generative transformers and specializes in frame interpolation between the keyframes, benefiting from structural guidance provided by intermediate frames. Our comprehensive set of experiments illustrates the efficacy and efficiency of MaskINT when compared to other diffusion-based methodologies. This research offers a practical solution for text-based video editing and showcases the potential of non-autoregressive masked generative transformers in this domain.

AK

25,368 Aufrufe • vor 2 Jahren

Turn still images into stunning 4K videos in seconds! With Akool’s AI-powered Image to Video tool, you can customize your video with creative promos and personal touches — no editing skills needed. Try it now:
0:15

Turn still images into stunning 4K videos in seconds! With Akool’s AI-powered Image to Video tool, you can customize your video with creative promos and personal touches — no editing skills needed. Try it now:

Akool Inc

11,229,929 Aufrufe • vor 1 Jahr

Relightify: Relightable 3D Faces from a Single Image via Diffusion Models abs: paper page:
0:10

Relightify: Relightable 3D Faces from a Single Image via Diffusion Models abs: paper page:

AK

85,893 Aufrufe • vor 3 Jahren

High-resolution image and video generation is hitting a wall because attention in DiTs scales quadratically with token count. But does every pixel need to be in full resolution? Introducing Foveated Diffusion: a new approach for efficient diffusion-based generation that allocates compute where it matters most. 1/7🧵
0:17

High-resolution image and video generation is hitting a wall because attention in DiTs scales quadratically with token count. But does every pixel need to be in full resolution? Introducing Foveated Diffusion: a new approach for efficient diffusion-based generation that allocates compute where it matters most. 1/7🧵

Gordon Wetzstein

163,139 Aufrufe • vor 2 Monaten