Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

MagicSketch 🤩 Interactive image editing Gradio app. 🤯 An MLLM even infers editing intent in real-time and generates a prompt for inpainting for you!

Gradio

54,663 subscribers

39,802 views • 1 year ago •via X (Twitter)

Education Arts Science & Technology

Anya Rossi• Live Now

Private livecam show

1 Comments

Gradio1 year ago

MagicSketch Gradio app coming soon on Spaces! Stay tuned. Visit Gradio today and start building your dream GenAI App with us!

Related Videos

Object Cutter Create high-quality HD background removal for ANY object in your image with a text prompt or bounding boxes!

Object Cutter Create high-quality HD background removal for ANY object in your image with a text prompt or bounding boxes!

Gradio

136,042 views • 1 year ago

Text3D - a nice little gradio app that generates images that can be used to generate 3D artefacts downstream.

Text3D - a nice little gradio app that generates images that can be used to generate 3D artefacts downstream.

Gradio

42,475 views • 1 year ago

Have you had the chance to try out the amazing music generation Mustango Gradio app yet?Have you tried the Mustango Gradio app for generating music yet? It's amazing!🎶🎵🤩 Awesome work by Soujanya Poria Deepanway Ghosal and whole DeCLaRe team🙌

Have you had the chance to try out the amazing music generation Mustango Gradio app yet?Have you tried the Mustango Gradio app for generating music yet? It's amazing!🎶🎵🤩 Awesome work by Soujanya Poria Deepanway Ghosal and whole DeCLaRe team🙌

Gradio

39,550 views • 2 years ago

🚀 Introducing 𝐈𝐃𝐌-𝐕𝐓𝐎𝐍 : A novel diffusion model for image-based virtual try-on! 👗 😍 Improves garment fidelity and generates authentic visuals. 🔧 Uses two modules to encode garment semantics: visual encoder for high-level & parallel UNet for low-level. Links below👇

🚀 Introducing 𝐈𝐃𝐌-𝐕𝐓𝐎𝐍 : A novel diffusion model for image-based virtual try-on! 👗 😍 Improves garment fidelity and generates authentic visuals. 🔧 Uses two modules to encode garment semantics: visual encoder for high-level & parallel UNet for low-level. Links below👇

Gradio

104,492 views • 2 years ago

What if you could edit any image with just a prompt? Now you can. No masks. No brushes. Just words. Prompt-based editing is live for everyone in Ideogram.

What if you could edit any image with just a prompt? Now you can. No masks. No brushes. Just words. Prompt-based editing is live for everyone in Ideogram.

Ideogram

10,338 views • 6 months ago

Wait what 🤯 Gradio's new Playground Search is just: "how do i use image component?" ↓ *gets perfect docs* ↓ *generates working code* ↓ *demo ready* we really used to read docs at one point?

Wait what 🤯 Gradio's new Playground Search is just: "how do i use image component?" ↓ gets perfect docs ↓ generates working code ↓ demo ready we really used to read docs at one point?

Gradio

13,919 views • 1 year ago

skz making an mv for airplane on vlive in real time and then seungmin editing it 😭

skz making an mv for airplane on vlive in real time and then seungmin editing it 😭

mel ꕤ

170,048 views • 1 year ago

TurboEdit Instant text-based image editing discuss: We address the challenges of precise image inversion and disentangled image editing in the context of few-step diffusion models. We introduce an encoder based iterative inversion technique. The inversion network is conditioned on the input image and the reconstructed image from the previous step, allowing for correction of the next reconstruction towards the input image. We demonstrate that disentangled controls can be easily achieved in the few-step diffusion model by conditioning on an (automatically generated) detailed text prompt. To manipulate the inverted image, we freeze the noise maps and modify one attribute in the text prompt (either manually or via instruction based editing driven by an LLM), resulting in the generation of a new image similar to the input image with only one attribute changed. It can further control the editing strength and accept instructive text prompt. Our approach facilitates realistic text-guided image edits in real-time, requiring only 8 number of functional evaluations (NFEs) in inversion (one-time cost) and 4 NFEs per edit. Our method is not only fast, but also significantly outperforms state-of-the-art multi-step diffusion editing techniques.

TurboEdit Instant text-based image editing discuss: We address the challenges of precise image inversion and disentangled image editing in the context of few-step diffusion models. We introduce an encoder based iterative inversion technique. The inversion network is conditioned on the input image and the reconstructed image from the previous step, allowing for correction of the next reconstruction towards the input image. We demonstrate that disentangled controls can be easily achieved in the few-step diffusion model by conditioning on an (automatically generated) detailed text prompt. To manipulate the inverted image, we freeze the noise maps and modify one attribute in the text prompt (either manually or via instruction based editing driven by an LLM), resulting in the generation of a new image similar to the input image with only one attribute changed. It can further control the editing strength and accept instructive text prompt. Our approach facilitates realistic text-guided image edits in real-time, requiring only 8 number of functional evaluations (NFEs) in inversion (one-time cost) and 4 NFEs per edit. Our method is not only fast, but also significantly outperforms state-of-the-art multi-step diffusion editing techniques.

AK

16,062 views • 2 years ago

𝐒𝐔𝐏𝐈𝐑: An advanced image restoration method that combines generative prior and model scaling,using a 20-million image dataset, and can manipulate restorations with textual prompts. Kudos to Fanghua Yu Jinjin Gu Xintao Wang et al🚀 SUPIR supports Gradio demo in repo [links👇]

𝐒𝐔𝐏𝐈𝐑: An advanced image restoration method that combines generative prior and model scaling,using a 20-million image dataset, and can manipulate restorations with textual prompts. Kudos to Fanghua Yu Jinjin Gu Xintao Wang et al🚀 SUPIR supports Gradio demo in repo [links👇]

Gradio

56,366 views • 2 years ago

InstantDrag Improving Interactivity in Drag-based Image Editing discuss: Drag-based image editing has recently gained popularity for its interactivity and precision. However, despite the ability of text-to-image models to generate samples within a second, drag editing still lags behind due to the challenge of accurately reflecting user interaction while maintaining image content. Some existing approaches rely on computationally intensive per-image optimization or intricate guidance-based methods, requiring additional inputs such as masks for movable regions and text prompts, thereby compromising the interactivity of the editing process. We introduce InstantDrag, an optimization-free pipeline that enhances interactivity and speed, requiring only an image and a drag instruction as input. InstantDrag consists of two carefully designed networks: a drag-conditioned optical flow generator (FlowGen) and an optical flow-conditioned diffusion model (FlowDiffusion). InstantDrag learns motion dynamics for drag-based image editing in real-world video datasets by decomposing the task into motion generation and motion-conditioned image generation. We demonstrate InstantDrag's capability to perform fast, photo-realistic edits without masks or text prompts through experiments on facial video datasets and general scenes. These results highlight the efficiency of our approach in handling drag-based image editing, making it a promising solution for interactive, real-time applications.

InstantDrag Improving Interactivity in Drag-based Image Editing discuss: Drag-based image editing has recently gained popularity for its interactivity and precision. However, despite the ability of text-to-image models to generate samples within a second, drag editing still lags behind due to the challenge of accurately reflecting user interaction while maintaining image content. Some existing approaches rely on computationally intensive per-image optimization or intricate guidance-based methods, requiring additional inputs such as masks for movable regions and text prompts, thereby compromising the interactivity of the editing process. We introduce InstantDrag, an optimization-free pipeline that enhances interactivity and speed, requiring only an image and a drag instruction as input. InstantDrag consists of two carefully designed networks: a drag-conditioned optical flow generator (FlowGen) and an optical flow-conditioned diffusion model (FlowDiffusion). InstantDrag learns motion dynamics for drag-based image editing in real-world video datasets by decomposing the task into motion generation and motion-conditioned image generation. We demonstrate InstantDrag's capability to perform fast, photo-realistic edits without masks or text prompts through experiments on facial video datasets and general scenes. These results highlight the efficiency of our approach in handling drag-based image editing, making it a promising solution for interactive, real-time applications.

AK

71,232 views • 1 year ago

Meta has released Melody Flow!🚀 🎵 😮 High fidelity Music Generation for your prompt, and you can Edit your music too! [Sound: ON]

Meta has released Melody Flow!🚀 🎵 😮 High fidelity Music Generation for your prompt, and you can Edit your music too! [Sound: ON]

Gradio

86,683 views • 1 year ago

✨ Lights on, AI activated ✨ Upload ANY photo with lamp(s). Watch this app instantly illuminate it. No Photoshop. No editing skills needed. Just pure AI magic.🔥 Try Finegrain Light Switcher now.

✨ Lights on, AI activated ✨ Upload ANY photo with lamp(s). Watch this app instantly illuminate it. No Photoshop. No editing skills needed. Just pure AI magic.🔥 Try Finegrain Light Switcher now.

Gradio

62,995 views • 1 year ago

Qwen-Image-Edit is out in anycoder for image editing in your vibe coded apps Built on 20B Qwen-Image, it brings precise bilingual text editing (Chinese & English) while preserving style, and supports both semantic and appearance-level editing.

Qwen-Image-Edit is out in anycoder for image editing in your vibe coded apps Built on 20B Qwen-Image, it brings precise bilingual text editing (Chinese & English) while preserving style, and supports both semantic and appearance-level editing.

AK

119,012 views • 1 year ago

Introducing Clova Its cursor for video editing, generates full edits from a simple prompt & its live right now @ joinclova. com/edit

Introducing Clova Its cursor for video editing, generates full edits from a simple prompt & its live right now @ joinclova. com/edit

William Wang

833,503 views • 1 year ago

🤯 OneDiffusion: A versatile, large-scale diffusion model that seamlessly supports bidirectional image synthesis and understanding across diverse tasks. ✅ Text to Image ✅ Image to Depth ✅ Image to Segmentation ✅ Image to Pose ✅ FaceID ✅ Image to Multiview How to use & more👇

🤯 OneDiffusion: A versatile, large-scale diffusion model that seamlessly supports bidirectional image synthesis and understanding across diverse tasks. ✅ Text to Image ✅ Image to Depth ✅ Image to Segmentation ✅ Image to Pose ✅ FaceID ✅ Image to Multiview How to use & more👇

Gradio

11,820 views • 1 year ago