Loading video...

Video Failed to Load

Go Home

MagicSketch ๐Ÿคฉ Interactive image editing Gradio app. ๐Ÿคฏ An MLLM even infers editing intent in real-time and generates a prompt for inpainting for you!

39,802 views โ€ข 1 year ago โ€ขvia X (Twitter)

1 Comments

Gradio's profile picture
Gradio1 year ago

MagicSketch Gradio app coming soon on Spaces! Stay tuned. Visit Gradio today and start building your dream GenAI App with us!

Related Videos

InstantDrag Improving Interactivity in Drag-based Image Editing discuss: Drag-based image editing has recently gained popularity for its interactivity and precision. However, despite the ability of text-to-image models to generate samples within a second, drag editing still lags behind due to the challenge of accurately reflecting user interaction while maintaining image content. Some existing approaches rely on computationally intensive per-image optimization or intricate guidance-based methods, requiring additional inputs such as masks for movable regions and text prompts, thereby compromising the interactivity of the editing process. We introduce InstantDrag, an optimization-free pipeline that enhances interactivity and speed, requiring only an image and a drag instruction as input. InstantDrag consists of two carefully designed networks: a drag-conditioned optical flow generator (FlowGen) and an optical flow-conditioned diffusion model (FlowDiffusion). InstantDrag learns motion dynamics for drag-based image editing in real-world video datasets by decomposing the task into motion generation and motion-conditioned image generation. We demonstrate InstantDrag's capability to perform fast, photo-realistic edits without masks or text prompts through experiments on facial video datasets and general scenes. These results highlight the efficiency of our approach in handling drag-based image editing, making it a promising solution for interactive, real-time applications.

AK

71,228 views โ€ข 1 year ago