Sensitive content

This media may contain sensitive content.

正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold paper page:

AK

395,973 subscribers

3,396,886 次观看 • 3 年前 •via X (Twitter)

教育科学技术

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

This is wild: DraGAN: Interactive point-based manipulation of images using AI. This gives you controllability of the pose, shape, expression, and layout of the objects in your images.

This is wild: DraGAN: Interactive point-based manipulation of images using AI. This gives you controllability of the pose, shape, expression, and layout of the objects in your images.

AI Breakfast

1,101,113 次观看 • 3 年前

InstantDrag Improving Interactivity in Drag-based Image Editing discuss: Drag-based image editing has recently gained popularity for its interactivity and precision. However, despite the ability of text-to-image models to generate samples within a second, drag editing still lags behind due to the challenge of accurately reflecting user interaction while maintaining image content. Some existing approaches rely on computationally intensive per-image optimization or intricate guidance-based methods, requiring additional inputs such as masks for movable regions and text prompts, thereby compromising the interactivity of the editing process. We introduce InstantDrag, an optimization-free pipeline that enhances interactivity and speed, requiring only an image and a drag instruction as input. InstantDrag consists of two carefully designed networks: a drag-conditioned optical flow generator (FlowGen) and an optical flow-conditioned diffusion model (FlowDiffusion). InstantDrag learns motion dynamics for drag-based image editing in real-world video datasets by decomposing the task into motion generation and motion-conditioned image generation. We demonstrate InstantDrag's capability to perform fast, photo-realistic edits without masks or text prompts through experiments on facial video datasets and general scenes. These results highlight the efficiency of our approach in handling drag-based image editing, making it a promising solution for interactive, real-time applications.

InstantDrag Improving Interactivity in Drag-based Image Editing discuss: Drag-based image editing has recently gained popularity for its interactivity and precision. However, despite the ability of text-to-image models to generate samples within a second, drag editing still lags behind due to the challenge of accurately reflecting user interaction while maintaining image content. Some existing approaches rely on computationally intensive per-image optimization or intricate guidance-based methods, requiring additional inputs such as masks for movable regions and text prompts, thereby compromising the interactivity of the editing process. We introduce InstantDrag, an optimization-free pipeline that enhances interactivity and speed, requiring only an image and a drag instruction as input. InstantDrag consists of two carefully designed networks: a drag-conditioned optical flow generator (FlowGen) and an optical flow-conditioned diffusion model (FlowDiffusion). InstantDrag learns motion dynamics for drag-based image editing in real-world video datasets by decomposing the task into motion generation and motion-conditioned image generation. We demonstrate InstantDrag's capability to perform fast, photo-realistic edits without masks or text prompts through experiments on facial video datasets and general scenes. These results highlight the efficiency of our approach in handling drag-based image editing, making it a promising solution for interactive, real-time applications.

AK

71,201 次观看 • 1 年前

📢📢 "Proteina: Scaling Flow-based Protein Structure Generative Models" #ICLR2025 (Oral Presentation) 🔥 Project page: 📜 Paper: 🛠️ Code and weights: 🧵Details in thread... (1/n)

📢📢 "Proteina: Scaling Flow-based Protein Structure Generative Models" #ICLR2025 (Oral Presentation) 🔥 Project page: 📜 Paper: 🛠️ Code and weights: 🧵Details in thread... (1/n)

Karsten Kreis

42,365 次观看 • 1 年前

📢A new learning-based approach to SfM: #ACEZero No img-to-img matching, optimises image-to-scene correspondences directly. Needs no pose priors. Works on unordered image sets. Efficiently handles thousands of images. Paper: Page:

📢A new learning-based approach to SfM: #ACEZero No img-to-img matching, optimises image-to-scene correspondences directly. Needs no pose priors. Works on unordered image sets. Efficiently handles thousands of images. Paper: Page:

Eric Brachmann

71,101 次观看 • 2 年前

DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objects abs: paper page:

DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objects abs: paper page:

AK

17,532 次观看 • 3 年前

I'm excited to share our new work, VistaDream, which generates a 3D Gaussian field from a single-view image. The codes have already been released. Project page: (with interactive demos) Code: Paper:

I'm excited to share our new work, VistaDream, which generates a 3D Gaussian field from a single-view image. The codes have already been released. Project page: (with interactive demos) Code: Paper:

Yuan Liu

79,571 次观看 • 1 年前

Check out our new paper that turns a (single image) => (interactive dynamic scene)! I’ve had so much fun playing around with this demo. Try it out yourself on the website:

Check out our new paper that turns a (single image) => (interactive dynamic scene)! I’ve had so much fun playing around with this demo. Try it out yourself on the website:

Aleksander Holynski

301,673 次观看 • 2 年前

Generative World Renderer paper:

Generative World Renderer paper:

AK

14,238 次观看 • 2 个月前

Google presents MobileDiffusion Subsecond Text-to-Image Generation on Mobile Devices paper page: MobileDiffusion achieves a remarkable sub-second inference speed for generating a 512 × 512 image on mobile devices, establishing a new state of the art.

Google presents MobileDiffusion Subsecond Text-to-Image Generation on Mobile Devices paper page: MobileDiffusion achieves a remarkable sub-second inference speed for generating a 512 × 512 image on mobile devices, establishing a new state of the art.

AK

150,538 次观看 • 2 年前

AR + AI effect We made an AR filter that interacts with your hands. I inpainted the image using Photoshop's new AI feature, and Sergei Galkin turned it into an interactive filter Made for @adobe using Photoshop (beta) Generative Fill #AdobeFirefly #AdobePartner

AR + AI effect We made an AR filter that interacts with your hands. I inpainted the image using Photoshop's new AI feature, and Sergei Galkin turned it into an interactive filter Made for @adobe using Photoshop (beta) Generative Fill #AdobeFirefly #AdobePartner

Karen X. Cheng

864,165 次观看 • 3 年前

🏗️ Build #3D scenes from a single input view based on the latest #NVIDIAResearch paper accepted at #ICCV2023. 👀 This 3D-aware #generativeAI model can build diverse and plausible views. research paper: project page:

🏗️ Build #3D scenes from a single input view based on the latest #NVIDIAResearch paper accepted at #ICCV2023. 👀 This 3D-aware #generativeAI model can build diverse and plausible views. research paper: project page:

NVIDIA AI Developer

113,832 次观看 • 2 年前

build an agent that speaks your UI. your charts. your forms. your seat maps. multi-turn, streaming, interactive. introducing tambo 1.0, the open-source generative UI toolkit for react.

build an agent that speaks your UI. your charts. your forms. your seat maps. multi-turn, streaming, interactive. introducing tambo 1.0, the open-source generative UI toolkit for react.

Michael Magán

261,138 次观看 • 3 个月前

Introducing Universal Simulator (UniSim), an interactive simulator of the real world. Interactive website: Paper:

Introducing Universal Simulator (UniSim), an interactive simulator of the real world. Interactive website: Paper:

Sherry Yang

440,007 次观看 • 2 年前

Dimension-Reduction Attack! Video Generative Models are Experts on Controllable Image Synthesis

Dimension-Reduction Attack! Video Generative Models are Experts on Controllable Image Synthesis

AK

28,101 次观看 • 11 个月前

Check out our new paper that turns (text, sparse images, videos) => (dynamic 3D scenes)! I can't get over how cool the interactive demo is. Try it out for yourself on the project page:

Check out our new paper that turns (text, sparse images, videos) => (dynamic 3D scenes)! I can't get over how cool the interactive demo is. Try it out for yourself on the project page:

Aleksander Holynski

37,142 次观看 • 1 年前

generative series of interactive, playable artworks Mitchell F Chan on July 17 with OpenSea x Art Blocks

generative series of interactive, playable artworks Mitchell F Chan on July 17 with OpenSea x Art Blocks

Dr Mimi Nguyen واحد 🥯

10,643 次观看 • 10 个月前

Generative image to scene is getting incredibly good. This is pure 3D without v2v generated from the image in the reply ...

Generative image to scene is getting incredibly good. This is pure 3D without v2v generated from the image in the reply ...

martin_casado

57,089 次观看 • 9 个月前

iOS 19 TabView concept, live and interactive in SwiftUI! based on the renders from fpt.

iOS 19 TabView concept, live and interactive in SwiftUI! based on the renders from fpt.

xezrunner

76,512 次观看 • 1 年前

Image analysis is now live for Pro users When you drag and drop an image into the input field Venice now auto-selects Qwen 2.5 VL 72B to analyze your image

Image analysis is now live for Pro users When you drag and drop an image into the input field Venice now auto-selects Qwen 2.5 VL 72B to analyze your image

Venice

52,829 次观看 • 1 年前