Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

We have implemented an image painter using DiffSynth, which support FLUX, Kolor, HunyuanDit, Stable Diffusion series. AK Gradio gradio demo is here: #DiffSynthPainter #InteractiveArt #InnovativePainting

5 Kommentare

Profilbild von Wenmeng Zhou
Wenmeng Zhouvor 2 Jahren

DiffSynth-Painter introduces a revolutionary interactive painting creation method. Building on the basic diffusion process, users can provide finer-grained partition prompts and use the canvas tool to draw the effective scope of the partition prompts, intuitively achieving complex compositions.

Profilbild von Wenmeng Zhou
Wenmeng Zhouvor 2 Jahren

Finally it comes the online huggingface space, thanks for the support from @_akhaliq @Gradio @Xianbao_QIAN @hysts12321 : and modelscope studio:

Profilbild von Andres Perez
Andres Perezvor 2 Jahren

@_akhaliq @Gradio Is this a web site or do we have to install the model?

Profilbild von Wenmeng Zhou
Wenmeng Zhouvor 2 Jahren

@_akhaliq @Gradio currently you need to run the code locally and it will automatically download models. but we are working to provide online demo to you guys asap

Profilbild von Йёрн Шиллинг
Йёрн Шиллингvor 2 Jahren

@_akhaliq @Gradio The “old_photo_restoration” model is not working, can you fix it?

Ähnliche Videos

🚀 The Segment Anything Model (SAM) has been upgraded to SAM2, featuring an efficient image encoder for segmenting images and videos. But does SAM2 outperform SAM1 in medical image and video segmentation? We're thrilled to present our paper "Segment Anything in Medical Images and Videos: Benchmark and Deployment"! We comprehensively benchmark SAM2 across 11 medical image modalities and videos. 📄 Paper: 💻 Code: **Highlights:** 1. SAM2 doesn’t always outperform SAM1 in 2D medical images, but excels in video segmentation, making it more accurate and efficient for 3D images, such as CT and MR scans. 2. MedSAM still outperforms SAM2 on most 2D modalities, but SAM2 surpasses MedSAM for 3D image segmentation in a slice-by-slice approach. 3. Segmentation performance varies with model size; sometimes the smallest model outperforms larger ones. 4. Fine-tuning SAM2 significantly boosts its performance for medical image segmentation. While SAM2 may struggle with challenging objects that have unclear boundaries or low contrast, it excels in generating good initial segmentation masks for common medical images and videos. However, the official interface doesn’t support medical data formats and has limitations on video length. To address this, we've developed a 3D Slicer Plugin and Gradio API for efficient 3D medical image and video segmentation. We invite you to try them out and provide feedback! 🔧 Deployment: - 3D Slicer Plugin: - Gradio API: (Note: Due to GPU limitations, the online API is available for only 12 hours and may be slow. We highly recommend deploying the Gradio API with your own computing resources: A big shoutout to Jun Ma (JunMa) who recently joined our UHN AI hub (UHN AI Hub) as Machine Learning Lead, and kudos to all co-authors: Sumin Kim, Feifei Li, Mohammed Baharoon (Mohammed Baharoon), Reza Asakereh, and Hongwei Lyu! This is true teamwork! Looking forward to collaborating with the community to advance 3D medical image and video segmentation foundation models! University Health Network U of T Department of Computer Science Department of Laboratory Medicine & Pathobiology Temerty Centre for AI in Medicine (T-CAIREM) Vector Institute #MedTech #AIinHealthcare #DeepLearning #MedicalImaging #SAM2 #MedSAM #AIResearch

Bo Wang

178,579 Aufrufe • vor 2 Jahren

MaterialFusion Enhancing Inverse Rendering with Material Diffusion Priors discuss: Recent works in inverse rendering have shown promise in using multi-view images of an object to recover shape, albedo, and materials. However, the recovered components often fail to render accurately under new lighting conditions due to the intrinsic challenge of disentangling albedo and material properties from input images. To address this challenge, we introduce MaterialFusion, an enhanced conventional 3D inverse rendering pipeline that incorporates a 2D prior on texture and material properties. We present StableMaterial, a 2D diffusion model prior that refines multi-lit data to estimate the most likely albedo and material from given input appearances. This model is trained on albedo, material, and relit image data derived from a curated dataset of approximately ~12K artist-designed synthetic Blender objects called BlenderVault. we incorporate this diffusion prior with an inverse rendering framework where we use score distillation sampling (SDS) to guide the optimization of the albedo and materials, improving relighting performance in comparison with previous work. We validate MaterialFusion's relighting performance on 4 datasets of synthetic and real objects under diverse illumination conditions, showing our diffusion-aided approach significantly improves the appearance of reconstructed objects under novel lighting conditions. We intend to publicly release our BlenderVault dataset to support further research in this field.

AK

22,959 Aufrufe • vor 1 Jahr