Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Text-to-image diffusion transformer models learn to align text and image representations as a byproduct of their conditional denoising task. By taking the dot product between the text and image representations of a DiT model (like Flux 2), you can create rich saliency maps.

alec_helbling's profile picture

Alec Helbling

10,711 subscribers

94,065 Aufrufe • vor 6 Monaten •via X (Twitter)

Wissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Text-to-image generators are incredible! But why must we use *plain text* as the interface? 🤔 Check out Rich Text-to-Image generation! Rich Text offers an intuitive and expressive way to explore your visual imagination. Some of my favorite examples. 👇
0:12

Text-to-image generators are incredible! But why must we use *plain text* as the interface? 🤔 Check out Rich Text-to-Image generation! Rich Text offers an intuitive and expressive way to explore your visual imagination. Some of my favorite examples. 👇

Jia-Bin Huang

73,372 Aufrufe • vor 2 Jahren

Switti -- a new scale-wise transformer for text-to-image generation 🦾 🔥 Improved generation of fine-grained details. Outperforms existing T2I AR models and competes with state-of-the-art T2I diffusion models while being up to 7x faster.
0:16

Switti -- a new scale-wise transformer for text-to-image generation 🦾 🔥 Improved generation of fine-grained details. Outperforms existing T2I AR models and competes with state-of-the-art T2I diffusion models while being up to 7x faster.

Gradio

29,267 Aufrufe • vor 1 Jahr

Diffusion Transformers aren't just generative models, but also powerful multi-modal encoders. ConceptAttention creates rich heatmaps of text concepts in images from DiT representations. This even works on real images, and can be applied to tasks like segmentation! Demo 👇
0:14

Diffusion Transformers aren't just generative models, but also powerful multi-modal encoders. ConceptAttention creates rich heatmaps of text concepts in images from DiT representations. This even works on real images, and can be applied to tasks like segmentation! Demo 👇

Alec Helbling

24,380 Aufrufe • vor 1 Jahr

Snap presents MoA Mixture-of-Attention for Subject-Context Disentanglement in Personalized Image Generation We introduce a new architecture for personalization of text-to-image diffusion models, coined Mixture-of-Attention (MoA). Inspired by the Mixture-of-Experts
0:11

Snap presents MoA Mixture-of-Attention for Subject-Context Disentanglement in Personalized Image Generation We introduce a new architecture for personalization of text-to-image diffusion models, coined Mixture-of-Attention (MoA). Inspired by the Mixture-of-Experts

AK

47,384 Aufrufe • vor 2 Jahren

📷 a new GPT Image 2 use case: text-to-360 turn text or an image into a 360° panorama.
0:18

📷 a new GPT Image 2 use case: text-to-360 turn text or an image into a 360° panorama.

ilker

80,486 Aufrufe • vor 1 Monat

FLUX.2 is live on Runware! D0 drop! 🔥 Built by Black Forest Labs, FLUX.2 is the new SOTA model that brings better control over structure, text, and references in image generation. This is a huge step forward for image gen & image editing. And we’re here to offer you the best prices on D0. This model comes in three versions. Details below.
0:15

FLUX.2 is live on Runware! D0 drop! 🔥 Built by Black Forest Labs, FLUX.2 is the new SOTA model that brings better control over structure, text, and references in image generation. This is a huge step forward for image gen & image editing. And we’re here to offer you the best prices on D0. This model comes in three versions. Details below.

Runware

293,432 Aufrufe • vor 6 Monaten

NVIDIA just released a very impressive text-to-video paper. Video Latent Diffusion Models (Video LDMs) use a diffusion model in a compressed latent space to generate high-resolution videos. Here's a brief overview of how it works: 1. Pre-train image LDM on a dataset of images. 2. Turn the image LDM into a Video LDM by adding temporal layers to model video frames. 3. Fine-tune the Video LDM on encoded video sequences to create a video generator. 4. Temporally align diffusion model upsamplers to generate high-resolution videos. 5. Validate Video LDM on real driving videos of 512x1024 resolution, achieving state-of-the-art performance. 6. Apply the approach in creative content creation with text-to-video modeling. Paper: Project:
0:14

NVIDIA just released a very impressive text-to-video paper. Video Latent Diffusion Models (Video LDMs) use a diffusion model in a compressed latent space to generate high-resolution videos. Here's a brief overview of how it works: 1. Pre-train image LDM on a dataset of images. 2. Turn the image LDM into a Video LDM by adding temporal layers to model video frames. 3. Fine-tune the Video LDM on encoded video sequences to create a video generator. 4. Temporally align diffusion model upsamplers to generate high-resolution videos. 5. Validate Video LDM on real driving videos of 512x1024 resolution, achieving state-of-the-art performance. 6. Apply the approach in creative content creation with text-to-video modeling. Paper: Project:

Lior Alexander

158,539 Aufrufe • vor 3 Jahren

You can build your own AI-apps powered by OpenAI and Stable Diffusion. **Even if you don't know how to code** Using no-code, build your own text and image generation apps with: - Bubble - OpenAI - Stable Diffusion Learn how:
0:12

You can build your own AI-apps powered by OpenAI and Stable Diffusion. **Even if you don't know how to code** Using no-code, build your own text and image generation apps with: - Bubble - OpenAI - Stable Diffusion Learn how:

Seth Kramer

6,893,639 Aufrufe • vor 3 Jahren

RIP Photoshop. Higgsfield just launched Canvas, a state-of-the-art image editing model. With just two clicks, you can swap any object in an image. Logos, text, texture and scale stay exactly as they are... Here's how it works:
0:15

RIP Photoshop. Higgsfield just launched Canvas, a state-of-the-art image editing model. With just two clicks, you can swap any object in an image. Logos, text, texture and scale stay exactly as they are... Here's how it works:

Angry Tom

155,788 Aufrufe • vor 11 Monaten

Adobe just launched the beta of Firefly, their AI image creator. And it's incredible! - text-to-image - AI 3D modelling - AI Video editing This is the first AI image generator built towards solving creator problems. Here's a breakdown.
0:13

Adobe just launched the beta of Firefly, their AI image creator. And it's incredible! - text-to-image - AI 3D modelling - AI Video editing This is the first AI image generator built towards solving creator problems. Here's a breakdown.

Sudharshan

1,224,102 Aufrufe • vor 3 Jahren

Text to Image: ChatGPT Image to Video: Kling 2.0 Prompt: Shot from a person's point of view (POV), the person starts using computer Kling AI
0:10

Text to Image: ChatGPT Image to Video: Kling 2.0 Prompt: Shot from a person's point of view (POV), the person starts using computer Kling AI

Ozan Sihay

40,919 Aufrufe • vor 1 Jahr

ANNOUNCEMENT Now anyone can use Stable Diffusion XL, our latest text-to-image generative AI model, on our Clipdrop platform, for free! Test the limits of your creativity. #SDXL Try it here →
0:14

ANNOUNCEMENT Now anyone can use Stable Diffusion XL, our latest text-to-image generative AI model, on our Clipdrop platform, for free! Test the limits of your creativity. #SDXL Try it here →

Stability AI

348,278 Aufrufe • vor 3 Jahren

Create a 3D model from a single image, set of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”
0:18

Create a 3D model from a single image, set of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”

Bilawal Sidhu

92,760 Aufrufe • vor 2 Jahren

Krea 2 is now on Artificial Analysis #1 image model from an independent research lab and #6 globally on text-to-image leaderboard. open-source cooking and coming soon.
0:13

Krea 2 is now on Artificial Analysis #1 image model from an independent research lab and #6 globally on text-to-image leaderboard. open-source cooking and coming soon.

Krea

79,309 Aufrufe • vor 7 Tagen

🤯 𝐒𝐥𝐢𝐜𝐞𝐝𝐢𝐭 : A revolutionary approach to zero-shot video editing✏️🎥 using text-to-image diffusion models 🎞️Slicedit achieves great temporal consistency by leveraging spatio-temporal "slices"🔀
0:10

🤯 𝐒𝐥𝐢𝐜𝐞𝐝𝐢𝐭 : A revolutionary approach to zero-shot video editing✏️🎥 using text-to-image diffusion models 🎞️Slicedit achieves great temporal consistency by leveraging spatio-temporal "slices"🔀

Gradio

19,581 Aufrufe • vor 2 Jahren

I built a tool that automatically puts text between your image
0:12

I built a tool that automatically puts text between your image

Aditya

295,876 Aufrufe • vor 11 Monaten

New ML gem on the hub: LDM3D by Intel. This diffusion model generates image &amp; depth from text prompts. Using a custom @gradio 6dof three.js component you can generate immersive 360-degree views from prompts demo: model:
0:13

New ML gem on the hub: LDM3D by Intel. This diffusion model generates image &amp; depth from text prompts. Using a custom @gradio 6dof three.js component you can generate immersive 360-degree views from prompts demo: model:

Radamés Ajna

56,696 Aufrufe • vor 2 Jahren

SOMEONE GOT TIRED OF PAYING HIGGSFIELD AI'S SUBSCRIPTION SO HE REBUILT THE WHOLE THING AND OPEN-SOURCED IT 200+ models. text-to-image, image-to-image, text-to-video, image-to-video all in one interface you configure a virtual camera in the Cinema Studio. pick the body, the lens, the focal length, the aperture and it writes the optimized cinematic prompt for you. completely in the background you never touch the camera keywords. you just set up the shot like a real cinematographer would Kling v3, Sora 2, Veo 3, Flux Dev, Midjourney v7, GPT-4o, Seedream 5.0, Runway Gen-3 all in there self-hosted. MIT licensed. runs on your machine. your data stays local the only thing you pay for is the model API calls themselves someone built this so you never have to pay Higgsfield AI again
0:18

SOMEONE GOT TIRED OF PAYING HIGGSFIELD AI'S SUBSCRIPTION SO HE REBUILT THE WHOLE THING AND OPEN-SOURCED IT 200+ models. text-to-image, image-to-image, text-to-video, image-to-video all in one interface you configure a virtual camera in the Cinema Studio. pick the body, the lens, the focal length, the aperture and it writes the optimized cinematic prompt for you. completely in the background you never touch the camera keywords. you just set up the shot like a real cinematographer would Kling v3, Sora 2, Veo 3, Flux Dev, Midjourney v7, GPT-4o, Seedream 5.0, Runway Gen-3 all in there self-hosted. MIT licensed. runs on your machine. your data stays local the only thing you pay for is the model API calls themselves someone built this so you never have to pay Higgsfield AI again

Rimsha Bhardwaj

100,590 Aufrufe • vor 2 Monaten

Show-o One Single Transformer to Unify Multimodal Understanding and Generation discuss: We present a unified transformer, i.e., Show-o, that unifies multimodal understanding and generation. Unlike fully autoregressive models, Show-o unifies autoregressive and (discrete) diffusion modeling to adaptively handle inputs and outputs of various and mixed modalities. The unified model flexibly supports a wide range of vision-language tasks including visual question-answering, text-to-image generation, text-guided inpainting/extrapolation, and mixed-modality generation. Across various benchmarks, it demonstrates comparable or superior performance to existing individual models with an equivalent or larger number of parameters tailored for understanding or generation. This significantly highlights its potential as a next-generation foundation model.
0:13

Show-o One Single Transformer to Unify Multimodal Understanding and Generation discuss: We present a unified transformer, i.e., Show-o, that unifies multimodal understanding and generation. Unlike fully autoregressive models, Show-o unifies autoregressive and (discrete) diffusion modeling to adaptively handle inputs and outputs of various and mixed modalities. The unified model flexibly supports a wide range of vision-language tasks including visual question-answering, text-to-image generation, text-guided inpainting/extrapolation, and mixed-modality generation. Across various benchmarks, it demonstrates comparable or superior performance to existing individual models with an equivalent or larger number of parameters tailored for understanding or generation. This significantly highlights its potential as a next-generation foundation model.

AK

123,982 Aufrufe • vor 1 Jahr

Tips for using Grok Imagine: You can ask Grok to add text to your image.
0:10

Tips for using Grok Imagine: You can ask Grok to add text to your image.

Déborah

1,200,646 Aufrufe • vor 10 Monaten