正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Canvas-to-Image Compositional Image Generation with Multimodal Controls

AK

488,341 subscribers

31,268 次观看 • 11 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

T2I-CompBench: A Comprehensive Benchmark for Open-world Compositional Text-to-image Generation paper page: Despite the stunning ability to generate high-quality images by recent text-to-image models, current approaches often struggle to effectively compose objects with different attributes and relationships into a complex and coherent scene. We propose T2I-CompBench, a comprehensive benchmark for open-world compositional text-to-image generation, consisting of 6,000 compositional text prompts from 3 categories (attribute binding, object relationships, and complex compositions) and 6 sub-categories (color binding, shape binding, texture binding, spatial relationships, non-spatial relationships, and complex compositions). We further propose several evaluation metrics specifically designed to evaluate compositional text-to-image generation. We introduce a new approach, Generative mOdel fine-tuning with Reward-driven Sample selection (GORS), to boost the compositional text-to-image generation abilities of pretrained text-to-image models. Extensive experiments and evaluations are conducted to benchmark previous methods on T2I-CompBench, and to validate the effectiveness of our proposed evaluation metrics and GORS approach.

T2I-CompBench: A Comprehensive Benchmark for Open-world Compositional Text-to-image Generation paper page: Despite the stunning ability to generate high-quality images by recent text-to-image models, current approaches often struggle to effectively compose objects with different attributes and relationships into a complex and coherent scene. We propose T2I-CompBench, a comprehensive benchmark for open-world compositional text-to-image generation, consisting of 6,000 compositional text prompts from 3 categories (attribute binding, object relationships, and complex compositions) and 6 sub-categories (color binding, shape binding, texture binding, spatial relationships, non-spatial relationships, and complex compositions). We further propose several evaluation metrics specifically designed to evaluate compositional text-to-image generation. We introduce a new approach, Generative mOdel fine-tuning with Reward-driven Sample selection (GORS), to boost the compositional text-to-image generation abilities of pretrained text-to-image models. Extensive experiments and evaluations are conducted to benchmark previous methods on T2I-CompBench, and to validate the effectiveness of our proposed evaluation metrics and GORS approach.

AK

17,503 次观看 • 3 年前

My canvas based AI image generation tool is live! It's built on top of tldraw and uses Nano Banana 2 Lite for image generation. You can sketch, annotate, collage in a frame... And then click to generate an image. Check it out 👉

My canvas based AI image generation tool is live! It's built on top of tldraw and uses Nano Banana 2 Lite for image generation. You can sketch, annotate, collage in a frame... And then click to generate an image. Check it out 👉

Charlie Clark

50,562 次观看 • 10 个月前

I was frustrated by the image generation experiences in existing apps. Including ours. That's why I spent almost a year playing with alternative UX. Today, we finally have something to show for it. Introducing T3 Canvas, the world's best image generation experience.

I was frustrated by the image generation experiences in existing apps. Including ours. That's why I spent almost a year playing with alternative UX. Today, we finally have something to show for it. Introducing T3 Canvas, the world's best image generation experience.

Theo - t3.gg

345,685 次观看 • 8 个月前

"designers trying to get Figma MCP to work" "meanwhile Tenor recreating UI straight onto the canvas from a reference image with full interactivity upon generation"

"designers trying to get Figma MCP to work" "meanwhile Tenor recreating UI straight onto the canvas from a reference image with full interactivity upon generation"

andres

12,184 次观看 • 7 个月前

messin' with some canvas and GSAP to build ascii trail image reveals

messin' with some canvas and GSAP to build ascii trail image reveals

jhey ʕ•ᴥ•ʔ

243,591 次观看 • 2 年前

Introducing Omni, one unified model can support any-to-any multimodal modeling, including multimodal understanding, image/video generation and editing, world modeling and 3D reconstruction. All in one that adopts standard mixture-of-experts arch with only 3B activations.

Introducing Omni, one unified model can support any-to-any multimodal modeling, including multimodal understanding, image/video generation and editing, world modeling and 3D reconstruction. All in one that adopts standard mixture-of-experts arch with only 3B activations.

Ceyuan Yang

32,971 次观看 • 6 个月前

We have updated image generation models with Nano Banana, Qwen-image, and Seedream 4.0, now enabling direct image-to-video creation. Up to 4k images generation. Stremline your workflow! -> Retweet to get 300 credits in DMs (72H ONLY)

We have updated image generation models with Nano Banana, Qwen-image, and Seedream 4.0, now enabling direct image-to-video creation. Up to 4k images generation. Stremline your workflow! -> Retweet to get 300 credits in DMs (72H ONLY)

PixVerse

76,835 次观看 • 1 年前

bytedance just released BAGEL! an open-source multimodal alternative to gpt-4o and gemini flash it supports: > image reasoning > image editing > video generation > style transfer (ghiblify anyone?) > 3d rotation > outpainting > navigation

bytedance just released BAGEL! an open-source multimodal alternative to gpt-4o and gemini flash it supports: > image reasoning > image editing > video generation > style transfer (ghiblify anyone?) > 3d rotation > outpainting > navigation

Dreaming Tulpa 🥓👑

258,053 次观看 • 1 年前

Expressive Text-to-Image Generation with Rich Text abs: project page:

Expressive Text-to-Image Generation with Rich Text abs: project page:

AK

209,410 次观看 • 3 年前

The Microsoft AI model family expands in Microsoft Foundry with 7 new models. A complete multimodal stack: Text, image, transcription, and voice, ready for developers to build with under one set of governance and security controls. #MSBuild

The Microsoft AI model family expands in Microsoft Foundry with 7 new models. A complete multimodal stack: Text, image, transcription, and voice, ready for developers to build with under one set of governance and security controls. #MSBuild

Microsoft

54,259 次观看 • 5 个月前

Bria Fibo 2.0 from BRIA AI is live on fal. The #1 open-weight image editing model on Artificial Analysis, with text-to-image generation and targeted editing. Trained only on licensed data, with clear commercial rights. - Image editing with up to four input images - Background swaps, product restaging and lighting changes - Text-to-image generation for reasoning-heavy prompts

Bria Fibo 2.0 from BRIA AI is live on fal. The #1 open-weight image editing model on Artificial Analysis, with text-to-image generation and targeted editing. Trained only on licensed data, with clear commercial rights. - Image editing with up to four input images - Background swaps, product restaging and lighting changes - Text-to-image generation for reasoning-heavy prompts

fal

15,730 次观看 • 11 天前

Excited to share "MultiDiffusion"! A controlled image generation framework w/ pre-trained text-to-image diffusion model. * Spatial guidance controls (bounding boxes/masks) * Arbitrary aspect ratios (huge Panoramas!) NO training NO finetuning. [1/3]Lior Yariv Yaron Lipman Tali Dekel

Excited to share "MultiDiffusion"! A controlled image generation framework w/ pre-trained text-to-image diffusion model. * Spatial guidance controls (bounding boxes/masks) * Arbitrary aspect ratios (huge Panoramas!) NO training NO finetuning. [1/3]Lior Yariv Yaron Lipman Tali Dekel

Omer Bar Tal

88,883 次观看 • 3 年前

Introducing Manus image generation. Manus doesn’t just generate images. It understands your intent, plans a solution, and knows how to effectively use image generation along with other tools to accomplish your task.

Introducing Manus image generation. Manus doesn’t just generate images. It understands your intent, plans a solution, and knows how to effectively use image generation along with other tools to accomplish your task.

Manus

178,317 次观看 • 1 年前

Introducing 🔥BLIP-Diffusion🔥, a novel method for enabling Text-to-image Diffusion models with multimodal controllable generation/editing, powered by BLIP-2 pre-trained text-aligned subject representation. Paper: Project: (1/n)

Introducing 🔥BLIP-Diffusion🔥, a novel method for enabling Text-to-image Diffusion models with multimodal controllable generation/editing, powered by BLIP-2 pre-trained text-aligned subject representation. Paper: Project: (1/n)

Steven Hoi

40,615 次观看 • 3 年前

Introducing Higgsfield Canvas: a state-of-the-art image editing model. Paint products directly onto your image with pixel-perfect control. Say hi to your new go-to for product placement, editing, and layout! 👋🏻 Comment Canvas to get the full guide in the DM.

Introducing Higgsfield Canvas: a state-of-the-art image editing model. Paint products directly onto your image with pixel-perfect control. Say hi to your new go-to for product placement, editing, and layout! 👋🏻 Comment Canvas to get the full guide in the DM.

Higgsfield AI 🧩

2,627,572 次观看 • 1 年前

Qwen Image 2.1 is here! 🖼️ A 7B params native image generation and editing model, with up to 10 image references The model comes with it's own prompt enhancement LLMs, integrated with diffusers 🧨 and ComfyUI ▶️ on Spaces

Qwen Image 2.1 is here! 🖼️ A 7B params native image generation and editing model, with up to 10 image references The model comes with it's own prompt enhancement LLMs, integrated with diffusers 🧨 and ComfyUI ▶️ on Spaces

Hugging Apps

92,424 次观看 • 1 个月前

Always wanted to scratch this image generation itch.

Always wanted to scratch this image generation itch.

Derrick

964,795 次观看 • 10 个月前