正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Canvas-to-Image Compositional Image Generation with Multimodal Controls

AK

488,341 subscribers

31,268 次观看 • 9 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

T2I-CompBench: A Comprehensive Benchmark for Open-world Compositional Text-to-image Generation paper page: Despite the stunning ability to generate high-quality images by recent text-to-image models, current approaches often struggle to effectively compose objects with different attributes and relationships into a complex and coherent scene. We propose T2I-CompBench, a comprehensive benchmark for open-world compositional text-to-image generation, consisting of 6,000 compositional text prompts from 3 categories (attribute binding, object relationships, and complex compositions) and 6 sub-categories (color binding, shape binding, texture binding, spatial relationships, non-spatial relationships, and complex compositions). We further propose several evaluation metrics specifically designed to evaluate compositional text-to-image generation. We introduce a new approach, Generative mOdel fine-tuning with Reward-driven Sample selection (GORS), to boost the compositional text-to-image generation abilities of pretrained text-to-image models. Extensive experiments and evaluations are conducted to benchmark previous methods on T2I-CompBench, and to validate the effectiveness of our proposed evaluation metrics and GORS approach.

T2I-CompBench: A Comprehensive Benchmark for Open-world Compositional Text-to-image Generation paper page: Despite the stunning ability to generate high-quality images by recent text-to-image models, current approaches often struggle to effectively compose objects with different attributes and relationships into a complex and coherent scene. We propose T2I-CompBench, a comprehensive benchmark for open-world compositional text-to-image generation, consisting of 6,000 compositional text prompts from 3 categories (attribute binding, object relationships, and complex compositions) and 6 sub-categories (color binding, shape binding, texture binding, spatial relationships, non-spatial relationships, and complex compositions). We further propose several evaluation metrics specifically designed to evaluate compositional text-to-image generation. We introduce a new approach, Generative mOdel fine-tuning with Reward-driven Sample selection (GORS), to boost the compositional text-to-image generation abilities of pretrained text-to-image models. Extensive experiments and evaluations are conducted to benchmark previous methods on T2I-CompBench, and to validate the effectiveness of our proposed evaluation metrics and GORS approach.

AK

17,503 次观看 • 3 年前

My canvas based AI image generation tool is live! It's built on top of tldraw and uses Nano Banana 2 Lite for image generation. You can sketch, annotate, collage in a frame... And then click to generate an image. Check it out 👉

My canvas based AI image generation tool is live! It's built on top of tldraw and uses Nano Banana 2 Lite for image generation. You can sketch, annotate, collage in a frame... And then click to generate an image. Check it out 👉

Charlie Clark

50,562 次观看 • 9 个月前

I was frustrated by the image generation experiences in existing apps. Including ours. That's why I spent almost a year playing with alternative UX. Today, we finally have something to show for it. Introducing T3 Canvas, the world's best image generation experience.

I was frustrated by the image generation experiences in existing apps. Including ours. That's why I spent almost a year playing with alternative UX. Today, we finally have something to show for it. Introducing T3 Canvas, the world's best image generation experience.

Theo - t3.gg

331,882 次观看 • 6 个月前

"designers trying to get Figma MCP to work" "meanwhile Tenor recreating UI straight onto the canvas from a reference image with full interactivity upon generation"

"designers trying to get Figma MCP to work" "meanwhile Tenor recreating UI straight onto the canvas from a reference image with full interactivity upon generation"

andres

12,143 次观看 • 5 个月前

messin' with some canvas and GSAP to build ascii trail image reveals

messin' with some canvas and GSAP to build ascii trail image reveals

jhey ʕ•ᴥ•ʔ

243,591 次观看 • 1 年前

Introducing Omni, one unified model can support any-to-any multimodal modeling, including multimodal understanding, image/video generation and editing, world modeling and 3D reconstruction. All in one that adopts standard mixture-of-experts arch with only 3B activations.

Introducing Omni, one unified model can support any-to-any multimodal modeling, including multimodal understanding, image/video generation and editing, world modeling and 3D reconstruction. All in one that adopts standard mixture-of-experts arch with only 3B activations.

Ceyuan Yang

32,469 次观看 • 4 个月前

We have updated image generation models with Nano Banana, Qwen-image, and Seedream 4.0, now enabling direct image-to-video creation. Up to 4k images generation. Stremline your workflow! -> Retweet to get 300 credits in DMs (72H ONLY)

We have updated image generation models with Nano Banana, Qwen-image, and Seedream 4.0, now enabling direct image-to-video creation. Up to 4k images generation. Stremline your workflow! -> Retweet to get 300 credits in DMs (72H ONLY)

PixVerse

76,804 次观看 • 10 个月前

bytedance just released BAGEL! an open-source multimodal alternative to gpt-4o and gemini flash it supports: > image reasoning > image editing > video generation > style transfer (ghiblify anyone?) > 3d rotation > outpainting > navigation

bytedance just released BAGEL! an open-source multimodal alternative to gpt-4o and gemini flash it supports: > image reasoning > image editing > video generation > style transfer (ghiblify anyone?) > 3d rotation > outpainting > navigation

Dreaming Tulpa 🥓👑

258,053 次观看 • 1 年前

Expressive Text-to-Image Generation with Rich Text abs: project page:

Expressive Text-to-Image Generation with Rich Text abs: project page:

AK

209,402 次观看 • 3 年前

The Microsoft AI model family expands in Microsoft Foundry with 7 new models. A complete multimodal stack: Text, image, transcription, and voice, ready for developers to build with under one set of governance and security controls. #MSBuild

The Microsoft AI model family expands in Microsoft Foundry with 7 new models. A complete multimodal stack: Text, image, transcription, and voice, ready for developers to build with under one set of governance and security controls. #MSBuild

Microsoft

52,863 次观看 • 3 个月前

Introducing Manus image generation. Manus doesn’t just generate images. It understands your intent, plans a solution, and knows how to effectively use image generation along with other tools to accomplish your task.

Introducing Manus image generation. Manus doesn’t just generate images. It understands your intent, plans a solution, and knows how to effectively use image generation along with other tools to accomplish your task.

Manus

178,164 次观看 • 1 年前

Excited to share "MultiDiffusion"! A controlled image generation framework w/ pre-trained text-to-image diffusion model. * Spatial guidance controls (bounding boxes/masks) * Arbitrary aspect ratios (huge Panoramas!) NO training NO finetuning. [1/3]Lior Yariv Yaron Lipman Tali Dekel

Excited to share "MultiDiffusion"! A controlled image generation framework w/ pre-trained text-to-image diffusion model. * Spatial guidance controls (bounding boxes/masks) * Arbitrary aspect ratios (huge Panoramas!) NO training NO finetuning. [1/3]Lior Yariv Yaron Lipman Tali Dekel

Omer Bar Tal

88,871 次观看 • 3 年前

Introducing 🔥BLIP-Diffusion🔥, a novel method for enabling Text-to-image Diffusion models with multimodal controllable generation/editing, powered by BLIP-2 pre-trained text-aligned subject representation. Paper: Project: (1/n)

Introducing 🔥BLIP-Diffusion🔥, a novel method for enabling Text-to-image Diffusion models with multimodal controllable generation/editing, powered by BLIP-2 pre-trained text-aligned subject representation. Paper: Project: (1/n)

Steven Hoi

40,615 次观看 • 3 年前

Always wanted to scratch this image generation itch.

Always wanted to scratch this image generation itch.

Derrick

964,795 次观看 • 8 个月前

Whipped up a fun canvas based image generation tool using tldraw and Nano Banana 2 Lite Is this cool? Should I ship this?

Whipped up a fun canvas based image generation tool using tldraw and Nano Banana 2 Lite Is this cool? Should I ship this?

Charlie Clark

62,413 次观看 • 9 个月前

Introducing Higgsfield Canvas: a state-of-the-art image editing model. Paint products directly onto your image with pixel-perfect control. Say hi to your new go-to for product placement, editing, and layout! 👋🏻 Comment Canvas to get the full guide in the DM.

Introducing Higgsfield Canvas: a state-of-the-art image editing model. Paint products directly onto your image with pixel-perfect control. Say hi to your new go-to for product placement, editing, and layout! 👋🏻 Comment Canvas to get the full guide in the DM.

Higgsfield AI 🧩

2,627,572 次观看 • 1 年前

introducing Seedream 5.0 Pro. this new multimodal model brings advance reasoning, precise image editing, and support for up to 10 image references. try it now on Krea.

introducing Seedream 5.0 Pro. this new multimodal model brings advance reasoning, precise image editing, and support for up to 10 image references. try it now on Krea.

Krea

38,896 次观看 • 2 个月前