Can you make a jigsaw puzzle with two different... solutions? Or an image that changes appearance when flipped? We can do that, and a lot more, by using diffusion models to generate optical illusions! Continue reading for more illusions and method details 🧵show more

Can we use motion to prompt diffusion models? Our... #ICLR2024 paper does just that. We propose Motion Guidance, a technique that allows users to edit an image by specifying “where things should move.”show more

Want to generate images from the world's best models... like Nano Banana or GPT Image side by side? Now you can with Image Lab 🚀 Run a single prompt across up to 25 models, with up to 20 images from each, and see results in seconds. You've seen our leaderboards. Now generate and evaluate the models yourself. Link in thread 🧵👇show more

One of the best optical illusions: stare at the... stairs and they seem to switch direction every 10–15 seconds — even though the image never changes.show more

Multi-bot chat allows you to seamlessly combine the unique... strengths of different bots to complete tasks. For example, using fal’s latest bots, you can generate an image and remove the background within one conversational thread for a more efficient workflow. (1/2)show more

DINOv2 by Meta AI is the first method for... training computer vision models that uses self-supervised learning to achieve results matching or exceeding industry standards. More details and a demo ⬇️show more

3. Modify image Use this prompt to modify the... image you have chosen: "Modify image [1] with seed [1470033597]: add a parrot on her shoulder" Dall-E 3 identifies the image and makes the changes for you! Tips and tricks: - You can generate as many variations as you like. - It's also possible to remove an element from the image using the same method. - Sometimes the image isn't 100% identical, but still looks very similar.show more

when you get access to gpt-5, try a message... like "use beatbot to make a sick beat to celebrate gpt-5". it's a nice preview of what we think this will be like as AI starts to generate its own UX and interfaces get more dynamic. it's cool that you can interact with the synthesizer directly or ask chatgpt to make changes!show more

I topped up $5 on an API aggregator ToAPIs... Then I found out GPT Image 2 costs only around $0.015 per image. If you do a lot of testing or batch-generate commercial AI images, that difference adds up fast. I think I just found the secret to generating more, testing more, and spending less. And it’s not just one model. With the same key, you can access 50+ models for image, video, and text, including GPT Image 2, Gemini Omni, Seedance 2.0, Kling AI 3.0, grok-video-1.5-preview, and more. Some models are priced up to 80% lower than official platforms. Just top up and test what you need: Made on ToAPIs with GPT Image 2 + Seedance 2.0show more

Why brawl when you can outwit? Loki turns the... battlefield into a mind game with illusions, disruption, and sneaky strikes when enemies slip up.show more

Introducing ⇆ Marigold-DC — our training-free zero-shot approach to... monocular Depth Completion with guided diffusion! If you have ever wondered how else a long denoising diffusion schedule can be useful, we have an answer for you! Details 🧵show more

LLMs require more GPU memory as they generate longer... responses. Can we make GPU memory constant without significantly sacrificing accuracy? IceCache is a new method for managing KV caches that leverages Dynamic Continuous Indexing (DCI) to efficiently group and retrieve tokens by semantics. Joint work w/ Yuzhen Mao, Qitong Wang and Martin Ester. For details, check out the links below.show more

Chop the gradients ✂️! We found that truncating decoder... gradients in latent video diffusion to a fixed window allows us to finetune on videos with pixel-wise perceptual losses without running out of memory. Pixel losses have been essential for image generation and reconstruction, but until now, they haven't scaled to long-duration, high-resolution video diffusion due to recursive activation accumulation in causal decoders, leading to OOM during training 💥📉. Project: Video diffusion models can do a lot more 🚀 when you can backprop the decoder! Post-process neural rendered scenes, super-resolve videos, harmonize lighting in controlled synthetic driving scenes, and inpaint videos — all in a single step ⚡ with a quick finetune from a standard diffusion model.show more

The Hidden Language of Diffusion Models paper page: tackle... the challenge of understanding concept representations in text-to-image models by decomposing an input text prompt into a small set of interpretable elements. This is achieved by learning a pseudo-token that is a sparse weighted combination of tokens from the model's vocabulary, with the objective of reconstructing the images generated for the given concept. Applied over the state-of-the-art Stable Diffusion model, this decomposition reveals non-trivial and surprising structures in the representations of concepts. For example, we find that some concepts such as "a president" or "a composer" are dominated by specific instances (e.g., "Obama", "Biden") and their interpolations. Other concepts, such as "happiness" combine associated terms that can be concrete ("family", "laughter") or abstract ("friendship", "emotion"). In addition to peering into the inner workings of Stable Diffusion, our method also enables applications such as single-image decomposition to tokens, bias detection and mitigation, and semantic image manipulationshow more

You can now turn any image on X into... a video. Long press on an image that you like and select Make Video with Grok.show more

1/ Happy to share VADER: Video Diffusion Alignment via... Reward Gradients. We adapt foundational video diffusion models using pre-trained reward models to generate high-quality, aligned videos for various end-applications. Below we generated a short movie using VADER 😀, we used ChatGPT to write a script and an off-the-shelf AI music generator to generate the sound. Our code & weights are open-sourced:show more

i can spot a temptress when i see one,... just by using that triangle methodshow more

Generate mermaid diagrams that you can then edit manually,... using your favorite coding agent! Just use Decode's MCP server and ask your agent to explain things or help you think more clearly when designing & planning.show more