Introducing Diffusion Forcing, which unifies next-token prediction (eg LLMs)... and full-seq. diffusion (eg SORA)! It offers improved performance & new sampling strategies in vision and robotics, such as stable, infinite video generation, better diffusion planning, and more! (1/8)show more

Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models... "Block diffusion sequentially generates blocks of tokens by performing diffusion within each block and conditioning on previous blocks. By combining strength from autoregressive and diffusion models, block diffusion overcomes the limitations of both approaches by supporting variable-length, higher-quality generation and improving inference efficiency with KV caching and parallel sampling."show more

Stochastic and deterministic sampling strategies for diffusion models produce... strikingly different trajectories, but both ultimately achieve the same aim. I had a great time presenting our work, Diffusion Explorer, this week at IEEE VIS in Vienna.show more

generative 3D heads in Blender with Stable Diffusion, ControlNet... and FaceBuildershow more

You can build your own AI-apps powered by OpenAI... and Stable Diffusion. **Even if you don't know how to code** Using no-code, build your own text and image generation apps with: - Bubble - OpenAI - Stable Diffusion Learn how:show more

DimensionX: Create Any 3D and 4D Scenes from a... Single Image with Controllable Video Diffusion TL;DR: Create 3/4DGS from Video Diffusion Note: Some first inference code released (not all yet). Contributions (cited): • We present DimensionX, a novel framework for generating photorealistic 3D and 4D scenes from only a single image using controllable video diffusion. • We propose ST-Director, which decouples the spatial and temporal priors in video diffusion models by learning (spatial and temporal) dimension-aware modules with our curated datasets. We further enhance the hybriddimension control with a training-free composition approach according to the essence of video diffusion denoising process. • To bridge the gap between video diffusion and real-world scenes, we design a trajectory-aware mechanism for 3D generation and an identity-preserving denoising approach for 4D generation, enabling more realistic and controllable scene synthesis. • Extensive experiments manifest that our DimensionX delivers superior performance in video, 3D, and 4D generation compared with baseline methods.show more

🚨Announcing our #ICLR2025 Oral! 🔥Diffusion LMs are on the... rise for parallel text generation! But unlike autoregressive LMs, they struggle with quality, fixed-length constraints & lack of KV caching. 🚀Introducing Block Diffusion—combining autoregressive and diffusion models for the best of both worlds! 👇1/7show more

Made this cool AI Vid with AnimateDiff and Inpainting... with Stable Diffusion!show more

Playing with Stable Diffusion #SwiftUI

Diffusions are excellent in creating fantastic images and videos... 🔎 We cooked a *diffusion* model to synthesize structured data #ICLR2025 🔥 Introducing TabDiff, a mixed-type diffusion model for generating synthetic tabular data, imputing missing values, and beyond! 🧵 1/nshow more

MMaDA-Parallel Multimodal Large Diffusion Language Models for Thinking-Aware Editing... and Generationshow more

🚨New paper! Generative models are often “miscalibrated”. We calibrate... diffusion models, LLMs, and more to meet desired distributional properties. E.g. we finetune protein models to better match the diversity of natural proteins.show more

⚡ Video diffusion is slow. PDD changes that. 🚀... Introducing Parallel Decoding Distillation, our latest work on accelerating video diffusion models. Paper: Page: By Neta Shaul, Julius Berner, and Chao Liu. Below PDD on LTX-2.3 🔊show more

Meta presents MarDini Masked Autoregressive Diffusion for Video Generation... at Scaleshow more

NCMs are pretty fast! See the language generation speed... vs. autoregressive and diffusion baselines below.show more

DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion abs: project... page: github:show more

Blog post - Autoregression vs Diffusion - Understanding Sampling... via Optimal Transport Autoregression and diffusion look like opposites. Yet, beneath the implementation details, both are solving the same transport problem: how to turn simple noise into structured data.show more

MiniMax H3 is more than a video generation model.... Its open-weight release enables developers to build on a powerful multimodal system with generation, editing, and consistency features. Supported by ComfyUI, Diffusers, SGLang Diffusion, and Hugging Face, it simplifies integration and could inspire new AI video applications.show more

Today, we are adding Stable Video Diffusion, our foundation... model for generative video to the Stability AI Developer Platform API. The model can generate 2 seconds of video, comprising of 25 generated frames and 24 frames of FILM interpolation, within an average time of 41 seconds. Developers interested in utilizing Stable Video Diffusion through an API can access it now on the Stability AI Developer Platform. Learn more here:show more

(1/2) Intrinsic Image Diffusion for Single-view Material Estimation! We... propose a probabilistic diffusion model to handle material & lighting ambiguities. We obtain sharp material estimates and facilitate high-fidelity relighting.show more