GANs are so back?! Scientists from Brown and Cornell... have published a paper with a ✨ modern architecture GAN ✨ that is 🗿 stable to train 🗿 and competitive with SOTA GANs and even diffusion models Paper and demo 👇show more

Okay, this is seriously cool. A team from Google... DeepMind, including DeepMind Cofounder Shane Legg, published a paper "From AGI to ASI". In the paper, they include instructions for an AI agent to read along with you. You can open the paper in Codex's in-app browser and have GPT-5.5 read it with you and explain all the concepts. This is the future. AI agents will be part of the target audience, and help us to understand anything we want.show more

This symmetric diffusion paper at ICLR is nice (simple... idea in retrospect): SymmCD: Symmetry-Preserving Crystal Generation with Diffusion Models We'd actually implemented this idea internally at Orbital, and it works nicely even for very large crystal structures:show more

NVIDIA AI Released DiffusionRenderer: An AI Model for Editable,... Photorealistic 3D Scenes from a Single Video In a groundbreaking new paper, researchers at NVIDIA, University of Toronto, Vector Institute and the University of Illinois Urbana-Champaign have unveiled a framework that directly tackles this challenge. DiffusionRenderer represents a revolutionary leap forward, moving beyond mere generation to offer a unified solution for understanding and manipulating 3D scenes from a single video. It effectively bridges the gap between generation and editing, unlocking the true creative potential of AI-driven content. DiffusionRenderer treats the “what” (the scene’s properties) and the “how” (the rendering) in one unified framework built on the same powerful video diffusion architecture that underpins models like Stable Video Diffusion..... Read full article here: Paper: GitHub Page: NVIDIA NVIDIA AI NVIDIAnewsroom NVIDIA AIDevshow more

I made a tool called Diffusion Explorer that lets... you to train and visualize simple 2D diffusion and flow models live in the browser. You can draw your own distributions and observe how the generated samples converge during training. Try it live 👇show more

This is the direction West African architecture could have... evolved into; Modern, rooted in a shared central space, expressed with earthen materials, and different from all these modern boxes we now have.show more

The Hidden Language of Diffusion Models paper page: tackle... the challenge of understanding concept representations in text-to-image models by decomposing an input text prompt into a small set of interpretable elements. This is achieved by learning a pseudo-token that is a sparse weighted combination of tokens from the model's vocabulary, with the objective of reconstructing the images generated for the given concept. Applied over the state-of-the-art Stable Diffusion model, this decomposition reveals non-trivial and surprising structures in the representations of concepts. For example, we find that some concepts such as "a president" or "a composer" are dominated by specific instances (e.g., "Obama", "Biden") and their interpolations. Other concepts, such as "happiness" combine associated terms that can be concrete ("family", "laughter") or abstract ("friendship", "emotion"). In addition to peering into the inner workings of Stable Diffusion, our method also enables applications such as single-image decomposition to tokens, bias detection and mitigation, and semantic image manipulationshow more

My first PhD paper!🎉We learn *diffusion* models for code... generation that learn to directly *edit* syntax trees of programs. The result is a system that can incrementally write code, see the execution output, and debug it. 🧵1/nshow more

✨ OneFootball Credits are here ✨ Now that the... Open Edition Mint has concluded (rewards have been distributed, see thread), OneFootball is ready to announce "OneFootball Credits" and its newly emerging ecosystem! Read our ecosystem paper here: 👉show more

Our new paper is published today on Development!!!! A... collaboration with Deirdre Lyons and Vanessa Barone where we use sea star embryos to analyse the 3D packing dynamics and, of course, #sctuoids. This is the Thesis work of Antonio Tagua.show more

i’ve always loved how fate has such a beautiful... way of leading them back to each other over and over. there are like 26 papers in there and new drew a paper with tay’s name by random is crazyshow more

Since he’s not in Paris anymore, here it is:... Hudson Williams yesterday was at the balcony with Aika Flores (his hairstylist and friend) signing autographs and sending them as little paper planes and then he shouted that he ran out of paper for them to be careful with the heads and threw a clementine. via sofianealarcon & _anais_louiseshow more

Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation paper page:... Large text-to-image diffusion models have exhibited impressive proficiency in generating high-quality images. However, when applying these models to video domain, ensuring temporal consistency across video frames remains a formidable challenge. This paper proposes a novel zero-shot text-guided video-to-video translation framework to adapt image models to videos. The framework includes two parts: key frame translation and full video translation. The first part uses an adapted diffusion model to generate key frames, with hierarchical cross-frame constraints applied to enforce coherence in shapes, textures and colors. The second part propagates the key frames to other frames with temporal-aware patch matching and frame blending. Our framework achieves global style and local texture temporal consistency at a low cost (without re-training or optimization). The adaptation is compatible with existing image diffusion techniques, allowing our framework to take advantage of them, such as customizing a specific subject with LoRA, and introducing extra spatial guidance with ControlNet. Extensive experimental results demonstrate the effectiveness of our proposed framework over existing methods in rendering high-quality and temporally-coherent videos.show more

We are also releasing self-contained lecture notes that explain... flow matching and diffusion models from scratch. This goes from "zero" to the state-of-the-art in modern Generative AI. 📖 Read the notes here: Joint work with Ezra Erives.show more

Hi! My name is David, and THIS is just... a little bit of the animation and cleaning up work I've done over the last year ✨ #Portfolio Music from Paper Mario: Sticker Starshow more

JUST IN: Meta AI introduces Voicebox, an all-in-one generative... speech model. Voicebox is an impressive breakthrough! It could do for speech what other models like GPT-3 and Stable Diffusion have done for text and images. Some key details: - Voicebox can synthesize speech across 6 languages - It's a general-purpose model that can perform tasks it wasn't trained on. It can perform noise removal, content editing, style conversion, and more - Supports in-context text-to-speech synthesis and cross-lingual style transfer - It's 20x faster than current models and outperforms single-purpose models through in-context learning paper: blog:show more

What to pack and fuel up with at a... tournament or back to back games/events/competitions as a student-athlete ?? 👇These are the high-quality protein + carbohydrate options to have on hand to support energy needs! ✨Volleyball ✨Swimming ✨Track & field/XC ✨Baseball/softball ✨Basketball ✨Wrestling ✨Tennis ✨Football ✨Soccer/LAX ✨Field & Ice Hockeyshow more

Google dropped a new AI paper called LUMIERE. It's... remarkably flexible, supporting video inpainting, image-to-video, AND stylized video generation tasks. Say hello to “space-time diffusion” for video generation! Now what the heck does that mean exactly?! 🌐⏳ → TL;DR it utilizes a “Space-Time UNet” architecture that generates the full duration of the video in one pass, rather than generating distant keyframes and interpolating between them like prior works. Because the computation is done in this “compressed space-time representation” to generate the full clip at once, it's far more temporally consistent. → Another benefit of generating the full video at once is that you can “direct” the video generation, making it easier to hand off to other models/tasks without having to stitch together partial solutions. You can condition generations on additional inputs, meaning you get the full stack of AI video capabilities – from video inpainting to image-to-video and beyond. → New SOTA for AI video generation? User study results in the paper suggest human evaluators preferred Lumiere over Runway Gen-2, Pika Labs, and Stable Video Diffusion in terms of quality, text alignment AND motion. But as always, we need to get hands-on with this tech when Google *actually* decides to ship it. → Could this end up inside YouTube? Y’all know i’m obsessed with blending reality and imagination – so it’s the video inpainting tech I'm most excited about. I really hope this model finds its way into YouTube's Generative AI efforts, and based on their prior announcements and the list of acknowledgments in the paper I think it might! 🤞🏽 Links: 🔗Paper: 🔗Project:show more