So happy to share! 🎉 Recently, we’ve seen 🔥... work using generative models to elucidate candidate principles of neural connectivity. Our v2: Inspired by redundancy reduction, our new model can generate both the topology & weights of the connectome:show more

1/ Happy to share VADER: Video Diffusion Alignment via... Reward Gradients. We adapt foundational video diffusion models using pre-trained reward models to generate high-quality, aligned videos for various end-applications. Below we generated a short movie using VADER 😀, we used ChatGPT to write a script and an off-the-shelf AI music generator to generate the sound. Our code & weights are open-sourced:show more

The latent space of earlier generative models like GANS... can linearly encode concepts of the data. What if the data was model weights? We present weights2weights, a subspace in diffusion weights that behaves as an interpretable latent space over customized diffusion models.show more

Today, we are releasing Stable Video Diffusion, our first... foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:show more

Excited to share our new work "AvatarPopUp"! "Instant 3D... Human Avatar Generation using Image Diffusion Models" 💻 📄show more

Happy to share I'm joining Runway 🎉 working on... generative video models and tools! 📹show more

🚀 Excited to share our #ICLR2025 work on planning... with neural dynamics models! While our lab has developed diverse neural dynamics models for manipulating rigid, deformable, and granular objects, having the model alone doesn’t solve the problem—planning with it remains a challenge. 💡 Enter BaB-ND, led by Keyi and Jiangwei! We propose a scalable, GPU-accelerated branch-and-bound algorithm, inspired by neural network verification, to enable effective planning for diverse objects modeled with neural dynamics. 🔗 Project page (open-source + detailed docs!): 🎥 Watch the video to see T being pushed around obstacles, and check out Keyi’s thread for more details!show more

Introducing ✨ Aya Vision ✨ - an open-weights model... to connect our world through language and vision Aya Vision adds breakthrough multimodal capabilities to our state-of-the-art multilingual 8B and 32B models. 🌿show more

Generative 3d environments just became a thing with the... announcement of OpenAI's new video model, Sora. Michael Rublof from took one of those videos, and turned it into a NeRF using Colmap and Nerfstudio. While people are laughing at the topology of generated models, the world is changing around us, and that's exciting and a little scary, but we'll find a way to turn Gen Ai into creative superpowers. I believe in human creativity, in our ability to surprise, to move, to change and to challenge. Here's to the future! #ai #artshow more

Happy New Year! 🎉 As we look back on... the past year, we celebrate the joy we’ve shared as a community, the memories we’ve created, and the challenges we’ve overcome together. With so much ahead, the best is yet to come! 🚀 Every new year is filled with opportunity. Thank you to our amazing community in this time of celebration! See you in 2025! 🙏 Share your Happy New Year VeVe fam messages in the comments below 👇show more

1/ Happy to share UniDisc - Unified Multimodal Discrete... Diffusion – We train a 1.5 billion parameter transformer model from scratch on 250 million image/caption pairs using a **discrete diffusion objective**. Our model has all the benefits of diffusion models but now in multimodal space! - flexible compute-quality tradeoff, zero-shot inpainting and editing, better control via classifier-free guidance and lower latency! We open source everything - our code, weights and the training dataset.show more

ANNOUNCEMENT Now anyone can use Stable Diffusion XL, our... latest text-to-image generative AI model, on our Clipdrop platform, for free! Test the limits of your creativity. #SDXL Try it here →show more

Improving tropical cyclone prediction can help communities better prepare... & stay safe. Developed with Google DeepMind, we're launching Weather Lab to share our AI weather prediction models, starting with the new experimental cyclone prediction model. 🧵show more

One of the core principles of how we design... @Reve is to be true to the material. Bringing form to how our frontier model thinks and creates from spatial layout has been one of the true highlights of our latest release.show more

Want to generate images from the world's best models... like Nano Banana or GPT Image side by side? Now you can with Image Lab 🚀 Run a single prompt across up to 25 models, with up to 20 images from each, and see results in seconds. You've seen our leaderboards. Now generate and evaluate the models yourself. Link in thread 🧵👇show more

now live! After years of requests to access some... of our client generative software. We’ve started an archive for the public to play with a little bit of our toolbox. 3 tools available now and many more to come. Enjoy!show more

Excited to announce the release of our open-source protein... family language model, ProFam-1, designed to generate functional protein variants and predict fitness using in-context example sequences. 1/nshow more

🚨 We're very happy to introduce TRIBE v2: a... foundation model of the brain's responses to sight, sound & language. 📄 Paper: ▶️ Demo: 💻 Code: 🤗 Model:show more

Today, we are adding Stable Video Diffusion, our foundation... model for generative video to the Stability AI Developer Platform API. The model can generate 2 seconds of video, comprising of 25 generated frames and 24 frames of FILM interpolation, within an average time of 41 seconds. Developers interested in utilizing Stable Video Diffusion through an API can access it now on the Stability AI Developer Platform. Learn more here:show more

MY MESSAGE TO REFORM Please share this so we... have the best chance of getting it seen by the Reform candidate and hopefully Nigel Farage MP. Nick #makedoncastersafeagainshow more

Zeudi recently liked both of these Instagram reels from... Chicago’s skyline so the USA Zeudiners better pay attention to what our girl likesshow more