So happy to share! 🎉 Recently, we’ve seen 🔥... work using generative models to elucidate candidate principles of neural connectivity. Our v2: Inspired by redundancy reduction, our new model can generate both the topology & weights of the connectome:show more

1/ Happy to share VADER: Video Diffusion Alignment via... Reward Gradients. We adapt foundational video diffusion models using pre-trained reward models to generate high-quality, aligned videos for various end-applications. Below we generated a short movie using VADER 😀, we used ChatGPT to write a script and an off-the-shelf AI music generator to generate the sound. Our code & weights are open-sourced:show more

Today, we are releasing Stable Video Diffusion, our first... foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:show more

🚀 Excited to share our #ICLR2025 work on planning... with neural dynamics models! While our lab has developed diverse neural dynamics models for manipulating rigid, deformable, and granular objects, having the model alone doesn’t solve the problem—planning with it remains a challenge. 💡 Enter BaB-ND, led by Keyi and Jiangwei! We propose a scalable, GPU-accelerated branch-and-bound algorithm, inspired by neural network verification, to enable effective planning for diverse objects modeled with neural dynamics. 🔗 Project page (open-source + detailed docs!): 🎥 Watch the video to see T being pushed around obstacles, and check out Keyi’s thread for more details!show more

Introducing ✨ Aya Vision ✨ - an open-weights model... to connect our world through language and vision Aya Vision adds breakthrough multimodal capabilities to our state-of-the-art multilingual 8B and 32B models. 🌿show more

Generative 3d environments just became a thing with the... announcement of OpenAI's new video model, Sora. Michael Rublof from took one of those videos, and turned it into a NeRF using Colmap and Nerfstudio. While people are laughing at the topology of generated models, the world is changing around us, and that's exciting and a little scary, but we'll find a way to turn Gen Ai into creative superpowers. I believe in human creativity, in our ability to surprise, to move, to change and to challenge. Here's to the future! #ai #artshow more

Happy New Year! 🎉 As we look back on... the past year, we celebrate the joy we’ve shared as a community, the memories we’ve created, and the challenges we’ve overcome together. With so much ahead, the best is yet to come! 🚀 Every new year is filled with opportunity. Thank you to our amazing community in this time of celebration! See you in 2025! 🙏 Share your Happy New Year VeVe fam messages in the comments below 👇show more

1/ Happy to share UniDisc - Unified Multimodal Discrete... Diffusion – We train a 1.5 billion parameter transformer model from scratch on 250 million image/caption pairs using a **discrete diffusion objective**. Our model has all the benefits of diffusion models but now in multimodal space! - flexible compute-quality tradeoff, zero-shot inpainting and editing, better control via classifier-free guidance and lower latency! We open source everything - our code, weights and the training dataset.show more

ANNOUNCEMENT Now anyone can use Stable Diffusion XL, our... latest text-to-image generative AI model, on our Clipdrop platform, for free! Test the limits of your creativity. #SDXL Try it here →show more

Improving tropical cyclone prediction can help communities better prepare... & stay safe. Developed with Google DeepMind, we're launching Weather Lab to share our AI weather prediction models, starting with the new experimental cyclone prediction model. 🧵show more

Want to generate images from the world's best models... like Nano Banana or GPT Image side by side? Now you can with Image Lab 🚀 Run a single prompt across up to 25 models, with up to 20 images from each, and see results in seconds. You've seen our leaderboards. Now generate and evaluate the models yourself. Link in thread 🧵👇show more

Excited to announce the release of our open-source protein... family language model, ProFam-1, designed to generate functional protein variants and predict fitness using in-context example sequences. 1/nshow more

MY MESSAGE TO REFORM Please share this so we... have the best chance of getting it seen by the Reform candidate and hopefully Nigel Farage MP. Nick #makedoncastersafeagainshow more

Today, we are adding Stable Video Diffusion, our foundation... model for generative video to the Stability AI Developer Platform API. The model can generate 2 seconds of video, comprising of 25 generated frames and 24 frames of FILM interpolation, within an average time of 41 seconds. Developers interested in utilizing Stable Video Diffusion through an API can access it now on the Stability AI Developer Platform. Learn more here:show more

Zeudi recently liked both of these Instagram reels from... Chicago’s skyline so the USA Zeudiners better pay attention to what our girl likesshow more

Happy new year! Are you ready to take flight?... TOMORROW, Jan. 6th, is the launch of our new campaign, Flight of the Icaron, GM'd by Lou Wilson! Stick around our socials to meet the ship's crew ... Here's a preview of the score, composed by Will Savino!show more

our new website just dropped!! built it to finally... showcase our work, and share what we do. super proud of the voice agent as well 🫶show more

Traditional physics-based models struggle with extreme rainfall, often overestimating... light events while underestimating extreme precipitation. Our new hybrid climate model, NeuralGCM, more accurately simulates extreme rainfall, mean precipitation (with a 40% bias reduction compared to CMIP6 models), and the diurnal cycle of precipitation. These improvements are a direct result of training the model on NASA satellite observations, not just reanalysis data.show more

Always a thrill to see customer results like this.... Perplexity is a pioneering generative AI startup that’s reimagining the future of search (catch their app in action below). They accelerated their foundation model training up to 40% using Amazon SageMaker HyperPod. And by deploying models on our best-in-class infrastructure, they’re able to handle over 100k queries per hour without compromising latency or the user experience. Proud to support innovators like Perplexity in pushing the boundaries of AI. Happy searching!show more

Sneak peek at some stuff 🫣 This is our... local development environment where we can compare what the models generate by default to what they generate with our opinions layered in. So much more to do, but already obvious improvements from just focusing on little details like hanging punctuation, card content alignment, lighting/elevation cues, and edge highlighting of avatars.show more

Many of you asked for code & weights for... π₀, we are happy to announce that we are releasing π₀ and pre-trained checkpoints in our new openpi repository! We tested the model on a few public robots, and we include code for you to fine-tune it yourself.show more