Today, we are releasing Stable Video Diffusion, our first... foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:show more

Today, we’re thrilled to announce the open weights for... Stable Diffusion 3 Medium, the latest and most advanced text-to-image AI model in our Stable Diffusion 3 series! This new release represents a major milestone in the evolution of generative AI and continues our commitment to democratising this powerful technology. 🎉 Learn more and get started here:show more

Today we are announcing Stable Artisan, bringing the capabilities... of Stability AI’s Developer Platform API accessible to a wider audience. Featuring our advanced models such as Stable Diffusion 3, Stable Video, and Stable Image Core, Stable Artisan enables users to create high-quality media directly within Discord. Join the server and get started here: Read our blog here:show more

TokenFlow: Consistent Diffusion Features for Consistent Video Editing paper... page: The generative AI revolution has recently expanded to videos. Nevertheless, current state-of-the-art video models are still lagging behind image models in terms of visual quality and user control over the generated content. In this work, we present a framework that harnesses the power of a text-to-image diffusion model for the task of text-driven video editing. Specifically, given a source video and a target text-prompt, our method generates a high-quality video that adheres to the target text, while preserving the spatial layout and motion of the input video. Our method is based on a key observation that consistency in the edited video can be obtained by enforcing consistency in the diffusion feature space. We achieve this by explicitly propagating diffusion features based on inter-frame correspondences, readily available in the model. Thus, our framework does not require any training or fine-tuning, and can work in conjunction with any off-the-shelf text-to-image editing method. We demonstrate state-of-the-art editing results on a variety of real-world videos.show more

This is a big day. Meta is open-sourcing AudioCraft.... You can now generate incredible music and sounds with a single prompt. It includes the most performant Generative AI Model (audio) on the market, the "Llama" of Audio. The research framework contains the weights and code of these models: ▸ MusicGen: controllable text-to-music model. ▸ AudioGen: text-to-sound model. ▸ EnCodec: high fidelity neural audio codec. ▸ Multi Band Diffusion: An EnCodec compatible decoder using diffusion. This is going to tremendously speed up audio research 👏show more

Align your Latents: High-Resolution Video Synthesis with Latent Diffusion... Models turn the publicly available, state-of-the-art text-to-image LDM Stable Diffusion into an efficient and expressive text-to-video model with resolution up to 1280 x 2048 abs: project page:show more

Today, Generative AI takes its next big step forward.... Introducing Gen-1: a new AI model that uses language and images to generate new videos out of existing ones. Sign up for early research access:show more

Exciting milestones in our generative AI research: Emu Video,... which lets you create high quality videos from a text prompt, and Emu Edit, which enables detailed image editing based on your instructions. These new models are built on Emu, our foundation model for image generation and technology from them will underpin new creative features across our apps next year. Try it out: Emu Video: Emu Edit:show more

Stable Diffusion 3.5 from Stability AI is now LIVE... on Civitai! Stable Diffusion 3.5 Large is a Multimodal Diffusion Transformer text-to-image model that features improved performance in image quality, typography, complex prompt understanding, and resource-efficiency. Generate with SD 3.5 Live on Civitai here👇🏽 All images used to create this video were generated with SD 3.5 by our community 🫶🏽show more

Today we’re sharing two new advances in our generative... AI research: Emu Video & Emu Edit. Details ➡️ These new models deliver exciting results in high quality, diffusion-based text-to-video generation & controlled image editing w/ text instructions. 🧵show more

Today, we're introducing PlayHT2.0 - our new Conversational Text-to-Voice... AI Model that's trained and built to generate humanlike conversations across languages with <1s latency. Sign up for beta access -show more

Introducing Veo 2, our new, state-of-the-art video model (with... better understanding of real-world physics & movement, up to 4K resolution). You can join the waitlist on VideoFX. Our new and improved Imagen 3 model also achieves SOTA results, and is coming today to 100+ countries in ImageFX.show more

Stable Diffusion generates beautiful images, but can it be... used for open-world recognition? Try Demo! Our #CVPR2023 paper shows that the pre-trained diffusion model indeed is a good image parser, allows for open-vocabulary segmentation and detection.show more

We introduce W.A.L.T, a diffusion model for photorealistic video... generation. Our model is a transformer trained on image and video generation in a shared latent space. 🧵👇show more

Starting today you can try our new foundation research... model for audio generation. The demo includes Zero shot TTS, Text to sound effects, Infilling and more! Try Audiobox ➡️show more

I'm thrilled to announce the launch of ⚡️Flash Diffusion... from Jasper! Earlier this year, with our acquisition of Clipdrop, we launched the Jasper AI Research Lab in Paris. Today, we are excited to release our first piece of groundbreaking research: the open-source distillation method, "Flash Diffusion". Flash Diffusion accelerates inference by 500%, reduces computing costs, and produces higher-quality image outputs. Dive into the details and discover how Flash Diffusion is set to revolutionize the field of AI and image synthesis. Read all about it here: Try a demo on Hugging Face:show more

Introducing SDXL Turbo: A real-time text-to-image generation model. SDXL... Turbo achieves state-of-the-art performance with a new distillation technology, enabling single-step image generation with unprecedented quality, reducing the required step count from 50 to just one. The code, research paper, and weights for non-commercial use are now available on our website. You can test SDXL Turbo on Stability AI’s image editing platform Clipdrop, with a beta demonstration of the real-time text-to-image generation capabilities. Learn more:show more

if you’re already off of the waitlist, here’s a... brief overview on how to fund your Gamebytes account via Phantom sign up for the waitlist on our website!show more

We are thrilled to announce a massive update to... our Text-To-Speech (TTS) model for Twi! We are confident it is the best Twi TTS there now! Give it a listen and see if you agree! Sign up for our API and incorporate it into your products today! 🙏🏾 (link in bio)show more

This approach has made Sonnet the model of choice... for developers worldwide. In addition to our new model, we're launching Claude Code, our first coding tool, in a limited research preview. With Claude Code, you can delegate substantial tasks to Claude—right from your terminal.show more

The reception since we launched the first unified audio... + text + image to video model in production last week has been incredible! We wanted to take a moment and highlight some firsts: - the first omnimodal modal that jointly operates over text, image, and audio. Fun fact: we shipped our first audio-to-video model Character-1 last June! - Character-3 is generating 5 minute uncut clips, and capable of temporally stable longform prediction. - Character-3 handles realistic humans, cartoons, side profiles, dynamic backgrounds, anime, animals, and more. - Character-3 sets a new standard for fast & efficient video diffusion at HD and SD resolutions, leveraging our advancements in realtime video generation. We'll have an announcement soon, but you can read more about an earlier version of this line of work in our paper here:show more