Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Introducing Runway Aleph, a new way to edit, transform and generate video. Aleph is a state-of-the-art in-context video model, setting a new frontier for multi-task visual generation, with the ability to perform a wide range of edits on an input video such as adding, removing and transforming objects, getting... show more

Runway

292,145 subscribers

648,689 views • 1 year ago •via X (Twitter)

Science & Technology Arts

Anya Rossi• Live Now

Private livecam show

35 Comments

Runway1 year ago

The model can generalize to a wide spectrum of tasks, edits and generation capabilities. For a full breakdown of what the model can do, see the page below:

Runway1 year ago

We are gradually rolling out access to Runway Aleph. It will be available to everyone in the coming days.

TechHalla1 year ago

OK, now I'm about to have a very busy weekend

Alex Patrascu1 year ago

Oh, wow! 😯 There isn't a single boring day in the AI space!

Allen T.1 year ago

Massive, massive release. Opens up so many possibilities

Ed Newton-Rex1 year ago

What’s the training data?

𝓓𝖗. 𝓥𝖔𝕏 𝓞𝖈𝖚𝖑𝖎 ᴹᴰ 👁️‍🗨️1 year ago

So, let's have an honest discussion here... what is the end game for all this AI media technology? To be able to create your very own personalized Netflix series with one prompt? What about after we can accomplish that? What's left?

Vladimir Druts1 year ago

Every single video project I've tried in Runway has been a massive facepalm failure, with garbled motion, fingers and terrible quality. Is this one different?

Mike Mason1 year ago

Insanity. Every day, it seems you're bringing AI filmmaking & storytelling closer and closer within reach of solo creatives. Unfortunately, the credits required to make these videos are still very cost-prohibitive to the average person. Kudos, though!

Dave Clark1 year ago

🤩

Christopher Fryant1 year ago

This looks stunning! Where would this show up in the interface once I get it?

WVI@Runway1 year ago

🚨🚨

Dreaming Tulpa 🥓👑1 year ago

gosh this looks fantastic

David JW Villalva1 year ago

Wow, love this.

ᴍɪɴɪsᴛʀʏ ᴏᴠ ᴛʀᴠᴛʜ1 year ago

There goes my weekend

LudovicCreator1 year ago

Sounds great

Blaine Brown1 year ago

Brah 🤯

Tom Blake1 year ago

Very excited for this. Great job and congrats to the team!

Kris Kashtanova1 year ago

This is incredibly!

Gone Scholarknighting1 year ago

Holy shit was just talking about this.

Ben Nash1 year ago

Any word on time length?

Ai Wiz1 year ago

Wow this is crazy Runway is becoming the truth! 😂

Chrissie1 year ago

Wow! Thank you @runwayml

OscarAI1 year ago

This looks very promising.

￦1 year ago

ngl, dat's cool!

Archit Rathi 👨🏻‍💻1 year ago

Game changer for creators. Getting this level of control to edit any video unlocks a whole new layer of precision in AI filmmaking. Hope the model performs as smoothly as that demo Kudos to team Runway!🚀

Emily1 year ago

Hopefully the speed will be good, because we are rendering the video again 🤔🤔🤔

Elena Savlokhova1 year ago

Wow!

Dheepan Ratnam1 year ago

Holy shit this is awesome 😆

Jesus Plaza1 year ago

You never stop surprising us!!! Congrats

Yael Vinker1 year ago

🤯👏 amazing!!

Antonio1 year ago

I love this. I think it’s going to be something revolutionary

ATou1 year ago

Holy fu….! Great job! Want to try it NOW!

ElevateArtist1 year ago

this is incredible

Smoke-away1 year ago

New angles of a scene.

Related Videos

Runway Aleph is a new way to edit, transform and generate video. Its ability to perform a wide range of generalized tasks means it can reimagine ordinary footage in endless new ways. Allowing you to turn images and videos you already have into anything you want. See below for a quick breakdown on how Aleph can effortlessly remove the subject from these scenes, just by asking it to.

Runway Aleph is a new way to edit, transform and generate video. Its ability to perform a wide range of generalized tasks means it can reimagine ordinary footage in endless new ways. Allowing you to turn images and videos you already have into anything you want. See below for a quick breakdown on how Aleph can effortlessly remove the subject from these scenes, just by asking it to.

Runway

37,873 views • 1 year ago

Introducing our new frontier video model, Runway Gen-4.5. Previously known as Whisper Thunder (aka) David. Gen-4.5 is state-of-the-art and sets a new standard for video generation motion quality, prompt adherence and visual fidelity. Learn more below.

Introducing our new frontier video model, Runway Gen-4.5. Previously known as Whisper Thunder (aka) David. Gen-4.5 is state-of-the-art and sets a new standard for video generation motion quality, prompt adherence and visual fidelity. Learn more below.

Runway

854,925 views • 10 months ago

We have completed rollout of access to Runway Aleph for 100% of all our paid plans. Aleph is a completely new way of creating, editing, transforming and generating video. To learn more about best practices for prompting, see the link below.

We have completed rollout of access to Runway Aleph for 100% of all our paid plans. Aleph is a completely new way of creating, editing, transforming and generating video. To learn more about best practices for prompting, see the link below.

Runway

84,650 views • 1 year ago

So Runway Aleph 2.0 just dropped, and it introduces a pretty interesting workflow for AI video footage editing. Rather than repeatedly prompting a video model and hoping it makes the change you want, you can edit a specific frame first, then use that frame to guide the video generation. For this test, I take an existing footage inside Runway: • Picked a frame from the original video • Used Nano Banana Pro to add a new effect/object • Brought that frame into Aleph 2.0 to generate the updated video It feels like a more controllable and potentially cheaper way to make targeted edits to existing footage than current AI video omni models available like Seedance and Gemini.

So Runway Aleph 2.0 just dropped, and it introduces a pretty interesting workflow for AI video footage editing. Rather than repeatedly prompting a video model and hoping it makes the change you want, you can edit a specific frame first, then use that frame to guide the video generation. For this test, I take an existing footage inside Runway: • Picked a frame from the original video • Used Nano Banana Pro to add a new effect/object • Brought that frame into Aleph 2.0 to generate the updated video It feels like a more controllable and potentially cheaper way to make targeted edits to existing footage than current AI video omni models available like Seedance and Gemini.

Curious Refuge

11,410 views • 3 months ago

With Gen-3 Alpha you can now use an existing video as a guide to generate new outputs with text prompts. This new level of control allows you to maintain the shapes and movements of your input video while transforming its style.

With Gen-3 Alpha you can now use an existing video as a guide to generate new outputs with text prompts. This new level of control allows you to maintain the shapes and movements of your input video while transforming its style.

Runway

74,730 views • 2 years ago

Runway Aleph experiment: using one initial vid clip as a character 'video reference' to generate many more with consistent aesthetics/world Whole video is made from aleph generations based on one initial clip (prompt and clip in the comments)

Runway Aleph experiment: using one initial vid clip as a character 'video reference' to generate many more with consistent aesthetics/world Whole video is made from aleph generations based on one initial clip (prompt and clip in the comments)

Ray (movie arc)

30,373 views • 1 year ago

Just got early access to Aleph, a new in-context video model from Runway. Here’s a snippet of my first experiment using a toy car. Audio added with the MMAudio Gradio demo on Hugging Face spaces

Just got early access to Aleph, a new in-context video model from Runway. Here’s a snippet of my first experiment using a toy car. Audio added with the MMAudio Gradio demo on Hugging Face spaces

William Lamkin

79,195 views • 1 year ago

First, we are excited to share a number of new updates to our frontier video generation model, Gen-4.5 Soon you will be able to both generate and edit native audio with Gen-4.5 and edit video at arbitrary lengths with multi-shot editing.

First, we are excited to share a number of new updates to our frontier video generation model, Gen-4.5 Soon you will be able to both generate and edit native audio with Gen-4.5 and edit video at arbitrary lengths with multi-shot editing.

Runway

33,513 views • 9 months ago

Aleph 2.0 is here. Now you can edit a single frame in your video, preview the change and then Aleph 2.0 carries that edit across the rest of your video. Try it now in the new Edit Studio on web at the link below.

Aleph 2.0 is here. Now you can edit a single frame in your video, preview the change and then Aleph 2.0 carries that edit across the rest of your video. Try it now in the new Edit Studio on web at the link below.

Runway

4,957,165 views • 4 months ago

I’m so excited to finally talk about our new model, Atlas, and share some generations from it..so excited, in fact, that I made a fan trailer for it 😆 It’s an incredibly versatile, multi-task model with a wide range of capabilities. There are many powerful video models out there right now, but after working with Atlas and experimenting with it for so long, I’ve come to really appreciate its elegance and malleability...all rooted in the framework’s simple autoregressive design. As you can see in this video, Atlas is, at a high level, a camera-conditioned visual generation model. But its formulation allows it to learn and perform a variety of tasks remarkably efficiently!

I’m so excited to finally talk about our new model, Atlas, and share some generations from it..so excited, in fact, that I made a fan trailer for it 😆 It’s an incredibly versatile, multi-task model with a wide range of capabilities. There are many powerful video models out there right now, but after working with Atlas and experimenting with it for so long, I’ve come to really appreciate its elegance and malleability...all rooted in the framework’s simple autoregressive design. As you can see in this video, Atlas is, at a high level, a camera-conditioned visual generation model. But its formulation allows it to learn and perform a variety of tasks remarkably efficiently!

Gowthami

17,035 views • 1 month ago

🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike. More details and examples of what Movie Gen can do ➡️ 🛠️ Movie Gen models and capabilities Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt. Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment. Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes. Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video. We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.

🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike. More details and examples of what Movie Gen can do ➡️ 🛠️ Movie Gen models and capabilities Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt. Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment. Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes. Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video. We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.

AI at Meta

2,267,059 views • 2 years ago

Introducing Gen-3 Alpha: Runway’s new base model for video generation. Gen-3 Alpha can create highly detailed videos with complex scene changes, a wide range of cinematic choices, and detailed art directions. (1/10)

Introducing Gen-3 Alpha: Runway’s new base model for video generation. Gen-3 Alpha can create highly detailed videos with complex scene changes, a wide range of cinematic choices, and detailed art directions. (1/10)

Runway

1,033,180 views • 2 years ago

Runway Aleph can precisely alter specific parts of a video, all while maintaining the integrity of everything else. Change outfits, hairstyles, lighting, locations and much more. All you need to do is tell Aleph what you want.

Runway Aleph can precisely alter specific parts of a video, all while maintaining the integrity of everything else. Change outfits, hairstyles, lighting, locations and much more. All you need to do is tell Aleph what you want.

Runway

80,800 views • 1 year ago

Runway Aleph can precisely replace, retexture or entirely reimagine specific parts of a video, making it possible to rapidly ideate and iterate new concepts with existing footage. All you need to do is tell Aleph what you want.

Runway Aleph can precisely replace, retexture or entirely reimagine specific parts of a video, making it possible to rapidly ideate and iterate new concepts with existing footage. All you need to do is tell Aleph what you want.

Runway

74,809 views • 1 year ago

I know we are all excited about Sora 2, but don't sleep on the other models. Runway Aleph is a powerful tool as you can essentially control AI generated characters using videos recorded with your phone. And it's now on Freepik 🔥 To use Runway Aleph on Freepik, head to the new clip editor. Then pick the Aleph model from the menu (or leave it on Auto). Add a prompt and hit generate. All covered in the short tutorial below.

I know we are all excited about Sora 2, but don't sleep on the other models. Runway Aleph is a powerful tool as you can essentially control AI generated characters using videos recorded with your phone. And it's now on Freepik 🔥 To use Runway Aleph on Freepik, head to the new clip editor. Then pick the Aleph model from the menu (or leave it on Auto). Add a prompt and hit generate. All covered in the short tutorial below.

Martin LeBlanc

12,050 views • 1 year ago

Change the aspect ratio of a video to to fit any platform. Aleph 2.0 expands the scene to fit the new aspect ratio so your video looks like it was filmed that way from the start. Learn how in today's Runway Academy.

Change the aspect ratio of a video to to fit any platform. Aleph 2.0 expands the scene to fit the new aspect ratio so your video looks like it was filmed that way from the start. Learn how in today's Runway Academy.

Runway

13,715 views • 3 months ago

FLUX 3 Video now has fast, precise editing. The fastest and lowest cost video editing model in the world. In our internal benchmarking, it’s also ahead of other leading models in the accuracy and precision of edits. Edit an existing video by: • Adding, removing, or replacing objects and characters • Replacing backgrounds • Editing text • Changing colors, materials, visual effects • Changing or translating dialogue with accurate lip sync • Changing the events of a clip

FLUX 3 Video now has fast, precise editing. The fastest and lowest cost video editing model in the world. In our internal benchmarking, it’s also ahead of other leading models in the accuracy and precision of edits. Edit an existing video by: • Adding, removing, or replacing objects and characters • Replacing backgrounds • Editing text • Changing colors, materials, visual effects • Changing or translating dialogue with accurate lip sync • Changing the events of a clip

Black Forest Labs

78,506 views • 22 days ago

A breakthrough in real-time video generation. As a research preview developed with NVIDIA and shared at NVIDIAGTC this week, we trained a new real-time video model running on Vera Rubin. HD videos generate instantly, with time-to-first-frame under 100ms. Unlocking an entirely new creative paradigm and bolstering the foundations of our General World Model, GWM-1. Real-time generation opens a fundamentally different design space for video models and world simulation. We're investing in co-designing our models alongside advances in hardware to keep pushing this frontier.

A breakthrough in real-time video generation. As a research preview developed with NVIDIA and shared at NVIDIAGTC this week, we trained a new real-time video model running on Vera Rubin. HD videos generate instantly, with time-to-first-frame under 100ms. Unlocking an entirely new creative paradigm and bolstering the foundations of our General World Model, GWM-1. Real-time generation opens a fundamentally different design space for video models and world simulation. We're investing in co-designing our models alongside advances in hardware to keep pushing this frontier.

Runway

1,165,744 views • 6 months ago

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!

Santiago

65,446 views • 5 months ago