Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Introducing Runway Aleph, a new way to edit, transform and generate video. Aleph is a state-of-the-art in-context video model, setting a new frontier for multi-task visual generation, with the ability to perform a wide range of edits on an input video such as adding, removing and transforming objects, getting...

runwayml's profile picture

Runway

284,235 subscribers

647,134 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & TechnologieKunst
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Runway Aleph is a new way to edit, transform and generate video. Its ability to perform a wide range of generalized tasks means it can reimagine ordinary footage in endless new ways. Allowing you to turn images and videos you already have into anything you want. See below for a quick breakdown on how Aleph can effortlessly remove the subject from these scenes, just by asking it to.
1:00

Runway Aleph is a new way to edit, transform and generate video. Its ability to perform a wide range of generalized tasks means it can reimagine ordinary footage in endless new ways. Allowing you to turn images and videos you already have into anything you want. See below for a quick breakdown on how Aleph can effortlessly remove the subject from these scenes, just by asking it to.

Runway

37,873 Aufrufe • vor 11 Monaten

Introducing our new frontier video model, Runway Gen-4.5. Previously known as Whisper Thunder (aka) David. Gen-4.5 is state-of-the-art and sets a new standard for video generation motion quality, prompt adherence and visual fidelity. Learn more below.
1:28

Introducing our new frontier video model, Runway Gen-4.5. Previously known as Whisper Thunder (aka) David. Gen-4.5 is state-of-the-art and sets a new standard for video generation motion quality, prompt adherence and visual fidelity. Learn more below.

Runway

853,211 Aufrufe • vor 8 Monaten

We have completed rollout of access to Runway Aleph for 100% of all our paid plans. Aleph is a completely new way of creating, editing, transforming and generating video. To learn more about best practices for prompting, see the link below.
1:26

We have completed rollout of access to Runway Aleph for 100% of all our paid plans. Aleph is a completely new way of creating, editing, transforming and generating video. To learn more about best practices for prompting, see the link below.

Runway

84,575 Aufrufe • vor 1 Jahr

So Runway Aleph 2.0 just dropped, and it introduces a pretty interesting workflow for AI video footage editing. Rather than repeatedly prompting a video model and hoping it makes the change you want, you can edit a specific frame first, then use that frame to guide the video generation. For this test, I take an existing footage inside Runway: • Picked a frame from the original video • Used Nano Banana Pro to add a new effect/object • Brought that frame into Aleph 2.0 to generate the updated video It feels like a more controllable and potentially cheaper way to make targeted edits to existing footage than current AI video omni models available like Seedance and Gemini.
2:59

So Runway Aleph 2.0 just dropped, and it introduces a pretty interesting workflow for AI video footage editing. Rather than repeatedly prompting a video model and hoping it makes the change you want, you can edit a specific frame first, then use that frame to guide the video generation. For this test, I take an existing footage inside Runway: • Picked a frame from the original video • Used Nano Banana Pro to add a new effect/object • Brought that frame into Aleph 2.0 to generate the updated video It feels like a more controllable and potentially cheaper way to make targeted edits to existing footage than current AI video omni models available like Seedance and Gemini.

Curious Refuge

11,410 Aufrufe • vor 1 Monat

With Gen-3 Alpha you can now use an existing video as a guide to generate new outputs with text prompts. This new level of control allows you to maintain the shapes and movements of your input video while transforming its style.
1:00

With Gen-3 Alpha you can now use an existing video as a guide to generate new outputs with text prompts. This new level of control allows you to maintain the shapes and movements of your input video while transforming its style.

Runway

74,716 Aufrufe • vor 1 Jahr

Runway Aleph experiment: using one initial vid clip as a character 'video reference' to generate many more with consistent aesthetics/world Whole video is made from aleph generations based on one initial clip (prompt and clip in the comments)
0:53

Runway Aleph experiment: using one initial vid clip as a character 'video reference' to generate many more with consistent aesthetics/world Whole video is made from aleph generations based on one initial clip (prompt and clip in the comments)

Ray (movie arc)

30,361 Aufrufe • vor 1 Jahr

Just got early access to Aleph, a new in-context video model from Runway. Here’s a snippet of my first experiment using a toy car. Audio added with the MMAudio Gradio demo on Hugging Face spaces
0:35

Just got early access to Aleph, a new in-context video model from Runway. Here’s a snippet of my first experiment using a toy car. Audio added with the MMAudio Gradio demo on Hugging Face spaces

William Lamkin

79,195 Aufrufe • vor 1 Jahr

First, we are excited to share a number of new updates to our frontier video generation model, Gen-4.5 Soon you will be able to both generate and edit native audio with Gen-4.5 and edit video at arbitrary lengths with multi-shot editing.
2:10

First, we are excited to share a number of new updates to our frontier video generation model, Gen-4.5 Soon you will be able to both generate and edit native audio with Gen-4.5 and edit video at arbitrary lengths with multi-shot editing.

Runway

33,369 Aufrufe • vor 8 Monaten

Aleph 2.0 is here. Now you can edit a single frame in your video, preview the change and then Aleph 2.0 carries that edit across the rest of your video. Try it now in the new Edit Studio on web at the link below.
1:13

Aleph 2.0 is here. Now you can edit a single frame in your video, preview the change and then Aleph 2.0 carries that edit across the rest of your video. Try it now in the new Edit Studio on web at the link below.

Runway

4,950,427 Aufrufe • vor 2 Monaten

🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike. More details and examples of what Movie Gen can do ➡️ 🛠️ Movie Gen models and capabilities Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt. Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment. Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes. Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video. We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.
0:30

🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike. More details and examples of what Movie Gen can do ➡️ 🛠️ Movie Gen models and capabilities Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt. Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment. Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes. Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video. We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.

AI at Meta

2,265,399 Aufrufe • vor 1 Jahr

Introducing Gen-3 Alpha: Runway’s new base model for video generation. Gen-3 Alpha can create highly detailed videos with complex scene changes, a wide range of cinematic choices, and detailed art directions. (1/10)
0:58

Introducing Gen-3 Alpha: Runway’s new base model for video generation. Gen-3 Alpha can create highly detailed videos with complex scene changes, a wide range of cinematic choices, and detailed art directions. (1/10)

Runway

1,032,486 Aufrufe • vor 2 Jahren

I know we are all excited about Sora 2, but don't sleep on the other models. Runway Aleph is a powerful tool as you can essentially control AI generated characters using videos recorded with your phone. And it's now on Freepik 🔥 To use Runway Aleph on Freepik, head to the new clip editor. Then pick the Aleph model from the menu (or leave it on Auto). Add a prompt and hit generate. All covered in the short tutorial below.
1:34

I know we are all excited about Sora 2, but don't sleep on the other models. Runway Aleph is a powerful tool as you can essentially control AI generated characters using videos recorded with your phone. And it's now on Freepik 🔥 To use Runway Aleph on Freepik, head to the new clip editor. Then pick the Aleph model from the menu (or leave it on Auto). Add a prompt and hit generate. All covered in the short tutorial below.

Martin LeBlanc

12,050 Aufrufe • vor 10 Monaten

Runway Aleph can precisely alter specific parts of a video, all while maintaining the integrity of everything else. Change outfits, hairstyles, lighting, locations and much more. All you need to do is tell Aleph what you want.
0:45

Runway Aleph can precisely alter specific parts of a video, all while maintaining the integrity of everything else. Change outfits, hairstyles, lighting, locations and much more. All you need to do is tell Aleph what you want.

Runway

80,775 Aufrufe • vor 1 Jahr

Runway Aleph can precisely replace, retexture or entirely reimagine specific parts of a video, making it possible to rapidly ideate and iterate new concepts with existing footage. All you need to do is tell Aleph what you want.
0:41

Runway Aleph can precisely replace, retexture or entirely reimagine specific parts of a video, making it possible to rapidly ideate and iterate new concepts with existing footage. All you need to do is tell Aleph what you want.

Runway

74,692 Aufrufe • vor 1 Jahr

Veo 3 works with Runway Aleph. It keeps the SFX and audio even after you modify the video. The latest Runway Chat update has brought in Veo 3 as a new third party model. Here's how to use it!
0:44

Veo 3 works with Runway Aleph. It keeps the SFX and audio even after you modify the video. The latest Runway Chat update has brought in Veo 3 as a new third party model. Here's how to use it!

Jerrod Lew

14,339 Aufrufe • vor 11 Monaten

Change the aspect ratio of a video to to fit any platform. Aleph 2.0 expands the scene to fit the new aspect ratio so your video looks like it was filmed that way from the start. Learn how in today's Runway Academy.
2:01

Change the aspect ratio of a video to to fit any platform. Aleph 2.0 expands the scene to fit the new aspect ratio so your video looks like it was filmed that way from the start. Learn how in today's Runway Academy.

Runway

13,715 Aufrufe • vor 1 Monat

A breakthrough in real-time video generation. As a research preview developed with NVIDIA and shared at NVIDIAGTC this week, we trained a new real-time video model running on Vera Rubin. HD videos generate instantly, with time-to-first-frame under 100ms. Unlocking an entirely new creative paradigm and bolstering the foundations of our General World Model, GWM-1. Real-time generation opens a fundamentally different design space for video models and world simulation. We're investing in co-designing our models alongside advances in hardware to keep pushing this frontier.
0:54

A breakthrough in real-time video generation. As a research preview developed with NVIDIA and shared at NVIDIAGTC this week, we trained a new real-time video model running on Vera Rubin. HD videos generate instantly, with time-to-first-frame under 100ms. Unlocking an entirely new creative paradigm and bolstering the foundations of our General World Model, GWM-1. Real-time generation opens a fundamentally different design space for video models and world simulation. We're investing in co-designing our models alongside advances in hardware to keep pushing this frontier.

Runway

1,163,539 Aufrufe • vor 4 Monaten

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!
2:41

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!

Santiago

65,446 Aufrufe • vor 3 Monaten

New release from Meta FAIR — Meta Motivo is a first-of-its-kind behavioral foundation model for controlling virtual physics-based humanoid agents for a wide range of complex whole-body tasks. The model is capable of expressing human-like behaviors and achieves performance competitive with task-specific methods and outperforms state-of-the-art unsupervised RL and model-based baselines. Try the demo ➡️ Get the model and code ➡️ We’re excited about how this research could pave the way for fully embodied agents, leading to more lifelike NPCs, democratization of character animation and new types of immersive experiences.
1:10

New release from Meta FAIR — Meta Motivo is a first-of-its-kind behavioral foundation model for controlling virtual physics-based humanoid agents for a wide range of complex whole-body tasks. The model is capable of expressing human-like behaviors and achieves performance competitive with task-specific methods and outperforms state-of-the-art unsupervised RL and model-based baselines. Try the demo ➡️ Get the model and code ➡️ We’re excited about how this research could pave the way for fully embodied agents, leading to more lifelike NPCs, democratization of character animation and new types of immersive experiences.

AI at Meta

129,182 Aufrufe • vor 1 Jahr

Gen:48 Aleph Edition winners, light mode comes to the web app, new ways to use Aleph and a community showcase. Get caught up on what happened This Week with Runway.
2:52

Gen:48 Aleph Edition winners, light mode comes to the web app, new ways to use Aleph and a community showcase. Get caught up on what happened This Week with Runway.

Runway

13,862 Aufrufe • vor 11 Monaten