Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Latest Experiment: Control a character in a video generation using a sketch with motion paths (Combining Runway Aleph and Image Reference) Builds on the last example: given that you can also add image references to Aleph gens you can also add extra instructions via an image (prompt in replies).

Ray (movie arc)

2,305 subscribers

47,420 views • 10 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Runway Aleph experiment: using one initial vid clip as a character 'video reference' to generate many more with consistent aesthetics/world Whole video is made from aleph generations based on one initial clip (prompt and clip in the comments)

Runway Aleph experiment: using one initial vid clip as a character 'video reference' to generate many more with consistent aesthetics/world Whole video is made from aleph generations based on one initial clip (prompt and clip in the comments)

Ray (movie arc)

30,344 views • 10 months ago

2. Use the generated image as an image prompt for Runway or any video model that supports End-Frames. Use the image as the final/last frame and create a prompt that reveals the image in an ink-style animation. Example prompt:

2. Use the generated image as an image prompt for Runway or any video model that supports End-Frames. Use the image as the final/last frame and create a prompt that reveals the image in an ink-style animation. Example prompt:

Halim Alrasihi

14,596 views • 1 year ago

Even your most boring footage can become a playground with Runway Aleph. Add to it. Alter it. Or, add a seagull to it. And all you need to do is tell Aleph what you want.

Even your most boring footage can become a playground with Runway Aleph. Add to it. Alter it. Or, add a seagull to it. And all you need to do is tell Aleph what you want.

Jamie

23,537 views • 10 months ago

Runway Aleph can seamlessly add new objects and effects to existing footage. Matching lighting, color temperature and motion. All you need to do is tell Aleph what you want.

Runway Aleph can seamlessly add new objects and effects to existing footage. Matching lighting, color temperature and motion. All you need to do is tell Aleph what you want.

Runway

22,764 views • 9 months ago

GPT Image 2 - Character Reference Sheet Prompt You can create a character reference sheet in any style you want for use in your Seedance 2.0 videos. All you need to do is either provide a reference image or describe your character. You can also input random values to generate completely random characters. This reference sheet provides a clear, structured, and highly readable visual breakdown of the character, helping the model maintain strong identity consistency across different outputs. The layout ensures the model focuses on essential visual information rather than stylistic noise, while the inclusion of expressions, head angles, and performance cues improves the model’s ability to generate believable acting and varied poses without losing character integrity. All clips in the demonstration video were generated using the reference sheet image and the same Seedance 2.0 prompt. You can find the prompts in the replies. 👇 GPT Image 2 and Seedance 2.0 are both available on mitte.ai

GPT Image 2 - Character Reference Sheet Prompt You can create a character reference sheet in any style you want for use in your Seedance 2.0 videos. All you need to do is either provide a reference image or describe your character. You can also input random values to generate completely random characters. This reference sheet provides a clear, structured, and highly readable visual breakdown of the character, helping the model maintain strong identity consistency across different outputs. The layout ensures the model focuses on essential visual information rather than stylistic noise, while the inclusion of expressions, head angles, and performance cues improves the model’s ability to generate believable acting and varied poses without losing character integrity. All clips in the demonstration video were generated using the reference sheet image and the same Seedance 2.0 prompt. You can find the prompts in the replies. 👇 GPT Image 2 and Seedance 2.0 are both available on mitte.ai

Kōda

155,429 views • 1 month ago

This new AI image generator is impressive. You can now create an image based on a simple sketch and text prompt.

This new AI image generator is impressive. You can now create an image based on a simple sketch and text prompt.

Rowan Cheung

543,188 views • 3 years ago

I know we are all excited about Sora 2, but don't sleep on the other models. Runway Aleph is a powerful tool as you can essentially control AI generated characters using videos recorded with your phone. And it's now on Freepik 🔥 To use Runway Aleph on Freepik, head to the new clip editor. Then pick the Aleph model from the menu (or leave it on Auto). Add a prompt and hit generate. All covered in the short tutorial below.

I know we are all excited about Sora 2, but don't sleep on the other models. Runway Aleph is a powerful tool as you can essentially control AI generated characters using videos recorded with your phone. And it's now on Freepik 🔥 To use Runway Aleph on Freepik, head to the new clip editor. Then pick the Aleph model from the menu (or leave it on Auto). Add a prompt and hit generate. All covered in the short tutorial below.

Martin LeBlanc

12,050 views • 8 months ago

Just tested Runway Aleph 2.0 and this blew my mind a bit lol I saw a video like this when Aleph first released and with the new Aleph 2.0 I wanted to create my own version. You basically select a single frame from the video, apply a change to that specific frame using Nano Banana Pro, GPT Image 2 or Gen-4 and based on the newly generated image Aleph propagates the change through the entire shot. It's really cool seeing the whole sequence adapt from just one edited frame

Just tested Runway Aleph 2.0 and this blew my mind a bit lol I saw a video like this when Aleph first released and with the new Aleph 2.0 I wanted to create my own version. You basically select a single frame from the video, apply a change to that specific frame using Nano Banana Pro, GPT Image 2 or Gen-4 and based on the newly generated image Aleph propagates the change through the entire shot. It's really cool seeing the whole sequence adapt from just one edited frame

Ege

87,367 views • 25 days ago

Did you know you can create captivating motion sync videos on Yapper Follow the steps below and push your creativity boundaries Step 1: Go to on your browser step 2: Click on videos and select Motion Sync Step 3: Select Base Video The video's movement will be used to animate the reference image. Step 4: Add Reference Image Upload an image of a character to be animated by the base video. Step 5: Describe Your Vision Write a prompt that guides the background of the output video. Step 6: Generate Select your model and the output video will be generated in real-time

Did you know you can create captivating motion sync videos on Yapper Follow the steps below and push your creativity boundaries Step 1: Go to on your browser step 2: Click on videos and select Motion Sync Step 3: Select Base Video The video's movement will be used to animate the reference image. Step 4: Add Reference Image Upload an image of a character to be animated by the base video. Step 5: Describe Your Vision Write a prompt that guides the background of the output video. Step 6: Generate Select your model and the output video will be generated in real-time

Kuria | AI

46,344 views • 1 month ago

Combine a single character reference image with any location reference image to place your character in that scene. Prompt for new camera angles, compositions, character styling and more. (2/4)

Combine a single character reference image with any location reference image to place your character in that scene. Prompt for new camera angles, compositions, character styling and more. (2/4)

Runway

31,852 views • 1 year ago

Ever needed to generate a shot of your character entering the scene? Realizing that Runway's Aleph can use my reference image as the final frame in my video is such a huge unlock. Two Cherubs by Raffaello Sanzio Raphael

Ever needed to generate a shot of your character entering the scene? Realizing that Runway's Aleph can use my reference image as the final frame in my video is such a huge unlock. Two Cherubs by Raffaello Sanzio Raphael

🍥 Timmy 🍥

12,612 views • 10 months ago

I just tested Motion Sync on Yapper and I like the cinematic Video made in minutes. Let me show you how you can do it 👇 Step 1: Open Step 2: Click on video and select Motion Sync. Then, ✅️Select base video Pick a video with the movement you want — this will drive the animation. ✅️Add reference image Upload your character or image you want to bring to life. ✅️Generate video Hit generate and watch your idea turn into a smooth motion sync clip. Simple, fast, and actually fun to experiment with.

I just tested Motion Sync on Yapper and I like the cinematic Video made in minutes. Let me show you how you can do it 👇 Step 1: Open Step 2: Click on video and select Motion Sync. Then, ✅️Select base video Pick a video with the movement you want — this will drive the animation. ✅️Add reference image Upload your character or image you want to bring to life. ✅️Generate video Hit generate and watch your idea turn into a smooth motion sync clip. Simple, fast, and actually fun to experiment with.

Leonardo

50,931 views • 1 month ago

My canvas based AI image generation tool is live! It's built on top of tldraw and uses Nano Banana Pro for image generation. You can sketch, annotate, collage in a frame... And then click to generate an image. Check it out 👉

My canvas based AI image generation tool is live! It's built on top of tldraw and uses Nano Banana Pro for image generation. You can sketch, annotate, collage in a frame... And then click to generate an image. Check it out 👉

Charlie Clark

44,335 views • 6 months ago

You can now generate videos on This is what I've been using to create my background videos. It's using Runway with a midjourney image. Add prompts like zoom, effects, environments to make the image come to life. Combined with scripting and voices, it's incredibly easy to create shorts or just add b-rolls.

You can now generate videos on This is what I've been using to create my background videos. It's using Runway with a midjourney image. Add prompts like zoom, effects, environments to make the image come to life. Combined with scripting and voices, it's incredibly easy to create shorts or just add b-rolls.

Meng To

50,500 views • 1 year ago

Hedra’s Character-3 is a game-changer for AI storytelling! 🔥✨ Upload an image, add speech and movement prompts, or even drop in an audio file, and it generates the full video for you. The Process is super easy: Image: Freepik Audio: elevenlabs (you can record yourself) Video: Hedra Video prompt: female reporter excitedly reporting the news, holds a microphone, wearing a professional suit, delivering a live broadcast., natural movements You can also use Hedra to generate audio and images! All in one 🚀🔥 What do you think of the result!?

Hedra’s Character-3 is a game-changer for AI storytelling! 🔥✨ Upload an image, add speech and movement prompts, or even drop in an audio file, and it generates the full video for you. The Process is super easy: Image: Freepik Audio: elevenlabs (you can record yourself) Video: Hedra Video prompt: female reporter excitedly reporting the news, holds a microphone, wearing a professional suit, delivering a live broadcast., natural movements You can also use Hedra to generate audio and images! All in one 🚀🔥 What do you think of the result!?

Amira Zairi

76,116 views • 1 year ago

Runway Aleph has granular object control. Which means you can add to or alter your video in ways which feel both natural and realistic without any complex prompting or key framing. Or, you can break the laws of physics altogether. All you need to do is tell Aleph what you want.

Runway Aleph has granular object control. Which means you can add to or alter your video in ways which feel both natural and realistic without any complex prompting or key framing. Or, you can break the laws of physics altogether. All you need to do is tell Aleph what you want.

Runway

51,736 views • 10 months ago

Runway Aleph can add objects and characters to scenes, seamlessly matching lighting conditions, color temperature and more. All you need to do is tell Aleph what you want.

Runway Aleph can add objects and characters to scenes, seamlessly matching lighting conditions, color temperature and more. All you need to do is tell Aleph what you want.

Runway

27,019 views • 10 months ago

(1/2) LightIt: Illumination Modeling and Control for Diffusion Models! #CVPR2024 We facilitate lighting control for novel image generation from text prompts. We can also edit lighting for a given input image. Video: Project:

(1/2) LightIt: Illumination Modeling and Control for Diffusion Models! #CVPR2024 We facilitate lighting control for novel image generation from text prompts. We can also edit lighting for a given input image. Video: Project:

Matthias Niessner

19,835 views • 2 years ago

Runway Aleph can precisely control specific parts of a video, including manipulating ambient, atmospheric and directional light sources with accuracy. All you need to do is tell Aleph what you want.

Runway Aleph can precisely control specific parts of a video, including manipulating ambient, atmospheric and directional light sources with accuracy. All you need to do is tell Aleph what you want.

Runway

83,693 views • 10 months ago

Another example of video extension using the latest Grok Imagine update: I created an image in Grok Imagine. I animated it. Then I clicked on video extension: you can choose 6 seconds or 10 seconds, write an animation prompt, and select the starting image. This ensures perfect continuity of the scene: fluidity of the image and sound atmosphere (music and sound effects).

Another example of video extension using the latest Grok Imagine update: I created an image in Grok Imagine. I animated it. Then I clicked on video extension: you can choose 6 seconds or 10 seconds, write an animation prompt, and select the starting image. This ensures perfect continuity of the scene: fluidity of the image and sound atmosphere (music and sound effects).

Déborah

627,757 views • 3 months ago