Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Latest Experiment: Control a character in a video generation using a sketch with motion paths (Combining Runway Aleph and Image Reference) Builds on the last example: given that you can also add image references to Aleph gens you can also add extra instructions via an image (prompt in replies).

rayisdoingfilm's profile picture

Ray (movie arc)

2,305 subscribers

47,420 Aufrufe • vor 11 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Runway Aleph experiment: using one initial vid clip as a character 'video reference' to generate many more with consistent aesthetics/world Whole video is made from aleph generations based on one initial clip (prompt and clip in the comments)
0:53

Runway Aleph experiment: using one initial vid clip as a character 'video reference' to generate many more with consistent aesthetics/world Whole video is made from aleph generations based on one initial clip (prompt and clip in the comments)

Ray (movie arc)

30,348 Aufrufe • vor 11 Monaten

2. Use the generated image as an image prompt for Runway or any video model that supports End-Frames. Use the image as the final/last frame and create a prompt that reveals the image in an ink-style animation. Example prompt:
0:21

2. Use the generated image as an image prompt for Runway or any video model that supports End-Frames. Use the image as the final/last frame and create a prompt that reveals the image in an ink-style animation. Example prompt:

Halim Alrasihi

14,596 Aufrufe • vor 1 Jahr

Even your most boring footage can become a playground with Runway Aleph. Add to it. Alter it. Or, add a seagull to it. And all you need to do is tell Aleph what you want.
0:45

Even your most boring footage can become a playground with Runway Aleph. Add to it. Alter it. Or, add a seagull to it. And all you need to do is tell Aleph what you want.

Jamie

23,537 Aufrufe • vor 11 Monaten

Runway Aleph can seamlessly add new objects and effects to existing footage. Matching lighting, color temperature and motion. All you need to do is tell Aleph what you want.
0:41

Runway Aleph can seamlessly add new objects and effects to existing footage. Matching lighting, color temperature and motion. All you need to do is tell Aleph what you want.

Runway

22,764 Aufrufe • vor 10 Monaten

GPT Image 2 - Character Reference Sheet Prompt You can create a character reference sheet in any style you want for use in your Seedance 2.0 videos. All you need to do is either provide a reference image or describe your character. You can also input random values to generate completely random characters. This reference sheet provides a clear, structured, and highly readable visual breakdown of the character, helping the model maintain strong identity consistency across different outputs. The layout ensures the model focuses on essential visual information rather than stylistic noise, while the inclusion of expressions, head angles, and performance cues improves the model’s ability to generate believable acting and varied poses without losing character integrity. All clips in the demonstration video were generated using the reference sheet image and the same Seedance 2.0 prompt. You can find the prompts in the replies. 👇 GPT Image 2 and Seedance 2.0 are both available on mitte.ai
1:15

GPT Image 2 - Character Reference Sheet Prompt You can create a character reference sheet in any style you want for use in your Seedance 2.0 videos. All you need to do is either provide a reference image or describe your character. You can also input random values to generate completely random characters. This reference sheet provides a clear, structured, and highly readable visual breakdown of the character, helping the model maintain strong identity consistency across different outputs. The layout ensures the model focuses on essential visual information rather than stylistic noise, while the inclusion of expressions, head angles, and performance cues improves the model’s ability to generate believable acting and varied poses without losing character integrity. All clips in the demonstration video were generated using the reference sheet image and the same Seedance 2.0 prompt. You can find the prompts in the replies. 👇 GPT Image 2 and Seedance 2.0 are both available on mitte.ai

Kōda

158,201 Aufrufe • vor 2 Monaten

This new AI image generator is impressive. You can now create an image based on a simple sketch and text prompt.
0:36

This new AI image generator is impressive. You can now create an image based on a simple sketch and text prompt.

Rowan Cheung

543,202 Aufrufe • vor 3 Jahren

I know we are all excited about Sora 2, but don't sleep on the other models. Runway Aleph is a powerful tool as you can essentially control AI generated characters using videos recorded with your phone. And it's now on Freepik 🔥 To use Runway Aleph on Freepik, head to the new clip editor. Then pick the Aleph model from the menu (or leave it on Auto). Add a prompt and hit generate. All covered in the short tutorial below.
1:34

I know we are all excited about Sora 2, but don't sleep on the other models. Runway Aleph is a powerful tool as you can essentially control AI generated characters using videos recorded with your phone. And it's now on Freepik 🔥 To use Runway Aleph on Freepik, head to the new clip editor. Then pick the Aleph model from the menu (or leave it on Auto). Add a prompt and hit generate. All covered in the short tutorial below.

Martin LeBlanc

12,050 Aufrufe • vor 9 Monaten

Just tested Runway Aleph 2.0 and this blew my mind a bit lol I saw a video like this when Aleph first released and with the new Aleph 2.0 I wanted to create my own version. You basically select a single frame from the video, apply a change to that specific frame using Nano Banana Pro, GPT Image 2 or Gen-4 and based on the newly generated image Aleph propagates the change through the entire shot. It's really cool seeing the whole sequence adapt from just one edited frame
0:27

Just tested Runway Aleph 2.0 and this blew my mind a bit lol I saw a video like this when Aleph first released and with the new Aleph 2.0 I wanted to create my own version. You basically select a single frame from the video, apply a change to that specific frame using Nano Banana Pro, GPT Image 2 or Gen-4 and based on the newly generated image Aleph propagates the change through the entire shot. It's really cool seeing the whole sequence adapt from just one edited frame

Ege

87,744 Aufrufe • vor 1 Monat

Did you know you can create captivating motion sync videos on Yapper Follow the steps below and push your creativity boundaries Step 1: Go to on your browser step 2: Click on videos and select Motion Sync Step 3: Select Base Video The video's movement will be used to animate the reference image. Step 4: Add Reference Image Upload an image of a character to be animated by the base video. Step 5: Describe Your Vision Write a prompt that guides the background of the output video. Step 6: Generate Select your model and the output video will be generated in real-time
1:56

Did you know you can create captivating motion sync videos on Yapper Follow the steps below and push your creativity boundaries Step 1: Go to on your browser step 2: Click on videos and select Motion Sync Step 3: Select Base Video The video's movement will be used to animate the reference image. Step 4: Add Reference Image Upload an image of a character to be animated by the base video. Step 5: Describe Your Vision Write a prompt that guides the background of the output video. Step 6: Generate Select your model and the output video will be generated in real-time

Kuria | AI

46,344 Aufrufe • vor 2 Monaten

Combine a single character reference image with any location reference image to place your character in that scene. Prompt for new camera angles, compositions, character styling and more. (2/4)
0:28

Combine a single character reference image with any location reference image to place your character in that scene. Prompt for new camera angles, compositions, character styling and more. (2/4)

Runway

31,852 Aufrufe • vor 1 Jahr

Ever needed to generate a shot of your character entering the scene? Realizing that Runway's Aleph can use my reference image as the final frame in my video is such a huge unlock. Two Cherubs by Raffaello Sanzio Raphael
0:28

Ever needed to generate a shot of your character entering the scene? Realizing that Runway's Aleph can use my reference image as the final frame in my video is such a huge unlock. Two Cherubs by Raffaello Sanzio Raphael

🍥 Timmy 🍥

12,612 Aufrufe • vor 10 Monaten

I just tested Motion Sync on Yapper and I like the cinematic Video made in minutes. Let me show you how you can do it 👇 Step 1: Open Step 2: Click on video and select Motion Sync. Then, ✅️Select base video Pick a video with the movement you want — this will drive the animation. ✅️Add reference image Upload your character or image you want to bring to life. ✅️Generate video Hit generate and watch your idea turn into a smooth motion sync clip. Simple, fast, and actually fun to experiment with.
1:32

I just tested Motion Sync on Yapper and I like the cinematic Video made in minutes. Let me show you how you can do it 👇 Step 1: Open Step 2: Click on video and select Motion Sync. Then, ✅️Select base video Pick a video with the movement you want — this will drive the animation. ✅️Add reference image Upload your character or image you want to bring to life. ✅️Generate video Hit generate and watch your idea turn into a smooth motion sync clip. Simple, fast, and actually fun to experiment with.

Leonardo

50,931 Aufrufe • vor 2 Monaten

My canvas based AI image generation tool is live! It's built on top of tldraw and uses Nano Banana Pro for image generation. You can sketch, annotate, collage in a frame... And then click to generate an image. Check it out 👉
1:00

My canvas based AI image generation tool is live! It's built on top of tldraw and uses Nano Banana Pro for image generation. You can sketch, annotate, collage in a frame... And then click to generate an image. Check it out 👉

Charlie Clark

44,335 Aufrufe • vor 7 Monaten

You can now generate videos on This is what I've been using to create my background videos. It's using Runway with a midjourney image. Add prompts like zoom, effects, environments to make the image come to life. Combined with scripting and voices, it's incredibly easy to create shorts or just add b-rolls.
0:43

You can now generate videos on This is what I've been using to create my background videos. It's using Runway with a midjourney image. Add prompts like zoom, effects, environments to make the image come to life. Combined with scripting and voices, it's incredibly easy to create shorts or just add b-rolls.

Meng To

50,513 Aufrufe • vor 1 Jahr

Hedra’s Character-3 is a game-changer for AI storytelling! 🔥✨ Upload an image, add speech and movement prompts, or even drop in an audio file, and it generates the full video for you. The Process is super easy: Image: Freepik Audio: elevenlabs (you can record yourself) Video: Hedra Video prompt: female reporter excitedly reporting the news, holds a microphone, wearing a professional suit, delivering a live broadcast., natural movements You can also use Hedra to generate audio and images! All in one 🚀🔥 What do you think of the result!?
0:27

Hedra’s Character-3 is a game-changer for AI storytelling! 🔥✨ Upload an image, add speech and movement prompts, or even drop in an audio file, and it generates the full video for you. The Process is super easy: Image: Freepik Audio: elevenlabs (you can record yourself) Video: Hedra Video prompt: female reporter excitedly reporting the news, holds a microphone, wearing a professional suit, delivering a live broadcast., natural movements You can also use Hedra to generate audio and images! All in one 🚀🔥 What do you think of the result!?

Amira Zairi

76,116 Aufrufe • vor 1 Jahr

Runway Aleph has granular object control. Which means you can add to or alter your video in ways which feel both natural and realistic without any complex prompting or key framing. Or, you can break the laws of physics altogether. All you need to do is tell Aleph what you want.
0:41

Runway Aleph has granular object control. Which means you can add to or alter your video in ways which feel both natural and realistic without any complex prompting or key framing. Or, you can break the laws of physics altogether. All you need to do is tell Aleph what you want.

Runway

51,736 Aufrufe • vor 11 Monaten

Runway Aleph can add objects and characters to scenes, seamlessly matching lighting conditions, color temperature and more. All you need to do is tell Aleph what you want.
0:31

Runway Aleph can add objects and characters to scenes, seamlessly matching lighting conditions, color temperature and more. All you need to do is tell Aleph what you want.

Runway

27,019 Aufrufe • vor 10 Monaten

(1/2) LightIt: Illumination Modeling and Control for Diffusion Models! #CVPR2024 We facilitate lighting control for novel image generation from text prompts. We can also edit lighting for a given input image. Video: Project:
0:31

(1/2) LightIt: Illumination Modeling and Control for Diffusion Models! #CVPR2024 We facilitate lighting control for novel image generation from text prompts. We can also edit lighting for a given input image. Video: Project:

Matthias Niessner

19,849 Aufrufe • vor 2 Jahren

Runway Aleph can precisely control specific parts of a video, including manipulating ambient, atmospheric and directional light sources with accuracy. All you need to do is tell Aleph what you want.
0:33

Runway Aleph can precisely control specific parts of a video, including manipulating ambient, atmospheric and directional light sources with accuracy. All you need to do is tell Aleph what you want.

Runway

83,737 Aufrufe • vor 11 Monaten

Another example of video extension using the latest Grok Imagine update: I created an image in Grok Imagine. I animated it. Then I clicked on video extension: you can choose 6 seconds or 10 seconds, write an animation prompt, and select the starting image. This ensures perfect continuity of the scene: fluidity of the image and sound atmosphere (music and sound effects).
0:20

Another example of video extension using the latest Grok Imagine update: I created an image in Grok Imagine. I animated it. Then I clicked on video extension: you can choose 6 seconds or 10 seconds, write an animation prompt, and select the starting image. This ensures perfect continuity of the scene: fluidity of the image and sound atmosphere (music and sound effects).

Déborah

628,800 Aufrufe • vor 4 Monaten