Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Gen-3 Alpha Image to Video now supports using an image as either the first or last frame of your video generation. This feature can be used on its own or combined with a text prompt for additional guidance. All examples below demonstrate using an image as the last frame. (1/5)

Runway

283,178 subscribers

143,494 views • 1 year ago •via X (Twitter)

Science & Technology Arts Education

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Character Consistency with Google Veo 3 now in Gemini API! 🤯 Use Images as starting frame to keep character consistency! Here is an python script on how to make consistent viral videos, like you see on TikTok or Youtube shorts: 1. Based on an idea, it generates a series of scene prompts using Gemini 2.5. 2. Generates a Image based on the first scene using Imagen 3 3. For each scene prompt Veo 3 (fast) generates a video clip. 4. Uses Gemini 2.0 image editing to make sure the starting images fits the scenes 5. Combine the individual video clips into a single final video using MoviePy Veo 3 starts at $0.75 / second and Veo 3 at $0.40 / second with audio. ! 📹 🔉 Prompt: “A realistic energy drink commercial for athletes.”

Character Consistency with Google Veo 3 now in Gemini API! 🤯 Use Images as starting frame to keep character consistency! Here is an python script on how to make consistent viral videos, like you see on TikTok or Youtube shorts: 1. Based on an idea, it generates a series of scene prompts using Gemini 2.5. 2. Generates a Image based on the first scene using Imagen 3 3. For each scene prompt Veo 3 (fast) generates a video clip. 4. Uses Gemini 2.0 image editing to make sure the starting images fits the scenes 5. Combine the individual video clips into a single final video using MoviePy Veo 3 starts at $0.75 / second and Veo 3 at $0.40 / second with audio. ! 📹 🔉 Prompt: “A realistic energy drink commercial for athletes.”

Philipp Schmid

15,863 views • 11 months ago

3. Modify image Use this prompt to modify the image you have chosen: "Modify image [1] with seed [1470033597]: add a parrot on her shoulder" Dall-E 3 identifies the image and makes the changes for you! Tips and tricks: - You can generate as many variations as you like. - It's also possible to remove an element from the image using the same method. - Sometimes the image isn't 100% identical, but still looks very similar.

3. Modify image Use this prompt to modify the image you have chosen: "Modify image [1] with seed [1470033597]: add a parrot on her shoulder" Dall-E 3 identifies the image and makes the changes for you! Tips and tricks: - You can generate as many variations as you like. - It's also possible to remove an element from the image using the same method. - Sometimes the image isn't 100% identical, but still looks very similar.

Paul Couvert

44,073 views • 2 years ago

Another example of video extension using the latest Grok Imagine update: I created an image in Grok Imagine. I animated it. Then I clicked on video extension: you can choose 6 seconds or 10 seconds, write an animation prompt, and select the starting image. This ensures perfect continuity of the scene: fluidity of the image and sound atmosphere (music and sound effects).

Another example of video extension using the latest Grok Imagine update: I created an image in Grok Imagine. I animated it. Then I clicked on video extension: you can choose 6 seconds or 10 seconds, write an animation prompt, and select the starting image. This ensures perfect continuity of the scene: fluidity of the image and sound atmosphere (music and sound effects).

Déborah

628,880 views • 4 months ago

introducing: save frame as image component for Framer. let your users download any frame on your site as an image with one click perfect for membership cards, gift cards, event passes, receipts, and more. comment 'SAVE' and i’ll send you the component :)

introducing: save frame as image component for Framer. let your users download any frame on your site as an image with one click perfect for membership cards, gift cards, event passes, receipts, and more. comment 'SAVE' and i’ll send you the component :)

Framer University

12,210 views • 1 year ago

Here's how you can isolate individual images from this ChatGPT Image 2.0 prompt. 1. Ask ChatGPT to label each individual frame with a number. 2. Then with the new image, ask again to isolate the specific scene. Video tutorial:

Here's how you can isolate individual images from this ChatGPT Image 2.0 prompt. 1. Ask ChatGPT to label each individual frame with a number. 2. Then with the new image, ask again to isolate the specific scene. Video tutorial:

Jerrod Lew

69,187 views • 2 months ago

Text-to-image generators are incredible! But why must we use *plain text* as the interface? 🤔 Check out Rich Text-to-Image generation! Rich Text offers an intuitive and expressive way to explore your visual imagination. Some of my favorite examples. 👇

Text-to-image generators are incredible! But why must we use plain text as the interface? 🤔 Check out Rich Text-to-Image generation! Rich Text offers an intuitive and expressive way to explore your visual imagination. Some of my favorite examples. 👇

Jia-Bin Huang

73,382 views • 2 years ago

Oh, on the Midjourney Explore page, the video and its starting frame are linked, so I can open the image used in the prompt. But I can’t do the same with my own videos — and I really need that.

Oh, on the Midjourney Explore page, the video and its starting frame are linked, so I can open the image used in the prompt. But I can’t do the same with my own videos — and I really need that.

Tatiana Tsiguleva

28,561 views • 10 months ago

Grok Imagine created an adorable little kitten. To make the video longer, I used the last frame of the first video and re-ran a custom prompt with it 😉

Grok Imagine created an adorable little kitten. To make the video longer, I used the last frame of the first video and re-ran a custom prompt with it 😉

Déborah

805,275 views • 9 months ago

From product image to video with just one tool - Dzine As you may have noticed, this is one of my favorite tools. It is also very underrated, as probably 50% of my tutorials include some workflow. I was testing the new image-to-video option today, and I love it. Step - by step guide in comments 🔽 I can do 95% of a workflow without switching between apps. Image generation, Image to image with style reference, background removal, background generation, and 2 frames image to video. The only other app I have been using for this video is CapCut so that I can stitch it together. Step by step 🔽

From product image to video with just one tool - Dzine As you may have noticed, this is one of my favorite tools. It is also very underrated, as probably 50% of my tutorials include some workflow. I was testing the new image-to-video option today, and I love it. Step - by step guide in comments 🔽 I can do 95% of a workflow without switching between apps. Image generation, Image to image with style reference, background removal, background generation, and 2 frames image to video. The only other app I have been using for this video is CapCut so that I can stitch it together. Step by step 🔽

Teodora P L

28,523 views • 1 year ago

This is what Al video can do now . This UGC ad is generated from a text and reference images. The realism jump in the last few months has been kind of insane to watch . Tools used: Seedance 2.0 (video), GPT 2 (image), Claude (brain). Prompt below 👇

This is what Al video can do now . This UGC ad is generated from a text and reference images. The realism jump in the last few months has been kind of insane to watch . Tools used: Seedance 2.0 (video), GPT 2 (image), Claude (brain). Prompt below 👇

Isabella

22,902 views • 18 days ago

So this is the dream: A video world model that takes an image as input and renders an environment you can explore and interact with. It could be a constant video stream - like your own lofi girl! Or you could jump in and “play” as a character.

So this is the dream: A video world model that takes an image as input and renders an environment you can explore and interact with. It could be a constant video stream - like your own lofi girl! Or you could jump in and “play” as a character.

Justine Moore

95,478 views • 11 months ago

Here's a fun one with Seedance 2.0 You can just tell the model to end with the first frame, so you can create looping videos without using first/last frames, a feature especially helpful when using the Omni variant of SD2. Generated in CapCut with early access. Prompt below (it's a big one):

Here's a fun one with Seedance 2.0 You can just tell the model to end with the first frame, so you can create looping videos without using first/last frames, a feature especially helpful when using the Omni variant of SD2. Generated in CapCut with early access. Prompt below (it's a big one):

Alex Patrascu

42,118 views • 4 months ago

Artificial Analysis Image-to-video generation is just as impressive. Input image: "Generate a 16:9 image from a dashcam view of a formula 1 racing event" Video prompt: "A high-speed racing event where a car navigates multiple winding turns" 🔊 Sound on - generated by Cosmos 3.

Artificial Analysis Image-to-video generation is just as impressive. Input image: "Generate a 16:9 image from a dashcam view of a formula 1 racing event" Video prompt: "A high-speed racing event where a car navigates multiple winding turns" 🔊 Sound on - generated by Cosmos 3.

NVIDIA AI

49,204 views • 1 month ago

Here are some really tactical ways to optimize the First and last frame capability: — Make sure your prompt includes precise camera motion descriptions for smooth and creative transitions between the first and last frames. — Or, you can simply include the word “transform” in your prompt for a smooth transition — Starting with a closeup in your first frame and then zooming out to a wide-shot in the final frame is an effective way to create a dramatic reveal.

Here are some really tactical ways to optimize the First and last frame capability: — Make sure your prompt includes precise camera motion descriptions for smooth and creative transitions between the first and last frames. — Or, you can simply include the word “transform” in your prompt for a smooth transition — Starting with a closeup in your first frame and then zooming out to a wide-shot in the final frame is an effective way to create a dramatic reveal.

Google AI

28,595 views • 8 months ago

I’ve used all the recent GenAI video models extensively & here’s my 2¢: 🎬 Runway Gen3 Alpha - best image quality & motion for text-to-video & embedded words. Great at prompt travel changes over the course of 10 sec. And I’m super bullish on how gen3 will evolve, hopefully adopting the features listed below. Kling - best quality for image-to-video with prompt control, like eating food. Great clip extension that accounts for character (ie walking stride) & camera movement (speed & angle), rather than just using final frame. But it’s limited availability & Chinese native language is limiting. Used for Spider-Man video below (via Midjourney). LumaLabs - best for keyframe start & end control (it can not be overstated how important this is. other services should add it ASAP!) and their high dynamic action movements are really fun. Luma was used in my viral Multiverse of Memes video. PikaLabs - they haven’t gotten as much attention as others lately. But they did update their video model a few weeks ago and it looks great. Also, they are notable for their unique & AWESOME features, like video in-painting & out-painting. My perfect AI video platform would have the following features: 1) Gen3’s quality, prompt control & text embedding. 2) KLing’s image-to-video quality, prompt control & clip extension quality. 3) Luma’s multi-keyframe control & dynamic movement ability. 4) Pika’s inpainting & outpainting ability. And a video-to-video (aka next-gen Runway gen1) could be a game changer, too. It’s an exciting time to be alive 🫶 Who will get there first? 🔉🔉

I’ve used all the recent GenAI video models extensively & here’s my 2¢: 🎬 Runway Gen3 Alpha - best image quality & motion for text-to-video & embedded words. Great at prompt travel changes over the course of 10 sec. And I’m super bullish on how gen3 will evolve, hopefully adopting the features listed below. Kling - best quality for image-to-video with prompt control, like eating food. Great clip extension that accounts for character (ie walking stride) & camera movement (speed & angle), rather than just using final frame. But it’s limited availability & Chinese native language is limiting. Used for Spider-Man video below (via Midjourney). LumaLabs - best for keyframe start & end control (it can not be overstated how important this is. other services should add it ASAP!) and their high dynamic action movements are really fun. Luma was used in my viral Multiverse of Memes video. PikaLabs - they haven’t gotten as much attention as others lately. But they did update their video model a few weeks ago and it looks great. Also, they are notable for their unique & AWESOME features, like video in-painting & out-painting. My perfect AI video platform would have the following features: 1) Gen3’s quality, prompt control & text embedding. 2) KLing’s image-to-video quality, prompt control & clip extension quality. 3) Luma’s multi-keyframe control & dynamic movement ability. 4) Pika’s inpainting & outpainting ability. And a video-to-video (aka next-gen Runway gen1) could be a game changer, too. It’s an exciting time to be alive 🫶 Who will get there first? 🔉🔉

Blaine Brown

26,535 views • 2 years ago

Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation paper page: Large text-to-image diffusion models have exhibited impressive proficiency in generating high-quality images. However, when applying these models to video domain, ensuring temporal consistency across video frames remains a formidable challenge. This paper proposes a novel zero-shot text-guided video-to-video translation framework to adapt image models to videos. The framework includes two parts: key frame translation and full video translation. The first part uses an adapted diffusion model to generate key frames, with hierarchical cross-frame constraints applied to enforce coherence in shapes, textures and colors. The second part propagates the key frames to other frames with temporal-aware patch matching and frame blending. Our framework achieves global style and local texture temporal consistency at a low cost (without re-training or optimization). The adaptation is compatible with existing image diffusion techniques, allowing our framework to take advantage of them, such as customizing a specific subject with LoRA, and introducing extra spatial guidance with ControlNet. Extensive experimental results demonstrate the effectiveness of our proposed framework over existing methods in rendering high-quality and temporally-coherent videos.

Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation paper page: Large text-to-image diffusion models have exhibited impressive proficiency in generating high-quality images. However, when applying these models to video domain, ensuring temporal consistency across video frames remains a formidable challenge. This paper proposes a novel zero-shot text-guided video-to-video translation framework to adapt image models to videos. The framework includes two parts: key frame translation and full video translation. The first part uses an adapted diffusion model to generate key frames, with hierarchical cross-frame constraints applied to enforce coherence in shapes, textures and colors. The second part propagates the key frames to other frames with temporal-aware patch matching and frame blending. Our framework achieves global style and local texture temporal consistency at a low cost (without re-training or optimization). The adaptation is compatible with existing image diffusion techniques, allowing our framework to take advantage of them, such as customizing a specific subject with LoRA, and introducing extra spatial guidance with ControlNet. Extensive experimental results demonstrate the effectiveness of our proposed framework over existing methods in rendering high-quality and temporally-coherent videos.

AK

375,123 views • 3 years ago

GPT Image 2 + Seedance 2.0 Prompt Share Created on mitte.ai I used the generic Seedance 2.0 storyboard-to-video prompt again, without any additional details. To get this style, I added an environment reference created in Midjourney. Without that reference image, it generates a stylized 3D version. You can check the prompts in the comments.

GPT Image 2 + Seedance 2.0 Prompt Share Created on mitte.ai I used the generic Seedance 2.0 storyboard-to-video prompt again, without any additional details. To get this style, I added an environment reference created in Midjourney. Without that reference image, it generates a stylized 3D version. You can check the prompts in the comments.

Kōda

37,854 views • 1 month ago

Create a 3D model from a single image, set of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”

Create a 3D model from a single image, set of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”

Bilawal Sidhu

92,792 views • 2 years ago