Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

New Kling, Runway, Luma competitor? Open text and image video generation model Pyramidal Flow Matching for Efficient Video Generative Modeling

_akhaliq's profile picture

AK

516,698 subscribers

91,250 görüntüleme • 1 yıl önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

10 Yorum

AK profil fotoğrafı
AK1 yıl önce

model:

AK profil fotoğrafı
AK1 yıl önce

github:

AK profil fotoğrafı
AK1 yıl önce

discuss:

AK profil fotoğrafı
AK1 yıl önce

Demo

Techguyver profil fotoğrafı
Techguyver1 yıl önce

I'd like that you're not mentioning SORA

A.Robot profil fotoğrafı
A.Robot1 yıl önce

Nice! Looks like it might run on < 20GB VRAM too

paras profil fotoğrafı
paras1 yıl önce

flow matching has come a long waaay!

Wu Han Solo  profil fotoğrafı
Wu Han Solo 1 yıl önce

yo @cocktailpeanut

huanggou profil fotoğrafı
huanggou1 yıl önce

@Kijaidesign

Jay Sensei👾 profil fotoğrafı
Jay Sensei👾1 yıl önce

The quality of output look like they have used stable diffusion as base model🙄

Benzer Videolar

New text and image to video generation AI model Open-Sora-Plan-v1.3.0
1:37

New text and image to video generation AI model Open-Sora-Plan-v1.3.0

AK

51,843 görüntüleme • 1 yıl önce

🎇 Video Model Comparison: Image2Video Video Model Comparison: Image2Video Same input image + text prompt on each model: • Pika 2.0 • PixVerse 3.5 • Runway Gen-3 • Kling AI 1.6 • Luma Dream Machine • Hailuo MiniMax I used the same Midjourney image and text prompt in each model and chose my favorite results.
1:00

🎇 Video Model Comparison: Image2Video Video Model Comparison: Image2Video Same input image + text prompt on each model: • Pika 2.0 • PixVerse 3.5 • Runway Gen-3 • Kling AI 1.6 • Luma Dream Machine • Hailuo MiniMax I used the same Midjourney image and text prompt in each model and chose my favorite results.

Heather Cooper

36,110 görüntüleme • 1 yıl önce

Video Model Comparison: Image to video I updated an older comparison with a new image and prompt to test in several models: • Pika 2.2 • PixVerse 4 • Runway Gen-4 • Google Veo 3 • OpenAI Sora • Kling 2.1 Pro • Luma Ray2 • Hailuo I2V I used the same prompt and Midjourney image in each model 2-3 times and chose my favorite results below:
1:12

Video Model Comparison: Image to video I updated an older comparison with a new image and prompt to test in several models: • Pika 2.2 • PixVerse 4 • Runway Gen-4 • Google Veo 3 • OpenAI Sora • Kling 2.1 Pro • Luma Ray2 • Hailuo I2V I used the same prompt and Midjourney image in each model 2-3 times and chose my favorite results below:

Heather Cooper

98,406 görüntüleme • 1 yıl önce

Struggling with slow inference of diffusion and flow models? Check out the video below—I’ve been using our new FastGen library to achieve 7-28x acceleration for text-2-image and {text,image,video}-2-video generation without sacrificing visual fidelity!
2:20

Struggling with slow inference of diffusion and flow models? Check out the video below—I’ve been using our new FastGen library to achieve 7-28x acceleration for text-2-image and {text,image,video}-2-video generation without sacrificing visual fidelity!

Julius Berner

13,729 görüntüleme • 6 ay önce

Can we simplify video generation by decomposing it into interleaved text-video co-generation? Would explicit, repeated thinking in language improve generation in pixels? We introduce TV2TV: a unified model that jointly learns - language modeling (next-token prediction) - video flow matching (next-frame prediction) At inference, TV2TV dynamically alternates between textual thinking and video generation. Model generations below: interleaved text plans and video slices (~1–2s) are co-generated over time, conditioned on a single frame per sport. 📖
0:36

Can we simplify video generation by decomposing it into interleaved text-video co-generation? Would explicit, repeated thinking in language improve generation in pixels? We introduce TV2TV: a unified model that jointly learns - language modeling (next-token prediction) - video flow matching (next-frame prediction) At inference, TV2TV dynamically alternates between textual thinking and video generation. Model generations below: interleaved text plans and video slices (~1–2s) are co-generated over time, conditioned on a single frame per sport. 📖

Xiaochuang Han

32,066 görüntüleme • 8 ay önce

Love my Krea workflow: Image to Video in a few clicks • New image models: Ideogram v2, FLUX1.1 [pro] • AI video models: Luma, Kling, Hailuo, Runway Watch how easy it is below: (Polaroid emulsion transfer image style inspired by LudovicCreator)
0:39

Love my Krea workflow: Image to Video in a few clicks • New image models: Ideogram v2, FLUX1.1 [pro] • AI video models: Luma, Kling, Hailuo, Runway Watch how easy it is below: (Polaroid emulsion transfer image style inspired by LudovicCreator)

Heather Cooper

11,082 görüntüleme • 1 yıl önce

Check out Lumina-Image 2.0 🖼️ an efficient, unified, and transparent image generative model built with Gemma 2's text encoder and FLUX’s VAE 👇
0:25

Check out Lumina-Image 2.0 🖼️ an efficient, unified, and transparent image generative model built with Gemma 2's text encoder and FLUX’s VAE 👇

Google AI Developers

33,467 görüntüleme • 1 yıl önce

This video is a reminder that data is what truly makes a model perform at its best. Bytedance’s latest whitepaper, Omnihuman, showcases human-like video generation like never before. Here’s how other models Luma , Kling AI , Runway , Hailuo AI (MiniMax) react to the same image/prompt. 👇 Comment which model did it best!
0:25

This video is a reminder that data is what truly makes a model perform at its best. Bytedance’s latest whitepaper, Omnihuman, showcases human-like video generation like never before. Here’s how other models Luma , Kling AI , Runway , Hailuo AI (MiniMax) react to the same image/prompt. 👇 Comment which model did it best!

OpenLedger

17,398 görüntüleme • 1 yıl önce

New open source image model called Mage-Flow by Microsoft. > Supports image generation and editing. > Lightweight 4B model with 4-step turbo variants. > Free and open-source, MIT license.
0:21

New open source image model called Mage-Flow by Microsoft. > Supports image generation and editing. > Lightweight 4B model with 4-step turbo variants. > Free and open-source, MIT license.

⚡AI Search⚡

14,424 görüntüleme • 22 gün önce

1. Vidnoz image to video Vidnoz's Image to Video feature now includes several top models, like Veo3, Kling, Hailuo, and Runway. Can also use Nano Banana with the Image Generator Kling + Veo3 + Hailuo + Runway available 🔗
0:22

1. Vidnoz image to video Vidnoz's Image to Video feature now includes several top models, like Veo3, Kling, Hailuo, and Runway. Can also use Nano Banana with the Image Generator Kling + Veo3 + Hailuo + Runway available 🔗

Arpita Trisha

165,637 görüntüleme • 8 ay önce

The first truly open-source audio-video model. LTX-2 is a DiT-based foundation model with all core video generation capabilities in one unified model. Designed to run locally on consumer GPUs. - text-to-video - image-to-video - and video-to-video modes 100% open-source.
0:25

The first truly open-source audio-video model. LTX-2 is a DiT-based foundation model with all core video generation capabilities in one unified model. Designed to run locally on consumer GPUs. - text-to-video - image-to-video - and video-to-video modes 100% open-source.

Akshay 🚀

66,088 görüntüleme • 7 ay önce

(1/2) LightIt: Illumination Modeling and Control for Diffusion Models! #CVPR2024 We facilitate lighting control for novel image generation from text prompts. We can also edit lighting for a given input image. Video: Project:
0:31

(1/2) LightIt: Illumination Modeling and Control for Diffusion Models! #CVPR2024 We facilitate lighting control for novel image generation from text prompts. We can also edit lighting for a given input image. Video: Project:

Matthias Niessner

19,849 görüntüleme • 2 yıl önce

I'm a bit confused... Google's Veo 2 is the best video model in text-to-video. But on the other hand... The newly released image-to-video for Veo 2 (on Freepik (now Magnific) and @FAL) feels underwhelming. Input images generated with Runway Frames. Here it is compared to Luma
1:29

I'm a bit confused... Google's Veo 2 is the best video model in text-to-video. But on the other hand... The newly released image-to-video for Veo 2 (on Freepik (now Magnific) and @FAL) feels underwhelming. Input images generated with Runway Frames. Here it is compared to Luma

Alex Patrascu

85,445 görüntüleme • 1 yıl önce

Okay final one. Had to include more of the characters. 😁 #severance Used: Flux and Openai for image generation. Luma for video generation.
0:20

Okay final one. Had to include more of the characters. 😁 #severance Used: Flux and Openai for image generation. Luma for video generation.

enigmatic_e

94,178 görüntüleme • 1 yıl önce

Today we’re sharing two new advances in our generative AI research: Emu Video & Emu Edit. Details ➡️ These new models deliver exciting results in high quality, diffusion-based text-to-video generation & controlled image editing w/ text instructions. 🧵
0:33

Today we’re sharing two new advances in our generative AI research: Emu Video & Emu Edit. Details ➡️ These new models deliver exciting results in high quality, diffusion-based text-to-video generation & controlled image editing w/ text instructions. 🧵

AI at Meta

798,304 görüntüleme • 2 yıl önce

Exciting milestones in our generative AI research: Emu Video, which lets you create high quality videos from a text prompt, and Emu Edit, which enables detailed image editing based on your instructions. These new models are built on Emu, our foundation model for image generation and technology from them will underpin new creative features across our apps next year. Try it out: Emu Video: Emu Edit:
0:37

Exciting milestones in our generative AI research: Emu Video, which lets you create high quality videos from a text prompt, and Emu Edit, which enables detailed image editing based on your instructions. These new models are built on Emu, our foundation model for image generation and technology from them will underpin new creative features across our apps next year. Try it out: Emu Video: Emu Edit:

Boz

110,733 görüntüleme • 2 yıl önce

Video generation models have come a long way in 2024 Veo 2 is not generally available yet. Meanwhile Hailuo, Kling, Runway and Luma have improved dramatically Still, a lot of room to improve
0:32

Video generation models have come a long way in 2024 Veo 2 is not generally available yet. Meanwhile Hailuo, Kling, Runway and Luma have improved dramatically Still, a lot of room to improve

Bindu Reddy

16,915 görüntüleme • 1 yıl önce

3D controllable video generation works well now and pixel alignment is impressive! We took our new 3D sculpt model, generated a blender scene and then asked a video-to-video model to render. Image to 3D sculpt: Common Sense Machines Synthetic rendering: Blender 🔶 Video-to-Video: Runway
0:29

3D controllable video generation works well now and pixel alignment is impressive! We took our new 3D sculpt model, generated a blender scene and then asked a video-to-video model to render. Image to 3D sculpt: Common Sense Machines Synthetic rendering: Blender 🔶 Video-to-Video: Runway

Common Sense Machines

18,714 görüntüleme • 1 yıl önce

■動画生成AI Image-to-Videoの比較 - Hailuo Ai (Hailuo AI (MiniMax) ) - Kling (Kling AI ) - Vidu (Vidu Japan Vidu AI ) - Luma (Luma ) - Runway (Runway ) を比べてみました どれを動画で採用するか悩ましいですね～
0:30

■動画生成AI Image-to-Videoの比較 - Hailuo Ai (Hailuo AI (MiniMax) ) - Kling (Kling AI ) - Vidu (Vidu Japan Vidu AI ) - Luma (Luma ) - Runway (Runway ) を比べてみました どれを動画で採用するか悩ましいですね～

とうや

15,824 görüntüleme • 1 yıl önce

Kling 2.0 Text to video is wild🔥 I am really enjoying Kling, the image quality, the fluid motion, the precision and camera movement is insane Video: Kling 2.0 SFX: Freepik Music: Suno 🧵Here are 12 new prompts 👇 🔖Bookmark for later
0:49

Kling 2.0 Text to video is wild🔥 I am really enjoying Kling, the image quality, the fluid motion, the precision and camera movement is insane Video: Kling 2.0 SFX: Freepik Music: Suno 🧵Here are 12 new prompts 👇 🔖Bookmark for later

MayorkingAI

104,867 görüntüleme • 1 yıl önce