Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Any2Caption Interpreting Any Condition to Caption for Controllable Video Generation

_akhaliq's profile picture

AK

410,653 subscribers

50,115 görüntüleme • 1 yıl önce •via X (Twitter)

EğitimBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

3 Yorum

AK profil fotoğrafı
AK1 yıl önce

discuss with author:

SecBriefs | Making Cybersecurity Simple profil fotoğrafı
SecBriefs | Making Cybersecurity Simple1 yıl önce

Quantum computers can break today’s encryption in seconds.🔑 Quantum tech will reshape our digital lives. Governments & hackers are preparing for the quantum era. How about you?🛡️ Don’t get left behind!🧠 Cybersecurity Dictionary for Everyone can help:

Tori profil fotoğrafı
Tori1 yıl önce

Thank @_akhaliq for sharing our work! A SoTA controllable video generation framework from **any condition** by leveraging MLLMs to interpret diverse inputs into dense structured captions. Project: Huggingface:

Benzer Videolar

CineMaster A 3D-Aware and Controllable Framework for Cinematic Text-to-Video Generation
1:43

CineMaster A 3D-Aware and Controllable Framework for Cinematic Text-to-Video Generation

AK

18,655 görüntüleme • 1 yıl önce

Wan-Move Motion-controllable Video Generation via Latent Trajectory Guidance
2:00

Wan-Move Motion-controllable Video Generation via Latent Trajectory Guidance

AK

14,853 görüntüleme • 6 ay önce

Gen-3 Alpha Text to Video is now available to everyone. A new frontier for high-fidelity, fast and controllable video generation. Try it now at
2:22

Gen-3 Alpha Text to Video is now available to everyone. A new frontier for high-fidelity, fast and controllable video generation. Try it now at

Runway

4,065,522 görüntüleme • 1 yıl önce

🔥1-min Interactive Video Generation with Multimodal Control🔥 Towards *long-context world model*, #LongVie is an end-to-end autoregressive framework for controllable ultra-long video generation - Page: - Paper: . Thanks AK
2:12

🔥1-min Interactive Video Generation with Multimodal Control🔥 Towards *long-context world model*, #LongVie is an end-to-end autoregressive framework for controllable ultra-long video generation - Page: - Paper: . Thanks AK

Ziwei Liu

14,150 görüntüleme • 10 ay önce

Infinity-RoPE Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rollout
1:00

Infinity-RoPE Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rollout

AK

19,562 görüntüleme • 6 ay önce

I'm excited to share our new work Diffusion as Shader (DaS), a versatile controllable video generation method for various tasks: object manipulation, camera control, mesh-to-video, and motion transfer. Project page: Github:
0:46

I'm excited to share our new work Diffusion as Shader (DaS), a versatile controllable video generation method for various tasks: object manipulation, camera control, mesh-to-video, and motion transfer. Project page: Github:

Yuan Liu

33,363 görüntüleme • 1 yıl önce

VIGGLE'S NEW MODEL IS HERE! Controllable video generation is our mission, and character is where we start. Animate any character just as you want, simply with a prompt, or by uploading a reference video featuring clear motion. Try Viggle for FREE:
1:00

VIGGLE'S NEW MODEL IS HERE! Controllable video generation is our mission, and character is where we start. Animate any character just as you want, simply with a prompt, or by uploading a reference video featuring clear motion. Try Viggle for FREE:

ViggleAI

37,487 görüntüleme • 2 yıl önce

I don’t have any caption. My caption is in the video.
1:03

I don’t have any caption. My caption is in the video.

Ifediche

13,708 görüntüleme • 4 ay önce

The poverty amongst Ugandans has been deliberate to keep them controllable See the generation Museveni has created 🙌
0:31

The poverty amongst Ugandans has been deliberate to keep them controllable See the generation Museveni has created 🙌

DR MORGANS

23,691 görüntüleme • 8 ay önce

Hunyuan-GameCraft High-dynamic Interactive Game Video Generation with Hybrid History Condition
1:02

Hunyuan-GameCraft High-dynamic Interactive Game Video Generation with Hybrid History Condition

AK

91,039 görüntüleme • 11 ay önce

Introducing Cube 2.0, a significant step towards controllable 3D game-world and video generation from any input. Powered by: 🌟 Image-to-3D in seconds w/ a new foundation model 🐎 Text-to-animation 🌎 AI rendering to create beautiful worlds (mesh+splats) Web app → Discord → Blog →
1:11

Introducing Cube 2.0, a significant step towards controllable 3D game-world and video generation from any input. Powered by: 🌟 Image-to-3D in seconds w/ a new foundation model 🐎 Text-to-animation 🌎 AI rendering to create beautiful worlds (mesh+splats) Web app → Discord → Blog →

Common Sense Machines

411,366 görüntüleme • 2 yıl önce

No need to caption! Condition of Health system in India .💔💔
0:22

No need to caption! Condition of Health system in India .💔💔

खुरपेंची स्वास्थ्य

35,667 görüntüleme • 6 ay önce

Condition of today’s generation
0:35

Condition of today’s generation

Mohini Maheshwari

126,015 görüntüleme • 1 yıl önce

No need any Caption for this Video..... Caption లో చెప్పాలి అనుకున్నవి మొత్తం ఈ Video లో చెప్పేసాo... Cult #Nagfans 🔥 🔥 🔥 We love ❤️ Nagarjuna Akkineni Sir always ❤️
3:29

No need any Caption for this Video..... Caption లో చెప్పాలి అనుకున్నవి మొత్తం ఈ Video లో చెప్పేసాo... Cult #Nagfans 🔥 🔥 🔥 We love ❤️ Nagarjuna Akkineni Sir always ❤️

NagaKiran Akkineni

23,871 görüntüleme • 9 ay önce

3D controllable video generation works well now and pixel alignment is impressive! We took our new 3D sculpt model, generated a blender scene and then asked a video-to-video model to render. Image to 3D sculpt: Common Sense Machines Synthetic rendering: Blender 🔶 Video-to-Video: Runway
0:29

3D controllable video generation works well now and pixel alignment is impressive! We took our new 3D sculpt model, generated a blender scene and then asked a video-to-video model to render. Image to 3D sculpt: Common Sense Machines Synthetic rendering: Blender 🔶 Video-to-Video: Runway

Common Sense Machines

18,714 görüntüleme • 1 yıl önce

1/ 🚀 Introducing AIDO.StructureDiffusion: A generative model for structural protein design—enabling high-quality, controllable generation of monomers, complexes, and antibodies. 🧵
0:33

1/ 🚀 Introducing AIDO.StructureDiffusion: A generative model for structural protein design—enabling high-quality, controllable generation of monomers, complexes, and antibodies. 🧵

GenBio AI

918,205 görüntüleme • 11 ay önce

(1/n) Time to unify your favorite visual generative models, VLMs, and simulators for controllable visual generation—Introducing a Product of Experts (PoE) framework for inference-time knowledge composition from heterogeneous models.
0:55

(1/n) Time to unify your favorite visual generative models, VLMs, and simulators for controllable visual generation—Introducing a Product of Experts (PoE) framework for inference-time knowledge composition from heterogeneous models.

Yunzhi Zhang

48,871 görüntüleme • 1 yıl önce

Remixable element "Ultimate Low Thermo Drivable Vehicles" just released in Dreams! Controllable vehicles for any game! #MadeInDreams
0:33

Remixable element "Ultimate Low Thermo Drivable Vehicles" just released in Dreams! Controllable vehicles for any game! #MadeInDreams

Freako

23,949 görüntüleme • 6 ay önce