Loading video...
Video Failed to Load
1/ Wonder Studio by @WonderDynamics Automatically animates, lights and composes CG characters into a live-action scene. No complicated 3D software, no expensive production hardware—all you need is a camera. Incredible.
35,048 views • 3 years ago •via X (Twitter)
10 Comments

The advancements happening with VIDEO in the Generative AI space is going to be one of the most exciting things to follow in 2023. Progress has entered an exponential growth curve. Here's what to keep an eye on:

2/ Gen-1 and Gen-2 by @runwayml Gen-1 is available for anyone to try today. You can turn any video you want, into whatever you can imagine with a prompt or a driving image. Gen-2 is invite-only at the moment, and is purely text-to-video. I covered Gen-2 below:

3/ There are some fantastic tools popping up everyday for text-to-video. Many are being built on Stable Diffusion + ControlNet. Here's a model you can try today that I covered in this video, which also features Runway's Gen-1 in action at the beginning:

4/ 3D motion via ControlNet depth map animation is also very interesting. Here's an example by u/kaelside on Reddit. I'll have a tutorial on how to achieve the effect on my YouTube next week using the following repo:

5/ Animation One of the most famous examples in the early going of how AI can disrupt animation is by @CorridorDigital, who with a combination of Stable Diffusion, green screen footage and some clean-up in post were able to create this masterpiece:

Text-to-video is going to be move FAST over the next 24 months. Incredible progress is happening every day. Follow @rpnickson and @ElunaAI and we'll make sure to keep you updated through it all.

@WonderDynamics Any recommendation of a company for content creators that you could do this with but just to do social content primarily?

@WonderDynamics 'ai is democratizing creativity' 🔥 thats a great perspective 👏

@WonderDynamics This in incredible we’ll soon be able to create movies and animations of our own with production cost at 0 🙏

@WonderDynamics @this_viq
