We're so cooked. ByteDance just announced Seaweed, a new 7B-parameter AI video model. There is no way to tell anymore... Here are 10 insane examples:

1. Generate videos from images By providing an image as the first frame, users can direct the model to generate the rest of the video with consistent motion and style.

2. Generate videos by references Whether it's a human reference image, an object reference image, or a combination of multiple reference images, the model can synthesize them into dynamic video sequences.

3. Human-centric video generation

4. Generate audio with video

5. Long-shot generation Seaweed supports natively generating a single shot lasting 20 seconds without any extension technique. It can generate videos up to a minute long.

6. Consistent storytelling Seaweed is capable of generating consistent, multi-shot, long-form stories, maintaining continuity across scenes and shots.

7. High-resolution generation Seaweed natively supports generating videos up to 1280x720 resolution. The result can also be further upsampled to 2K QHD (2560x1440) resolution

8. Real-time generation It can also generate videos in real-time at 1280x720 resolution and 24fps. This is particularly valuable for real-time and interactive applications, where immediate video generation is essential.

9. World exploration Seaweed can be utilized for modeling precise camera control through defined trajectories, providing not only enhanced creative direction but also an interactive way for users to explore the simulated world.

10. Enhanced Physically-Consistent Generation It can also be post-trained on synthetic video rendered via computer-generated imagery (CGI), enabling it to enhance the physical consistency in video generation while preserving photorealism.

Here’s a short film that highlights their model’s generative capabilities

Paper:

That's a wrap! If you enjoyed this thread: 1. Follow me @AngryTomtweets for more of these 2. RT the tweet below to share this thread with your audience

AI won't replace you, but a person using AI will. Join 500,000+ readers and learn how to use AI in just 5 minutes a day (for free).