Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

🔥Introducing Open-Sora Plan v1.3! We introduce the🚀Skiparse 3D attention and 🚄WFVAE, significantly reducing the training cost of the model. This video is an alternate ending we created for #BlackMythWukong , generated by our v1.3. Welcome to star!🌟

23,891 Aufrufe • vor 1 Jahr •via X (Twitter)

7 Kommentare

Profilbild von Bin Lin
Bin Linvor 1 Jahr

By the way, the #Allegro was built on our v1.2 version. I’m glad to see more and more companies fine-tuning and commercializing models based on our Open-Sora Plan. The significance of open-source is becoming increasingly tangible.♥️

Profilbild von Bin Lin
Bin Linvor 1 Jahr

Carefully! The video includes audio but Chinese version.

Profilbild von UNPLUGGED PERFORMANCE
UNPLUGGED PERFORMANCEvor 1 Jahr

Upgrade your Tesla with UP-03 Forged Wheels from Unplugged Performance! Unmatched strength, lightweight design, and track-proven durability—perfect for Model S, 3, X, and Y. Ready to ship with a lifetime warranty. #Tesla #UP03 #UnpluggedPerformance

Profilbild von Ray
Rayvor 1 Jahr

cool

Profilbild von Lyman
Lymanvor 1 Jahr

nice work

Profilbild von davis
davisvor 1 Jahr

老哥,videobench在hf 上挂了,可以帮忙在后台更新一下吗

Profilbild von Josh Garbutt
Josh Garbuttvor 1 Jahr

Hi Bin, Love the work you're doing!!! I'm actually partnered with a company based in the California who is looking for Gen AI specialists with experience in Character generation Would be great to speak more on this and see if youre interested?

Ähnliche Videos

Tencent presents GameGen-O Open-world Video Game Generation We introduce GameGen-O, the first diffusion transformer model tailored for the generation of open-world video games. This model facilitates high-quality, open-domain generation by simulating a wide array of game engine features, such as innovative characters, dynamic environments, complex actions, and diverse events. Additionally, it provides interactive controllability, thus allowing for the gameplay simulation. The development of GameGen-O involves a comprehensive data collection and processing effort from scratch. We collect and build the first Open-World Video Game Dataset (OGameData), amassed extensive data from over a hundred of next-generation open-world games, employing a proprietary data pipeline for efficient sorting, scoring, filtering, and decoupled captioning. This robust and extensive OGameData forms the foundation of our model's training process. GameGen-O undergoes a two-stage training process, consisting of foundation model pretraining and instruction tuning. In the first phase, the model is pre-trained on the OGameData via the text-to-video and video continuation, endowing GameGen-O with the capability for open-domain video game generation. In the second phase, the pre-trained model is frozen, and we fine-tuned using a trainable InstructNet, which enables the production of subsequent frames based on multimodal structural instructions. This whole training process imparts the model with the ability to generate and interactively control content. In summary, GameGen-O represents a notable initial step forward in the realm of open-world video game generation via generative models. It underscores the potential of generative models to serve as an alternative to rendering techniques, which can efficiently combine creative generation with interactive capabilities.

AK

367,000 Aufrufe • vor 1 Jahr

Google presents Still-Moving Customized Video Generation without Customized Video Data Customizing text-to-image (T2I) models has seen tremendous progress recently, particularly in areas such as personalization, stylization, and conditional generation. However, expanding this progress to video generation is still in its infancy, primarily due to the lack of customized video data. In this work, we introduce Still-Moving, a novel generic framework for customizing a text-to-video (T2V) model, without requiring any customized video data. The framework applies to the prominent T2V design where the video model is built over a text-to-image (T2I) model (e.g., via inflation). We assume access to a customized version of the T2I model, trained only on still image data (e.g., using DreamBooth or StyleDrop). Naively plugging in the weights of the customized T2I model into the T2V model often leads to significant artifacts or insufficient adherence to the customization data. To overcome this issue, we train lightweight Spatial Adapters that adjust the features produced by the injected T2I layers. Importantly, our adapters are trained on "frozen videos" (i.e., repeated images), constructed from image samples generated by the customized T2I model. This training is facilitated by a novel Motion Adapter module, which allows us to train on such static videos while preserving the motion prior of the video model. At test time, we remove the Motion Adapter modules and leave in only the trained Spatial Adapters. This restores the motion prior of the T2V model while adhering to the spatial prior of the customized T2I model. We demonstrate the effectiveness of our approach on diverse tasks including personalized, stylized, and conditional generation. In all evaluated scenarios, our method seamlessly integrates the spatial prior of the customized T2I model with a motion prior supplied by the T2V model.

AK

40,474 Aufrufe • vor 2 Jahren