Loading video...

Video Failed to Load

Go Home

Hunyuan-GameCraft High-dynamic Interactive Game Video Generation with Hybrid History Condition

_akhaliq's profile picture

AK

514,606 subscribers

91,212 views • 1 year ago •via X (Twitter)

Science & TechnologyGaming
LIVE

Anya Rossi• Live Now

Private livecam show

10 Comments

AK's profile picture
AK1 year ago

discuss with author:

Emily's profile picture
Emily1 year ago

In five years, it will be perfect, worst case scenario by 3032.

Dr Singularity's profile picture
Dr Singularity1 year ago

holodeck is nearer

𝚘𝚙𝚑𝚒𝚞𝚌𝚑𝚞𝚜's profile picture
𝚘𝚙𝚑𝚒𝚞𝚌𝚑𝚞𝚜1 year ago

☝️where are all the open source world models? why does hugging face not have a world model category yet?

revolver ocelot's profile picture
revolver ocelot1 year ago

Seems like a continuation of the earlier ones

Surfing Pigment's profile picture
Surfing Pigment1 year ago

Great find

Mario Princess's profile picture
Mario Princess1 year ago

Hybrid history conditions in game video generation—this could redefine player immersion. Exciting tech leap!

Himanshu Kumar's profile picture
Himanshu Kumar1 year ago

Impressive. Interactive game video generation evolves.

zdhpeter's profile picture
zdhpeter1 year ago

Will the model be open source or not?

Anon's profile picture
Anon1 year ago

AS odyssey 🤣

Related Videos

🚀We are thrilled to open-source Hunyuan-GameCraft, a high-dynamic interactive game video generation framework built on HunyuanVideo. It generates playable and physically realistic videos from a single scene image and user action signals, empowering creators and developers to "direct" games with first-person or third-person perspectives. Key Advantages: 🔹High Dynamics: Unifies standard keyboard inputs into a shared continuous action space, enabling high-precision control over velocity and angle. This allows for the exploration of complex trajectories, overcoming the stiff, limited motion of traditional models. It can also generate dynamic environmental content like moving clouds, rain, snow, and water flow. 🔹Long-term Consistency: Uses hybrid history condition to preserve the original scene information after significant movement. 🔹Significant Cost Reduction: No need for expensive modeling/rendering. PCM distillation compresses inference steps, boosting speed and lowering costs. This allows the quantized 13B model to run on consumer-grade GPUs like the RTX 4090. Project Page: Code: Technical Report: Hugging Face：
0:40

🚀We are thrilled to open-source Hunyuan-GameCraft, a high-dynamic interactive game video generation framework built on HunyuanVideo. It generates playable and physically realistic videos from a single scene image and user action signals, empowering creators and developers to "direct" games with first-person or third-person perspectives. Key Advantages: 🔹High Dynamics: Unifies standard keyboard inputs into a shared continuous action space, enabling high-precision control over velocity and angle. This allows for the exploration of complex trajectories, overcoming the stiff, limited motion of traditional models. It can also generate dynamic environmental content like moving clouds, rain, snow, and water flow. 🔹Long-term Consistency: Uses hybrid history condition to preserve the original scene information after significant movement. 🔹Significant Cost Reduction: No need for expensive modeling/rendering. PCM distillation compresses inference steps, boosting speed and lowering costs. This allows the quantized 13B model to run on consumer-grade GPUs like the RTX 4090. Project Page: Code: Technical Report: Hugging Face：

Tencent Hy

169,757 views • 1 year ago

VMem Consistent Interactive Video Scene Generation with Surfel-Indexed View Memory
0:59

VMem Consistent Interactive Video Scene Generation with Surfel-Indexed View Memory

AK

83,580 views • 1 year ago

LongLive Real-time Interactive Long Video Generation
0:59

LongLive Real-time Interactive Long Video Generation

AK

17,214 views • 10 months ago

Make Pixels Dance: High-Dynamic Video Generation paper page: Creating high-dynamic videos such as motion-rich actions and sophisticated visual effects poses a significant challenge in the field of artificial intelligence. Unfortunately, current state-of-the-art video generation methods, primarily focusing on text-to-video generation, tend to produce video clips with minimal motions despite maintaining high fidelity. We argue that relying solely on text instructions is insufficient and suboptimal for video generation. In this paper, we introduce PixelDance, a novel approach based on diffusion models that incorporates image instructions for both the first and last frames in conjunction with text instructions for video generation. Comprehensive experimental results demonstrate that PixelDance trained with public data exhibits significantly better proficiency in synthesizing videos with complex scenes and intricate motions, setting a new standard for video generation.
3:09

Make Pixels Dance: High-Dynamic Video Generation paper page: Creating high-dynamic videos such as motion-rich actions and sophisticated visual effects poses a significant challenge in the field of artificial intelligence. Unfortunately, current state-of-the-art video generation methods, primarily focusing on text-to-video generation, tend to produce video clips with minimal motions despite maintaining high fidelity. We argue that relying solely on text instructions is insufficient and suboptimal for video generation. In this paper, we introduce PixelDance, a novel approach based on diffusion models that incorporates image instructions for both the first and last frames in conjunction with text instructions for video generation. Comprehensive experimental results demonstrate that PixelDance trained with public data exhibits significantly better proficiency in synthesizing videos with complex scenes and intricate motions, setting a new standard for video generation.

AK

102,706 views • 2 years ago

Tencent Hunyuan Video has really changed the AI video game. There's a shift. And people can't stop getting creative with it. 10 wild examples:
1:00

Tencent Hunyuan Video has really changed the AI video game. There's a shift. And people can't stop getting creative with it. 10 wild examples:

Min Choi

71,703 views • 1 year ago

😀😀A short video to help you understand the Hybrid Mamba Transformer architecture behind the Hunyuan T1 & Turbo S models. Produced by EyeOpenAI.
5:19

😀😀A short video to help you understand the Hybrid Mamba Transformer architecture behind the Hunyuan T1 & Turbo S models. Produced by EyeOpenAI.

Tencent HY

21,922 views • 1 year ago

🚨 Hunyuan 3D 3.1 Pro and Rapid is here on fal! 🎯 Pro: High-fidelity Image-to-3D and Text-to-3D generation ⚡ Rapid: Speed-optimized 3D generation ✨ Smart Topology and Part generation for advanced 3D workflows
0:21

🚨 Hunyuan 3D 3.1 Pro and Rapid is here on fal! 🎯 Pro: High-fidelity Image-to-3D and Text-to-3D generation ⚡ Rapid: Speed-optimized 3D generation ✨ Smart Topology and Part generation for advanced 3D workflows

fal

26,138 views • 6 months ago

ByteDance is cooking! a solid rival to LTX2. ALIVE: Unified audio-video generation; - T2VA, I2VA, lifelike vids with synced sound; - dynamic, photorealistic, trained on high-quality data. - MMDiT, 480p base gens to 1080p
0:35

ByteDance is cooking! a solid rival to LTX2. ALIVE: Unified audio-video generation; - T2VA, I2VA, lifelike vids with synced sound; - dynamic, photorealistic, trained on high-quality data. - MMDiT, 480p base gens to 1080p

Wildminder

12,663 views • 6 months ago

Any2Caption Interpreting Any Condition to Caption for Controllable Video Generation
2:07

Any2Caption Interpreting Any Condition to Caption for Controllable Video Generation

AK

50,267 views • 1 year ago

Playing with omnidreams ( inside flashdreams ( Fully interactive video generation at - 30FPS, - 720P resolution, - On a single RTX 6000 PRO GPU
1:23

Playing with omnidreams ( inside flashdreams ( Fully interactive video generation at - 30FPS, - 720P resolution, - On a single RTX 6000 PRO GPU

Ruilong Li

18,196 views • 2 months ago

🔥1-min Interactive Video Generation with Multimodal Control🔥 Towards *long-context world model*, #LongVie is an end-to-end autoregressive framework for controllable ultra-long video generation - Page: - Paper: . Thanks AK
2:12

🔥1-min Interactive Video Generation with Multimodal Control🔥 Towards *long-context world model*, #LongVie is an end-to-end autoregressive framework for controllable ultra-long video generation - Page: - Paper: . Thanks AK

Ziwei Liu

14,201 views • 1 year ago

🚀Exciting News! Tencent Hunyuan 3D AI Creation Engine v2.5 is here, revolutionizing 3D generation with ultra-high-definition modeling! 1⃣Massive Leap in Precision: Upgraded geometric model with 10B parameters (up from 1B) and 10x more mesh faces, delivering 1024-resolution geometric details—smoother surfaces, sharper edges, and richer visuals! 2⃣High-quality Textures & PBR: Supports high-quality textures and fine-grained bump mapping for lifelike surfaces. Industry-first multi-view PBR generation for realistic lighting and reflections. 3⃣Animation Boost: Optimized skeletal rigging with automatic bone binding and skin weight assignment, streamlining 3D animation workflows. 4⃣Flexible Workflows: New pipeline templates for text-to-3D and image-to-3D mesh reduction, plus multi-view 3D generation, empowering game development, animation, and more with customizable 3D assets. 5⃣Accessible Creation: Generate high-quality 3D models from text or images, slashing complexity. Free daily quota doubled to 20 for the AI Engine, with the API now live on Tencent Cloud! ☀️From games to AR/VR, Hunyuan 3D is redefining 3D AIGC, making creation faster, smarter, and more inclusive. Try it now! Tencent Hunyuan 3D AI Creation Engine: Tencent Hunyuan 3D Open Source:
1:30

🚀Exciting News! Tencent Hunyuan 3D AI Creation Engine v2.5 is here, revolutionizing 3D generation with ultra-high-definition modeling! 1⃣Massive Leap in Precision: Upgraded geometric model with 10B parameters (up from 1B) and 10x more mesh faces, delivering 1024-resolution geometric details—smoother surfaces, sharper edges, and richer visuals! 2⃣High-quality Textures & PBR: Supports high-quality textures and fine-grained bump mapping for lifelike surfaces. Industry-first multi-view PBR generation for realistic lighting and reflections. 3⃣Animation Boost: Optimized skeletal rigging with automatic bone binding and skin weight assignment, streamlining 3D animation workflows. 4⃣Flexible Workflows: New pipeline templates for text-to-3D and image-to-3D mesh reduction, plus multi-view 3D generation, empowering game development, animation, and more with customizable 3D assets. 5⃣Accessible Creation: Generate high-quality 3D models from text or images, slashing complexity. Free daily quota doubled to 20 for the AI Engine, with the API now live on Tencent Cloud! ☀️From games to AR/VR, Hunyuan 3D is redefining 3D AIGC, making creation faster, smarter, and more inclusive. Try it now! Tencent Hunyuan 3D AI Creation Engine: Tencent Hunyuan 3D Open Source:

Tencent Hy

58,225 views • 1 year ago

GRADIUS GENERATION: BLACK LABEL A complete rework of the GBA’s Gradius Generation (Galaxies in the West) overhauled with features such as dynamic rank display, high visibility bullets, a practice mode with upgrade selection, and much more Check it out
1:49

GRADIUS GENERATION: BLACK LABEL A complete rework of the GBA’s Gradius Generation (Galaxies in the West) overhauled with features such as dynamic rank display, high visibility bullets, a practice mode with upgrade selection, and much more Check it out

STG Shmups

44,899 views • 2 months ago

SOME UPCOMING SPRITES IN-GAME #Fortnite | Video by Hybrid
3:29

SOME UPCOMING SPRITES IN-GAME #Fortnite | Video by Hybrid

Backers | Fortnite News

231,873 views • 2 months ago

🎬Dive into Hunyuan 3D 2.1, featuring high-precision geometry and PBR textures for stunningly realistic rendering. Get started with our comprehensive open-source package and tutorials⬇️ Model: Github: Hunyuan 3D Creation Engine:
0:36

🎬Dive into Hunyuan 3D 2.1, featuring high-precision geometry and PBR textures for stunningly realistic rendering. Get started with our comprehensive open-source package and tutorials⬇️ Model: Github: Hunyuan 3D Creation Engine:

Tencent Hy

29,454 views • 1 year ago

Interactive 3D particle simulation with evolving swarm formations, procedural animations, morphing transitions, and dynamic abstract structures.
0:26

Interactive 3D particle simulation with evolving swarm formations, procedural animations, morphing transitions, and dynamic abstract structures.

Techartist

11,189 views • 3 months ago

Collaborative Video Diffusion Consistent Multi-video Generation with Camera Control Research on video generation has recently made tremendous progress, enabling high-quality videos to be generated from text prompts or images. Adding control to the video generation
2:16

Collaborative Video Diffusion Consistent Multi-video Generation with Camera Control Research on video generation has recently made tremendous progress, enabling high-quality videos to be generated from text prompts or images. Adding control to the video generation

AK

29,278 views • 2 years ago

JUICE WRLD POI + IN-GAME TRIBUTE REVEALED 🔥 (Video by Hybrid)
0:27

JUICE WRLD POI + IN-GAME TRIBUTE REVEALED 🔥 (Video by Hybrid)

Shiina

5,268,322 views • 1 year ago