Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

VMem Consistent Interactive Video Scene Generation with Surfel-Indexed View Memory

_akhaliq's profile picture

AK

519,666 subscribers

83,595 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & TechnologieBildung
LIVE

Anya Rossi• Live Now

Private livecam show

7 Kommentare

Profilbild von AK
AKvor 1 Jahr

discuss with author:

Profilbild von Mobile Scanner
Mobile Scannervor 1 Jahr

Scan any documents, convert images into text, PDF files, etc. 👍

Profilbild von Jorge Lison
Jorge Lisonvor 1 Jahr

If this works as well as I think it will, it could be a major step forward for dynamic video and video game generation. I can’t wait to try it out. Github repo to save y'all time:

Profilbild von •UtilityCo
•UtilityCovor 1 Jahr

Surfel-indexed memory is a spicy upgrade. How does VMem keep occlusions clean when the camera teleports? We’re playing with tokenized digital twins for decentralized sim spaces and this could slot right in. Got a demo link? I wanna throw it at my poor RTX and see what happens

Profilbild von Himanshu Kumar
Himanshu Kumarvor 1 Jahr

Explore dynamic scenes with surfel-based view memory.

Profilbild von Quinn’s Neural Pathways
Quinn’s Neural Pathwaysvor 1 Jahr

Scene gen with memory—finally models get a sense of déjà vu. Surfel recall feels like evolution for digital cognition; maybe this is step one for true AI spatial awareness.

Profilbild von Buggin “Da” Muggin
Buggin “Da” Mugginvor 1 Jahr

Next step: Destructive worlds with memory 😆

Ähnliche Videos

Voyager Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generation
0:30

Voyager Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generation

AK

15,840 Aufrufe • vor 1 Jahr

SceneScape: Text-Driven Consistent Scene Generation abs: project page: text-driven perpetual view generation -- synthesizing long videos of arbitrary scenes solely from an input text describing the scene and camera poses
0:48

SceneScape: Text-Driven Consistent Scene Generation abs: project page: text-driven perpetual view generation -- synthesizing long videos of arbitrary scenes solely from an input text describing the scene and camera poses

AK

73,258 Aufrufe • vor 3 Jahren

*Why panorama?* Standard video models struggle with object permanence—if a camera pans away and comes back, objects may disappear. With panoramas, the model is forced to generate everything in the scene. This serves as a "working memory" for consistent world generation. (3/N)
0:50

*Why panorama?* Standard video models struggle with object permanence—if a camera pans away and comes back, objects may disappear. With panoramas, the model is forced to generate everything in the scene. This serves as a "working memory" for consistent world generation. (3/N)

Ziyi Wu

22,019 Aufrufe • vor 7 Monaten

this looks insane, MatAnyone Stable Video Matting with Consistent Memory Propagation
1:12

this looks insane, MatAnyone Stable Video Matting with Consistent Memory Propagation

AK

310,389 Aufrufe • vor 1 Jahr

Hunyuan-GameCraft High-dynamic Interactive Game Video Generation with Hybrid History Condition
1:02

Hunyuan-GameCraft High-dynamic Interactive Game Video Generation with Hybrid History Condition

AK

91,212 Aufrufe • vor 1 Jahr

AnchorWeave World-Consistent Video Generation with Retrieved Local Spatial Memories paper:
0:24

AnchorWeave World-Consistent Video Generation with Retrieved Local Spatial Memories paper:

AK

23,312 Aufrufe • vor 6 Monaten

Meta presents OneStory Coherent Multi-Shot Video Generation with Adaptive Memory
0:35

Meta presents OneStory Coherent Multi-Shot Video Generation with Adaptive Memory

AK

11,532 Aufrufe • vor 8 Monaten

Nvidia just dropped GEN3C 3D-Informed World-Consistent Video Generation with Precise Camera Control
1:18

Nvidia just dropped GEN3C 3D-Informed World-Consistent Video Generation with Precise Camera Control

AK

58,157 Aufrufe • vor 1 Jahr

Collaborative Video Diffusion Consistent Multi-video Generation with Camera Control Research on video generation has recently made tremendous progress, enabling high-quality videos to be generated from text prompts or images. Adding control to the video generation
2:16

Collaborative Video Diffusion Consistent Multi-video Generation with Camera Control Research on video generation has recently made tremendous progress, enabling high-quality videos to be generated from text prompts or images. Adding control to the video generation

AK

29,278 Aufrufe • vor 2 Jahren

Can we use video diffusion to generate 3D scenes? 𝐖𝐨𝐫𝐥𝐝𝐄𝐱𝐩𝐥𝐨𝐫𝐞𝐫 (#SIGGRAPHAsia25) creates fully-navigable scenes via autoregressive video generation. Text input -> 3DGS scene output & interactive rendering! 🌍 📽️
0:28

Can we use video diffusion to generate 3D scenes? 𝐖𝐨𝐫𝐥𝐝𝐄𝐱𝐩𝐥𝐨𝐫𝐞𝐫 (#SIGGRAPHAsia25) creates fully-navigable scenes via autoregressive video generation. Text input -> 3DGS scene output & interactive rendering! 🌍 📽️

Matthias Niessner

30,903 Aufrufe • vor 11 Monaten

ByteDance released BindWeave Subject-Consistent Video Generation via Cross-Modal Integration
0:50

ByteDance released BindWeave Subject-Consistent Video Generation via Cross-Modal Integration

AK

37,192 Aufrufe • vor 10 Monaten

Playing with omnidreams ( inside flashdreams ( Fully interactive video generation at - 30FPS, - 720P resolution, - On a single RTX 6000 PRO GPU
1:23

Playing with omnidreams ( inside flashdreams ( Fully interactive video generation at - 30FPS, - 720P resolution, - On a single RTX 6000 PRO GPU

Ruilong Li

18,684 Aufrufe • vor 2 Monaten

🔥1-min Interactive Video Generation with Multimodal Control🔥 Towards *long-context world model*, #LongVie is an end-to-end autoregressive framework for controllable ultra-long video generation - Page: - Paper: . Thanks AK
2:12

🔥1-min Interactive Video Generation with Multimodal Control🔥 Towards *long-context world model*, #LongVie is an end-to-end autoregressive framework for controllable ultra-long video generation - Page: - Paper: . Thanks AK

Ziwei Liu

14,201 Aufrufe • vor 1 Jahr

InSpatio-WorldFM. transforms single photos into multi-view consistent 3D worlds. - Explicit 3D anchors + implicit neural state. - Zero-drift spatial reasoning. Real-time interactive exploration.
0:54

InSpatio-WorldFM. transforms single photos into multi-view consistent 3D worlds. - Explicit 3D anchors + implicit neural state. - Zero-drift spatial reasoning. Real-time interactive exploration.

Wildminder

10,808 Aufrufe • vor 6 Monaten

Memory-V2V by Adobe: diffusion model with memory for consistent iterative editing; - ReCamMaster+LucyEdit; - reduces FLOPs by 30-90%; outperforming FIFO-Diffusion. high fidelity across long durations like consistent style transfer
0:24

Memory-V2V by Adobe: diffusion model with memory for consistent iterative editing; - ReCamMaster+LucyEdit; - reduces FLOPs by 30-90%; outperforming FIFO-Diffusion. high fidelity across long durations like consistent style transfer

Wildminder

10,248 Aufrufe • vor 7 Monaten

WorldExplorer: Towards Generating Fully Navigable 3D Scenes Contributions: • We introduce the first method for generating 3D scenes from text that supports high-quality view synthesis while enabling exploration across a wide range of camera poses. • We propose an iterative scene expansion strategy using video diffusion models, driven by trajectory sampling and adaptive collision detection. • We design a scene memory mechanism that conditions each video generation step on relevant past frames, improving view consistency and overall scene coherence.
0:37

WorldExplorer: Towards Generating Fully Navigable 3D Scenes Contributions: • We introduce the first method for generating 3D scenes from text that supports high-quality view synthesis while enabling exploration across a wide range of camera poses. • We propose an iterative scene expansion strategy using video diffusion models, driven by trajectory sampling and adaptive collision detection. • We design a scene memory mechanism that conditions each video generation step on relevant past frames, improving view consistency and overall scene coherence.

MrNeRF

23,814 Aufrufe • vor 1 Jahr

Diffuman4D 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models
0:58

Diffuman4D 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models

AK

12,518 Aufrufe • vor 1 Jahr

PixVerse just launched their first real-time video world model R1, powered by fal's high-performance compute. It turns AI video from static clips into a real-time, interactive world. 🔄 Continuous generation stream 🧠 Autoregressive memory system ⚡ Ultra-fast response engine
0:27

PixVerse just launched their first real-time video world model R1, powered by fal's high-performance compute. It turns AI video from static clips into a real-time, interactive world. 🔄 Continuous generation stream 🧠 Autoregressive memory system ⚡ Ultra-fast response engine

fal

19,243 Aufrufe • vor 7 Monaten

Meet Gemini Omni Flash on SeaArt. A natively multimodal model for video generation and conversational editing. Edit with natural language. Keep scenes and story consistent across edits. Motion follows real-world physics and logic. From prompt to scene — in one flow.
0:20

Meet Gemini Omni Flash on SeaArt. A natively multimodal model for video generation and conversational editing. Edit with natural language. Keep scenes and story consistent across edits. Motion follows real-world physics and logic. From prompt to scene — in one flow.

SeaArt.Ai🐋

30,455 Aufrufe • vor 2 Monaten

AI video generation finally becomes directable. Use real actor motion to drive your characters — and control the camera for cinematic shots. Consistent motion. Consistent framing. Real creative power.
0:30

AI video generation finally becomes directable. Use real actor motion to drive your characters — and control the camera for cinematic shots. Consistent motion. Consistent framing. Real creative power.

Kinetix

771,938 Aufrufe • vor 9 Monaten