Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

VMem Consistent Interactive Video Scene Generation with Surfel-Indexed View Memory

_akhaliq's profile picture

AK

502,613 subscribers

83,550 Aufrufe • vor 11 Monaten •via X (Twitter)

Wissenschaft & TechnologieBildung
LIVE

Anya Rossi• Live Now

Private livecam show

7 Kommentare

Profilbild von AK
AKvor 11 Monaten

discuss with author:

Profilbild von Mobile Scanner
Mobile Scannervor 11 Monaten

Scan any documents, convert images into text, PDF files, etc. 👍

Profilbild von Jorge Lison
Jorge Lisonvor 11 Monaten

If this works as well as I think it will, it could be a major step forward for dynamic video and video game generation. I can’t wait to try it out. Github repo to save y'all time:

Profilbild von •UtilityCo
•UtilityCovor 11 Monaten

Surfel-indexed memory is a spicy upgrade. How does VMem keep occlusions clean when the camera teleports? We’re playing with tokenized digital twins for decentralized sim spaces and this could slot right in. Got a demo link? I wanna throw it at my poor RTX and see what happens

Profilbild von Himanshu Kumar
Himanshu Kumarvor 11 Monaten

Explore dynamic scenes with surfel-based view memory.

Profilbild von Quinn’s Neural Pathways
Quinn’s Neural Pathwaysvor 11 Monaten

Scene gen with memory—finally models get a sense of déjà vu. Surfel recall feels like evolution for digital cognition; maybe this is step one for true AI spatial awareness.

Profilbild von Buggin “Da” Muggin
Buggin “Da” Mugginvor 11 Monaten

Next step: Destructive worlds with memory 😆

Ähnliche Videos

Voyager Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generation
0:30

Voyager Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generation

AK

15,840 Aufrufe • vor 1 Jahr

SceneScape: Text-Driven Consistent Scene Generation abs: project page: text-driven perpetual view generation -- synthesizing long videos of arbitrary scenes solely from an input text describing the scene and camera poses
0:48

SceneScape: Text-Driven Consistent Scene Generation abs: project page: text-driven perpetual view generation -- synthesizing long videos of arbitrary scenes solely from an input text describing the scene and camera poses

AK

73,258 Aufrufe • vor 3 Jahren

this looks insane, MatAnyone Stable Video Matting with Consistent Memory Propagation
1:12

this looks insane, MatAnyone Stable Video Matting with Consistent Memory Propagation

AK

310,358 Aufrufe • vor 1 Jahr

*Why panorama?* Standard video models struggle with object permanence—if a camera pans away and comes back, objects may disappear. With panoramas, the model is forced to generate everything in the scene. This serves as a "working memory" for consistent world generation. (3/N)
0:50

*Why panorama?* Standard video models struggle with object permanence—if a camera pans away and comes back, objects may disappear. With panoramas, the model is forced to generate everything in the scene. This serves as a "working memory" for consistent world generation. (3/N)

Ziyi Wu

21,992 Aufrufe • vor 4 Monaten

AnchorWeave World-Consistent Video Generation with Retrieved Local Spatial Memories paper:
0:24

AnchorWeave World-Consistent Video Generation with Retrieved Local Spatial Memories paper:

AK

23,312 Aufrufe • vor 3 Monaten

Hunyuan-GameCraft High-dynamic Interactive Game Video Generation with Hybrid History Condition
1:02

Hunyuan-GameCraft High-dynamic Interactive Game Video Generation with Hybrid History Condition

AK

91,039 Aufrufe • vor 11 Monaten

Meta presents OneStory Coherent Multi-Shot Video Generation with Adaptive Memory
0:35

Meta presents OneStory Coherent Multi-Shot Video Generation with Adaptive Memory

AK

11,532 Aufrufe • vor 6 Monaten

Nvidia just dropped GEN3C 3D-Informed World-Consistent Video Generation with Precise Camera Control
1:18

Nvidia just dropped GEN3C 3D-Informed World-Consistent Video Generation with Precise Camera Control

AK

58,146 Aufrufe • vor 1 Jahr

Collaborative Video Diffusion Consistent Multi-video Generation with Camera Control Research on video generation has recently made tremendous progress, enabling high-quality videos to be generated from text prompts or images. Adding control to the video generation
2:16

Collaborative Video Diffusion Consistent Multi-video Generation with Camera Control Research on video generation has recently made tremendous progress, enabling high-quality videos to be generated from text prompts or images. Adding control to the video generation

AK

29,262 Aufrufe • vor 2 Jahren

ByteDance released BindWeave Subject-Consistent Video Generation via Cross-Modal Integration
0:50

ByteDance released BindWeave Subject-Consistent Video Generation via Cross-Modal Integration

AK

37,173 Aufrufe • vor 7 Monaten

Can we use video diffusion to generate 3D scenes? 𝐖𝐨𝐫𝐥𝐝𝐄𝐱𝐩𝐥𝐨𝐫𝐞𝐫 (#SIGGRAPHAsia25) creates fully-navigable scenes via autoregressive video generation. Text input -> 3DGS scene output & interactive rendering! 🌍 📽️
0:28

Can we use video diffusion to generate 3D scenes? 𝐖𝐨𝐫𝐥𝐝𝐄𝐱𝐩𝐥𝐨𝐫𝐞𝐫 (#SIGGRAPHAsia25) creates fully-navigable scenes via autoregressive video generation. Text input -> 3DGS scene output & interactive rendering! 🌍 📽️

Matthias Niessner

30,777 Aufrufe • vor 8 Monaten

🔥1-min Interactive Video Generation with Multimodal Control🔥 Towards *long-context world model*, #LongVie is an end-to-end autoregressive framework for controllable ultra-long video generation - Page: - Paper: . Thanks AK
2:12

🔥1-min Interactive Video Generation with Multimodal Control🔥 Towards *long-context world model*, #LongVie is an end-to-end autoregressive framework for controllable ultra-long video generation - Page: - Paper: . Thanks AK

Ziwei Liu

14,150 Aufrufe • vor 10 Monaten

InSpatio-WorldFM. transforms single photos into multi-view consistent 3D worlds. - Explicit 3D anchors + implicit neural state. - Zero-drift spatial reasoning. Real-time interactive exploration.
0:54

InSpatio-WorldFM. transforms single photos into multi-view consistent 3D worlds. - Explicit 3D anchors + implicit neural state. - Zero-drift spatial reasoning. Real-time interactive exploration.

Wildminder

10,795 Aufrufe • vor 3 Monaten

Memory-V2V by Adobe: diffusion model with memory for consistent iterative editing; - ReCamMaster+LucyEdit; - reduces FLOPs by 30-90%; outperforming FIFO-Diffusion. high fidelity across long durations like consistent style transfer
0:24

Memory-V2V by Adobe: diffusion model with memory for consistent iterative editing; - ReCamMaster+LucyEdit; - reduces FLOPs by 30-90%; outperforming FIFO-Diffusion. high fidelity across long durations like consistent style transfer

Wildminder

10,248 Aufrufe • vor 4 Monaten

Diffuman4D 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models
0:58

Diffuman4D 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models

AK

12,518 Aufrufe • vor 10 Monaten

WorldExplorer: Towards Generating Fully Navigable 3D Scenes Contributions: • We introduce the first method for generating 3D scenes from text that supports high-quality view synthesis while enabling exploration across a wide range of camera poses. • We propose an iterative scene expansion strategy using video diffusion models, driven by trajectory sampling and adaptive collision detection. • We design a scene memory mechanism that conditions each video generation step on relevant past frames, improving view consistency and overall scene coherence.
0:37

WorldExplorer: Towards Generating Fully Navigable 3D Scenes Contributions: • We introduce the first method for generating 3D scenes from text that supports high-quality view synthesis while enabling exploration across a wide range of camera poses. • We propose an iterative scene expansion strategy using video diffusion models, driven by trajectory sampling and adaptive collision detection. • We design a scene memory mechanism that conditions each video generation step on relevant past frames, improving view consistency and overall scene coherence.

MrNeRF

23,814 Aufrufe • vor 1 Jahr

Yume An Interactive World Generation Model
2:34

Yume An Interactive World Generation Model

AK

16,582 Aufrufe • vor 10 Monaten

PixVerse just launched their first real-time video world model R1, powered by fal's high-performance compute. It turns AI video from static clips into a real-time, interactive world. 🔄 Continuous generation stream 🧠 Autoregressive memory system ⚡ Ultra-fast response engine
0:27

PixVerse just launched their first real-time video world model R1, powered by fal's high-performance compute. It turns AI video from static clips into a real-time, interactive world. 🔄 Continuous generation stream 🧠 Autoregressive memory system ⚡ Ultra-fast response engine

fal

18,822 Aufrufe • vor 4 Monaten

Full video on the $16,000,000 Indexed Finance hack!
13:07

Full video on the $16,000,000 Indexed Finance hack!

Junion

56,839 Aufrufe • vor 2 Jahren

The most consistent rapper of our generation
0:41

The most consistent rapper of our generation

Lidesty

1,231,923 Aufrufe • vor 1 Jahr