Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

INSPATIO-WORLD A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling paper:

_akhaliq's profile picture

AK

518,682 subscribers

16,461 görüntüleme • 4 ay önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Introducing Universal Simulator (UniSim), an interactive simulator of the real world. Interactive website: Paper:
1:57

Introducing Universal Simulator (UniSim), an interactive simulator of the real world. Interactive website: Paper:

Sherry Yang

440,007 görüntüleme • 2 yıl önce

Real-time World Models x Multi-agent reality simulator with Odyssey
0:23

Real-time World Models x Multi-agent reality simulator with Odyssey

Cris Lenta

45,923 görüntüleme • 6 ay önce

Robot Learning needs 4D world models! Robot Learning needs 4D world models! Robot Learning needs 4D world models! We introduce TesserAct, a 4D embodied world model that can simulate how agents interact with the 3D world over time! We achieve this by simply extending a pre-trained 2D video generation model to jointly predict RGB, depth, and surface normals. It enables: 1️⃣ Much better policy learning in the wild 2️⃣ Temporal + spatial coherence in 4D dynamic prediction 3️⃣ Novel view synthesis for embodied scenes Code: Paper Link: Project page:
0:32

Robot Learning needs 4D world models! Robot Learning needs 4D world models! Robot Learning needs 4D world models! We introduce TesserAct, a 4D embodied world model that can simulate how agents interact with the 3D world over time! We achieve this by simply extending a pre-trained 2D video generation model to jointly predict RGB, depth, and surface normals. It enables: 1️⃣ Much better policy learning in the wild 2️⃣ Temporal + spatial coherence in 4D dynamic prediction 3️⃣ Novel view synthesis for embodied scenes Code: Paper Link: Project page:

Chuang Gan

43,265 görüntüleme • 1 yıl önce

Grounding World Simulation Models in a Real-World Metropolis paper:
2:04

Grounding World Simulation Models in a Real-World Metropolis paper:

AK

33,812 görüntüleme • 5 ay önce

Agentic Real2Sim is an interesting take on world modeling. Instead of learning physics directly from videos, it lets a Vision-Language Agent reconstruct a physics simulator from a single real-world video. The result is an editable, executable world model that can be queried, simulated, and improved.
4:14

Agentic Real2Sim is an interesting take on world modeling. Instead of learning physics directly from videos, it lets a Vision-Language Agent reconstruct a physics simulator from a single real-world video. The result is an editable, executable world model that can be queried, simulated, and improved.

Robots Digest 🤖

11,940 görüntüleme • 1 ay önce

PixVerse just launched their first real-time video world model R1, powered by fal's high-performance compute. It turns AI video from static clips into a real-time, interactive world. 🔄 Continuous generation stream 🧠 Autoregressive memory system ⚡ Ultra-fast response engine
0:27

PixVerse just launched their first real-time video world model R1, powered by fal's high-performance compute. It turns AI video from static clips into a real-time, interactive world. 🔄 Continuous generation stream 🧠 Autoregressive memory system ⚡ Ultra-fast response engine

fal

19,243 görüntüleme • 7 ay önce

This is PlayerOne, an Egocentric World Simulator This AI builds a full VR world from one POV photo Then matches your every move in real-time🤯
0:20

This is PlayerOne, an Egocentric World Simulator This AI builds a full VR world from one POV photo Then matches your every move in real-time🤯

Min Choi

54,207 görüntüleme • 1 yıl önce

Current world models often separate spatial reasoning from temporal modeling, leading to consistency bottlenecks and scaling limits. We developed RAYNOVA, a 4D world foundation model, to address this by unifying space and time into a single representation via a pure auto-regressive framework. The result: Data-driven high-fidelity simulation data that scales across any vehicles, anywhere. Read the full technical breakdown:
0:27

Current world models often separate spatial reasoning from temporal modeling, leading to consistency bottlenecks and scaling limits. We developed RAYNOVA, a 4D world foundation model, to address this by unifying space and time into a single representation via a pure auto-regressive framework. The result: Data-driven high-fidelity simulation data that scales across any vehicles, anywhere. Read the full technical breakdown:

Applied Intuition

11,252 görüntüleme • 3 ay önce

Introducing Starchild-1 from Odyssey, the first ever real-time multimodal world model. This a model that can generate interactive simulations of the world that you can—for the first time ever—hear. Starchild-1 represents a big step towards a general-purpose world simulator.
2:15

Introducing Starchild-1 from Odyssey, the first ever real-time multimodal world model. This a model that can generate interactive simulations of the world that you can—for the first time ever—hear. Starchild-1 represents a big step towards a general-purpose world simulator.

Oliver Cameron

246,280 görüntüleme • 3 ay önce

Epona Autoregressive Diffusion World Model for Autonomous Driving
0:32

Epona Autoregressive Diffusion World Model for Autonomous Driving

AK

18,839 görüntüleme • 1 yıl önce

RynnWorld-4D 4D Embodied World Models for Robotic Manipulation
1:41

RynnWorld-4D 4D Embodied World Models for Robotic Manipulation

AK

33,467 görüntüleme • 1 ay önce

Somalia is a paper country. It doesn't exist in the real World.
0:20

Somalia is a paper country. It doesn't exist in the real World.

African Index

26,819 görüntüleme • 7 ay önce

4DGT: Learning a 4D Gaussian Transformer Using Real-World Monocular Videos Abstract: We propose 4DGT, a 4D Gaussian-based Transformer model for dynamic scene reconstruction, trained entirely on real-world monocular posed videos. Using 4D Gaussian as an inductive bias, 4DGT unifies static and dynamic components, enabling the modeling of complex, time-varying environments with varying object lifespans. We introduced a novel density control strategy in training, which allows our 4DGT to handle longer space-time input while maintaining efficient rendering at runtime. Our model processes 64 consecutive posed frames in a rolling-window fashion, predicting consistent 4D Gaussians in the scene. Unlike optimization-based methods, 4DGT performs purely feed-forward inference, reducing reconstruction time from hours to seconds and scaling effectively to long video sequences. Trained only on large-scale monocular posed video datasets, 4DGT can significantly outperform prior Gaussian-based networks in real-world videos and achieve on-par accuracy with optimization-based methods on cross-domain videos.
5:19

4DGT: Learning a 4D Gaussian Transformer Using Real-World Monocular Videos Abstract: We propose 4DGT, a 4D Gaussian-based Transformer model for dynamic scene reconstruction, trained entirely on real-world monocular posed videos. Using 4D Gaussian as an inductive bias, 4DGT unifies static and dynamic components, enabling the modeling of complex, time-varying environments with varying object lifespans. We introduced a novel density control strategy in training, which allows our 4DGT to handle longer space-time input while maintaining efficient rendering at runtime. Our model processes 64 consecutive posed frames in a rolling-window fashion, predicting consistent 4D Gaussians in the scene. Unlike optimization-based methods, 4DGT performs purely feed-forward inference, reducing reconstruction time from hours to seconds and scaling effectively to long video sequences. Trained only on large-scale monocular posed video datasets, 4DGT can significantly outperform prior Gaussian-based networks in real-world videos and achieve on-par accuracy with optimization-based methods on cross-domain videos.

MrNeRF

34,782 görüntüleme • 1 yıl önce

Robbyant released LingBot-World 2.0 (Infinity), a new open-source World model capable of generating hour-long experiences. > No quality decay, stable 720p / 60 fps real-time output. > Users can interact with the world via Actions. > The world is dynamic, with built-in agents generating new events in real time. > Multiplayer is supported within the same world. Testing time 👀
0:47

Robbyant released LingBot-World 2.0 (Infinity), a new open-source World model capable of generating hour-long experiences. > No quality decay, stable 720p / 60 fps real-time output. > Users can interact with the world via Actions. > The world is dynamic, with built-in agents generating new events in real time. > Multiplayer is supported within the same world. Testing time 👀

🚨 AI News | TestingCatalog

15,272 görüntüleme • 1 ay önce

“When paper cutouts take over the real world 😂🔥
1:03

“When paper cutouts take over the real world 😂🔥

Natalie

655,608 görüntüleme • 15 gün önce

Rolling Forcing Autoregressive Long Video Diffusion in Real Time
2:00

Rolling Forcing Autoregressive Long Video Diffusion in Real Time

AK

30,507 görüntüleme • 11 ay önce

The Waypoint-1.5 technical paper is now live. Waypoint-1.5 is a real-time video diffusion world model designed to run on consumer GPUs, bringing interactive world models closer to practical, accessible deployment.
0:44

The Waypoint-1.5 technical paper is now live. Waypoint-1.5 is a real-time video diffusion world model designed to run on consumer GPUs, bringing interactive world models closer to practical, accessible deployment.

Overworld

80,488 görüntüleme • 1 ay önce

dj simulator: world tour
1:01

dj simulator: world tour

CYCLOPS

254,321 görüntüleme • 3 yıl önce

1/ Tencent releases HY World 1.5 (WorldPlay), an open-source real-time world model with 24fps A streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency In direct comparison to Genie 3, it's technically inferior, and there's no information on how long the consistency will last. However, Tencent has released a significant world model as open source for the first time, making it available to everyone. A few more examples, a thread 🧵
1:06

1/ Tencent releases HY World 1.5 (WorldPlay), an open-source real-time world model with 24fps A streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency In direct comparison to Genie 3, it's technically inferior, and there's no information on how long the consistency will last. However, Tencent has released a significant world model as open source for the first time, making it available to everyone. A few more examples, a thread 🧵

Chubby♨️

37,776 görüntüleme • 8 ay önce