Loading video...

Video Failed to Load

Go Home

SpaceTimePilot Generative Rendering of Dynamic Scenes Across Space and Time

_akhaliq's profile picture

AK

482,330 subscribers

22,258 views • 6 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Check out our CVPR 2023 Award Candidate paper, DynIBaR! DynIBaR takes monocular videos of dynamic scenes and renders novel views in space and time. It addresses limitations of prior dynamic NeRF methods, rendering much higher quality views.
1:01

Check out our CVPR 2023 Award Candidate paper, DynIBaR! DynIBaR takes monocular videos of dynamic scenes and renders novel views in space and time. It addresses limitations of prior dynamic NeRF methods, rendering much higher quality views.

Zhengqi Li

86,193 views • 3 years ago

VideoRF: Rendering Dynamic Radiance Fields as 2D Feature Video Streams paper page: Neural Radiance Fields (NeRFs) excel in photorealistically rendering static scenes. However, rendering dynamic, long-duration radiance fields on ubiquitous devices remains challenging, due to data storage and computational constraints. In this paper, we introduce VideoRF, the first approach to enable real-time streaming and rendering of dynamic radiance fields on mobile platforms. At the core is a serialized 2D feature image stream representing the 4D radiance field all in one. We introduce a tailored training scheme directly applied to this 2D domain to impose the temporal and spatial redundancy of the feature image stream. By leveraging the redundancy, we show that the feature image stream can be efficiently compressed by 2D video codecs, which allows us to exploit video hardware accelerators to achieve real-time decoding. On the other hand, based on the feature image stream, we propose a novel rendering pipeline for VideoRF, which has specialized space mappings to query radiance properties efficiently. Paired with a deferred shading model, VideoRF has the capability of real-time rendering on mobile devices thanks to its efficiency. We have developed a real-time interactive player that enables online streaming and rendering of dynamic scenes, offering a seamless and immersive free-viewpoint experience across a range of devices, from desktops to mobile phones.
4:56

VideoRF: Rendering Dynamic Radiance Fields as 2D Feature Video Streams paper page: Neural Radiance Fields (NeRFs) excel in photorealistically rendering static scenes. However, rendering dynamic, long-duration radiance fields on ubiquitous devices remains challenging, due to data storage and computational constraints. In this paper, we introduce VideoRF, the first approach to enable real-time streaming and rendering of dynamic radiance fields on mobile platforms. At the core is a serialized 2D feature image stream representing the 4D radiance field all in one. We introduce a tailored training scheme directly applied to this 2D domain to impose the temporal and spatial redundancy of the feature image stream. By leveraging the redundancy, we show that the feature image stream can be efficiently compressed by 2D video codecs, which allows us to exploit video hardware accelerators to achieve real-time decoding. On the other hand, based on the feature image stream, we propose a novel rendering pipeline for VideoRF, which has specialized space mappings to query radiance properties efficiently. Paired with a deferred shading model, VideoRF has the capability of real-time rendering on mobile devices thanks to its efficiency. We have developed a real-time interactive player that enables online streaming and rendering of dynamic scenes, offering a seamless and immersive free-viewpoint experience across a range of devices, from desktops to mobile phones.

AK

38,686 views • 2 years ago

🔥Unbounded 4D City Generation🔥 #CityDreamer4D is a generative model of unbounded 4D cities that decouples static and dynamic scenes with realism and controllability - Project: - Code: - CityTopia Dataset:
1:02

🔥Unbounded 4D City Generation🔥 #CityDreamer4D is a generative model of unbounded 4D cities that decouples static and dynamic scenes with realism and controllability - Project: - Code: - CityTopia Dataset:

Ziwei Liu

24,326 views • 1 year ago

Light-X Generative 4D Video Rendering with Camera and Illumination Control
1:00

Light-X Generative 4D Video Rendering with Camera and Illumination Control

AK

31,126 views • 7 months ago

City-on-Web: Real-time Neural Rendering of Large-scale Scenes on the Web paper page: enables real-time neural rendering of large-scale scenes over web using laptop GPUs. The result is tested on the NVIDIA RTX 3060 Laptop GPU with 1920x1080 resolution
0:23

City-on-Web: Real-time Neural Rendering of Large-scale Scenes on the Web paper page: enables real-time neural rendering of large-scale scenes over web using laptop GPUs. The result is tested on the NVIDIA RTX 3060 Laptop GPU with 1920x1080 resolution

AK

79,439 views • 2 years ago

ReCamMaster Camera-Controlled Generative Rendering from A Single Video
0:43

ReCamMaster Camera-Controlled Generative Rendering from A Single Video

AK

256,278 views • 1 year ago

Static vs. Dynamic rendering in Next.js
1:20

Static vs. Dynamic rendering in Next.js

Delba

105,387 views • 2 years ago

WIP V-Tuber program in Unreal Engine 🎥 Developing a custom post-processing shader for the character! Focused on dynamic rim lighting and shadow rendering that preserves the model’s sense of depth and form even in dark scenes.
0:31

WIP V-Tuber program in Unreal Engine 🎥 Developing a custom post-processing shader for the character! Focused on dynamic rim lighting and shadow rendering that preserves the model’s sense of depth and form even in dark scenes.

Raming ( ω-、)

36,412 views • 8 months ago

2024 was a year of contrasts across Europe, with extreme heatwaves and large wildfires, alongside flooding and drought. @EUMETSAT’s video captures this dynamic year from space! Full #ESOTC2024 report:
2:33

2024 was a year of contrasts across Europe, with extreme heatwaves and large wildfires, alongside flooding and drought. @EUMETSAT’s video captures this dynamic year from space! Full #ESOTC2024 report:

World Meteorological Organization

12,645 views • 1 year ago

Introducing VGGT-Ω: scaling feed-forward reconstruction across static and dynamic scenes, and studying whether the learned geometric representations transfer beyond reconstruction.
0:48

Introducing VGGT-Ω: scaling feed-forward reconstruction across static and dynamic scenes, and studying whether the learned geometric representations transfer beyond reconstruction.

Jianyuan

779,239 views • 1 month ago

Have too little time for working on the project lately. Just updated the calculation and rendering of housing regions. Next steps will be dynamic calculation during building process and show/hide them when needed
0:25

Have too little time for working on the project lately. Just updated the calculation and rendering of housing regions. Next steps will be dynamic calculation during building process and show/hide them when needed

Pavel Valakh | Lands of Koastalia 🐏

17,497 views • 1 year ago

Think adding LLMs to your app is hard? Think again. We just released a collection of open-source examples and tutorials to help developers integrate generative AI into their apps using our Chat API. Thinking indicators, code, markdown, image, and table rendering just became a lot easier across *all* of Stream’s frontend SDKs 🛠️
1:54

Think adding LLMs to your app is hard? Think again. We just released a collection of open-source examples and tutorials to help developers integrate generative AI into their apps using our Chat API. Thinking indicators, code, markdown, image, and table rendering just became a lot easier across *all* of Stream’s frontend SDKs 🛠️

Stream

29,746 views • 1 year ago

Fight across time, space, and the streets of Toronto when Scott Pilgrim EX, a 2D action-adventure brawler, arrives next year. #IGNFanFest
2:18

Fight across time, space, and the streets of Toronto when Scott Pilgrim EX, a 2D action-adventure brawler, arrives next year. #IGNFanFest

IGN

37,307 views • 8 months ago

Subside running on PSVR2 with Dynamic Foveated Rendering at 90hz with no reprojection
0:45

Subside running on PSVR2 with Dynamic Foveated Rendering at 90hz with no reprojection

Khena B

200,213 views • 1 year ago

Today we're launching OpenUI Cloud We've spent months arguing AI deserves more than text. The uncomfortable truth is Generative UI in production needs much more than just rendering. The boring parts - validation, error correction, fallbacks, versioning, audit trails - eat up 80% of the time and become the critical factor in deciding whether your Generative UI agent reaches production or dies trying. OpenUI (open source) handles the rendering. OpenUI Cloud handles that 80% nobody should have to rebuild. > npx @openuidev/cli@latest create
0:33

Today we're launching OpenUI Cloud We've spent months arguing AI deserves more than text. The uncomfortable truth is Generative UI in production needs much more than just rendering. The boring parts - validation, error correction, fallbacks, versioning, audit trails - eat up 80% of the time and become the critical factor in deciding whether your Generative UI agent reaches production or dies trying. OpenUI (open source) handles the rendering. OpenUI Cloud handles that 80% nobody should have to rebuild. > npx @openuidev/cli@latest create

Rabi Shanker Guha

45,606 views • 2 days ago

Here is the recording ( page load ) NextJs on left ( 1.38 s = 1380ms ) Tanstack Start on the right ( 209ms ... ) ~7x - Playwright is now less flaky, 100% faster - Rendering and navigation is at least 3x faster across all dynamic and non-dynamic pages - file structure is more sane and customizable - just works client side and server side...... - Fast, easy to understand...
0:43

Here is the recording ( page load ) NextJs on left ( 1.38 s = 1380ms ) Tanstack Start on the right ( 209ms ... ) ~7x - Playwright is now less flaky, 100% faster - Rendering and navigation is at least 3x faster across all dynamic and non-dynamic pages - file structure is more sane and customizable - just works client side and server side...... - Fast, easy to understand...

Meabed

43,693 views • 5 months ago

From Rasterization ➡️ Ray Tracing ➡️ Path Tracing, render engines have leaped forward. A new rendering paradigm, Generative Rendering, might have chance to revolutionize it all again. #CG #b3d #GenerativeAI
0:34

From Rasterization ➡️ Ray Tracing ➡️ Path Tracing, render engines have leaped forward. A new rendering paradigm, Generative Rendering, might have chance to revolutionize it all again. #CG #b3d #GenerativeAI

Hyper3D by Deemos

50,866 views • 1 year ago