Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

SpaceTimePilot Generative Rendering of Dynamic Scenes Across Space and Time

_akhaliq's profile picture

AK

482,330 subscribers

22,258 Aufrufe • vor 5 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Check out our CVPR 2023 Award Candidate paper, DynIBaR! DynIBaR takes monocular videos of dynamic scenes and renders novel views in space and time. It addresses limitations of prior dynamic NeRF methods, rendering much higher quality views.
1:01

Check out our CVPR 2023 Award Candidate paper, DynIBaR! DynIBaR takes monocular videos of dynamic scenes and renders novel views in space and time. It addresses limitations of prior dynamic NeRF methods, rendering much higher quality views.

Zhengqi Li

86,193 Aufrufe • vor 3 Jahren

VideoRF: Rendering Dynamic Radiance Fields as 2D Feature Video Streams paper page: Neural Radiance Fields (NeRFs) excel in photorealistically rendering static scenes. However, rendering dynamic, long-duration radiance fields on ubiquitous devices remains challenging, due to data storage and computational constraints. In this paper, we introduce VideoRF, the first approach to enable real-time streaming and rendering of dynamic radiance fields on mobile platforms. At the core is a serialized 2D feature image stream representing the 4D radiance field all in one. We introduce a tailored training scheme directly applied to this 2D domain to impose the temporal and spatial redundancy of the feature image stream. By leveraging the redundancy, we show that the feature image stream can be efficiently compressed by 2D video codecs, which allows us to exploit video hardware accelerators to achieve real-time decoding. On the other hand, based on the feature image stream, we propose a novel rendering pipeline for VideoRF, which has specialized space mappings to query radiance properties efficiently. Paired with a deferred shading model, VideoRF has the capability of real-time rendering on mobile devices thanks to its efficiency. We have developed a real-time interactive player that enables online streaming and rendering of dynamic scenes, offering a seamless and immersive free-viewpoint experience across a range of devices, from desktops to mobile phones.
4:56

VideoRF: Rendering Dynamic Radiance Fields as 2D Feature Video Streams paper page: Neural Radiance Fields (NeRFs) excel in photorealistically rendering static scenes. However, rendering dynamic, long-duration radiance fields on ubiquitous devices remains challenging, due to data storage and computational constraints. In this paper, we introduce VideoRF, the first approach to enable real-time streaming and rendering of dynamic radiance fields on mobile platforms. At the core is a serialized 2D feature image stream representing the 4D radiance field all in one. We introduce a tailored training scheme directly applied to this 2D domain to impose the temporal and spatial redundancy of the feature image stream. By leveraging the redundancy, we show that the feature image stream can be efficiently compressed by 2D video codecs, which allows us to exploit video hardware accelerators to achieve real-time decoding. On the other hand, based on the feature image stream, we propose a novel rendering pipeline for VideoRF, which has specialized space mappings to query radiance properties efficiently. Paired with a deferred shading model, VideoRF has the capability of real-time rendering on mobile devices thanks to its efficiency. We have developed a real-time interactive player that enables online streaming and rendering of dynamic scenes, offering a seamless and immersive free-viewpoint experience across a range of devices, from desktops to mobile phones.

AK

38,686 Aufrufe • vor 2 Jahren

🔥Unbounded 4D City Generation🔥 #CityDreamer4D is a generative model of unbounded 4D cities that decouples static and dynamic scenes with realism and controllability - Project: - Code: - CityTopia Dataset:
1:02

🔥Unbounded 4D City Generation🔥 #CityDreamer4D is a generative model of unbounded 4D cities that decouples static and dynamic scenes with realism and controllability - Project: - Code: - CityTopia Dataset:

Ziwei Liu

24,326 Aufrufe • vor 1 Jahr

Light-X Generative 4D Video Rendering with Camera and Illumination Control
1:00

Light-X Generative 4D Video Rendering with Camera and Illumination Control

AK

31,126 Aufrufe • vor 6 Monaten

ReCamMaster Camera-Controlled Generative Rendering from A Single Video
0:43

ReCamMaster Camera-Controlled Generative Rendering from A Single Video

AK

256,244 Aufrufe • vor 1 Jahr

City-on-Web: Real-time Neural Rendering of Large-scale Scenes on the Web paper page: enables real-time neural rendering of large-scale scenes over web using laptop GPUs. The result is tested on the NVIDIA RTX 3060 Laptop GPU with 1920x1080 resolution
0:23

City-on-Web: Real-time Neural Rendering of Large-scale Scenes on the Web paper page: enables real-time neural rendering of large-scale scenes over web using laptop GPUs. The result is tested on the NVIDIA RTX 3060 Laptop GPU with 1920x1080 resolution

AK

79,439 Aufrufe • vor 2 Jahren

Static vs. Dynamic rendering in Next.js
1:20

Static vs. Dynamic rendering in Next.js

Delba

105,383 Aufrufe • vor 2 Jahren

WIP V-Tuber program in Unreal Engine 🎥 Developing a custom post-processing shader for the character! Focused on dynamic rim lighting and shadow rendering that preserves the model’s sense of depth and form even in dark scenes.
0:31

WIP V-Tuber program in Unreal Engine 🎥 Developing a custom post-processing shader for the character! Focused on dynamic rim lighting and shadow rendering that preserves the model’s sense of depth and form even in dark scenes.

Raming ( ω-、)

36,412 Aufrufe • vor 7 Monaten

2024 was a year of contrasts across Europe, with extreme heatwaves and large wildfires, alongside flooding and drought. @EUMETSAT’s video captures this dynamic year from space! Full #ESOTC2024 report:
2:33

2024 was a year of contrasts across Europe, with extreme heatwaves and large wildfires, alongside flooding and drought. @EUMETSAT’s video captures this dynamic year from space! Full #ESOTC2024 report:

World Meteorological Organization

12,645 Aufrufe • vor 1 Jahr

Introducing VGGT-Ω: scaling feed-forward reconstruction across static and dynamic scenes, and studying whether the learned geometric representations transfer beyond reconstruction.
0:48

Introducing VGGT-Ω: scaling feed-forward reconstruction across static and dynamic scenes, and studying whether the learned geometric representations transfer beyond reconstruction.

Jianyuan@CVPR

776,363 Aufrufe • vor 21 Tagen

Have too little time for working on the project lately. Just updated the calculation and rendering of housing regions. Next steps will be dynamic calculation during building process and show/hide them when needed
0:25

Have too little time for working on the project lately. Just updated the calculation and rendering of housing regions. Next steps will be dynamic calculation during building process and show/hide them when needed

Pavel Valakh | Lands of Koastalia 🐏

17,487 Aufrufe • vor 1 Jahr

Think adding LLMs to your app is hard? Think again. We just released a collection of open-source examples and tutorials to help developers integrate generative AI into their apps using our Chat API. Thinking indicators, code, markdown, image, and table rendering just became a lot easier across *all* of Stream’s frontend SDKs 🛠️
1:54

Think adding LLMs to your app is hard? Think again. We just released a collection of open-source examples and tutorials to help developers integrate generative AI into their apps using our Chat API. Thinking indicators, code, markdown, image, and table rendering just became a lot easier across *all* of Stream’s frontend SDKs 🛠️

Stream

29,746 Aufrufe • vor 1 Jahr

Fight across time, space, and the streets of Toronto when Scott Pilgrim EX, a 2D action-adventure brawler, arrives next year. #IGNFanFest
2:18

Fight across time, space, and the streets of Toronto when Scott Pilgrim EX, a 2D action-adventure brawler, arrives next year. #IGNFanFest

IGN

37,307 Aufrufe • vor 7 Monaten

Subside running on PSVR2 with Dynamic Foveated Rendering at 90hz with no reprojection
0:45

Subside running on PSVR2 with Dynamic Foveated Rendering at 90hz with no reprojection

Khena B

200,213 Aufrufe • vor 1 Jahr

Introducing BUSY in Marfa. A new generative artwork that samples the unique experience of being in Marfa, TX and combines it with a dynamic generative algorithm. I'll be at the Art Blocks gallery creating these in person next week, come say hey!
0:51

Introducing BUSY in Marfa. A new generative artwork that samples the unique experience of being in Marfa, TX and combines it with a dynamic generative algorithm. I'll be at the Art Blocks gallery creating these in person next week, come say hey!

James Merrill

10,623 Aufrufe • vor 1 Jahr

Here is the recording ( page load ) NextJs on left ( 1.38 s = 1380ms ) Tanstack Start on the right ( 209ms ... ) ~7x - Playwright is now less flaky, 100% faster - Rendering and navigation is at least 3x faster across all dynamic and non-dynamic pages - file structure is more sane and customizable - just works client side and server side...... - Fast, easy to understand...
0:43

Here is the recording ( page load ) NextJs on left ( 1.38 s = 1380ms ) Tanstack Start on the right ( 209ms ... ) ~7x - Playwright is now less flaky, 100% faster - Rendering and navigation is at least 3x faster across all dynamic and non-dynamic pages - file structure is more sane and customizable - just works client side and server side...... - Fast, easy to understand...

Meabed

43,693 Aufrufe • vor 4 Monaten

From Rasterization ➡️ Ray Tracing ➡️ Path Tracing, render engines have leaped forward. A new rendering paradigm, Generative Rendering, might have chance to revolutionize it all again. #CG #b3d #GenerativeAI
0:34

From Rasterization ➡️ Ray Tracing ➡️ Path Tracing, render engines have leaped forward. A new rendering paradigm, Generative Rendering, might have chance to revolutionize it all again. #CG #b3d #GenerativeAI

Hyper3D by Deemos

50,783 Aufrufe • vor 1 Jahr