正在加载视频...

视频加载失败

返回首页

SpaceTimePilot Generative Rendering of Dynamic Scenes Across Space and Time

_akhaliq's profile picture

AK

482,330 subscribers

22,258 次观看 • 6 个月前 •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Check out our CVPR 2023 Award Candidate paper, DynIBaR! DynIBaR takes monocular videos of dynamic scenes and renders novel views in space and time. It addresses limitations of prior dynamic NeRF methods, rendering much higher quality views.
1:01

Check out our CVPR 2023 Award Candidate paper, DynIBaR! DynIBaR takes monocular videos of dynamic scenes and renders novel views in space and time. It addresses limitations of prior dynamic NeRF methods, rendering much higher quality views.

Zhengqi Li

86,193 次观看 • 3 年前

VideoRF: Rendering Dynamic Radiance Fields as 2D Feature Video Streams paper page: Neural Radiance Fields (NeRFs) excel in photorealistically rendering static scenes. However, rendering dynamic, long-duration radiance fields on ubiquitous devices remains challenging, due to data storage and computational constraints. In this paper, we introduce VideoRF, the first approach to enable real-time streaming and rendering of dynamic radiance fields on mobile platforms. At the core is a serialized 2D feature image stream representing the 4D radiance field all in one. We introduce a tailored training scheme directly applied to this 2D domain to impose the temporal and spatial redundancy of the feature image stream. By leveraging the redundancy, we show that the feature image stream can be efficiently compressed by 2D video codecs, which allows us to exploit video hardware accelerators to achieve real-time decoding. On the other hand, based on the feature image stream, we propose a novel rendering pipeline for VideoRF, which has specialized space mappings to query radiance properties efficiently. Paired with a deferred shading model, VideoRF has the capability of real-time rendering on mobile devices thanks to its efficiency. We have developed a real-time interactive player that enables online streaming and rendering of dynamic scenes, offering a seamless and immersive free-viewpoint experience across a range of devices, from desktops to mobile phones.
4:56

VideoRF: Rendering Dynamic Radiance Fields as 2D Feature Video Streams paper page: Neural Radiance Fields (NeRFs) excel in photorealistically rendering static scenes. However, rendering dynamic, long-duration radiance fields on ubiquitous devices remains challenging, due to data storage and computational constraints. In this paper, we introduce VideoRF, the first approach to enable real-time streaming and rendering of dynamic radiance fields on mobile platforms. At the core is a serialized 2D feature image stream representing the 4D radiance field all in one. We introduce a tailored training scheme directly applied to this 2D domain to impose the temporal and spatial redundancy of the feature image stream. By leveraging the redundancy, we show that the feature image stream can be efficiently compressed by 2D video codecs, which allows us to exploit video hardware accelerators to achieve real-time decoding. On the other hand, based on the feature image stream, we propose a novel rendering pipeline for VideoRF, which has specialized space mappings to query radiance properties efficiently. Paired with a deferred shading model, VideoRF has the capability of real-time rendering on mobile devices thanks to its efficiency. We have developed a real-time interactive player that enables online streaming and rendering of dynamic scenes, offering a seamless and immersive free-viewpoint experience across a range of devices, from desktops to mobile phones.

AK

38,686 次观看 • 2 年前

🔥Unbounded 4D City Generation🔥 #CityDreamer4D is a generative model of unbounded 4D cities that decouples static and dynamic scenes with realism and controllability - Project: - Code: - CityTopia Dataset:
1:02

🔥Unbounded 4D City Generation🔥 #CityDreamer4D is a generative model of unbounded 4D cities that decouples static and dynamic scenes with realism and controllability - Project: - Code: - CityTopia Dataset:

Ziwei Liu

24,326 次观看 • 1 年前

Light-X Generative 4D Video Rendering with Camera and Illumination Control
1:00

Light-X Generative 4D Video Rendering with Camera and Illumination Control

AK

31,126 次观看 • 7 个月前

ReCamMaster Camera-Controlled Generative Rendering from A Single Video
0:43

ReCamMaster Camera-Controlled Generative Rendering from A Single Video

AK

256,278 次观看 • 1 年前

City-on-Web: Real-time Neural Rendering of Large-scale Scenes on the Web paper page: enables real-time neural rendering of large-scale scenes over web using laptop GPUs. The result is tested on the NVIDIA RTX 3060 Laptop GPU with 1920x1080 resolution
0:23

City-on-Web: Real-time Neural Rendering of Large-scale Scenes on the Web paper page: enables real-time neural rendering of large-scale scenes over web using laptop GPUs. The result is tested on the NVIDIA RTX 3060 Laptop GPU with 1920x1080 resolution

AK

79,439 次观看 • 2 年前

Static vs. Dynamic rendering in Next.js
1:20

Static vs. Dynamic rendering in Next.js

Delba

105,387 次观看 • 2 年前

WIP V-Tuber program in Unreal Engine 🎥 Developing a custom post-processing shader for the character! Focused on dynamic rim lighting and shadow rendering that preserves the model’s sense of depth and form even in dark scenes.
0:31

WIP V-Tuber program in Unreal Engine 🎥 Developing a custom post-processing shader for the character! Focused on dynamic rim lighting and shadow rendering that preserves the model’s sense of depth and form even in dark scenes.

Raming ( ω-、)

36,412 次观看 • 8 个月前

2024 was a year of contrasts across Europe, with extreme heatwaves and large wildfires, alongside flooding and drought. @EUMETSAT’s video captures this dynamic year from space! Full #ESOTC2024 report:
2:33

2024 was a year of contrasts across Europe, with extreme heatwaves and large wildfires, alongside flooding and drought. @EUMETSAT’s video captures this dynamic year from space! Full #ESOTC2024 report:

World Meteorological Organization

12,649 次观看 • 1 年前

Introducing VGGT-Ω: scaling feed-forward reconstruction across static and dynamic scenes, and studying whether the learned geometric representations transfer beyond reconstruction.
0:48

Introducing VGGT-Ω: scaling feed-forward reconstruction across static and dynamic scenes, and studying whether the learned geometric representations transfer beyond reconstruction.

Jianyuan

779,506 次观看 • 1 个月前

Have too little time for working on the project lately. Just updated the calculation and rendering of housing regions. Next steps will be dynamic calculation during building process and show/hide them when needed
0:25

Have too little time for working on the project lately. Just updated the calculation and rendering of housing regions. Next steps will be dynamic calculation during building process and show/hide them when needed

Pavel Valakh | Lands of Koastalia 🐏

17,497 次观看 • 1 年前

Think adding LLMs to your app is hard? Think again. We just released a collection of open-source examples and tutorials to help developers integrate generative AI into their apps using our Chat API. Thinking indicators, code, markdown, image, and table rendering just became a lot easier across *all* of Stream’s frontend SDKs 🛠️
1:54

Think adding LLMs to your app is hard? Think again. We just released a collection of open-source examples and tutorials to help developers integrate generative AI into their apps using our Chat API. Thinking indicators, code, markdown, image, and table rendering just became a lot easier across *all* of Stream’s frontend SDKs 🛠️

Stream

29,746 次观看 • 1 年前

Fight across time, space, and the streets of Toronto when Scott Pilgrim EX, a 2D action-adventure brawler, arrives next year. #IGNFanFest
2:18

Fight across time, space, and the streets of Toronto when Scott Pilgrim EX, a 2D action-adventure brawler, arrives next year. #IGNFanFest

IGN

37,307 次观看 • 8 个月前

Subside running on PSVR2 with Dynamic Foveated Rendering at 90hz with no reprojection
0:45

Subside running on PSVR2 with Dynamic Foveated Rendering at 90hz with no reprojection

Khena B

200,213 次观看 • 1 年前

Introducing BUSY in Marfa. A new generative artwork that samples the unique experience of being in Marfa, TX and combines it with a dynamic generative algorithm. I'll be at the Art Blocks gallery creating these in person next week, come say hey!
0:51

Introducing BUSY in Marfa. A new generative artwork that samples the unique experience of being in Marfa, TX and combines it with a dynamic generative algorithm. I'll be at the Art Blocks gallery creating these in person next week, come say hey!

James Merrill

10,623 次观看 • 1 年前

Here is the recording ( page load ) NextJs on left ( 1.38 s = 1380ms ) Tanstack Start on the right ( 209ms ... ) ~7x - Playwright is now less flaky, 100% faster - Rendering and navigation is at least 3x faster across all dynamic and non-dynamic pages - file structure is more sane and customizable - just works client side and server side...... - Fast, easy to understand...
0:43

Here is the recording ( page load ) NextJs on left ( 1.38 s = 1380ms ) Tanstack Start on the right ( 209ms ... ) ~7x - Playwright is now less flaky, 100% faster - Rendering and navigation is at least 3x faster across all dynamic and non-dynamic pages - file structure is more sane and customizable - just works client side and server side...... - Fast, easy to understand...

Meabed

43,693 次观看 • 5 个月前

Today we're launching OpenUI Cloud We've spent months arguing AI deserves more than text. The uncomfortable truth is Generative UI in production needs much more than just rendering. The boring parts - validation, error correction, fallbacks, versioning, audit trails - eat up 80% of the time and become the critical factor in deciding whether your Generative UI agent reaches production or dies trying. OpenUI (open source) handles the rendering. OpenUI Cloud handles that 80% nobody should have to rebuild. > npx @openuidev/cli@latest create
0:33

Today we're launching OpenUI Cloud We've spent months arguing AI deserves more than text. The uncomfortable truth is Generative UI in production needs much more than just rendering. The boring parts - validation, error correction, fallbacks, versioning, audit trails - eat up 80% of the time and become the critical factor in deciding whether your Generative UI agent reaches production or dies trying. OpenUI (open source) handles the rendering. OpenUI Cloud handles that 80% nobody should have to rebuild. > npx @openuidev/cli@latest create

Rabi Shanker Guha

46,778 次观看 • 5 天前