Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

CLiFT Compressive Light-Field Tokens for Compute-Efficient and Adaptive Neural Rendering

AK

512,017 subscribers

29,378 views • 1 year ago •via X (Twitter)

Science & Technology Education

Anya Rossi• Live Now

Private livecam show

2 Comments

AK1 year ago

discuss with author:

Himanshu Kumar1 year ago

Interesting. Isn't compression often at odds with neural network quality though?

Related Videos

Check out the Neural Graph Mapping for Dense SLAM with Efficient Loop Closure paper by Leonard Bruns, Jun Zhang, and Patric Jensfelt, visualized with Rerun. “Existing neural field-based SLAM methods typically employ a single monolithic field as their scene representation. This prevents efficient incorporation of loop closure constraints and limits scalability. To address these shortcomings, we propose a neural mapping framework which anchors lightweight neural fields to the pose graph of a sparse visual SLAM system.”

Check out the Neural Graph Mapping for Dense SLAM with Efficient Loop Closure paper by Leonard Bruns, Jun Zhang, and Patric Jensfelt, visualized with Rerun. “Existing neural field-based SLAM methods typically employ a single monolithic field as their scene representation. This prevents efficient incorporation of loop closure constraints and limits scalability. To address these shortcomings, we propose a neural mapping framework which anchors lightweight neural fields to the pose graph of a sparse visual SLAM system.”

Rerun

12,865 views • 2 years ago

Real-Time Neural Light Field on Mobile Devices abs: project page:

Real-Time Neural Light Field on Mobile Devices abs: project page:

AK

56,225 views • 3 years ago

Going to #CVPR2023 ? Checkout our tutorial on Efficient Neural Networks: From Algorithm Design to Practical Mobile Deployment. We’ll do a deep dive into mobile transformers, mobile neural rendering and SnapFusion--the fastest mobile text-to-image model. Our content in 32 seconds

Going to #CVPR2023 ? Checkout our tutorial on Efficient Neural Networks: From Algorithm Design to Practical Mobile Deployment. We’ll do a deep dive into mobile transformers, mobile neural rendering and SnapFusion--the fastest mobile text-to-image model. Our content in 32 seconds

Sergey Tulyakov

23,365 views • 3 years ago

Implicit Neural Light Spheres lets you turn panoramic captures into dynamic wide FOV renders (with real-time rendering!). Instead of generating panoramas with image stitching, we use neural light spheres to jointly estimate the camera path and a high-resolution scene reconstruction to produce novel wide field-of-view projections of the environment. Code, data, and info: Amazing work with Ilya Chugunov, Amogh Joshi, Kiran Murthy, François Bleibel

Implicit Neural Light Spheres lets you turn panoramic captures into dynamic wide FOV renders (with real-time rendering!). Instead of generating panoramas with image stitching, we use neural light spheres to jointly estimate the camera path and a high-resolution scene reconstruction to produce novel wide field-of-view projections of the environment. Code, data, and info: Amazing work with Ilya Chugunov, Amogh Joshi, Kiran Murthy, François Bleibel

Felix Heide

10,301 views • 1 year ago

Google presents RadSplat Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPS Recent advances in view synthesis and real-time rendering have achieved photorealistic quality at impressive rendering speeds. While Radiance Field-based

Google presents RadSplat Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPS Recent advances in view synthesis and real-time rendering have achieved photorealistic quality at impressive rendering speeds. While Radiance Field-based

AK

139,521 views • 2 years ago

🚀 Introducing DiffusionRenderer, a neural rendering engine powered by video diffusion models. 🎥 Estimates high-quality geometry and materials from videos, synthesizes photorealistic light transport, enables relighting and material editing with realistic shadows and reflections

🚀 Introducing DiffusionRenderer, a neural rendering engine powered by video diffusion models. 🎥 Estimates high-quality geometry and materials from videos, synthesizes photorealistic light transport, enables relighting and material editing with realistic shadows and reflections

Zian Wang

125,452 views • 1 year ago

Rendering a 125GB Protomaps vector tile dataset dynamically in Three.js using compute passes and workers

Rendering a 125GB Protomaps vector tile dataset dynamically in Three.js using compute passes and workers

Three.js

80,834 views • 1 month ago

vMAP: Vectorised Object Mapping for Neural Field SLAM abs: project page:

vMAP: Vectorised Object Mapping for Neural Field SLAM abs: project page:

AK

36,137 views • 3 years ago

Tokens are the new commodity, and compute is revenue, says Jensen Huang.

Tokens are the new commodity, and compute is revenue, says Jensen Huang.

Yahoo Finance

6,237,005 views • 3 months ago

Excited to share Norman Müller's DiffRF: Rendering-guided 3D Radiance Field Diffusion #CVPR2023 highlight! 2D diffusion is great, but what about 3D? We show radiance field diffusion with rendering guidance for consistent and editable 3D synthesis. Vid:

Excited to share Norman Müller's DiffRF: Rendering-guided 3D Radiance Field Diffusion #CVPR2023 highlight! 2D diffusion is great, but what about 3D? We show radiance field diffusion with rendering guidance for consistent and editable 3D synthesis. Vid:

Matthias Niessner

118,156 views • 3 years ago

Light-X Generative 4D Video Rendering with Camera and Illumination Control

Light-X Generative 4D Video Rendering with Camera and Illumination Control

AK

31,126 views • 7 months ago

Nvidia and UC San Diego announce What You See is What You GAN Rendering Every Pixel for High-Fidelity Geometry in 3D GANs paper page: scale neural volume rendering to high resolution by rendering every pixel to ensure that "what you see in 2D, is what you get in 3D"

Nvidia and UC San Diego announce What You See is What You GAN Rendering Every Pixel for High-Fidelity Geometry in 3D GANs paper page: scale neural volume rendering to high resolution by rendering every pixel to ensure that "what you see in 2D, is what you get in 3D"

AK

127,419 views • 2 years ago

EasyVolcap from Zhen Xu and Xiaowei Zhou is here! It's a unified open-source Pytorch library for accelerating neural volumetric video capturing, reconstruction, and rendering, akin to nerfstudio but tailored for 4D applications. 🔗

EasyVolcap from Zhen Xu and Xiaowei Zhou is here! It's a unified open-source Pytorch library for accelerating neural volumetric video capturing, reconstruction, and rendering, akin to nerfstudio but tailored for 4D applications. 🔗

Radiance Fields

10,611 views • 2 years ago

Introducing the new era of rendering, powered by GeForce RTX 50 Series and AI ‘Zorah’ is our new groundbreaking RTX neural rendering tech demo that highlights the latest innovations in shader, geometry, lighting and character technologies. #CES2025

Introducing the new era of rendering, powered by GeForce RTX 50 Series and AI ‘Zorah’ is our new groundbreaking RTX neural rendering tech demo that highlights the latest innovations in shader, geometry, lighting and character technologies. #CES2025

NVIDIA GeForce

117,165 views • 1 year ago

EEVEE is extremely efficient for Vector Displacement 🔥 Perfect for previewing oceans in real-time before switching to Cycles for final rendering 🌊 #b3d

EEVEE is extremely efficient for Vector Displacement 🔥 Perfect for previewing oceans in real-time before switching to Cycles for final rendering 🌊 #b3d

Thomas Marcos

16,348 views • 5 months ago

3. jamie building AIWS AIWS is an infrastructure platform that enables AI agents to deploy themselves onto decentralized compute instances and pay for their own computational resources using tokens. jamie demonstrates this by showing how joi 🌸 could deploy itself to its own cloud instance, purchase aiws tokens to pay for compute, and manage its own hosting infrastructure autonomously.

3. jamie building AIWS AIWS is an infrastructure platform that enables AI agents to deploy themselves onto decentralized compute instances and pay for their own computational resources using tokens. jamie demonstrates this by showing how joi 🌸 could deploy itself to its own cloud instance, purchase aiws tokens to pay for compute, and manage its own hosting infrastructure autonomously.

nader dabit

15,479 views • 1 year ago