Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

CLiFT Compressive Light-Field Tokens for Compute-Efficient and Adaptive Neural Rendering

_akhaliq's profile picture

AK

507,890 subscribers

29,347 Aufrufe • vor 11 Monaten •via X (Twitter)

Wissenschaft & TechnologieBildung
LIVE

Anya Rossi• Live Now

Private livecam show

2 Kommentare

Profilbild von AK
AKvor 11 Monaten

discuss with author:

Profilbild von Himanshu Kumar
Himanshu Kumarvor 11 Monaten

Interesting. Isn't compression often at odds with neural network quality though?

Ähnliche Videos

Check out the Neural Graph Mapping for Dense SLAM with Efficient Loop Closure paper by Leonard Bruns, Jun Zhang, and Patric Jensfelt, visualized with Rerun. “Existing neural field-based SLAM methods typically employ a single monolithic field as their scene representation. This prevents efficient incorporation of loop closure constraints and limits scalability. To address these shortcomings, we propose a neural mapping framework which anchors lightweight neural fields to the pose graph of a sparse visual SLAM system.”
0:37

Check out the Neural Graph Mapping for Dense SLAM with Efficient Loop Closure paper by Leonard Bruns, Jun Zhang, and Patric Jensfelt, visualized with Rerun. “Existing neural field-based SLAM methods typically employ a single monolithic field as their scene representation. This prevents efficient incorporation of loop closure constraints and limits scalability. To address these shortcomings, we propose a neural mapping framework which anchors lightweight neural fields to the pose graph of a sparse visual SLAM system.”

Rerun

12,865 Aufrufe • vor 2 Jahren

Real-Time Neural Light Field on Mobile Devices abs: project page:
0:27

Real-Time Neural Light Field on Mobile Devices abs: project page:

AK

56,225 Aufrufe • vor 3 Jahren

Going to #CVPR2023 ? Checkout our tutorial on Efficient Neural Networks: From Algorithm Design to Practical Mobile Deployment. We’ll do a deep dive into mobile transformers, mobile neural rendering and SnapFusion--the fastest mobile text-to-image model. Our content in 32 seconds
0:32

Going to #CVPR2023 ? Checkout our tutorial on Efficient Neural Networks: From Algorithm Design to Practical Mobile Deployment. We’ll do a deep dive into mobile transformers, mobile neural rendering and SnapFusion--the fastest mobile text-to-image model. Our content in 32 seconds

Sergey Tulyakov

23,365 Aufrufe • vor 3 Jahren

Implicit Neural Light Spheres lets you turn panoramic captures into dynamic wide FOV renders (with real-time rendering!). Instead of generating panoramas with image stitching, we use neural light spheres to jointly estimate the camera path and a high-resolution scene reconstruction to produce novel wide field-of-view projections of the environment. Code, data, and info: Amazing work with Ilya Chugunov, Amogh Joshi, Kiran Murthy, François Bleibel
0:51

Implicit Neural Light Spheres lets you turn panoramic captures into dynamic wide FOV renders (with real-time rendering!). Instead of generating panoramas with image stitching, we use neural light spheres to jointly estimate the camera path and a high-resolution scene reconstruction to produce novel wide field-of-view projections of the environment. Code, data, and info: Amazing work with Ilya Chugunov, Amogh Joshi, Kiran Murthy, François Bleibel

Felix Heide

10,300 Aufrufe • vor 1 Jahr

Google presents RadSplat Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPS Recent advances in view synthesis and real-time rendering have achieved photorealistic quality at impressive rendering speeds. While Radiance Field-based
0:49

Google presents RadSplat Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPS Recent advances in view synthesis and real-time rendering have achieved photorealistic quality at impressive rendering speeds. While Radiance Field-based

AK

139,521 Aufrufe • vor 2 Jahren

🚀 Introducing DiffusionRenderer, a neural rendering engine powered by video diffusion models. 🎥 Estimates high-quality geometry and materials from videos, synthesizes photorealistic light transport, enables relighting and material editing with realistic shadows and reflections
2:14

🚀 Introducing DiffusionRenderer, a neural rendering engine powered by video diffusion models. 🎥 Estimates high-quality geometry and materials from videos, synthesizes photorealistic light transport, enables relighting and material editing with realistic shadows and reflections

Zian Wang

125,404 Aufrufe • vor 1 Jahr

Rendering a 125GB Protomaps vector tile dataset dynamically in Three.js using compute passes and workers
0:21

Rendering a 125GB Protomaps vector tile dataset dynamically in Three.js using compute passes and workers

Three.js

80,834 Aufrufe • vor 1 Monat

vMAP: Vectorised Object Mapping for Neural Field SLAM abs: project page:
2:41

vMAP: Vectorised Object Mapping for Neural Field SLAM abs: project page:

AK

36,137 Aufrufe • vor 3 Jahren

Tokens are the new commodity, and compute is revenue, says Jensen Huang.
2:12

Tokens are the new commodity, and compute is revenue, says Jensen Huang.

Yahoo Finance

6,237,005 Aufrufe • vor 3 Monaten

Excited to share Norman Müller's DiffRF: Rendering-guided 3D Radiance Field Diffusion #CVPR2023 highlight! 2D diffusion is great, but what about 3D? We show radiance field diffusion with rendering guidance for consistent and editable 3D synthesis. Vid:
0:27

Excited to share Norman Müller's DiffRF: Rendering-guided 3D Radiance Field Diffusion #CVPR2023 highlight! 2D diffusion is great, but what about 3D? We show radiance field diffusion with rendering guidance for consistent and editable 3D synthesis. Vid:

Matthias Niessner

118,156 Aufrufe • vor 3 Jahren

Light-X Generative 4D Video Rendering with Camera and Illumination Control
1:00

Light-X Generative 4D Video Rendering with Camera and Illumination Control

AK

31,126 Aufrufe • vor 7 Monaten

Nvidia and UC San Diego announce What You See is What You GAN Rendering Every Pixel for High-Fidelity Geometry in 3D GANs paper page: scale neural volume rendering to high resolution by rendering every pixel to ensure that "what you see in 2D, is what you get in 3D"
3:11

Nvidia and UC San Diego announce What You See is What You GAN Rendering Every Pixel for High-Fidelity Geometry in 3D GANs paper page: scale neural volume rendering to high resolution by rendering every pixel to ensure that "what you see in 2D, is what you get in 3D"

AK

127,419 Aufrufe • vor 2 Jahren

EasyVolcap from Zhen Xu and Xiaowei Zhou is here! It's a unified open-source Pytorch library for accelerating neural volumetric video capturing, reconstruction, and rendering, akin to nerfstudio but tailored for 4D applications. 🔗
0:42

EasyVolcap from Zhen Xu and Xiaowei Zhou is here! It's a unified open-source Pytorch library for accelerating neural volumetric video capturing, reconstruction, and rendering, akin to nerfstudio but tailored for 4D applications. 🔗

Radiance Fields

10,611 Aufrufe • vor 2 Jahren

Introducing the new era of rendering, powered by GeForce RTX 50 Series and AI ‘Zorah’ is our new groundbreaking RTX neural rendering tech demo that highlights the latest innovations in shader, geometry, lighting and character technologies. #CES2025
1:36

Introducing the new era of rendering, powered by GeForce RTX 50 Series and AI ‘Zorah’ is our new groundbreaking RTX neural rendering tech demo that highlights the latest innovations in shader, geometry, lighting and character technologies. #CES2025

NVIDIA GeForce

117,165 Aufrufe • vor 1 Jahr

EEVEE is extremely efficient for Vector Displacement 🔥 Perfect for previewing oceans in real-time before switching to Cycles for final rendering 🌊 #b3d
0:36

EEVEE is extremely efficient for Vector Displacement 🔥 Perfect for previewing oceans in real-time before switching to Cycles for final rendering 🌊 #b3d

Thomas Marcos

16,348 Aufrufe • vor 5 Monaten

City-on-Web: Real-time Neural Rendering of Large-scale Scenes on the Web paper page: enables real-time neural rendering of large-scale scenes over web using laptop GPUs. The result is tested on the NVIDIA RTX 3060 Laptop GPU with 1920x1080 resolution
0:23

City-on-Web: Real-time Neural Rendering of Large-scale Scenes on the Web paper page: enables real-time neural rendering of large-scale scenes over web using laptop GPUs. The result is tested on the NVIDIA RTX 3060 Laptop GPU with 1920x1080 resolution

AK

79,439 Aufrufe • vor 2 Jahren

3. jamie building AIWS AIWS is an infrastructure platform that enables AI agents to deploy themselves onto decentralized compute instances and pay for their own computational resources using tokens. jamie demonstrates this by showing how joi 🌸 could deploy itself to its own cloud instance, purchase aiws tokens to pay for compute, and manage its own hosting infrastructure autonomously.
14:31

3. jamie building AIWS AIWS is an infrastructure platform that enables AI agents to deploy themselves onto decentralized compute instances and pay for their own computational resources using tokens. jamie demonstrates this by showing how joi 🌸 could deploy itself to its own cloud instance, purchase aiws tokens to pay for compute, and manage its own hosting infrastructure autonomously.

nader dabit

15,479 Aufrufe • vor 1 Jahr