Загрузка видео...

Не удалось загрузить видео

На главную

Woah, Gaussian splats in mixed reality look so good! Tech stack: lichtfeld studio for splattering training, virtual desktop for PC VR streaming and passthrough MR using a virtual green screen, gracia for VR splat rendering using the green screen background feature

Azadux's profile picture

Azad Balabanian

11,519 subscribers

38,080 просмотров • 4 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

The greatest Gaussian Splatting VR demo ever? Captured live at NVIDIA GTC — Mariya Sha experiencing 4D Gaussian Splatting in VR for the very first time. You can tell just from her reaction that this was something else! The scene was optimized using QUEEN, NVIDIA AI Developer's advanced research project for fast radiance field rendering. It’s an incredible look at what happens when high fidelity static and dynamic gaussian splats meets VR. Watch the full video on YouTube: Robert Scoble Did you get to do this one? #VR #3D #VFX
0:47

The greatest Gaussian Splatting VR demo ever? Captured live at NVIDIA GTC — Mariya Sha experiencing 4D Gaussian Splatting in VR for the very first time. You can tell just from her reaction that this was something else! The scene was optimized using QUEEN, NVIDIA AI Developer's advanced research project for fast radiance field rendering. It’s an incredible look at what happens when high fidelity static and dynamic gaussian splats meets VR. Watch the full video on YouTube: Robert Scoble Did you get to do this one? #VR #3D #VFX

Jonathan Stephens

28,114 просмотров • 1 год назад

🟦 CLEAN FEED | After over 20 years using virtual sets and green screen technology, ITV News has switched to using a physical set, in its Studio 1 facility at ITN, which it now shares with Good Morning Britain. But graphics and set backdrop visuals remain largely unchanged.
0:49

🟦 CLEAN FEED | After over 20 years using virtual sets and green screen technology, ITV News has switched to using a physical set, in its Studio 1 facility at ITN, which it now shares with Good Morning Britain. But graphics and set backdrop visuals remain largely unchanged.

The TV Room

84,954 просмотров • 6 месяцев назад

It's so easy for NASA to fake "space" using just a few wires, harnesses, and green-screen CGI. 🎥🧑‍🚀
2:11

It's so easy for NASA to fake "space" using just a few wires, harnesses, and green-screen CGI. 🎥🧑‍🚀

FLAT OUT TRUTH

73,185 просмотров • 1 год назад

Last week we got a peek at what Andy Orsow achieves using only two lights for his green screen studio in Oregon. Let's compare the five light setup for our projection studio in California.
3:39

Last week we got a peek at what Andy Orsow achieves using only two lights for his green screen studio in Oregon. Let's compare the five light setup for our projection studio in California.

Joseph Todaro

11,349 просмотров • 2 месяцев назад

Virtual production with your iPhone?📱 ✅ Shoot on or off green screen ✅ Unreal Engine 5 environments ✅ Cloud rendering & pixel streaming And now… 💡 realistic AI relighting of your subjects! Stoked for Skyglass 2.0 - out next week ⤵️
0:28

Virtual production with your iPhone?📱 ✅ Shoot on or off green screen ✅ Unreal Engine 5 environments ✅ Cloud rendering & pixel streaming And now… 💡 realistic AI relighting of your subjects! Stoked for Skyglass 2.0 - out next week ⤵️

Bilawal Sidhu

40,928 просмотров • 2 лет назад

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.
1:10

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

MrNeRF

66,016 просмотров • 9 месяцев назад

Painting with 3D Gaussian Splat Brushes Contributions: • Designing a set of interactive tools and brush parameters for artistic brush creation and control using 3DGS content. • Computing oriented 3D Gaussian splat brushes for stamp-based painting on 3D surfaces represented as meshes or 3DGS scenes. • Deforming the splats in a brush stamp to ensure a smooth appearance of the painted 3D stroke. • Producing seamless brush strokes despite overlapping brush stamps, using diffusion inpainting. • Efficient modeling and rendering of brush strokes to facilitate 3DGS painting in real time.
0:27

Painting with 3D Gaussian Splat Brushes Contributions: • Designing a set of interactive tools and brush parameters for artistic brush creation and control using 3DGS content. • Computing oriented 3D Gaussian splat brushes for stamp-based painting on 3D surfaces represented as meshes or 3DGS scenes. • Deforming the splats in a brush stamp to ensure a smooth appearance of the painted 3D stroke. • Producing seamless brush strokes despite overlapping brush stamps, using diffusion inpainting. • Efficient modeling and rendering of brush strokes to facilitate 3DGS painting in real time.

MrNeRF

22,958 просмотров • 1 год назад

Look at how crispy this 3d gaussian splat came out! The reflections in the painting have me floored. Captured with a Sony a7iii camera and 18mm lens. I posed the imagery using epic's reality capture and trained it with lichtfeld studio. Lichtfeld is my new favorite way to train splats -- it integrates all the latest research and it’s completely free. Also what I love about 3d capture -- you can process old datasets with new algorithms and breathe new life into them.
0:27

Look at how crispy this 3d gaussian splat came out! The reflections in the painting have me floored. Captured with a Sony a7iii camera and 18mm lens. I posed the imagery using epic's reality capture and trained it with lichtfeld studio. Lichtfeld is my new favorite way to train splats -- it integrates all the latest research and it’s completely free. Also what I love about 3d capture -- you can process old datasets with new algorithms and breathe new life into them.

Bilawal Sidhu

78,613 просмотров • 4 месяцев назад

FOR VTUBERS WHO (like me) HAVE BEEN USING GREEN SCREEN - STOP DOING THAT AND DO THIS I know it's pretty common knowledge but I literally did not know about this button on vtube studio for a year
0:45

FOR VTUBERS WHO (like me) HAVE BEEN USING GREEN SCREEN - STOP DOING THAT AND DO THIS I know it's pretty common knowledge but I literally did not know about this button on vtube studio for a year

Inanna Bell 🍵🔔 【Fairy VTuber】

172,174 просмотров • 1 год назад

Apple Vision Pro’s M5 decoder is freaking insane for wireless PC VR 4K x 4K per eye HEVC, 10-Bit, at 120hz. With no struggle at all.. even while screen recording this clip and using the wacky breakthrough features
0:35

Apple Vision Pro’s M5 decoder is freaking insane for wireless PC VR 4K x 4K per eye HEVC, 10-Bit, at 120hz. With no struggle at all.. even while screen recording this clip and using the wacky breakthrough features

Brad Lynch

480,670 просмотров • 8 месяцев назад

Spark 2.0 is here! 🚀 We’re redefining what’s possible on the web with a streamable LoD system for 3D Gaussian Splatting. Built on Three.js, you can now stream massive 100M+ splat worlds to any device from mobile to VR using WebGL2. All open-source. Dive into the tech 👇
0:39

Spark 2.0 is here! 🚀 We’re redefining what’s possible on the web with a streamable LoD system for 3D Gaussian Splatting. Built on Three.js, you can now stream massive 100M+ splat worlds to any device from mobile to VR using WebGL2. All open-source. Dive into the tech 👇

spark

417,722 просмотров • 3 месяцев назад

🚀🚀 First Virtual Reality in Endoscopy Training in Czech! 🎮🩺 🙏 to Boston Scientific, Motol Hospital, Charles University, and 3NDO for the incredible support! 🙌 Advancing education and innovation in endoscopy! 🌍✨ #GiTwitter #MedTwitter #Endoscopy #VR #AppleVisionPro
0:27

🚀🚀 First Virtual Reality in Endoscopy Training in Czech! 🎮🩺 🙏 to Boston Scientific, Motol Hospital, Charles University, and 3NDO for the incredible support! 🙌 Advancing education and innovation in endoscopy! 🌍✨ #GiTwitter #MedTwitter #Endoscopy #VR #AppleVisionPro

Jan Král

17,186 просмотров • 1 год назад

Reminder that this Tuesday is the 1551 concert. Here's a comparison to 1551 album music I did for a test. (ignore the bits of green and the creepy pic in the background. Just needed something for green screen testing and will hammer it all out lol)
0:35

Reminder that this Tuesday is the 1551 concert. Here's a comparison to 1551 album music I did for a test. (ignore the bits of green and the creepy pic in the background. Just needed something for green screen testing and will hammer it all out lol)

Jeremy Dooley

18,831 просмотров • 8 месяцев назад

For people who don’t get the 2D gaming on virtual monitors in VR use case: HMDs have the potential to be the ultimate monitor for any content. Any aspect ratio, any resolution, any size, it’s all “native” in vr I get to play my game on a massive screen while I have spatial awareness, see my wife, take a sip of coffee, and have depth correct rendering content in my room. If and when I choose to, I can “turn off” my surrounds and go into a virtual environment. It’s MR by default, VR by choice Nobody has really taken this use case all that seriously and optimized the hardware/software around it. Now, it seems like Valve is. Also some context: I’m streaming SW Jedi Fallen Order at 4k 90fps my PC to my Vision Pro, and playing the audio thru my surround sound speakers. It’s the best of ALL worlds
0:20

For people who don’t get the 2D gaming on virtual monitors in VR use case: HMDs have the potential to be the ultimate monitor for any content. Any aspect ratio, any resolution, any size, it’s all “native” in vr I get to play my game on a massive screen while I have spatial awareness, see my wife, take a sip of coffee, and have depth correct rendering content in my room. If and when I choose to, I can “turn off” my surrounds and go into a virtual environment. It’s MR by default, VR by choice Nobody has really taken this use case all that seriously and optimized the hardware/software around it. Now, it seems like Valve is. Also some context: I’m streaming SW Jedi Fallen Order at 4k 90fps my PC to my Vision Pro, and playing the audio thru my surround sound speakers. It’s the best of ALL worlds

Azad Balabanian

616,738 просмотров • 8 месяцев назад

Testing the Insta360 X5 for gaussian splatting. Kensal Green Cemetery, London. Trained in Brush and running around with a PS5 controller in Unity using Aras Pranckevičius 🇺🇦🇱🇹 plugin. #gaussiansplatting #3DGS
1:43

Testing the Insta360 X5 for gaussian splatting. Kensal Green Cemetery, London. Trained in Brush and running around with a PS5 controller in Unity using Aras Pranckevičius 🇺🇦🇱🇹 plugin. #gaussiansplatting #3DGS

grade eterna

37,020 просмотров • 1 год назад

If you're looking to master 3D Compositing for Virtual Production in Unreal Engine with Composure, veteran VFX artist Dean Yurke - Unreal Engine and VFX Filmmaking has the green screen and CG character integration insights you need🎥 Retain plate shadows, embed video in Fog and VDBs, hold out your plate with the environment—all in real-time and in context. Check out the multi-episode series exploring low cost virtual production using the new camera mapping workflow in Composure here:
0:52

If you're looking to master 3D Compositing for Virtual Production in Unreal Engine with Composure, veteran VFX artist Dean Yurke - Unreal Engine and VFX Filmmaking has the green screen and CG character integration insights you need🎥 Retain plate shadows, embed video in Fog and VDBs, hold out your plate with the environment—all in real-time and in context. Check out the multi-episode series exploring low cost virtual production using the new camera mapping workflow in Composure here:

Unreal Engine

23,093 просмотров • 3 месяцев назад

I made ‘Shadow of the Czar’ in ~6 weeks for World Labs launch, including screenplay, environments, audio, VFX, green screen shoots, gameplay, engineering & more using Marble + spark Sneak a peek behind-the-scenes now… 🔎🕵️
1:55

I made ‘Shadow of the Czar’ in ~6 weeks for World Labs launch, including screenplay, environments, audio, VFX, green screen shoots, gameplay, engineering & more using Marble + spark Sneak a peek behind-the-scenes now… 🔎🕵️

jamesckane

40,995 просмотров • 7 месяцев назад

SqueezeMe: Efficient Gaussian Avatars for VR TL;DR: Three of these Gaussian Splatting avatars can be run at 72 frames per second. It runs locally on a Meta Quest 3 VR headset. Abstract (excerpt): While previous methods require a desktop GPU for real-time inference of a single avatar, we aim to squeeze multiple Gaussian avatars onto a portable virtual reality headset with real-time drivable inference. We begin by training a previous work, Animatable Gaussians, on a high-quality dataset captured with 512 cameras. The Gaussians are animated by controlling a base set of Gaussians with linear blend skinning (LBS) motion, and then further adjusting them with a neural network decoder to correct their appearance. When deploying the model on a Meta Quest 3 VR headset, we find two major computational bottlenecks: the decoder and the rendering. To accelerate the decoder, we train the Gaussians in UV-space instead of pixel-space and distill the decoder to a single neural network layer. Further, we discover that neighborhoods of Gaussians can share a single corrective from the decoder, providing an additional speedup. To accelerate the rendering, we develop a custom pipeline in Vulkan that runs on the mobile GPU. Putting it all together, we run 3 Gaussian avatars concurrently at 72 FPS on a VR headset.
0:38

SqueezeMe: Efficient Gaussian Avatars for VR TL;DR: Three of these Gaussian Splatting avatars can be run at 72 frames per second. It runs locally on a Meta Quest 3 VR headset. Abstract (excerpt): While previous methods require a desktop GPU for real-time inference of a single avatar, we aim to squeeze multiple Gaussian avatars onto a portable virtual reality headset with real-time drivable inference. We begin by training a previous work, Animatable Gaussians, on a high-quality dataset captured with 512 cameras. The Gaussians are animated by controlling a base set of Gaussians with linear blend skinning (LBS) motion, and then further adjusting them with a neural network decoder to correct their appearance. When deploying the model on a Meta Quest 3 VR headset, we find two major computational bottlenecks: the decoder and the rendering. To accelerate the decoder, we train the Gaussians in UV-space instead of pixel-space and distill the decoder to a single neural network layer. Further, we discover that neighborhoods of Gaussians can share a single corrective from the decoder, providing an additional speedup. To accelerate the rendering, we develop a custom pipeline in Vulkan that runs on the mobile GPU. Putting it all together, we run 3 Gaussian avatars concurrently at 72 FPS on a VR headset.

MrNeRF

27,104 просмотров • 1 год назад

dope 3d tech: mixed reality flight simulators are easier than ever using a Quest 3 headset + mil-sim video games like DCS. your real-life joystick & controls are composited into the cockpit of your virtual jet fighter – all so you can take a sip of Mt. Dew and cue 'Top Gun Anthem' for the umpteenth time 😎 video credit: yokohvr on tiktok
0:34

dope 3d tech: mixed reality flight simulators are easier than ever using a Quest 3 headset + mil-sim video games like DCS. your real-life joystick & controls are composited into the cockpit of your virtual jet fighter – all so you can take a sip of Mt. Dew and cue 'Top Gun Anthem' for the umpteenth time 😎 video credit: yokohvr on tiktok

Bilawal Sidhu

56,500 просмотров • 2 лет назад

I'm excited to share the Geo Register Plugin for LichtFeld Studio from the LichtFeld community! This plugin helps bring Gaussian splat scenes into real-world geographic space. It registers a scene to WGS-84 and ECEF coordinates, so you can click any point on the model and get its latitude, longitude and altitude. It supports multiple georeferencing sources, including EXIF GPS data, image position CSVs, RealityScan camera parameters and saved similarity transforms. Once the scene is registered, you can export geo-referenced splat models as LAS, LAZ or 3D Tiles datasets for use in GIS and 3D mapping workflows. Built for anyone working with drone data, photogrammetry, Gaussian splatting, GIS, ArcGIS or CesiumJS. Link in the comment below!
0:22

I'm excited to share the Geo Register Plugin for LichtFeld Studio from the LichtFeld community! This plugin helps bring Gaussian splat scenes into real-world geographic space. It registers a scene to WGS-84 and ECEF coordinates, so you can click any point on the model and get its latitude, longitude and altitude. It supports multiple georeferencing sources, including EXIF GPS data, image position CSVs, RealityScan camera parameters and saved similarity transforms. Once the scene is registered, you can export geo-referenced splat models as LAS, LAZ or 3D Tiles datasets for use in GIS and 3D mapping workflows. Built for anyone working with drone data, photogrammetry, Gaussian splatting, GIS, ArcGIS or CesiumJS. Link in the comment below!

MrNeRF

51,473 просмотров • 2 месяцев назад