正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Woah, Gaussian splats in mixed reality look so good! Tech stack: lichtfeld studio for splattering training, virtual desktop for PC VR streaming and passthrough MR using a virtual green screen, gracia for VR splat rendering using the green screen background feature

Azad Balabanian

11,519 subscribers

38,080 次观看 • 4 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

The greatest Gaussian Splatting VR demo ever? Captured live at NVIDIA GTC — Mariya Sha experiencing 4D Gaussian Splatting in VR for the very first time. You can tell just from her reaction that this was something else! The scene was optimized using QUEEN, NVIDIA AI Developer's advanced research project for fast radiance field rendering. It’s an incredible look at what happens when high fidelity static and dynamic gaussian splats meets VR. Watch the full video on YouTube: Robert Scoble Did you get to do this one? #VR #3D #VFX

The greatest Gaussian Splatting VR demo ever? Captured live at NVIDIA GTC — Mariya Sha experiencing 4D Gaussian Splatting in VR for the very first time. You can tell just from her reaction that this was something else! The scene was optimized using QUEEN, NVIDIA AI Developer's advanced research project for fast radiance field rendering. It’s an incredible look at what happens when high fidelity static and dynamic gaussian splats meets VR. Watch the full video on YouTube: Robert Scoble Did you get to do this one? #VR #3D #VFX

Jonathan Stephens

28,114 次观看 • 1 年前

🟦 CLEAN FEED | After over 20 years using virtual sets and green screen technology, ITV News has switched to using a physical set, in its Studio 1 facility at ITN, which it now shares with Good Morning Britain. But graphics and set backdrop visuals remain largely unchanged.

🟦 CLEAN FEED | After over 20 years using virtual sets and green screen technology, ITV News has switched to using a physical set, in its Studio 1 facility at ITN, which it now shares with Good Morning Britain. But graphics and set backdrop visuals remain largely unchanged.

The TV Room

84,954 次观看 • 7 个月前

It's so easy for NASA to fake "space" using just a few wires, harnesses, and green-screen CGI. 🎥🧑‍🚀

It's so easy for NASA to fake "space" using just a few wires, harnesses, and green-screen CGI. 🎥🧑‍🚀

FLAT OUT TRUTH

73,194 次观看 • 2 年前

Last week we got a peek at what Andy Orsow achieves using only two lights for his green screen studio in Oregon. Let's compare the five light setup for our projection studio in California.

Last week we got a peek at what Andy Orsow achieves using only two lights for his green screen studio in Oregon. Let's compare the five light setup for our projection studio in California.

Joseph Todaro

11,349 次观看 • 3 个月前

Psychology at in CHI at Crumlin has partnered with Assim Kalouaz PhD candidate & Dr Brendan Rooney, Assoc Professor, Virtual Reality for Good in UCD to develop and implement Virtual Reality (VR) experiences with young people attending the hospital. Watch for more info ⤵️

Psychology at in CHI at Crumlin has partnered with Assim Kalouaz PhD candidate & Dr Brendan Rooney, Assoc Professor, Virtual Reality for Good in UCD to develop and implement Virtual Reality (VR) experiences with young people attending the hospital. Watch for more info ⤵️

Children's Health Ireland

10,620 次观看 • 3 年前

Virtual production with your iPhone?📱 ✅ Shoot on or off green screen ✅ Unreal Engine 5 environments ✅ Cloud rendering & pixel streaming And now… 💡 realistic AI relighting of your subjects! Stoked for Skyglass 2.0 - out next week ⤵️

Virtual production with your iPhone?📱 ✅ Shoot on or off green screen ✅ Unreal Engine 5 environments ✅ Cloud rendering & pixel streaming And now… 💡 realistic AI relighting of your subjects! Stoked for Skyglass 2.0 - out next week ⤵️

Bilawal Sidhu

40,928 次观看 • 2 年前

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

MrNeRF

66,016 次观看 • 9 个月前

Painting with 3D Gaussian Splat Brushes Contributions: • Designing a set of interactive tools and brush parameters for artistic brush creation and control using 3DGS content. • Computing oriented 3D Gaussian splat brushes for stamp-based painting on 3D surfaces represented as meshes or 3DGS scenes. • Deforming the splats in a brush stamp to ensure a smooth appearance of the painted 3D stroke. • Producing seamless brush strokes despite overlapping brush stamps, using diffusion inpainting. • Efficient modeling and rendering of brush strokes to facilitate 3DGS painting in real time.

Painting with 3D Gaussian Splat Brushes Contributions: • Designing a set of interactive tools and brush parameters for artistic brush creation and control using 3DGS content. • Computing oriented 3D Gaussian splat brushes for stamp-based painting on 3D surfaces represented as meshes or 3DGS scenes. • Deforming the splats in a brush stamp to ensure a smooth appearance of the painted 3D stroke. • Producing seamless brush strokes despite overlapping brush stamps, using diffusion inpainting. • Efficient modeling and rendering of brush strokes to facilitate 3DGS painting in real time.

MrNeRF

23,010 次观看 • 1 年前

Look at how crispy this 3d gaussian splat came out! The reflections in the painting have me floored. Captured with a Sony a7iii camera and 18mm lens. I posed the imagery using epic's reality capture and trained it with lichtfeld studio. Lichtfeld is my new favorite way to train splats -- it integrates all the latest research and it’s completely free. Also what I love about 3d capture -- you can process old datasets with new algorithms and breathe new life into them.

Look at how crispy this 3d gaussian splat came out! The reflections in the painting have me floored. Captured with a Sony a7iii camera and 18mm lens. I posed the imagery using epic's reality capture and trained it with lichtfeld studio. Lichtfeld is my new favorite way to train splats -- it integrates all the latest research and it’s completely free. Also what I love about 3d capture -- you can process old datasets with new algorithms and breathe new life into them.

Bilawal Sidhu

78,613 次观看 • 5 个月前

DDG finally comes clean and admits he's been using a green screen for the past 2 days pretending to be at Streamer University 💔😭

DDG finally comes clean and admits he's been using a green screen for the past 2 days pretending to be at Streamer University 💔😭

e/DDG

146,995 次观看 • 22 天前

FOR VTUBERS WHO (like me) HAVE BEEN USING GREEN SCREEN - STOP DOING THAT AND DO THIS I know it's pretty common knowledge but I literally did not know about this button on vtube studio for a year

FOR VTUBERS WHO (like me) HAVE BEEN USING GREEN SCREEN - STOP DOING THAT AND DO THIS I know it's pretty common knowledge but I literally did not know about this button on vtube studio for a year

Inanna Bell 🍵🔔 ❥❥ OTAKUTHON

172,280 次观看 • 1 年前

Apple Vision Pro’s M5 decoder is freaking insane for wireless PC VR 4K x 4K per eye HEVC, 10-Bit, at 120hz. With no struggle at all.. even while screen recording this clip and using the wacky breakthrough features

Apple Vision Pro’s M5 decoder is freaking insane for wireless PC VR 4K x 4K per eye HEVC, 10-Bit, at 120hz. With no struggle at all.. even while screen recording this clip and using the wacky breakthrough features

Brad Lynch

480,670 次观看 • 9 个月前

Spark 2.0 is here! 🚀 We’re redefining what’s possible on the web with a streamable LoD system for 3D Gaussian Splatting. Built on Three.js, you can now stream massive 100M+ splat worlds to any device from mobile to VR using WebGL2. All open-source. Dive into the tech 👇

Spark 2.0 is here! 🚀 We’re redefining what’s possible on the web with a streamable LoD system for 3D Gaussian Splatting. Built on Three.js, you can now stream massive 100M+ splat worlds to any device from mobile to VR using WebGL2. All open-source. Dive into the tech 👇

spark

418,699 次观看 • 3 个月前

🚀🚀 First Virtual Reality in Endoscopy Training in Czech! 🎮🩺 🙏 to Boston Scientific, Motol Hospital, Charles University, and 3NDO for the incredible support! 🙌 Advancing education and innovation in endoscopy! 🌍✨ #GiTwitter #MedTwitter #Endoscopy #VR #AppleVisionPro

🚀🚀 First Virtual Reality in Endoscopy Training in Czech! 🎮🩺 🙏 to Boston Scientific, Motol Hospital, Charles University, and 3NDO for the incredible support! 🙌 Advancing education and innovation in endoscopy! 🌍✨ #GiTwitter #MedTwitter #Endoscopy #VR #AppleVisionPro

Jan Král

17,186 次观看 • 1 年前

Reminder that this Tuesday is the 1551 concert. Here's a comparison to 1551 album music I did for a test. (ignore the bits of green and the creepy pic in the background. Just needed something for green screen testing and will hammer it all out lol)

Reminder that this Tuesday is the 1551 concert. Here's a comparison to 1551 album music I did for a test. (ignore the bits of green and the creepy pic in the background. Just needed something for green screen testing and will hammer it all out lol)

Jeremy Dooley

18,831 次观看 • 9 个月前

For people who don’t get the 2D gaming on virtual monitors in VR use case: HMDs have the potential to be the ultimate monitor for any content. Any aspect ratio, any resolution, any size, it’s all “native” in vr I get to play my game on a massive screen while I have spatial awareness, see my wife, take a sip of coffee, and have depth correct rendering content in my room. If and when I choose to, I can “turn off” my surrounds and go into a virtual environment. It’s MR by default, VR by choice Nobody has really taken this use case all that seriously and optimized the hardware/software around it. Now, it seems like Valve is. Also some context: I’m streaming SW Jedi Fallen Order at 4k 90fps my PC to my Vision Pro, and playing the audio thru my surround sound speakers. It’s the best of ALL worlds

For people who don’t get the 2D gaming on virtual monitors in VR use case: HMDs have the potential to be the ultimate monitor for any content. Any aspect ratio, any resolution, any size, it’s all “native” in vr I get to play my game on a massive screen while I have spatial awareness, see my wife, take a sip of coffee, and have depth correct rendering content in my room. If and when I choose to, I can “turn off” my surrounds and go into a virtual environment. It’s MR by default, VR by choice Nobody has really taken this use case all that seriously and optimized the hardware/software around it. Now, it seems like Valve is. Also some context: I’m streaming SW Jedi Fallen Order at 4k 90fps my PC to my Vision Pro, and playing the audio thru my surround sound speakers. It’s the best of ALL worlds

Azad Balabanian

616,738 次观看 • 8 个月前

Testing the Insta360 X5 for gaussian splatting. Kensal Green Cemetery, London. Trained in Brush and running around with a PS5 controller in Unity using Aras Pranckevičius 🇺🇦🇱🇹 plugin. #gaussiansplatting #3DGS

Testing the Insta360 X5 for gaussian splatting. Kensal Green Cemetery, London. Trained in Brush and running around with a PS5 controller in Unity using Aras Pranckevičius 🇺🇦🇱🇹 plugin. #gaussiansplatting #3DGS

grade eterna

37,190 次观看 • 1 年前

If you're looking to master 3D Compositing for Virtual Production in Unreal Engine with Composure, veteran VFX artist Dean Yurke - Unreal Engine and VFX Filmmaking has the green screen and CG character integration insights you need🎥 Retain plate shadows, embed video in Fog and VDBs, hold out your plate with the environment—all in real-time and in context. Check out the multi-episode series exploring low cost virtual production using the new camera mapping workflow in Composure here:

If you're looking to master 3D Compositing for Virtual Production in Unreal Engine with Composure, veteran VFX artist Dean Yurke - Unreal Engine and VFX Filmmaking has the green screen and CG character integration insights you need🎥 Retain plate shadows, embed video in Fog and VDBs, hold out your plate with the environment—all in real-time and in context. Check out the multi-episode series exploring low cost virtual production using the new camera mapping workflow in Composure here:

Unreal Engine

23,093 次观看 • 4 个月前

I made ‘Shadow of the Czar’ in ~6 weeks for World Labs launch, including screenplay, environments, audio, VFX, green screen shoots, gameplay, engineering & more using Marble + spark Sneak a peek behind-the-scenes now… 🔎🕵️

I made ‘Shadow of the Czar’ in ~6 weeks for World Labs launch, including screenplay, environments, audio, VFX, green screen shoots, gameplay, engineering & more using Marble + spark Sneak a peek behind-the-scenes now… 🔎🕵️

jamesckane

40,995 次观看 • 7 个月前

SqueezeMe: Efficient Gaussian Avatars for VR TL;DR: Three of these Gaussian Splatting avatars can be run at 72 frames per second. It runs locally on a Meta Quest 3 VR headset. Abstract (excerpt): While previous methods require a desktop GPU for real-time inference of a single avatar, we aim to squeeze multiple Gaussian avatars onto a portable virtual reality headset with real-time drivable inference. We begin by training a previous work, Animatable Gaussians, on a high-quality dataset captured with 512 cameras. The Gaussians are animated by controlling a base set of Gaussians with linear blend skinning (LBS) motion, and then further adjusting them with a neural network decoder to correct their appearance. When deploying the model on a Meta Quest 3 VR headset, we find two major computational bottlenecks: the decoder and the rendering. To accelerate the decoder, we train the Gaussians in UV-space instead of pixel-space and distill the decoder to a single neural network layer. Further, we discover that neighborhoods of Gaussians can share a single corrective from the decoder, providing an additional speedup. To accelerate the rendering, we develop a custom pipeline in Vulkan that runs on the mobile GPU. Putting it all together, we run 3 Gaussian avatars concurrently at 72 FPS on a VR headset.

MrNeRF

27,104 次观看 • 1 年前