Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

From 2 second (faster on higher end GPUs) Gaussian splat generations, using Apple's "Sharp Monocular View Synthesis in Less Than a Second" code, running locally on my system. Imported into Octane Render 2026 which has fully path traced rendering of Gaussian splats. Stuff like this is why I've been...

MartinNebelong's profile picture

Martin Nebelong

33,760 subscribers

36,774 Aufrufe • vor 5 Monaten •via X (Twitter)

KunstWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

A few environments, created locally on my PC in a few seconds each using that cool new Apple image to Gaussian splat tech, stitched together and lit in Octane Render 2026 and combined with a few models made using Hyper3D by Deemos Rodin. Next year is bound to be the year of Generative 3d.
0:58

A few environments, created locally on my PC in a few seconds each using that cool new Apple image to Gaussian splat tech, stitched together and lit in Octane Render 2026 and combined with a few models made using Hyper3D by Deemos Rodin. Next year is bound to be the year of Generative 3d.

Martin Nebelong

10,485 Aufrufe • vor 5 Monaten

Gaussian Splatting in VR, all code written by me from scratch on DX12 + OpenVR. 2x2016x2240 res, no clever multi-view stuff yet so just running the whole render pipeline once per eye. Left the frame timer on so you can see I've been truthful about my perf :D
1:00

Gaussian Splatting in VR, all code written by me from scratch on DX12 + OpenVR. 2x2016x2240 res, no clever multi-view stuff yet so just running the whole render pipeline once per eye. Left the frame timer on so you can see I've been truthful about my perf :D

Charlie Shenton

121,776 Aufrufe • vor 2 Jahren

From 2D video to a very rough 4D Gaussian Splatting POC on the Apple Vision Pro 👀 Took Big Buck Bunny frames, turned them into Gaussian splats with Sharp (Apple), compressed them with PlayCanvas splat transform to SOG, and played all frames via WebXR + spark Still rough and not fully optimized, but wow, dynamic GS in AVP feels wild 🤯 Second part of the video is on my laptop #threejs
0:29

From 2D video to a very rough 4D Gaussian Splatting POC on the Apple Vision Pro 👀 Took Big Buck Bunny frames, turned them into Gaussian splats with Sharp (Apple), compressed them with PlayCanvas splat transform to SOG, and played all frames via WebXR + spark Still rough and not fully optimized, but wow, dynamic GS in AVP feels wild 🤯 Second part of the video is on my laptop #threejs

Stijn Spanhove

20,127 Aufrufe • vor 5 Monaten

Another AI Experiment. Using SHARP, Apple's ML framework - magical stuff. 2D Images to 3D Gaussian splats. Plotted and flown in Three.js
0:57

Another AI Experiment. Using SHARP, Apple's ML framework - magical stuff. 2D Images to 3D Gaussian splats. Plotted and flown in Three.js

M. Ali Kapadia

26,845 Aufrufe • vor 3 Monaten

Happy to announce the results of our latest research, which takes 3D Gaussian Splatting to the next level: "A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasets," which has been accepted at #SIGGRAPH2024!🎉 Find it here:
1:40

Happy to announce the results of our latest research, which takes 3D Gaussian Splatting to the next level: "A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasets," which has been accepted at #SIGGRAPH2024!🎉 Find it here:

Bernhard Kerbl

356,188 Aufrufe • vor 2 Jahren

I've implemented a Gaussian Splatting renderer in VRChat! It was tricky, but turned out to be feasible. I've also made a public gallery with 12 splats you can check out: By the way the renderer is open source!
1:46

I've implemented a Gaussian Splatting renderer in VRChat! It was tricky, but turned out to be feasible. I've also made a public gallery with 12 splats you can check out: By the way the renderer is open source!

Mykhailo Moroz

45,776 Aufrufe • vor 11 Monaten

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.
0:20

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.

MrNeRF

27,275 Aufrufe • vor 1 Jahr

Made this massive gaussian splat scene with World Labs which just launched in beta This is 7 image-to-world generations, 6.5M splats in total.
1:27

Made this massive gaussian splat scene with World Labs which just launched in beta This is 7 image-to-world generations, 6.5M splats in total.

Evan Jones

27,614 Aufrufe • vor 8 Monaten

Experimenting with Gaussian splatting as a scene representation for monocular autonomous driving. visualization using Rerun running through a custom Apple ML-Sharp based pipeline..
0:43

Experimenting with Gaussian splatting as a scene representation for monocular autonomous driving. visualization using Rerun running through a custom Apple ML-Sharp based pipeline..

Jaskirat Singh

18,719 Aufrufe • vor 5 Monaten

Getting my hands dirty with 30 Gaussian splats scanned in my garden. Is this the most splats ever in a single shot? Made with the support of Lenovo Snapdragon and the new Gaussian Splatting plugin by irrealix
0:37

Getting my hands dirty with 30 Gaussian splats scanned in my garden. Is this the most splats ever in a single shot? Made with the support of Lenovo Snapdragon and the new Gaussian Splatting plugin by irrealix

Paul Trillo

90,911 Aufrufe • vor 1 Jahr

DiffSplat Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation DiffSplat is a generative framework to synthesize 3D Gaussian Splats from text prompts & single-view images in ⚡️ 1~2 seconds. It is fine-tuned directly from a pretrained text-to-image diffusion model.
0:24

DiffSplat Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation DiffSplat is a generative framework to synthesize 3D Gaussian Splats from text prompts & single-view images in ⚡️ 1~2 seconds. It is fine-tuned directly from a pretrained text-to-image diffusion model.

AK

38,416 Aufrufe • vor 1 Jahr

Meta AI strikes again, with Relightable Gaussian Codec Avatars This is an update to the Meta Codec Avatars 2.0, building on 3D Gaussian Splatting. As a result, we get fully relightable real-time avatars, accurate at the hair strand level 🤯 More details below ⬇️⬇️
0:27

Meta AI strikes again, with Relightable Gaussian Codec Avatars This is an update to the Meta Codec Avatars 2.0, building on 3D Gaussian Splatting. As a result, we get fully relightable real-time avatars, accurate at the hair strand level 🤯 More details below ⬇️⬇️

Alex Carlier

445,646 Aufrufe • vor 2 Jahren

Code released: "GaussianObject: Just Taking Four Images to Get A High-Quality 3D Object with Gaussian Splatting"
1:10

Code released: "GaussianObject: Just Taking Four Images to Get A High-Quality 3D Object with Gaussian Splatting"

MrNeRF

22,119 Aufrufe • vor 2 Jahren

Our new Gaussian point splatting renders huge 3DGS scenes in real time (e.g. 425 M⬇️). It samples pixel-sized points from the Gaussians with massive parallelism and splats them to the screen using 64-bit atomics. Grab ACM SIGGRAPH 2026 paper+code+video now:
0:24

Our new Gaussian point splatting renders huge 3DGS scenes in real time (e.g. 425 M⬇️). It samples pixel-sized points from the Gaussians with massive parallelism and splats them to the screen using 64-bit atomics. Grab ACM SIGGRAPH 2026 paper+code+video now:

Christoph Peters

22,195 Aufrufe • vor 19 Tagen

New paper from Apple - Sharp Monocular View Synthesis in Less than a Second Mescheder et al. @ Apple just released a very impressive paper (congrats! 🎉🥳). You give it an image and it generates a really great looking 3d Gaussian representation. Uses depth pro. It's really good. The model is about 3GB, and takes ~5-10s on my M1 Max per image. Single feedforward pass network. The video is using "Metal Splatter" to view the .ply from ml-sharp on Apple Vision Pro. Some really wow moments today trying it on different scenes.
0:22

New paper from Apple - Sharp Monocular View Synthesis in Less than a Second Mescheder et al. @ Apple just released a very impressive paper (congrats! 🎉🥳). You give it an image and it generates a really great looking 3d Gaussian representation. Uses depth pro. It's really good. The model is about 3GB, and takes ~5-10s on my M1 Max per image. Single feedforward pass network. The video is using "Metal Splatter" to view the .ply from ml-sharp on Apple Vision Pro. Some really wow moments today trying it on different scenes.

Tim Davison ᯅ

132,673 Aufrufe • vor 5 Monaten

3D scanning and rendering is moving so fast - got my splats up and running and I'm mind blown getting ~100fps for this complex 3D scene ⬇️ 🤯 1. WAY faster than NeRF: For comparison, NeRFs would takes around 10 seconds per frame (!) Instead I'm zipping around with FPV controls without breaking a sweat - though I do crash a few times towards the end of the video lol 2. Old Meets New: Gaussian Splatting is cool in that it fuses classical graphics and deep learning techniques. Like NeRFs, this is still a radiance field - just without the slower (ne)ural rendering part. 3. Explicit Representation: Instead you represent a 3D scene as a collection of ellipsoidal "splats" called gaussians. Each gaussian has a position, size, and color. Rendering in real-time is done by projecting into the image plane and alpha blending. 4. Photorealistic Effects: Gaussian splatting use spherical harmonics to represent the view-dependent effects and lighting - allowing surfaces to change color when viewed from different angles, enabling greater photorealism. It doesn't use a neural network, but the training loop is similar to deep learning. 5. Enables Direct Editing: But it's not just speed - with Gaussian Splatting you also get 3D editing support! So you can select, move, and delete stuff, even relight stuff. This type of editing has been more tedious to do with NeRFs and their implicit black box representations. 📲 More tests cooking! Much more to unpack here including simpler explanations. If you enjoyed this post, you might enjoy my feed: Bilawal Sidhu
0:35

3D scanning and rendering is moving so fast - got my splats up and running and I'm mind blown getting ~100fps for this complex 3D scene ⬇️ 🤯 1. WAY faster than NeRF: For comparison, NeRFs would takes around 10 seconds per frame (!) Instead I'm zipping around with FPV controls without breaking a sweat - though I do crash a few times towards the end of the video lol 2. Old Meets New: Gaussian Splatting is cool in that it fuses classical graphics and deep learning techniques. Like NeRFs, this is still a radiance field - just without the slower (ne)ural rendering part. 3. Explicit Representation: Instead you represent a 3D scene as a collection of ellipsoidal "splats" called gaussians. Each gaussian has a position, size, and color. Rendering in real-time is done by projecting into the image plane and alpha blending. 4. Photorealistic Effects: Gaussian splatting use spherical harmonics to represent the view-dependent effects and lighting - allowing surfaces to change color when viewed from different angles, enabling greater photorealism. It doesn't use a neural network, but the training loop is similar to deep learning. 5. Enables Direct Editing: But it's not just speed - with Gaussian Splatting you also get 3D editing support! So you can select, move, and delete stuff, even relight stuff. This type of editing has been more tedious to do with NeRFs and their implicit black box representations. 📲 More tests cooking! Much more to unpack here including simpler explanations. If you enjoyed this post, you might enjoy my feed: Bilawal Sidhu

Bilawal Sidhu

336,924 Aufrufe • vor 2 Jahren

I've made Gaussian Splat Coloring Book for Vision Pro. Still rough on the edges, but working in splats on AVP is super rewarding, and now I'm thinking about full blown Gaussian Splats editor instead of just a coloring book :D
0:56

I've made Gaussian Splat Coloring Book for Vision Pro. Still rough on the edges, but working in splats on AVP is super rewarding, and now I'm thinking about full blown Gaussian Splats editor instead of just a coloring book :D

Adam Roszyk

46,328 Aufrufe • vor 7 Monaten

Spatial AI is increasingly important, and the newest papers from #NVIDIAResearch, 3DGRT and 3DGUT, represent significant advancements in enabling researchers and developers to explore and innovate with 3D Gaussian Splatting techniques. 💎 3DGRT (Gaussian Ray Tracing) ➡️ - Enables secondary lighting effects such as refractions, shadows, depth of field, and mirrors. - Provides a foundation for further research in ray tracing-based rendering of Gaussian representations. - Achieves real-time rendering performance on modern GPUs. ✨ 3DGUT (Gaussain Unscented Transform) ➡️ - Support for distorted camera models and time-dependent effects like rolling shutter. - Enables phenomena such as reflections and refractions while retaining real-time efficiency. 📥 Code:
0:27

Spatial AI is increasingly important, and the newest papers from #NVIDIAResearch, 3DGRT and 3DGUT, represent significant advancements in enabling researchers and developers to explore and innovate with 3D Gaussian Splatting techniques. 💎 3DGRT (Gaussian Ray Tracing) ➡️ - Enables secondary lighting effects such as refractions, shadows, depth of field, and mirrors. - Provides a foundation for further research in ray tracing-based rendering of Gaussian representations. - Achieves real-time rendering performance on modern GPUs. ✨ 3DGUT (Gaussain Unscented Transform) ➡️ - Support for distorted camera models and time-dependent effects like rolling shutter. - Enables phenomena such as reflections and refractions while retaining real-time efficiency. 📥 Code:

NVIDIA AI Developer

27,724 Aufrufe • vor 1 Jahr

Excited to announce 🚀gsplat v1.0🚀: a ⏩efficient⏩ CUDA backend for 3D Gaussian Splatting! A drop-in replacement of the official impl. with: - Up to 2x faster training; - Up to 4x less GPU memory; - Render millions of GSs in real-time; - And more;
0:33

Excited to announce 🚀gsplat v1.0🚀: a ⏩efficient⏩ CUDA backend for 3D Gaussian Splatting! A drop-in replacement of the official impl. with: - Up to 2x faster training; - Up to 4x less GPU memory; - Render millions of GSs in real-time; - And more;

Ruilong Li

87,917 Aufrufe • vor 2 Jahren

3D gaussian splatting + time (video) = 4D gaussian splatting is now possible This means in the near future you'll be able to fly around on your phone in any video you recorded A lot like the "braindance" in Cyberpunk 2077
0:29

3D gaussian splatting + time (video) = 4D gaussian splatting is now possible This means in the near future you'll be able to fly around on your phone in any video you recorded A lot like the "braindance" in Cyberpunk 2077

@levelsio

589,960 Aufrufe • vor 1 Jahr