Are people still doubting gaussian splatting fidelity? Interactive from William Beck on PlayCanvas:

@playcanvas Thus is mid. I want to be able to zoom in on the atoms.

@playcanvas That sounds good to me as long as we’re talking about 3D atom splatting and not 3D atom splitting

@playcanvas This is my fidelity for a building

@playcanvas omg you’re vast-piano??

@playcanvas Oh, yes on Reddit? I don’t even remember my name there. Reddit gave me a random one :)

@playcanvas Yes! I was wondering what the origin of your username was 🤣

@playcanvas That's insane level of detail capture! How?? Did they seriously capture images down each vein of the heatsink? Or is this some newer AI assisted GS?? I want to know! Awesome skill either way.

@playcanvas wow

@playcanvas what the actual fuck

@playcanvas I heard recently people arging of splats, the rage bait is real.

@playcanvas seriously.

@playcanvas Yes, here: @RadianceFields

@playcanvas I also saw that. I felt it must just be rage bait since how incorrect the post is

@NeoVroloK @playcanvas Care to share why?

Editing is increasing at a fast rate. You can now relight in a few platforms, ranging from @VolingaAI, to @sidefx Houdini, to full path tracing and relighting in @OTOY OctaneRender. There is also @playcanvas, whose SuperSplat editor makes many adjustments easy and is open source. I would also personally disagree that they are hard to move with either a mouse or trackpad. Nuke from @TheFoundryTeam added gaussian splatting support in the 17.0 beta and gaussian splatting is being used professionally in some of the biggest film productions. Early examples that have already released would be Superman and I am interviewing a couple VFX teams this week that used gaussian splatting. A few of my friends in the AEC and GIS world are heavily mixing and matching splats with traditionally modeled scenes. In some cases, they are turning their traditional scenes into splats and sending those to clients through platforms like PlayCanvas. Depending on the number of splats, file sizes are pretty compressed (like 10-20mb). If you're shipping something with 10s of millions of splats, you're ending up with a comparable file size as the computer example above, which is 180mb. That said, compression is one of the hottest areas of gaussian splatting research rn and I don't see any indication of it plateauing. Splats also use rasterization, just with a different primitive. Also, this isn't to say that gaussians should be or are the best. There's been a lot of exciting research around triangles, convex, deformable betas, etc.. NVIDIA added support for 3DGUT in Isaac Sim last June: and quite a few additional robotics and autonomous vehicle companies, ranging from Tesla, to Wayve, to Waabi, are all using gaussian splatting for their simulation. Even the recently announced Alpmayo from NVIDIA at CES is powered by 3DGUT: I also interviewed the VP of Omniverse and Simulation at NVIDIA this past March and he explicitly told me that gaussian splatting is critical to robotics A large amount of industry standard software support gaussian splatting, including Unreal Engine, Unity, Houdini, Nuke, DaVinci Resolve, Blender, After Effects, V-Ray, Cinema4D, OctaneRender, Rhino, TouchDesigner, 3DS Max, Maya, among others. Things are certainly moving fast and it is really difficult to keep up with how much progress across both research and industry is occurring in parallel.

@playcanvas @nahrzf

@playcanvas how to handle the reflection on the metal?

@playcanvas what do you mean by handling?

@eralagee @playcanvas You can't do reflections in splats the true way, instead it fills in the area behind the reflective surface with a mirror of the world to appear like it. If you have something behind the reflective surface taking up that space already, you can't have a reflection there.

@eralagee @playcanvas There is headway in this area though! Check out this somewhat recent Inria paper from SIGGRAPH Asia

@eralagee @playcanvas Ah that's good, finally I see an acknowledgement of the problem somewhere. Most people struggle to even agree it's a thing surprisingly

@eralagee @playcanvas There are definitely people who are working through some of these, but it can be hard to find. You might be interested in this paper from NVIDIA too:

@playcanvas Hi, for anyone asking - the camera used was a GFX 100ii with a 50mm lens. 693 images were aligned but that’s probably overkill.

@playcanvas Spawned points from the CAD

@playcanvas no CAD involved😃

@playcanvas always high quality shares, thanks!

@playcanvas 🫡

@playcanvas No doubts from us. The first tech to be able to get super realistic 3d online easily in a webpage as far as I can see. We’ll be using it for products we could never really achieve before. It’s great!

@playcanvas That is absolutely staggering. Wow!

@playcanvas Crazy

@playcanvas what's the file size of this one?

@playcanvas This is on the larger size at 182mb currently!

@playcanvas What camera is this? How were camera poses/extrinsics (Colmap) figured out?

@playcanvas

@playcanvas I saw only one error, the gap at the most right radiator fin seems to be closed. Check time 21s.

@hautexsavant @playcanvas @grok

@playcanvas new fpv racing sim map just dropped

@playcanvas that playcanvas demo makes realtime splats feel practical

@playcanvas the video is incredible, this is open source and re-creatable?

@playcanvas the distribution platform, SuperSplat, from @playcanvas is open source and there are plenty of free ways to do the reconstructions! It’s very much re-creatable.

@playcanvas This just blows my mind.. insane

@playcanvas photogrammetry from just one picture?

@playcanvas gaussian splatting is actually a radiance field representation, but this specific one was created from several images!

@playcanvas incredible. I still can't figure out how the hell to control the camera on supersplat. but nice.

@playcanvas how do i create a splat with this kind of fidelity??

@playcanvas @grok explain "gaussian splatting" to me like I'm a retard

@playcanvas Is there a tutorial or blog on how we can do the same??

@playcanvas I just put out a tutorial on the first part about how to take images or videos! A video on the different processing options is coming soon.

@playcanvas my phone doubts

@playcanvas what software is used to compose this gaussian splat????

@playcanvas Any practicable utility beyond rendering?

@playcanvas Its really good! Do you know which model is used to produce this 3DGS? Is it the original open source model and the only difference is that the images used are high res?