Some promising experiments to make tooling for gaussian splats! Objects can be cut out / masked, and multiple captures can be combined together. Captures with Luma, viewer by Aras Pranckevičius 🇺🇦🇱🇹

@aras_p Next steps:

@LumaLabsAI @aras_p Amazing! Imagine tech like this combined with 6DOF tools and sculpting/painting like in Dreams 😍

@LumaLabsAI @aras_p Yeah, I’m pretty happy „fancy particles“ has a revival now, and that someone found a good way to get the right particles for a given object. Lots of ideas that could merge between SDFs, Splats, Particles, Photogrammetry

@LumaLabsAI Ah, I was wondering whether “clip with a sphere” tool would work well. Looks like it does! Now I’ll have to implement it… unless someone contributes it to the repo, wink wink :)

@LumaLabsAI PR here: Notably it doesn't set the deleted bit yet, I'm not quite sure how to do that right

@LumaLabsAI @aras_p Was thinking - this would be an are where VR editing workflow would be great, shave off bad splats, tiltbrush style grab and shuffle I was also wondering, could you go into a scene, essentially sketch in the volumes that the splat covers (like hull brush) and then get that

@LumaLabsAI @aras_p Might be! I think editing could be SDF-based, and then whether it's VR or not is just a matter of input. SDF would have the advantage that it's not just pure filtering of splats (like in my demo above) but could also multiply in alpha gradients at the borders

@LumaLabsAI @aras_p Woohoo!

@LumaLabsAI @aras_p Are doing this all in the Luna ai app?

@LumaLabsAI @aras_p The captures are made with the Luna app, then downloaded and put into Unity thanks to Aras' viewer implementation, plus some experiments by me for cutout handling