Gabriele Romagnoli
@GabRoXR • 8,576 subscribers
Showcasing the best of #XR & #AI for creatives and professionals | Tech Ambassador | Speaker Content Manager at @ShapesXR
Videos
"#AI will never create clean meshes" AI 👇 This is the new #AI model from NVIDIA called Meshtron (jeez what a name 😅). It generates meshes of complex 3D objects closely resembling those created by professional artists. It opens the door to a more realistic generation of detailed 3D assets for animation, gaming, and virtual environments. The current version accepts the following control inputs: - Point cloud: Determines the shape of the output mesh. - Face count: Determines the density of the output mesh. - Quad ratio: Switches between quad and triangle tessellation. - Creativity: Can be adjusted to generate extra details in the model. Meshtron can either serve as a stand-alone remesher to improve the quality of existing models, or be used in tandem with a text-to-3D or image-to-3D model to generate artist-grade meshes from scratch.
Gabriele Romagnoli2,177,191 Aufrufe • vor 1 Jahr
These are just 2 Keyframes. #AI did the rest. Cascadeur – The Future of Animation just released an impressive update that adds to the AI interpolation features that run locally on your PC 🤯. I am not an animator but creating a walk cycle took me literally 20 seconds... and the majority of that time was spent understanding how to add a new keyframe.
Gabriele Romagnoli731,471 Aufrufe • vor 9 Monaten
I had to do this for "science" 🥼🔬😅. Jokes aside, there were a few things I learned by testing #mixedreality outdoor: 1- Sun was coming and going BUT the tracking on the #Quest3 was surprisingly stable.... including the controllers 2- After the initial hesitation to move around it was great to walk and build without the restrictions of walls or furniture. Right now the majority of the apps are designed for a standing experience without much movement or locomotion happening in the real world. That is a real shame because the moments when I move physically are when I feel the most immersed. Maybe #outdoor #MR can bring back some of that magic 3- Jumping in the whole DID feel believable and "kinda scary" to be honest. Are there other #MR apps that are great to test outdoors? Let me know below 👇
Gabriele Romagnoli598,373 Aufrufe • vor 2 Jahren
This museum is inside a 35-meter-tall seated human figure and it took 4'25" to turn it into a #GaussianSplatting CORPUS is the world's first interactive museum dedicated entirely to the human body, offering an experience unlike any traditional museum. Instead of looking at exhibits from the outside, you embark on a journey through literally the human body itself. This is my submission for the #SplatYourWorld contest organized by Niantic Spatial 🌎 . It was captured using a 360-degree drone and processed on the cloud using Scaniverse .
Gabriele Romagnoli25,176 Aufrufe • vor 1 Monat
Playing #VR games "without" a headset... ... Absolute genius or total abomination? This is called PortalVR and it lets you play any SteamVR game or app on your Windows PC without wearing a headset. Just plug in your #MetaQuest via USB, put it on your desk facing you, and use your controllers while facing your screen. The setup and connection is quite seamless and the team came up with a clever locomotion system to simulate turning the user's head by just tapping the top of the thumbstick. Now the biggest question is: does this make any sense? In my opinion, to play "standard" VR #games, it doesn't. You lose the beauty of being immersed and reaching out to grab objects or looking around can be tricky. On the other hand, I think there might be experiences specifically designed with this interaction in mind like interactive installations or educational experiences that could greatly benefit from a more tactile interface than a mouse and a keyboard
Gabriele Romagnoli66,345 Aufrufe • vor 8 Monaten
Everybody is asking me how to get #GaussianSplatting in #VR. This is my answer 👇 You might not like it, but the truth is that right now Unity is not ready and it doesn't matter how hard you try as soon as you go above 400K, the framerate on standalone headsets is terrible. You should instead look at the amazing work that teams at World Labs and PlayCanvas are doing. They are pushing innovation and are building stunning tech demos where features like the LOD turns into gameplay mechanic. Using your hands as a sort of torch to define the LOD is genius! This is the best moment to experiment and show innovation. For a second, take a step back from your training and simulations, train an AI on how to build on Playcanvas or Spark and break things.
Gabriele Romagnoli18,337 Aufrufe • vor 1 Monat
Shared experiences in #AugmentedReality are going to be something special. We can experience a glimpse of what's to come right now, but once you look beyond gaming and think of the opportunities once digital content can be meaningfully anchored on top of our world AND these devices become more widespread, the possibilities become much bigger. I believe the first major step will come through location-based entertainment in 2026–2027, enabled by the arrival of devices like Spectacles. These experiences will allow people to enter shared digital worlds together, blending physical spaces with persistent AR content. But that will only be the beginning. Once AR glasses become lighter, more affordable, and part of everyday life, we’ll start seeing experiences that go far beyond entertainment: from social interactions and education to work, tourism, and entirely new ways of engaging with the world around us.
Gabriele Romagnoli11,355 Aufrufe • vor 1 Monat
Animated #GaussianSplatting can now be streamed like a YouTube video. So far, you had to download large files BEFORE experiencing them anywhere, but Gracia has just released several demos that stream like a normal video. The first thing I tried was to make a side-by-side comparison, but I could hardly notice any difference. As long as you have a solid internet connection, you can play them on the web, headset and even on mobile in #augmentedreality. Interested in the latest in #3D, #XR and #AI? This is the type of news and updates I share every week on my newsletter (link on top of my profile).
Gabriele Romagnoli44,321 Aufrufe • vor 5 Monaten
This web demo lets you create a portal to your own AI-generated world 👇 The Off-Axis spatial Kit built by Johannes Tscharn and Ian Curtis now supports the import function for your own splat. To get it, make sure to reach out to Ferhan Özkan and the SensAI Hackademy team, who have been building end-to-end workflow Kits for Unity, Unreal Engine and #WebXR.
Gabriele Romagnoli36,773 Aufrufe • vor 4 Monaten
Let me share a long-awaited behind-the-scenes video of how Simulon works. It all starts with setting up a scene. You set the location, lighting conditions and capture the light map with a few turns. After that, you can capture the environment mesh using the Lidar scanner. That's the moment the fun begins. You can bring in your #3D models with animations and capture a video of up to 50" using the #AR preview on screen. After that is done, you send the footage to the cloud and in a couple of minutes you get back an incredible #CGI shot. And this is just the beginning. Follow Gabriele Romagnoli to see how Simulon integrates with #Blender and in a full #VFX workflow. A special thanks to Divesh Naidoo for sharing early access and for building something 🤯
Gabriele Romagnoli142,698 Aufrufe • vor 2 Jahren
This is Segment Anything for #GaussianSplatting running on the web... but it comes with a caveat. This is SplatEdit, a powerful #3DGS editing software built on top of SuperSplat. Last week, it added a segmentation selection feature powered by Segment Anything, running locally in the browser. Just upload a splat, click on the "mug" icon and select entire objects in the scene. The problem is that everything after the object is also selected (as you can see in the video). To fix that, just use the brush tool to subtract the unwanted portion of the scene (hold CTRL while brushing). I feel we are getting closer and closer to having more editing control on these amazing fuzzy clouds 😉
Gabriele Romagnoli14,741 Aufrufe • vor 1 Monat
#GaussianSplatting are impossible to animate. Lazar Bogdan made this tutorial to prove otherwise: It is 1h 20 min and covers on how to rig, skin and animate a fly in Houdini. This is the type of finding I share with the Pro members of my newsletter XR AI Spotlight, every week. I spend countless hours finding and curating the latest updates and valuable resources for professionals and creatives at the intersection of hashtag#3D, hashtag#XR and hashtag#AI. Make sure to check it out.
Gabriele Romagnoli17,334 Aufrufe • vor 2 Monaten
Here is what I learned from experiencing animated #GaussianSplatting in #mixedreality. File sizes are shrinking. Gracia manages to compress at around 1GB per minute, but once you are done with the download, the experience is mindblowing The crowded dance scene in the middle of the video (captured with a 180-degree rig) was a recent addition and a nice surprise to show how you can be immersed in other types of performances. Temporal stability is tricky. Fast-movements result in some artefacts (especially when you're getting closer). Transparencies are probably even more impressive than reflective surfaces The library keeps growing and I strongly advise you to check it out.
Gabriele Romagnoli50,448 Aufrufe • vor 8 Monaten
#VisionPro pushes for far interactions but is that the best way? With gaze and pinch, #Apple seems to discourage developers from implementing more direct hand interactions into their experiences. There are certainly some advantages but I thought the whole purpose of #VR and #spatialcomputing was to be immersed and feel like you are interacting with #digital objects as if they were real. I am even more convinced after testing this SDK from SpectreXR that takes advantage of the Nvidia physics engine to make hand interactions feel more natural. Would you use more direct interactions like in the video or stick with far gaze+pinch?
Gabriele Romagnoli104,043 Aufrufe • vor 2 Jahren
This is the latest Google research on XR Interaction: World Mouse. Instead of using hand rays or gestures to point at things in the physical space, you move a cursor with a mouse and the system figures out where that cursor should sit in the 3D world. It works in two main ways: - On an object, the cursor follows the surface, so you can move precisely across walls, screens, furniture, or virtual objects. - Between objects, the system creates a smooth bridge through space, so the cursor can travel from one surface to another. That means you can go from a 2D panel to a 3D object, place content on a real wall, manipulate virtual objects, or interact with physical devices through digital proxies. This is the type of news, tools and product updates I share weekly in my newsletter. If you are into 3D XR and AI make sure to check it out (link on top of my profile). Based on “World Mouse: Exploring Interactions with a Cross-Reality Cursor” by Esen K. Tütüncü, Mar Gonzalez-Franco, Khushman Patel, and Eric J. Gonzalez
Gabriele Romagnoli28,945 Aufrufe • vor 5 Monaten
This is the biggest announcement from Apple that nobody has talked about. Generating #GaussianSplatting with #AI using models like Trellis or Sam3D hasn’t made much sense...until now. Meshes are still far easier to edit, integrate cleanly into #3D workflows, and with recent retopology advances, you can get high-quality low-poly assets with detailed textures. That said, this is where the balance starts to shift toward 3DGS. Until recently, AI struggled to generate splats with proper view-dependent effects. That’s changed with LiTo, a new model from Apple that can generate 3DGS with realistic view-dependent rendering, and the results are impressive. They’re not ready for game development pipelines yet. But for VFX, e-commerce, configurators, architecture, and similar domains, the implications are significant. What would it take for you to seriously explore AI-generated 3DGS for non-gaming use cases?
Gabriele Romagnoli20,817 Aufrufe • vor 4 Monaten
Just one of the projects you'll build during this free online workshop on July 8th, 11 AM PT 👉 You will learn: - how to create and edit #3D worlds with Marble - run detection on synthetic splats to add interactivity, - reconstruct real-world spaces with XGRIDS workflows, - deploy splat worlds into #WebXR, #Unity and #Unreal
Gabriele Romagnoli11,750 Aufrufe • vor 2 Monaten