Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

I am releasing the “MLSharp” app for macOS. MLSharp is a premium macOS application that transforms 2D images into immersive 3D Gaussian Splatting (3DGS) models using state-of-the-art AI.

むっちゃん

1,407 subscribers

91,080 views • 5 months ago •via X (Twitter)

Arts Science & Technology

Anya Rossi• Live Now

Private livecam show

17 Comments

むっちゃん5 months ago

It can be used not only for viewing the generated 3DGS files but also as a general-purpose 3D viewer for 3DGS files.

むっちゃん5 months ago

I have corrected the error in the download link. To generate 3DGS from 2D images, you need to download the AI model (2.67 GB) from the app. For more details, please read the instructions on the download page.

luminati5 months ago

Download link is 404

むっちゃん5 months ago

I have corrected the error in the download link. To generate 3DGS from 2D images, you need to download the AI model (2.67 GB) from the app. For more details, please read the instructions on the download page.

Shannon Potter5 months ago

Download link not found :(

むっちゃん5 months ago

I have corrected the error in the download link. To generate 3DGS from 2D images, you need to download the AI model (2.67 GB) from the app. For more details, please read the instructions on the download page.

undefined5 months ago

@fangiskhan i will have to try this with aeon

Ben Fischer5 months ago

For anyone looking for the file, I believe this is it. I don’t have my Mac with me so I can’t test it, but if this doesn’t work someone let me know so I can pull the link (re-uploaded the .dmg via file . io):

Terry Carson5 months ago

Congrats on the launch! This looks super impressive. Can't wait to see what people create with it.

Micah Berkley - TheAIMogul5 months ago

What if you supplied a 360 photo (i.e insta360) ?

Lehuy Vo🔸5 months ago

It looks super, i will try this

Bemba5 months ago

uuuuh what?

Igor Strebz5 months ago

Nice! 😍 It doesn't stitch photos, does it?

Dmitry Starkov5 months ago

Faster than MLX?

Michael Freeman5 months ago

Where is the model published on Huggingface and how did you train it ?

Carles Déau5 months ago

Please unlock 3D VISION 😅 😎 Great job tho 💪🔥👍✨️

Josh Zhang ∣ 極客財務官5 months ago

Wow, that's impressive! As an AI OCR guy, I appreciate the power of transforming 2D data. I can imagine applications for inventory management or even property valuation. Just a thought!

Related Videos

📢 I’m testing ViggleAI new AI tool, PINOC, and it’s seriously impressive. You can create 3D Gaussian splatting models from just one image and animate them with a video! It’s the first AI I’ve tried that can animate Gaussian splatting models. I also talked to someone from Viggle, and they might add the option to import your own Gaussian splatting models and animate them. If that happens, I’ll probably make a video tutorial showing how to boost the detail level of a Gaussian splatting model by 4x to create highly realistic animated characters.

📢 I’m testing ViggleAI new AI tool, PINOC, and it’s seriously impressive. You can create 3D Gaussian splatting models from just one image and animate them with a video! It’s the first AI I’ve tried that can animate Gaussian splatting models. I also talked to someone from Viggle, and they might add the option to import your own Gaussian splatting models and animate them. If that happens, I’ll probably make a video tutorial showing how to boost the detail level of a Gaussian splatting model by 4x to create highly realistic animated characters.

Alex

29,776 views • 4 months ago

Introducing SAM 3D, the newest addition to the SAM collection, bringing common sense 3D understanding of everyday images. SAM 3D includes two models: 🛋️ SAM 3D Objects for object and scene reconstruction 🧑‍🤝‍🧑 SAM 3D Body for human pose and shape estimation Both models achieve state-of-the-art performance transforming static 2D images into vivid, accurate reconstructions. 🔗 Learn more:

Introducing SAM 3D, the newest addition to the SAM collection, bringing common sense 3D understanding of everyday images. SAM 3D includes two models: 🛋️ SAM 3D Objects for object and scene reconstruction 🧑‍🤝‍🧑 SAM 3D Body for human pose and shape estimation Both models achieve state-of-the-art performance transforming static 2D images into vivid, accurate reconstructions. 🔗 Learn more:

AI at Meta

860,857 views • 10 months ago

Let's make a beautiful artbook that celebrates the art and craft of app icon design on the desktop. 🔴 The macOS App Icon Book Kickstarter is LIVE 📓 →

Let's make a beautiful artbook that celebrates the art and craft of app icon design on the desktop. 🔴 The macOS App Icon Book Kickstarter is LIVE 📓 →

Michael Flarup

354,327 views • 3 years ago

Gaussian Shell Maps are a new neural scene representation that connects fields and 3D Gaussians. This representation unlocks the full potential of 3D Gaussian splatting for generative AI applications, such as 3D avatar generation. 1/2

Gordon Wetzstein

52,480 views • 2 years ago

Is Voxels the future of 3D Gaussian Splats? 3DGS's days may be numbered... I dove into NVIDIA AI Developer's SVRaster over the past week and made a first impressions video. Link to full video: #computervision #3d #3DGS #VFX

Is Voxels the future of 3D Gaussian Splats? 3DGS's days may be numbered... I dove into NVIDIA AI Developer's SVRaster over the past week and made a first impressions video. Link to full video: #computervision #3d #3DGS #VFX

Jonathan Stephens

20,125 views • 1 year ago

InstantSplat++ is now open source. It is a lightweight library that connects foundation models (VGGT, MASt3R, MAP-Anything, etc.) with the Gaussian splatting family. Given uncalibrated images, it optimizes a 3D scene in a few seconds. Try the demo and code here:

InstantSplat++ is now open source. It is a lightweight library that connects foundation models (VGGT, MASt3R, MAP-Anything, etc.) with the Gaussian splatting family. Given uncalibrated images, it optimizes a 3D scene in a few seconds. Try the demo and code here:

Zhiwen(Aaron) Fan

31,864 views • 6 months ago

A test of real-time transfer of images captured on Quest to a PC, where they are converted into 3D using Apple's SHARP. Currently, the final 3DGS output is displayed on the PC. The next step is to bring the result back into Quest for in-headset viewing. #3DGS #metaquest #AR

A test of real-time transfer of images captured on Quest to a PC, where they are converted into 3D using Apple's SHARP. Currently, the final 3DGS output is displayed on the PC. The next step is to bring the result back into Quest for in-headset viewing. #3DGS #metaquest #AR

Takashi Yoshinaga

11,575 views • 5 months ago

$DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline$

DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline

AK

24,910 views • 2 years ago

CLM: Removing the GPU Memory Barrier for 3D Gaussian Splatting CLM trains a 102-million Gaussian model on the MatrixCity BigCity Aerial Dataset under 4 hours using a single RTX 4090, achieving a PSNR of 25.

CLM: Removing the GPU Memory Barrier for 3D Gaussian Splatting CLM trains a 102-million Gaussian model on the MatrixCity BigCity Aerial Dataset under 4 hours using a single RTX 4090, achieving a PSNR of 25.

Ryohei Sasaki@engineer

34,570 views • 8 months ago

Painting with 3D Gaussian Splat Brushes Contributions: • Designing a set of interactive tools and brush parameters for artistic brush creation and control using 3DGS content. • Computing oriented 3D Gaussian splat brushes for stamp-based painting on 3D surfaces represented as meshes or 3DGS scenes. • Deforming the splats in a brush stamp to ensure a smooth appearance of the painted 3D stroke. • Producing seamless brush strokes despite overlapping brush stamps, using diffusion inpainting. • Efficient modeling and rendering of brush strokes to facilitate 3DGS painting in real time.

Painting with 3D Gaussian Splat Brushes Contributions: • Designing a set of interactive tools and brush parameters for artistic brush creation and control using 3DGS content. • Computing oriented 3D Gaussian splat brushes for stamp-based painting on 3D surfaces represented as meshes or 3DGS scenes. • Deforming the splats in a brush stamp to ensure a smooth appearance of the painted 3D stroke. • Producing seamless brush strokes despite overlapping brush stamps, using diffusion inpainting. • Efficient modeling and rendering of brush strokes to facilitate 3DGS painting in real time.

MrNeRF

23,060 views • 1 year ago

3.8 mb 🤯 I tried the 3D Gaussian Splatting add-on for Unity by Aras Pranckevičius 🇺🇦🇱🇹 on my Nike shoe capture, and when using the “Very low” quality, the file size becomes 3.8mb with minimal visual loss. That’s the lowest file size I’ve seen for a 3DGS yet! #GaussianSplatting

3.8 mb 🤯 I tried the 3D Gaussian Splatting add-on for Unity by Aras Pranckevičius 🇺🇦🇱🇹 on my Nike shoe capture, and when using the “Very low” quality, the file size becomes 3.8mb with minimal visual loss. That’s the lowest file size I’ve seen for a 3DGS yet! #GaussianSplatting

Alex Carlier

62,211 views • 3 years ago

Open Sourcing Forge: 3D Gaussian splat rendering for web developers! 3DGS has become a dominant paradigm for differentiable rendering, combining high visual quality and real-time rendering. However, support for splatting on the web still lags behind its adoption in AI.

Open Sourcing Forge: 3D Gaussian splat rendering for web developers! 3DGS has become a dominant paradigm for differentiable rendering, combining high visual quality and real-time rendering. However, support for splatting on the web still lags behind its adoption in AI.

spark

120,050 views • 1 year ago

and just like that, first release of reflect >|< is out for macos at reflect is an app for android users who happen to use macos and or are jealous of iphone mirroring app. it works like the iphone mirroring app. so your android stays where you work

and just like that, first release of reflect >|< is out for macos at reflect is an app for android users who happen to use macos and or are jealous of iphone mirroring app. it works like the iphone mirroring app. so your android stays where you work

𝐚𝐢𝐤𝐢𝐧𝐬

16,349 views • 3 months ago

This is it, native PCVR on MacOS! The OpenXR SDK can be compiled on MacOS, So I implemented a runtime and a streaming app. Godot supports OpenXR on MacOS so I use it to test my integration. Unity could work too and of course native C++. 1/x

This is it, native PCVR on MacOS! The OpenXR SDK can be compiled on MacOS, So I implemented a runtime and a streaming app. Godot supports OpenXR on MacOS so I use it to test my integration. Unity could work too and of course native C++. 1/x

Yannick Comte

37,362 views • 6 months ago

Qwen 3.7-Max is genuinely one of the most impressive agentic coding models I’ve tested in a while. I had it generate a full macOS-style web OS clone and the UI replication was honestly kinda insane — multiple working apps, polished window management, accurate macOS-style layouts, and even the app icons were individually SVG-coded instead of being static images. Alibaba is getting VERY close to the frontier labs now. Full Breakdown:

Qwen 3.7-Max is genuinely one of the most impressive agentic coding models I’ve tested in a while. I had it generate a full macOS-style web OS clone and the UI replication was honestly kinda insane — multiple working apps, polished window management, accurate macOS-style layouts, and even the app icons were individually SVG-coded instead of being static images. Alibaba is getting VERY close to the frontier labs now. Full Breakdown:

WorldofAI

49,861 views • 3 months ago

Drivable 3D Gaussian Avatars paper page: present Drivable 3D Gaussian Avatars (D3GA), the first 3D controllable model for human bodies rendered with Gaussian splats. Current photorealistic drivable avatars require either accurate 3D registrations during training, dense input images during testing, or both. The ones based on neural radiance fields also tend to be prohibitively slow for telepresence applications. This work uses the recently presented 3D Gaussian Splatting (3DGS) technique to render realistic humans at real-time framerates, using dense calibrated multi-view videos as input. To deform those primitives, we depart from the commonly used point deformation method of linear blend skinning (LBS) and use a classic volumetric deformation method: cage deformations. Given their smaller size, we drive these deformations with joint angles and keypoints, which are more suitable for communication applications. Our experiments on nine subjects with varied body shapes, clothes, and motions obtain higher-quality results than state-of-the-art methods when using the same training and test data.

Drivable 3D Gaussian Avatars paper page: present Drivable 3D Gaussian Avatars (D3GA), the first 3D controllable model for human bodies rendered with Gaussian splats. Current photorealistic drivable avatars require either accurate 3D registrations during training, dense input images during testing, or both. The ones based on neural radiance fields also tend to be prohibitively slow for telepresence applications. This work uses the recently presented 3D Gaussian Splatting (3DGS) technique to render realistic humans at real-time framerates, using dense calibrated multi-view videos as input. To deform those primitives, we depart from the commonly used point deformation method of linear blend skinning (LBS) and use a classic volumetric deformation method: cage deformations. Given their smaller size, we drive these deformations with joint angles and keypoints, which are more suitable for communication applications. Our experiments on nine subjects with varied body shapes, clothes, and motions obtain higher-quality results than state-of-the-art methods when using the same training and test data.

AK

327,324 views • 2 years ago

Big news I found a way to convert Gaussian Splatting into a standard mesh while preserving all the visual advantages of Gaussian Splatting, such as reflections, shadows, and lighting that changes depending on the viewing angle. The result is excellent performance, even on an old laptop or a VR headset. And of course, the mesh can be animated like any regular 3D mesh, while still keeping the visual benefits of GS. I’ll soon show a full-body character animated using this technique.

Big news I found a way to convert Gaussian Splatting into a standard mesh while preserving all the visual advantages of Gaussian Splatting, such as reflections, shadows, and lighting that changes depending on the viewing angle. The result is excellent performance, even on an old laptop or a VR headset. And of course, the mesh can be animated like any regular 3D mesh, while still keeping the visual benefits of GS. I’ll soon show a full-body character animated using this technique.

Alex

38,119 views • 3 months ago