Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

I am releasing the “MLSharp” app for macOS. MLSharp is a premium macOS application that transforms 2D images into immersive 3D Gaussian Splatting (3DGS) models using state-of-the-art AI.

むっちゃん

1,407 subscribers

91,080 Aufrufe • vor 5 Monaten •via X (Twitter)

Kunst Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

17 Kommentare

Profilbild von むっちゃん

むっちゃんvor 5 Monaten

It can be used not only for viewing the generated 3DGS files but also as a general-purpose 3D viewer for 3DGS files.

Profilbild von むっちゃん

むっちゃんvor 5 Monaten

I have corrected the error in the download link. To generate 3DGS from 2D images, you need to download the AI model (2.67 GB) from the app. For more details, please read the instructions on the download page.

Profilbild von luminati

luminativor 5 Monaten

Download link is 404

Profilbild von むっちゃん

むっちゃんvor 5 Monaten

I have corrected the error in the download link. To generate 3DGS from 2D images, you need to download the AI model (2.67 GB) from the app. For more details, please read the instructions on the download page.

Profilbild von Shannon Potter

Shannon Pottervor 5 Monaten

Download link not found :(

Profilbild von むっちゃん

むっちゃんvor 5 Monaten

I have corrected the error in the download link. To generate 3DGS from 2D images, you need to download the AI model (2.67 GB) from the app. For more details, please read the instructions on the download page.

Profilbild von undefined

undefinedvor 5 Monaten

@fangiskhan i will have to try this with aeon

Profilbild von Ben Fischer

Ben Fischervor 5 Monaten

For anyone looking for the file, I believe this is it. I don’t have my Mac with me so I can’t test it, but if this doesn’t work someone let me know so I can pull the link (re-uploaded the .dmg via file . io):

Profilbild von Terry Carson

Terry Carsonvor 5 Monaten

Congrats on the launch! This looks super impressive. Can't wait to see what people create with it.

Profilbild von Micah Berkley - TheAIMogul

Micah Berkley - TheAIMogulvor 5 Monaten

What if you supplied a 360 photo (i.e insta360) ?

Profilbild von Lehuy Vo🔸

Lehuy Vo🔸vor 5 Monaten

It looks super, i will try this

Profilbild von Bemba

Bembavor 5 Monaten

uuuuh what?

Profilbild von Igor Strebz

Igor Strebzvor 5 Monaten

Nice! 😍 It doesn't stitch photos, does it?

Profilbild von Dmitry Starkov

Dmitry Starkovvor 5 Monaten

Faster than MLX?

Profilbild von Michael Freeman

Michael Freemanvor 5 Monaten

Where is the model published on Huggingface and how did you train it ?

Profilbild von Carles Déau

Carles Déauvor 5 Monaten

Please unlock 3D VISION 😅 😎 Great job tho 💪🔥👍✨️

Profilbild von Josh Zhang ∣ 極客財務官

Josh Zhang ∣ 極客財務官vor 5 Monaten

Wow, that's impressive! As an AI OCR guy, I appreciate the power of transforming 2D data. I can imagine applications for inventory management or even property valuation. Just a thought!

Ähnliche Videos

📢 I’m testing ViggleAI new AI tool, PINOC, and it’s seriously impressive. You can create 3D Gaussian splatting models from just one image and animate them with a video! It’s the first AI I’ve tried that can animate Gaussian splatting models. I also talked to someone from Viggle, and they might add the option to import your own Gaussian splatting models and animate them. If that happens, I’ll probably make a video tutorial showing how to boost the detail level of a Gaussian splatting model by 4x to create highly realistic animated characters.

📢 I’m testing ViggleAI new AI tool, PINOC, and it’s seriously impressive. You can create 3D Gaussian splatting models from just one image and animate them with a video! It’s the first AI I’ve tried that can animate Gaussian splatting models. I also talked to someone from Viggle, and they might add the option to import your own Gaussian splatting models and animate them. If that happens, I’ll probably make a video tutorial showing how to boost the detail level of a Gaussian splatting model by 4x to create highly realistic animated characters.

Alex

29,776 Aufrufe • vor 4 Monaten

Introducing SAM 3D, the newest addition to the SAM collection, bringing common sense 3D understanding of everyday images. SAM 3D includes two models: 🛋️ SAM 3D Objects for object and scene reconstruction 🧑‍🤝‍🧑 SAM 3D Body for human pose and shape estimation Both models achieve state-of-the-art performance transforming static 2D images into vivid, accurate reconstructions. 🔗 Learn more:

Introducing SAM 3D, the newest addition to the SAM collection, bringing common sense 3D understanding of everyday images. SAM 3D includes two models: 🛋️ SAM 3D Objects for object and scene reconstruction 🧑‍🤝‍🧑 SAM 3D Body for human pose and shape estimation Both models achieve state-of-the-art performance transforming static 2D images into vivid, accurate reconstructions. 🔗 Learn more:

AI at Meta

860,857 Aufrufe • vor 10 Monaten

Let's make a beautiful artbook that celebrates the art and craft of app icon design on the desktop. 🔴 The macOS App Icon Book Kickstarter is LIVE 📓 →

Let's make a beautiful artbook that celebrates the art and craft of app icon design on the desktop. 🔴 The macOS App Icon Book Kickstarter is LIVE 📓 →

Michael Flarup

354,327 Aufrufe • vor 3 Jahren

Gaussian Shell Maps are a new neural scene representation that connects fields and 3D Gaussians. This representation unlocks the full potential of 3D Gaussian splatting for generative AI applications, such as 3D avatar generation. 1/2

Gordon Wetzstein

52,480 Aufrufe • vor 2 Jahren

Is Voxels the future of 3D Gaussian Splats? 3DGS's days may be numbered... I dove into NVIDIA AI Developer's SVRaster over the past week and made a first impressions video. Link to full video: #computervision #3d #3DGS #VFX

Is Voxels the future of 3D Gaussian Splats? 3DGS's days may be numbered... I dove into NVIDIA AI Developer's SVRaster over the past week and made a first impressions video. Link to full video: #computervision #3d #3DGS #VFX

Jonathan Stephens

20,125 Aufrufe • vor 1 Jahr

InstantSplat++ is now open source. It is a lightweight library that connects foundation models (VGGT, MASt3R, MAP-Anything, etc.) with the Gaussian splatting family. Given uncalibrated images, it optimizes a 3D scene in a few seconds. Try the demo and code here:

InstantSplat++ is now open source. It is a lightweight library that connects foundation models (VGGT, MASt3R, MAP-Anything, etc.) with the Gaussian splatting family. Given uncalibrated images, it optimizes a 3D scene in a few seconds. Try the demo and code here:

Zhiwen(Aaron) Fan

31,864 Aufrufe • vor 6 Monaten

A test of real-time transfer of images captured on Quest to a PC, where they are converted into 3D using Apple's SHARP. Currently, the final 3DGS output is displayed on the PC. The next step is to bring the result back into Quest for in-headset viewing. #3DGS #metaquest #AR

A test of real-time transfer of images captured on Quest to a PC, where they are converted into 3D using Apple's SHARP. Currently, the final 3DGS output is displayed on the PC. The next step is to bring the result back into Quest for in-headset viewing. #3DGS #metaquest #AR

Takashi Yoshinaga

11,575 Aufrufe • vor 5 Monaten

$DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline$

DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline

AK

24,910 Aufrufe • vor 2 Jahren

CLM: Removing the GPU Memory Barrier for 3D Gaussian Splatting CLM trains a 102-million Gaussian model on the MatrixCity BigCity Aerial Dataset under 4 hours using a single RTX 4090, achieving a PSNR of 25.

CLM: Removing the GPU Memory Barrier for 3D Gaussian Splatting CLM trains a 102-million Gaussian model on the MatrixCity BigCity Aerial Dataset under 4 hours using a single RTX 4090, achieving a PSNR of 25.

Ryohei Sasaki@engineer

34,570 Aufrufe • vor 8 Monaten

3.8 mb 🤯 I tried the 3D Gaussian Splatting add-on for Unity by Aras Pranckevičius 🇺🇦🇱🇹 on my Nike shoe capture, and when using the “Very low” quality, the file size becomes 3.8mb with minimal visual loss. That’s the lowest file size I’ve seen for a 3DGS yet! #GaussianSplatting

3.8 mb 🤯 I tried the 3D Gaussian Splatting add-on for Unity by Aras Pranckevičius 🇺🇦🇱🇹 on my Nike shoe capture, and when using the “Very low” quality, the file size becomes 3.8mb with minimal visual loss. That’s the lowest file size I’ve seen for a 3DGS yet! #GaussianSplatting

Alex Carlier

62,211 Aufrufe • vor 3 Jahren

Painting with 3D Gaussian Splat Brushes Contributions: • Designing a set of interactive tools and brush parameters for artistic brush creation and control using 3DGS content. • Computing oriented 3D Gaussian splat brushes for stamp-based painting on 3D surfaces represented as meshes or 3DGS scenes. • Deforming the splats in a brush stamp to ensure a smooth appearance of the painted 3D stroke. • Producing seamless brush strokes despite overlapping brush stamps, using diffusion inpainting. • Efficient modeling and rendering of brush strokes to facilitate 3DGS painting in real time.

Painting with 3D Gaussian Splat Brushes Contributions: • Designing a set of interactive tools and brush parameters for artistic brush creation and control using 3DGS content. • Computing oriented 3D Gaussian splat brushes for stamp-based painting on 3D surfaces represented as meshes or 3DGS scenes. • Deforming the splats in a brush stamp to ensure a smooth appearance of the painted 3D stroke. • Producing seamless brush strokes despite overlapping brush stamps, using diffusion inpainting. • Efficient modeling and rendering of brush strokes to facilitate 3DGS painting in real time.

MrNeRF

23,060 Aufrufe • vor 1 Jahr

Open Sourcing Forge: 3D Gaussian splat rendering for web developers! 3DGS has become a dominant paradigm for differentiable rendering, combining high visual quality and real-time rendering. However, support for splatting on the web still lags behind its adoption in AI.

Open Sourcing Forge: 3D Gaussian splat rendering for web developers! 3DGS has become a dominant paradigm for differentiable rendering, combining high visual quality and real-time rendering. However, support for splatting on the web still lags behind its adoption in AI.

spark

120,050 Aufrufe • vor 1 Jahr

and just like that, first release of reflect >|< is out for macos at reflect is an app for android users who happen to use macos and or are jealous of iphone mirroring app. it works like the iphone mirroring app. so your android stays where you work

and just like that, first release of reflect >|< is out for macos at reflect is an app for android users who happen to use macos and or are jealous of iphone mirroring app. it works like the iphone mirroring app. so your android stays where you work

𝐚𝐢𝐤𝐢𝐧𝐬

16,349 Aufrufe • vor 3 Monaten

This is it, native PCVR on MacOS! The OpenXR SDK can be compiled on MacOS, So I implemented a runtime and a streaming app. Godot supports OpenXR on MacOS so I use it to test my integration. Unity could work too and of course native C++. 1/x

This is it, native PCVR on MacOS! The OpenXR SDK can be compiled on MacOS, So I implemented a runtime and a streaming app. Godot supports OpenXR on MacOS so I use it to test my integration. Unity could work too and of course native C++. 1/x

Yannick Comte

37,362 Aufrufe • vor 6 Monaten

Qwen 3.7-Max is genuinely one of the most impressive agentic coding models I’ve tested in a while. I had it generate a full macOS-style web OS clone and the UI replication was honestly kinda insane — multiple working apps, polished window management, accurate macOS-style layouts, and even the app icons were individually SVG-coded instead of being static images. Alibaba is getting VERY close to the frontier labs now. Full Breakdown:

Qwen 3.7-Max is genuinely one of the most impressive agentic coding models I’ve tested in a while. I had it generate a full macOS-style web OS clone and the UI replication was honestly kinda insane — multiple working apps, polished window management, accurate macOS-style layouts, and even the app icons were individually SVG-coded instead of being static images. Alibaba is getting VERY close to the frontier labs now. Full Breakdown:

WorldofAI

49,861 Aufrufe • vor 3 Monaten

Drivable 3D Gaussian Avatars paper page: present Drivable 3D Gaussian Avatars (D3GA), the first 3D controllable model for human bodies rendered with Gaussian splats. Current photorealistic drivable avatars require either accurate 3D registrations during training, dense input images during testing, or both. The ones based on neural radiance fields also tend to be prohibitively slow for telepresence applications. This work uses the recently presented 3D Gaussian Splatting (3DGS) technique to render realistic humans at real-time framerates, using dense calibrated multi-view videos as input. To deform those primitives, we depart from the commonly used point deformation method of linear blend skinning (LBS) and use a classic volumetric deformation method: cage deformations. Given their smaller size, we drive these deformations with joint angles and keypoints, which are more suitable for communication applications. Our experiments on nine subjects with varied body shapes, clothes, and motions obtain higher-quality results than state-of-the-art methods when using the same training and test data.

Drivable 3D Gaussian Avatars paper page: present Drivable 3D Gaussian Avatars (D3GA), the first 3D controllable model for human bodies rendered with Gaussian splats. Current photorealistic drivable avatars require either accurate 3D registrations during training, dense input images during testing, or both. The ones based on neural radiance fields also tend to be prohibitively slow for telepresence applications. This work uses the recently presented 3D Gaussian Splatting (3DGS) technique to render realistic humans at real-time framerates, using dense calibrated multi-view videos as input. To deform those primitives, we depart from the commonly used point deformation method of linear blend skinning (LBS) and use a classic volumetric deformation method: cage deformations. Given their smaller size, we drive these deformations with joint angles and keypoints, which are more suitable for communication applications. Our experiments on nine subjects with varied body shapes, clothes, and motions obtain higher-quality results than state-of-the-art methods when using the same training and test data.

AK

327,324 Aufrufe • vor 2 Jahren

Big news I found a way to convert Gaussian Splatting into a standard mesh while preserving all the visual advantages of Gaussian Splatting, such as reflections, shadows, and lighting that changes depending on the viewing angle. The result is excellent performance, even on an old laptop or a VR headset. And of course, the mesh can be animated like any regular 3D mesh, while still keeping the visual benefits of GS. I’ll soon show a full-body character animated using this technique.

Big news I found a way to convert Gaussian Splatting into a standard mesh while preserving all the visual advantages of Gaussian Splatting, such as reflections, shadows, and lighting that changes depending on the viewing angle. The result is excellent performance, even on an old laptop or a VR headset. And of course, the mesh can be animated like any regular 3D mesh, while still keeping the visual benefits of GS. I’ll soon show a full-body character animated using this technique.

Alex

38,119 Aufrufe • vor 3 Monaten