正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Another AI Experiment. Using SHARP, Apple's ML framework - magical stuff. 2D Images to 3D Gaussian splats. Plotted and flown in Three.js

M. Ali Kapadia

1,095 subscribers

26,845 次观看 • 3 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Another experiment with Gaussian Painters ✨🎨 By optimizing 3D Gaussian Splattings over separate images at several viewpoints, it is possible to get a Steganography effect! Three paintings are hidden in those gaussian splats

Another experiment with Gaussian Painters ✨🎨 By optimizing 3D Gaussian Splattings over separate images at several viewpoints, it is possible to get a Steganography effect! Three paintings are hidden in those gaussian splats

Alex Carlier

220,503 次观看 • 2 年前

Turning movies shots into 3D scenes using 3D Gaussian Splats 🤯 Next experiment will be about taking footages from movies, turning them in 3D and then take them into Unreal Engine to add/edit. Remember this scene ?

Turning movies shots into 3D scenes using 3D Gaussian Splats 🤯 Next experiment will be about taking footages from movies, turning them in 3D and then take them into Unreal Engine to add/edit. Remember this scene ?

Bad Decisions Studio

742,879 次观看 • 2 年前

Introducing EpsteinVR: A full 3D model of Jeffrey's Upper East Side mansion (and more), generated using Apple's new SHARP Gaussian Splat model. Coming soon to Jmail Suite at jmail . world

Introducing EpsteinVR: A full 3D model of Jeffrey's Upper East Side mansion (and more), generated using Apple's new SHARP Gaussian Splat model. Coming soon to Jmail Suite at jmail . world

Diego Rodriguez

2,324,997 次观看 • 5 个月前

DiffSplat Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation DiffSplat is a generative framework to synthesize 3D Gaussian Splats from text prompts & single-view images in ⚡️ 1~2 seconds. It is fine-tuned directly from a pretrained text-to-image diffusion model.

DiffSplat Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation DiffSplat is a generative framework to synthesize 3D Gaussian Splats from text prompts & single-view images in ⚡️ 1~2 seconds. It is fine-tuned directly from a pretrained text-to-image diffusion model.

AK

38,416 次观看 • 1 年前

How to convert 2D images to 3D assets you can use in your designs for free using AI.

How to convert 2D images to 3D assets you can use in your designs for free using AI.

Design Chief Priest

18,713 次观看 • 1 年前

From 2 second (faster on higher end GPUs) Gaussian splat generations, using Apple's "Sharp Monocular View Synthesis in Less Than a Second" code, running locally on my system. Imported into Octane Render 2026 which has fully path traced rendering of Gaussian splats. Stuff like this is why I've been so excited to see where Gaussian splatting research would go. Combined with a real-time Generative AI "renderer" this stuff could start to get quite insane. Combined with Dreams it would be even better ofc :D Code to the Apple code in the comments below.

From 2 second (faster on higher end GPUs) Gaussian splat generations, using Apple's "Sharp Monocular View Synthesis in Less Than a Second" code, running locally on my system. Imported into Octane Render 2026 which has fully path traced rendering of Gaussian splats. Stuff like this is why I've been so excited to see where Gaussian splatting research would go. Combined with a real-time Generative AI "renderer" this stuff could start to get quite insane. Combined with Dreams it would be even better ofc :D Code to the Apple code in the comments below.

Martin Nebelong

36,774 次观看 • 5 个月前

PlayCanvas Engine v2.13.0 is here 🚀 Your free and open source 3D engine for the web ✅ Streamed LOD system for 3D Gaussian Splats ✅ Splat shader effects framework ✅ Globally sorted splats [1 / 2]

PlayCanvas Engine v2.13.0 is here 🚀 Your free and open source 3D engine for the web ✅ Streamed LOD system for 3D Gaussian Splats ✅ Splat shader effects framework ✅ Globally sorted splats [1 / 2]

PlayCanvas

37,210 次观看 • 7 个月前

generating greek architectures with Apple's SHARP ML modal + threejs. magical to see these scenes come to life before you dreamy explorations 💭

generating greek architectures with Apple's SHARP ML modal + threejs. magical to see these scenes come to life before you dreamy explorations 💭

ty

24,862 次观看 • 3 个月前

Semantically annotating 3D gaussian splats on the fly using gemini 3.1 + sparkjs 1. Load any 3D scene and hit scan 2. Get 2D detections from VLM 3. Cluster outputs & project into 3D world space 4. Save as a persistent 3D semantic layer Inspired by Alexander Chen's experiments with gemini visual intelligence. Just had to try to lift it from 2D to 3D!

Semantically annotating 3D gaussian splats on the fly using gemini 3.1 + sparkjs 1. Load any 3D scene and hit scan 2. Get 2D detections from VLM 3. Cluster outputs & project into 3D world space 4. Save as a persistent 3D semantic layer Inspired by Alexander Chen's experiments with gemini visual intelligence. Just had to try to lift it from 2D to 3D!

Bilawal Sidhu

56,330 次观看 • 28 天前

I created a 3D Gaussian Splat of my kitchen using 1/3rd the images it used to take me by using NVIDIA AI Developer's 3DGRUT! I can now use 180 degree fisheye images and ray tracing to make detailed splats. The only reason the scene isn't sharper is because my input images weren't super sharp - when I took the images back in October, I was still learning to use the lens. I plan to make a "first reactions/overview video". Tutorial after that. For reference, this took 206 images and the ultrawide on my iPhone took 608 images to capture. #3D #AEC #Computervision

I created a 3D Gaussian Splat of my kitchen using 1/3rd the images it used to take me by using NVIDIA AI Developer's 3DGRUT! I can now use 180 degree fisheye images and ray tracing to make detailed splats. The only reason the scene isn't sharper is because my input images weren't super sharp - when I took the images back in October, I was still learning to use the lens. I plan to make a "first reactions/overview video". Tutorial after that. For reference, this took 206 images and the ultrawide on my iPhone took 608 images to capture. #3D #AEC #Computervision

Jonathan Stephens

30,617 次观看 • 1 年前

I am releasing the “MLSharp” app for macOS. MLSharp is a premium macOS application that transforms 2D images into immersive 3D Gaussian Splatting (3DGS) models using state-of-the-art AI.

I am releasing the “MLSharp” app for macOS. MLSharp is a premium macOS application that transforms 2D images into immersive 3D Gaussian Splatting (3DGS) models using state-of-the-art AI.

むっちゃん

90,482 次观看 • 2 个月前

Iconic macOS wallpapers recreated in 3D using Apple’s new ML-SHARP model.

Iconic macOS wallpapers recreated in 3D using Apple’s new ML-SHARP model.

Justin Ryan ᯅ

44,739 次观看 • 5 个月前

2d-to-3d video Gaussian splatting, fully local on an M4 Max. using Rerun for visualization.

2d-to-3d video Gaussian splatting, fully local on an M4 Max. using Rerun for visualization.

Jaskirat Singh

103,996 次观看 • 5 个月前

🚀 Just created something completely new! I Rewrote Apple's Sharp to generate 3D Gaussian Splats from a single 360° equirectangular image made from FLUX 2 (Flex) One equirectangular image → Full spherical 3DGS world! ✨ New web interface - drag & drop your pano, select quality, download PLY ⚡ 2-3 sec on a older laptop Quality tiers: ▫️ Low: 500K splats ▫️ Medium: 2M splats ▫️ High: 4.7M splats ▫️ Ultra: 8.4M splats The pipeline: 360° depth estimation from equirectangular input Spherical projection maps pixels → 3D points Each point becomes a Gaussian with depth-scaled radius - Export to standard PLY for any 3DGS viewer (Unity) No multi-view capture. No COLMAP. No NeRF training. Just upload a pano, pick quality, get your splats. #3DGS #GaussianSplatting #ComputerVision #AI #madewithunity #Splats Sharp Monocular View Synthesis in Less Than a Second

🚀 Just created something completely new! I Rewrote Apple's Sharp to generate 3D Gaussian Splats from a single 360° equirectangular image made from FLUX 2 (Flex) One equirectangular image → Full spherical 3DGS world! ✨ New web interface - drag & drop your pano, select quality, download PLY ⚡ 2-3 sec on a older laptop Quality tiers: ▫️ Low: 500K splats ▫️ Medium: 2M splats ▫️ High: 4.7M splats ▫️ Ultra: 8.4M splats The pipeline: 360° depth estimation from equirectangular input Spherical projection maps pixels → 3D points Each point becomes a Gaussian with depth-scaled radius - Export to standard PLY for any 3DGS viewer (Unity) No multi-view capture. No COLMAP. No NeRF training. Just upload a pano, pick quality, get your splats. #3DGS #GaussianSplatting #ComputerVision #AI #madewithunity #Splats Sharp Monocular View Synthesis in Less Than a Second

Daniel Skaale

73,031 次观看 • 5 个月前

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

MrNeRF

66,016 次观看 • 7 个月前

3D Gaussian Splats are cool, but they're static (Part 13). VR-GS makes it possible for users to interact with 3D Gaussian kernels in VR and can generate realistic dynamic responses and illumination in real-time.

3D Gaussian Splats are cool, but they're static (Part 13). VR-GS makes it possible for users to interact with 3D Gaussian kernels in VR and can generate realistic dynamic responses and illumination in real-time.

Dreaming Tulpa 🥓👑

73,759 次观看 • 2 年前

People are underestimating Apple in AI. I just ran Apple’s new SHARP model locally and watched my photos turn into 3D Gaussian splats in seconds, then stepped inside them on Vision Pro. This feels like the beginning of something special. You really have to try it.

People are underestimating Apple in AI. I just ran Apple’s new SHARP model locally and watched my photos turn into 3D Gaussian splats in seconds, then stepped inside them on Vision Pro. This feels like the beginning of something special. You really have to try it.

Justin Ryan ᯅ

255,193 次观看 • 5 个月前

love my particle generator that takes in an image → outputs a gaussian splat using apple's SHARP model can see this being used for some fun animations

love my particle generator that takes in an image → outputs a gaussian splat using apple's SHARP model can see this being used for some fun animations

ty

92,860 次观看 • 1 个月前

3d visual positioning experiment -- look at the alignment between the 3d mesh and the live camera view. Truly feels magical -- like x-ray vision. Workflow: 1. Scanned a street in 15 mins w/ xgrids 2. Localized against that scan at night, in real-time, while sitting in a car The xgrids scanner (w/ rgb + lidar) is perfect to build maps for humans (3d gaussian splats). Then multiset ai makes it easy to build machine-readable maps for AR and robotics to figure out exactly where they are in 3d space with cm-level accuracy.

3d visual positioning experiment -- look at the alignment between the 3d mesh and the live camera view. Truly feels magical -- like x-ray vision. Workflow: 1. Scanned a street in 15 mins w/ xgrids 2. Localized against that scan at night, in real-time, while sitting in a car The xgrids scanner (w/ rgb + lidar) is perfect to build maps for humans (3d gaussian splats). Then multiset ai makes it easy to build machine-readable maps for AR and robotics to figure out exactly where they are in 3d space with cm-level accuracy.

Bilawal Sidhu

27,278 次观看 • 6 个月前