Loading video...

Video Failed to Load

Go Home

People are underestimating Apple in AI. I just ran Apple’s new SHARP model locally and watched my photos turn into 3D Gaussian splats in seconds, then stepped inside them on Vision Pro. This feels like the beginning of something special. You really have to try it.

justinryanio's profile picture

Justin Ryan ᯅ

11,999 subscribers

255,283 views • 7 months ago •via X (Twitter)

EducationHealth & WellnessScience & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Excited to release our first public AI web app, powered by Apple’s open-source ML-SHARP model, capable of transforming a single image into a 3D Gaussian Splat with real depth understanding in seconds. Try it here → #AI #Apple #VR #GaussianSplatting
0:27

Excited to release our first public AI web app, powered by Apple’s open-source ML-SHARP model, capable of transforming a single image into a 3D Gaussian Splat with real depth understanding in seconds. Try it here → #AI #Apple #VR #GaussianSplatting

Niccolò Miranda

201,290 views • 6 months ago

Just experienced streamable 4D Gaussian Splatting content on Apple Vision Pro… and it's insane 🤯 Seeing life sized volumetric people performing right in my room is kind of mind blowing. It really feels like real humans are standing in front of you. And it streams online just like regular video. No massive downloads. No waiting. Awesome work by Gracia 👏 Apple Vision Pro + Gaussian Splatting is one of the most futuristic things I’ve seen in a long time.
0:34

Just experienced streamable 4D Gaussian Splatting content on Apple Vision Pro… and it's insane 🤯 Seeing life sized volumetric people performing right in my room is kind of mind blowing. It really feels like real humans are standing in front of you. And it streams online just like regular video. No massive downloads. No waiting. Awesome work by Gracia 👏 Apple Vision Pro + Gaussian Splatting is one of the most futuristic things I’ve seen in a long time.

Ben Geskin

1,009,249 views • 2 months ago

From 2D video to a very rough 4D Gaussian Splatting POC on the Apple Vision Pro 👀 Took Big Buck Bunny frames, turned them into Gaussian splats with Sharp (Apple), compressed them with PlayCanvas splat transform to SOG, and played all frames via WebXR + spark Still rough and not fully optimized, but wow, dynamic GS in AVP feels wild 🤯 Second part of the video is on my laptop #threejs
0:29

From 2D video to a very rough 4D Gaussian Splatting POC on the Apple Vision Pro 👀 Took Big Buck Bunny frames, turned them into Gaussian splats with Sharp (Apple), compressed them with PlayCanvas splat transform to SOG, and played all frames via WebXR + spark Still rough and not fully optimized, but wow, dynamic GS in AVP feels wild 🤯 Second part of the video is on my laptop #threejs

Stijn Spanhove

20,127 views • 7 months ago

Apple’s new Gaussian Splat model seems like the perfect tech for a native Maps app on Vision Pro. Imagine an immersive version of Look Around where you can actually walk through cities and explore places from every angle, in 3D. I tried it with some of my favorite places, and it genuinely feels like being there again. It’s wild that this works from just a single image.
0:47

Apple’s new Gaussian Splat model seems like the perfect tech for a native Maps app on Vision Pro. Imagine an immersive version of Look Around where you can actually walk through cities and explore places from every angle, in 3D. I tried it with some of my favorite places, and it genuinely feels like being there again. It’s wild that this works from just a single image.

Phil Traut ᯅ

31,958 views • 7 months ago

New paper from Apple - Sharp Monocular View Synthesis in Less than a Second Mescheder et al. @ Apple just released a very impressive paper (congrats! 🎉🥳). You give it an image and it generates a really great looking 3d Gaussian representation. Uses depth pro. It's really good. The model is about 3GB, and takes ~5-10s on my M1 Max per image. Single feedforward pass network. The video is using "Metal Splatter" to view the .ply from ml-sharp on Apple Vision Pro. Some really wow moments today trying it on different scenes.
0:22

New paper from Apple - Sharp Monocular View Synthesis in Less than a Second Mescheder et al. @ Apple just released a very impressive paper (congrats! 🎉🥳). You give it an image and it generates a really great looking 3d Gaussian representation. Uses depth pro. It's really good. The model is about 3GB, and takes ~5-10s on my M1 Max per image. Single feedforward pass network. The video is using "Metal Splatter" to view the .ply from ml-sharp on Apple Vision Pro. Some really wow moments today trying it on different scenes.

Tim Davison ᯅ

132,865 views • 7 months ago

oh may.. 3D Gaussian Splat is so crazy now last time we need weeks to turn a room into a 3D model.. now with AI 3DGS, you do it in seconds… even zoom into the text and looks perfect give it like 6 months… you can turn a whole city into a full detailed 3D model
0:22

oh may.. 3D Gaussian Splat is so crazy now last time we need weeks to turn a room into a 3D model.. now with AI 3DGS, you do it in seconds… even zoom into the text and looks perfect give it like 6 months… you can turn a whole city into a full detailed 3D model

el.cine

142,328 views • 8 months ago

I loved being one of the first directors to use Apple Vision Pro! I was completely blown away with how it helps you play, create, and explore new worlds. Watch Wicked now on the Apple TV app, and experience it in 3D on Apple Vision Pro.
1:00

I loved being one of the first directors to use Apple Vision Pro! I was completely blown away with how it helps you play, create, and explore new worlds. Watch Wicked now on the Apple TV app, and experience it in 3D on Apple Vision Pro.

Jon M. Chu

378,694 views • 1 year ago

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.
1:10

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

MrNeRF

66,016 views • 9 months ago

Introducing powered by Over the Reality. FreeGaussian is a new way to transform your existing photos, videos, and 360 captures for free into high-quality 3D Gaussian splats, directly in your browser. Whether you already have: ↳ a 360 recording captured with any 360 camera ↳ a set of photos ↳ or even a simple video from a place you visited you can now turn it into a photorealistic 3D Gaussian splat. Just go to upload your content, and let the reconstruction happen. Once it’s ready, you can download your 3D Gaussian splat and point cloud, and use them across your own projects, pipelines, or applications.
0:27

Introducing powered by Over the Reality. FreeGaussian is a new way to transform your existing photos, videos, and 360 captures for free into high-quality 3D Gaussian splats, directly in your browser. Whether you already have: ↳ a 360 recording captured with any 360 camera ↳ a set of photos ↳ or even a simple video from a place you visited you can now turn it into a photorealistic 3D Gaussian splat. Just go to upload your content, and let the reconstruction happen. Once it’s ready, you can download your 3D Gaussian splat and point cloud, and use them across your own projects, pipelines, or applications.

Over the Reality 🌐

86,245 views • 3 months ago

✨ Made a new mini feature on Photo AI: [ Grab from 3d model ] So the problem is we're at that stage in time (typical for AI) where image-to-3d models are not good enough but are fun to play with, but we know they'll be good enough in 1-2 years With [ Make 3d model ] you already can turn any Photo AI pic into a 3d model but it still looks hyper clunky and deformed, but it works! One cool idea I had to make that more useful and made now: Let people make a 3d model then change the view of the it with the 3d viewer, then press [ o ] and it grabs a frame of the 3d That image you can then [ Remix ] (img2img), and it becomes a real photo again and that in turn you can then turn into a video again with [ Make video ] So that essentially gives you a fully freeform camera position control to take photos with One thing I need to fix is the background/skybox, I kinda need to take the original photo and remove the person and just get the background for the 3d model viewer, in this case it should be white, but it's a start!
0:51

✨ Made a new mini feature on Photo AI: [ Grab from 3d model ] So the problem is we're at that stage in time (typical for AI) where image-to-3d models are not good enough but are fun to play with, but we know they'll be good enough in 1-2 years With [ Make 3d model ] you already can turn any Photo AI pic into a 3d model but it still looks hyper clunky and deformed, but it works! One cool idea I had to make that more useful and made now: Let people make a 3d model then change the view of the it with the 3d viewer, then press [ o ] and it grabs a frame of the 3d That image you can then [ Remix ] (img2img), and it becomes a real photo again and that in turn you can then turn into a video again with [ Make video ] So that essentially gives you a fully freeform camera position control to take photos with One thing I need to fix is the background/skybox, I kinda need to take the original photo and remove the person and just get the background for the 3d model viewer, in this case it should be white, but it's a start!

@levelsio

119,210 views • 1 year ago

AI + AR is going to change everything! I turned my photo into a 3D bobblehead in under 5 minutes using ChatGPT and Tripo3D. Dropped it into my space with Vision Pro. It’s wild. No wonder Apple and Meta are shifting some of their XR people onto AI teams.
0:29

AI + AR is going to change everything! I turned my photo into a 3D bobblehead in under 5 minutes using ChatGPT and Tripo3D. Dropped it into my space with Vision Pro. It’s wild. No wonder Apple and Meta are shifting some of their XR people onto AI teams.

Justin Ryan ᯅ

12,232 views • 1 year ago

From 2 second (faster on higher end GPUs) Gaussian splat generations, using Apple's "Sharp Monocular View Synthesis in Less Than a Second" code, running locally on my system. Imported into Octane Render 2026 which has fully path traced rendering of Gaussian splats. Stuff like this is why I've been so excited to see where Gaussian splatting research would go. Combined with a real-time Generative AI "renderer" this stuff could start to get quite insane. Combined with Dreams it would be even better ofc :D Code to the Apple code in the comments below.
0:33

From 2 second (faster on higher end GPUs) Gaussian splat generations, using Apple's "Sharp Monocular View Synthesis in Less Than a Second" code, running locally on my system. Imported into Octane Render 2026 which has fully path traced rendering of Gaussian splats. Stuff like this is why I've been so excited to see where Gaussian splatting research would go. Combined with a real-time Generative AI "renderer" this stuff could start to get quite insane. Combined with Dreams it would be even better ofc :D Code to the Apple code in the comments below.

Martin Nebelong

36,774 views • 7 months ago

I've been trained into an AI model. My voice, what I look like, 3d model of my face, even my personality. The folks even turned it into something you can actually talk to. It's freaking wild. You gotta try it 🤯👇
1:14

I've been trained into an AI model. My voice, what I look like, 3d model of my face, even my personality. The folks even turned it into something you can actually talk to. It's freaking wild. You gotta try it 🤯👇

Eric Simons

26,810 views • 1 year ago

Here’s my problem with Apple’s ai reframing, it isn’t just adding in more background, it’s generating people, text, and signs that weren’t there. I don’t believe tools like this should be built into the native photos app. This does not respect the art of photography
0:22

Here’s my problem with Apple’s ai reframing, it isn’t just adding in more background, it’s generating people, text, and signs that weren’t there. I don’t believe tools like this should be built into the native photos app. This does not respect the art of photography

GregsGadgets

46,178 views • 1 month ago

Experience history in a whole new way with Apple Vision Pro. GeoWhenWhere is a spatial quiz that lets you wander through immersive 3D Gaussian splat scenes, then test yourself by pinpointing where they belong on the map and when they fit on the timeline.
0:50

Experience history in a whole new way with Apple Vision Pro. GeoWhenWhere is a spatial quiz that lets you wander through immersive 3D Gaussian splat scenes, then test yourself by pinpointing where they belong on the map and when they fit on the timeline.

Cassandra👌𝕏

16,457 views • 1 month ago

this is officially one of my favorite new apps: Sceno on Apple Vision Pro! i couldn’t stop smiling while reliving memories exactly where they happened. you can browse past photos in immersive panoramas and explore new locations. i highly recommend it!
0:40

this is officially one of my favorite new apps: Sceno on Apple Vision Pro! i couldn’t stop smiling while reliving memories exactly where they happened. you can browse past photos in immersive panoramas and explore new locations. i highly recommend it!

Justin Ryan ᯅ

191,115 views • 1 year ago

This is insane!🔥 This is a 720p (2D) video I shot of my kids 15 years ago! I used AI to upscale it, depth-map it, & used the depth map to convert it to 3D SBS, & then converted that to Spatial Video for Apple Vision Pro (MV-HEVC). My son is currently a senior in high school, and my daughter is a sophomore in college. This video has complete spatial depth when viewed in the Apple Vision Pro. Obviously, you can't appreciate that via this post. But it's like I'm there & I can see into this room. Talk about giving you the feels.🥹 This can be done with ANY video. 🤯 I'm working on refining the workflow, as it's a bit cumbersome. I plan to share it, but holy cow! I had to post this.
0:54

This is insane!🔥 This is a 720p (2D) video I shot of my kids 15 years ago! I used AI to upscale it, depth-map it, & used the depth map to convert it to 3D SBS, & then converted that to Spatial Video for Apple Vision Pro (MV-HEVC). My son is currently a senior in high school, and my daughter is a sophomore in college. This video has complete spatial depth when viewed in the Apple Vision Pro. Obviously, you can't appreciate that via this post. But it's like I'm there & I can see into this room. Talk about giving you the feels.🥹 This can be done with ANY video. 🤯 I'm working on refining the workflow, as it's a bit cumbersome. I plan to share it, but holy cow! I had to post this.

Blaine Brown

1,468,349 views • 2 years ago

oh my.. hows this even possible Meta just dropped SAM 3D, you can auto select any object in still image and.. turn them into high quality 3D model the model is free to download and test in playground link in comments
0:27

oh my.. hows this even possible Meta just dropped SAM 3D, you can auto select any object in still image and.. turn them into high quality 3D model the model is free to download and test in playground link in comments

el.cine

794,788 views • 8 months ago

Sora: My only real wish for my husband is to stop turning his socks inside out and leaving them lying around. Jongin: Why? What's wrong with putting them inside out? Suji: But you have to flip them back again... Sora: Just thinking about him doing that makes me really angry. Jongin 😨 Sora: Why are you poking your face like that? Jongin: No... Fighting over something like that is really hard to believe. Suji: Really? Married couples really fight over things like this?Is it because I love you more? No, I love you more... Do you really think people fight over stuff like this? Jongin: No, no. But honestly, when it comes to socks, I think putting them inside out is fine. That's just my opinion. I mean, I always turn my socks inside out like this. Why are you making that face, nuna? Is it really that bad? Suji: Jongin-ah, nuna is on your side. I get scolded by my husband for this. I even turn my T-shirts inside out like this.
0:48

Sora: My only real wish for my husband is to stop turning his socks inside out and leaving them lying around. Jongin: Why? What's wrong with putting them inside out? Suji: But you have to flip them back again... Sora: Just thinking about him doing that makes me really angry. Jongin 😨 Sora: Why are you poking your face like that? Jongin: No... Fighting over something like that is really hard to believe. Suji: Really? Married couples really fight over things like this?Is it because I love you more? No, I love you more... Do you really think people fight over stuff like this? Jongin: No, no. But honestly, when it comes to socks, I think putting them inside out is fine. That's just my opinion. I mean, I always turn my socks inside out like this. Why are you making that face, nuna? Is it really that bad? Suji: Jongin-ah, nuna is on your side. I get scolded by my husband for this. I even turn my T-shirts inside out like this.

PandaSister_판다누나

23,636 views • 4 months ago

Okay, this is absolutely WILD – Apple’s new Sharp model is even more impressive on Vision Pro when you place it exactly where the original photo was taken. Since we’ll probably never have snow on Christmas again, seeing my parents’ garden covered in snow once more made me really emotional. I still can’t believe this was created from a single picture. We’re getting very close to real-life time machines.
0:32

Okay, this is absolutely WILD – Apple’s new Sharp model is even more impressive on Vision Pro when you place it exactly where the original photo was taken. Since we’ll probably never have snow on Christmas again, seeing my parents’ garden covered in snow once more made me really emotional. I still can’t believe this was created from a single picture. We’re getting very close to real-life time machines.

Phil Traut ᯅ

57,316 views • 7 months ago