Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

New paper from Apple - Sharp Monocular View Synthesis in Less than a Second Mescheder et al. @ Apple just released a very impressive paper (congrats! 🎉🥳). You give it an image and it generates a really great looking 3d Gaussian representation. Uses depth pro. It's really good. The... show more

Tim Davison ᯅ

4,978 subscribers

132,791 views • 6 months ago •via X (Twitter)

Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

People are underestimating Apple in AI. I just ran Apple’s new SHARP model locally and watched my photos turn into 3D Gaussian splats in seconds, then stepped inside them on Vision Pro. This feels like the beginning of something special. You really have to try it.

People are underestimating Apple in AI. I just ran Apple’s new SHARP model locally and watched my photos turn into 3D Gaussian splats in seconds, then stepped inside them on Vision Pro. This feels like the beginning of something special. You really have to try it.

Justin Ryan ᯅ

255,283 views • 6 months ago

Breaking: Apple just released a new Apple Vision Pro and Mac app called “Apple Immersive Video Utility,” which makes it possible to stream your immersive content from your Mac to your Vision Pro in seconds. The future is bright for content creators.

Breaking: Apple just released a new Apple Vision Pro and Mac app called “Apple Immersive Video Utility,” which makes it possible to stream your immersive content from your Mac to your Vision Pro in seconds. The future is bright for content creators.

Phil Traut ᯅ

37,652 views • 1 year ago

From 2D video to a very rough 4D Gaussian Splatting POC on the Apple Vision Pro 👀 Took Big Buck Bunny frames, turned them into Gaussian splats with Sharp (Apple), compressed them with PlayCanvas splat transform to SOG, and played all frames via WebXR + spark Still rough and not fully optimized, but wow, dynamic GS in AVP feels wild 🤯 Second part of the video is on my laptop #threejs

From 2D video to a very rough 4D Gaussian Splatting POC on the Apple Vision Pro 👀 Took Big Buck Bunny frames, turned them into Gaussian splats with Sharp (Apple), compressed them with PlayCanvas splat transform to SOG, and played all frames via WebXR + spark Still rough and not fully optimized, but wow, dynamic GS in AVP feels wild 🤯 Second part of the video is on my laptop #threejs

Stijn Spanhove

20,127 views • 6 months ago

Submerged—the first scripted short film captured in Apple Immersive Video—is available on Apple Vision Pro. And, wow, it’s awesome! Edward Berger takes viewers on an action-packed story from inside a submarine. Go behind-the-scenes this weekend:

Submerged—the first scripted short film captured in Apple Immersive Video—is available on Apple Vision Pro. And, wow, it’s awesome! Edward Berger takes viewers on an action-packed story from inside a submarine. Go behind-the-scenes this weekend:

Greg Joswiak

53,195 views • 1 year ago

WOW. 😳 Apple just quietly won the 3D maps war at WWDC. Gaussian Splatting is coming to Apple Maps Flyover this fall. Apple Maps Flyover covers 300+ cities. Until yesterday, every single one was built on standard drone photogrammetry. The technology captures photos from the air and reconstructs 3D geometry from them. Gaussian Splatting does not reconstruct geometry. It represents the scene as millions of tiny 3D ellipsoids, each one carrying its own color and opacity information based on how light actually behaves in that location. The output is not a mesh model. It is a field of light. When you move through it, it does not crumble at the edges. The detail holds because it was never geometry to begin with. Apple has been hiring for this for years. Their SHARP model, published in research last year, generates photorealistic 3D scenes from a single image in under a second. Google has more sensor data than anyone. More Street View cars, more satellites, more capture history. On navigation accuracy and geodata depth, Google Maps is still ahead by most measures. But fidelity in 3D city rendering is a different competition, and Apple just set a bar in that. Most people will experience this in the fall without knowing the name of the technology. They will open Flyover, look at a city they know, and notice it looks different. Real, not rendered. That is the moment Gaussian Splatting stops being a research term and becomes something a billion people use. Bookmark this. It will look prescient by October.

WOW. 😳 Apple just quietly won the 3D maps war at WWDC. Gaussian Splatting is coming to Apple Maps Flyover this fall. Apple Maps Flyover covers 300+ cities. Until yesterday, every single one was built on standard drone photogrammetry. The technology captures photos from the air and reconstructs 3D geometry from them. Gaussian Splatting does not reconstruct geometry. It represents the scene as millions of tiny 3D ellipsoids, each one carrying its own color and opacity information based on how light actually behaves in that location. The output is not a mesh model. It is a field of light. When you move through it, it does not crumble at the edges. The detail holds because it was never geometry to begin with. Apple has been hiring for this for years. Their SHARP model, published in research last year, generates photorealistic 3D scenes from a single image in under a second. Google has more sensor data than anyone. More Street View cars, more satellites, more capture history. On navigation accuracy and geodata depth, Google Maps is still ahead by most measures. But fidelity in 3D city rendering is a different competition, and Apple just set a bar in that. Most people will experience this in the fall without knowing the name of the technology. They will open Flyover, look at a city they know, and notice it looks different. Real, not rendered. That is the moment Gaussian Splatting stops being a research term and becomes something a billion people use. Bookmark this. It will look prescient by October.

Shruti

19,784 views • 28 days ago

I tried out that newly released Apple “single image to gaussian splat” model today It’s actually incredible. Unlike the current spatial scenes feature, you can actually WALK INTO the memory you captured on your phone It only took about 10 seconds on my MacBook Pro to generate

I tried out that newly released Apple “single image to gaussian splat” model today It’s actually incredible. Unlike the current spatial scenes feature, you can actually WALK INTO the memory you captured on your phone It only took about 10 seconds on my MacBook Pro to generate

Brad Lynch

623,213 views • 6 months ago

I'm excited to share our new work, VistaDream, which generates a 3D Gaussian field from a single-view image. The codes have already been released. Project page: (with interactive demos) Code: Paper:

I'm excited to share our new work, VistaDream, which generates a 3D Gaussian field from a single-view image. The codes have already been released. Project page: (with interactive demos) Code: Paper:

Yuan Liu

79,592 views • 1 year ago

Excited to release our first public AI web app, powered by Apple’s open-source ML-SHARP model, capable of transforming a single image into a 3D Gaussian Splat with real depth understanding in seconds. Try it here → #AI #Apple #VR #GaussianSplatting

Excited to release our first public AI web app, powered by Apple’s open-source ML-SHARP model, capable of transforming a single image into a 3D Gaussian Splat with real depth understanding in seconds. Try it here → #AI #Apple #VR #GaussianSplatting

Niccolò Miranda

201,185 views • 5 months ago

Just experienced streamable 4D Gaussian Splatting content on Apple Vision Pro… and it's insane 🤯 Seeing life sized volumetric people performing right in my room is kind of mind blowing. It really feels like real humans are standing in front of you. And it streams online just like regular video. No massive downloads. No waiting. Awesome work by Gracia 👏 Apple Vision Pro + Gaussian Splatting is one of the most futuristic things I’ve seen in a long time.

Just experienced streamable 4D Gaussian Splatting content on Apple Vision Pro… and it's insane 🤯 Seeing life sized volumetric people performing right in my room is kind of mind blowing. It really feels like real humans are standing in front of you. And it streams online just like regular video. No massive downloads. No waiting. Awesome work by Gracia 👏 Apple Vision Pro + Gaussian Splatting is one of the most futuristic things I’ve seen in a long time.

Ben Geskin

1,008,512 views • 1 month ago

From 2 second (faster on higher end GPUs) Gaussian splat generations, using Apple's "Sharp Monocular View Synthesis in Less Than a Second" code, running locally on my system. Imported into Octane Render 2026 which has fully path traced rendering of Gaussian splats. Stuff like this is why I've been so excited to see where Gaussian splatting research would go. Combined with a real-time Generative AI "renderer" this stuff could start to get quite insane. Combined with Dreams it would be even better ofc :D Code to the Apple code in the comments below.

From 2 second (faster on higher end GPUs) Gaussian splat generations, using Apple's "Sharp Monocular View Synthesis in Less Than a Second" code, running locally on my system. Imported into Octane Render 2026 which has fully path traced rendering of Gaussian splats. Stuff like this is why I've been so excited to see where Gaussian splatting research would go. Combined with a real-time Generative AI "renderer" this stuff could start to get quite insane. Combined with Dreams it would be even better ofc :D Code to the Apple code in the comments below.

Martin Nebelong

36,774 views • 6 months ago

I loved being one of the first directors to use Apple Vision Pro! I was completely blown away with how it helps you play, create, and explore new worlds. Watch Wicked now on the Apple TV app, and experience it in 3D on Apple Vision Pro.

I loved being one of the first directors to use Apple Vision Pro! I was completely blown away with how it helps you play, create, and explore new worlds. Watch Wicked now on the Apple TV app, and experience it in 3D on Apple Vision Pro.

Jon M. Chu

378,694 views • 1 year ago

Gaussian splat videos are getting really good. The detail here, especially in the fabric and hair, is seriously impressive. Well done Gracia Thanks for letting me check out the TestFlight on Apple Vision Pro.

Gaussian splat videos are getting really good. The detail here, especially in the fabric and hair, is seriously impressive. Well done Gracia Thanks for letting me check out the TestFlight on Apple Vision Pro.

Spatial Insider

75,866 views • 1 month ago

Experimenting with Gaussian splatting as a scene representation for monocular autonomous driving. visualization using Rerun running through a custom Apple ML-Sharp based pipeline..

Experimenting with Gaussian splatting as a scene representation for monocular autonomous driving. visualization using Rerun running through a custom Apple ML-Sharp based pipeline..

Jaskirat Singh

18,719 views • 5 months ago

Pinch and hold an app until it jiggles, then move it to a new spot in your Home View. Here’s how to customize Home View on Apple Vision Pro in #visionOS2.

Pinch and hold an app until it jiggles, then move it to a new spot in your Home View. Here’s how to customize Home View on Apple Vision Pro in #visionOS2.

Apple Support

45,192 views • 1 year ago

This is what your Persona looks like on Apple Vision Pro. It really is incredible.

This is what your Persona looks like on Apple Vision Pro. It really is incredible.

AppleLeaker

370,587 views • 2 years ago

🚀 Just created something completely new! I Rewrote Apple's Sharp to generate 3D Gaussian Splats from a single 360° equirectangular image made from FLUX 2 (Flex) One equirectangular image → Full spherical 3DGS world! ✨ New web interface - drag & drop your pano, select quality, download PLY ⚡ 2-3 sec on a older laptop Quality tiers: ▫️ Low: 500K splats ▫️ Medium: 2M splats ▫️ High: 4.7M splats ▫️ Ultra: 8.4M splats The pipeline: 360° depth estimation from equirectangular input Spherical projection maps pixels → 3D points Each point becomes a Gaussian with depth-scaled radius - Export to standard PLY for any 3DGS viewer (Unity) No multi-view capture. No COLMAP. No NeRF training. Just upload a pano, pick quality, get your splats. #3DGS #GaussianSplatting #ComputerVision #AI #madewithunity #Splats Sharp Monocular View Synthesis in Less Than a Second

🚀 Just created something completely new! I Rewrote Apple's Sharp to generate 3D Gaussian Splats from a single 360° equirectangular image made from FLUX 2 (Flex) One equirectangular image → Full spherical 3DGS world! ✨ New web interface - drag & drop your pano, select quality, download PLY ⚡ 2-3 sec on a older laptop Quality tiers: ▫️ Low: 500K splats ▫️ Medium: 2M splats ▫️ High: 4.7M splats ▫️ Ultra: 8.4M splats The pipeline: 360° depth estimation from equirectangular input Spherical projection maps pixels → 3D points Each point becomes a Gaussian with depth-scaled radius - Export to standard PLY for any 3DGS viewer (Unity) No multi-view capture. No COLMAP. No NeRF training. Just upload a pano, pick quality, get your splats. #3DGS #GaussianSplatting #ComputerVision #AI #madewithunity #Splats Sharp Monocular View Synthesis in Less Than a Second

Daniel Skaale

73,120 views • 6 months ago

Apple just released a web page promoting privacy and it uses an iPhone 15 Pro with no Liquid glass representation anywhere. It mentions a lot about Apple Intelligence Looks like this web page was made for WWDC24 and finally released because Apple Intelligence is almost ready

Apple just released a web page promoting privacy and it uses an iPhone 15 Pro with no Liquid glass representation anywhere. It mentions a lot about Apple Intelligence Looks like this web page was made for WWDC24 and finally released because Apple Intelligence is almost ready

SLK15

282,593 views • 5 months ago

Coming this Thursday. ‘Open Hearts,’ the new immersive music experience from Abel Tesfaye. See it first exclusively on Apple Vision Pro. Watch in Apple Stores where Apple Vision Pro is available, beginning November 15th.

Coming this Thursday. ‘Open Hearts,’ the new immersive music experience from Abel Tesfaye. See it first exclusively on Apple Vision Pro. Watch in Apple Stores where Apple Vision Pro is available, beginning November 15th.

Apple Music

98,689 views • 1 year ago

Our new work PSHuman reconstructs a detailed 3D human mesh from a single-view image in ~1min. Codes have already been released! Welcome to try it! Project page: Codes: Paper:

Our new work PSHuman reconstructs a detailed 3D human mesh from a single-view image in ~1min. Codes have already been released! Welcome to try it! Project page: Codes: Paper:

Yuan Liu

53,252 views • 1 year ago