Загрузка видео...

Не удалось загрузить видео

На главную

Apple’s new Gaussian Splat model seems like the perfect tech for a native Maps app on Vision Pro. Imagine an immersive version of Look Around where you can actually walk through cities and explore places from every angle, in 3D. I tried it with some of my favorite places,...

SpatiallyMe's profile picture

Phil Traut ᯅ

4,178 subscribers

31,958 просмотров • 9 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

World Labs just released Marble, and it’s wild. Their multimodal world model lets you prompt a high fidelity 3D world with text or an image, then explore it on Vision Pro like you’re actually there. We’re stepping into an entirely new era.
1:04

World Labs just released Marble, and it’s wild. Their multimodal world model lets you prompt a high fidelity 3D world with text or an image, then explore it on Vision Pro like you’re actually there. We’re stepping into an entirely new era.

Justin Ryan ᯅ

23,915 просмотров • 10 месяцев назад

People are underestimating Apple in AI. I just ran Apple’s new SHARP model locally and watched my photos turn into 3D Gaussian splats in seconds, then stepped inside them on Vision Pro. This feels like the beginning of something special. You really have to try it.
0:51

People are underestimating Apple in AI. I just ran Apple’s new SHARP model locally and watched my photos turn into 3D Gaussian splats in seconds, then stepped inside them on Vision Pro. This feels like the beginning of something special. You really have to try it.

Justin Ryan

255,612 просмотров • 9 месяцев назад

Google Maps helps you get from A to B. SuperSplat makes you feel like you're actually there. Built on 3D Gaussian splatting tech from PlayCanvas, photorealistic captures of real-world places stream to your browser in seconds. The best bit? It's all free and open source! [1/2]
0:30

Google Maps helps you get from A to B. SuperSplat makes you feel like you're actually there. Built on 3D Gaussian splatting tech from PlayCanvas, photorealistic captures of real-world places stream to your browser in seconds. The best bit? It's all free and open source! [1/2]

Will Eastcott

105,685 просмотров • 2 месяцев назад

Gaussian Splatting videos are now streamable, just like regular video. Tried it on Vision Pro today. No app, no download. Just opened Safari and watched from any angle I wanted. It’s pretty cool. Excited for when we can bring these out of the window and into our space.
0:37

Gaussian Splatting videos are now streamable, just like regular video. Tried it on Vision Pro today. No app, no download. Just opened Safari and watched from any angle I wanted. It’s pretty cool. Excited for when we can bring these out of the window and into our space.

Justin Ryan

68,905 просмотров • 6 месяцев назад

I don't even have a photograph of my uni dorm room. 🧑‍🎓 This guy scanned his as a 3D Gaussian splat. Every poster, every bit of desk clutter, a moment frozen in time. Imagine revisiting that room decades from now. SuperSplat lets you explore and share 3D scenes like these. [1/2]
0:45

I don't even have a photograph of my uni dorm room. 🧑‍🎓 This guy scanned his as a 3D Gaussian splat. Every poster, every bit of desk clutter, a moment frozen in time. Imagine revisiting that room decades from now. SuperSplat lets you explore and share 3D scenes like these. [1/2]

Will Eastcott

46,840 просмотров • 2 месяцев назад

Well, it appears that turning a Gaussian Splat into a #3D mesh was not that hard after all 😅. I have recently tried an app called KIRI Engine - 3D Scanner App and it offers several nice features that for me made it stand out from many other scanning apps: - It supports both photos and videos - You can clean up the splat directly in the app - It works on both Android, iOS and web! - BUT MOST IMPORTANTLY you can export the mesh making gaussian splitting a much more usable format for various production pipelines. I will be interviewing Jack Wang, the CEO of Kiri for an upcoming episode of XR AI Spotlight: What questions should I ask him?
0:59

Well, it appears that turning a Gaussian Splat into a #3D mesh was not that hard after all 😅. I have recently tried an app called KIRI Engine - 3D Scanner App and it offers several nice features that for me made it stand out from many other scanning apps: - It supports both photos and videos - You can clean up the splat directly in the app - It works on both Android, iOS and web! - BUT MOST IMPORTANTLY you can export the mesh making gaussian splitting a much more usable format for various production pipelines. I will be interviewing Jack Wang, the CEO of Kiri for an upcoming episode of XR AI Spotlight: What questions should I ask him?

Gabriele Romagnoli

22,997 просмотров • 1 год назад

They finally did it! YouTube is now an official app for Apple Vision Pro and can be downloaded from the App Store. It features 3D, 180 and 360-degree content and an optimised user interface. So far I really like it. Still, it feels surreal that this is actually happening.
0:22

They finally did it! YouTube is now an official app for Apple Vision Pro and can be downloaded from the App Store. It features 3D, 180 and 360-degree content and an optimised user interface. So far I really like it. Still, it feels surreal that this is actually happening.

Phil Traut ᯅ

74,922 просмотров • 7 месяцев назад

My journey with immersive storytelling began over a decade ago with Le Musk, exploring new languages of story through 3D, 360° VR, spatial experiences and scent. Today, that journey continues with the launch of the ARR Immersive App on Apple Vision Pro. This is a place where music, movement and storytelling come together through immersive experiences, from exclusive performances and Le Musk to ARR Live, with much more to come. I hope you’ll enjoy this new chapter with us. Available now on the Apple App Store for Apple Vision Pro. #EPI #arrimmersiveapp
1:30

My journey with immersive storytelling began over a decade ago with Le Musk, exploring new languages of story through 3D, 360° VR, spatial experiences and scent. Today, that journey continues with the launch of the ARR Immersive App on Apple Vision Pro. This is a place where music, movement and storytelling come together through immersive experiences, from exclusive performances and Le Musk to ARR Live, with much more to come. I hope you’ll enjoy this new chapter with us. Available now on the Apple App Store for Apple Vision Pro. #EPI #arrimmersiveapp

A.R.Rahman

269,829 просмотров • 2 месяцев назад

I just built a full 3D world I could actually walk through… from a single prompt. No Blender. No game engine. No complex 3D tools. Just AI. This is OpenArt Worlds and it feels like the future of world creation. 🌍 Let me show you what happened!
0:43

I just built a full 3D world I could actually walk through… from a single prompt. No Blender. No game engine. No complex 3D tools. Just AI. This is OpenArt Worlds and it feels like the future of world creation. 🌍 Let me show you what happened!

SPIDER ◾

64,706 просмотров • 6 месяцев назад

One of my new favorite apps on Apple Vision Pro is Story: Spatial Storytelling! It lets you create immersive experiences with text, images, videos, 3D models, keyframing, and more. You can also explore incredible creations from others. Definitely worth checking out!
0:27

One of my new favorite apps on Apple Vision Pro is Story: Spatial Storytelling! It lets you create immersive experiences with text, images, videos, 3D models, keyframing, and more. You can also explore incredible creations from others. Definitely worth checking out!

Justin Ryan ᯅ

20,495 просмотров • 1 год назад

This will change the way we experience sports forever -- watching the game from a gods eye view. Arcturus is building 4D gaussian splatting tech that can capture every angle of a sporting event and pushes the bar for volumetric video. I tested this in a headset and it makes 360 and 3D 180 video look ancient. This puts you closer to the action than any stadium seat, and it’s genuinely mind blowing.
0:23

This will change the way we experience sports forever -- watching the game from a gods eye view. Arcturus is building 4D gaussian splatting tech that can capture every angle of a sporting event and pushes the bar for volumetric video. I tested this in a headset and it makes 360 and 3D 180 video look ancient. This puts you closer to the action than any stadium seat, and it’s genuinely mind blowing.

Bilawal Sidhu

513,105 просмотров • 8 месяцев назад

Occasionally I try an AI tool so incredible that I simply can’t stop playing with it. The new World Labs model definitely qualifies here. It’s almost impossible to describe how cool it is to walk through a 3D world that you generated from a single image.
0:20

Occasionally I try an AI tool so incredible that I simply can’t stop playing with it. The new World Labs model definitely qualifies here. It’s almost impossible to describe how cool it is to walk through a 3D world that you generated from a single image.

Justine Moore

273,045 просмотров • 1 год назад

this is officially one of my favorite new apps: Sceno on Apple Vision Pro! i couldn’t stop smiling while reliving memories exactly where they happened. you can browse past photos in immersive panoramas and explore new locations. i highly recommend it!
0:40

this is officially one of my favorite new apps: Sceno on Apple Vision Pro! i couldn’t stop smiling while reliving memories exactly where they happened. you can browse past photos in immersive panoramas and explore new locations. i highly recommend it!

Justin Ryan

191,252 просмотров • 2 лет назад

WOW. 😳 Apple just quietly won the 3D maps war at WWDC. Gaussian Splatting is coming to Apple Maps Flyover this fall. Apple Maps Flyover covers 300+ cities. Until yesterday, every single one was built on standard drone photogrammetry. The technology captures photos from the air and reconstructs 3D geometry from them. Gaussian Splatting does not reconstruct geometry. It represents the scene as millions of tiny 3D ellipsoids, each one carrying its own color and opacity information based on how light actually behaves in that location. The output is not a mesh model. It is a field of light. When you move through it, it does not crumble at the edges. The detail holds because it was never geometry to begin with. Apple has been hiring for this for years. Their SHARP model, published in research last year, generates photorealistic 3D scenes from a single image in under a second. Google has more sensor data than anyone. More Street View cars, more satellites, more capture history. On navigation accuracy and geodata depth, Google Maps is still ahead by most measures. But fidelity in 3D city rendering is a different competition, and Apple just set a bar in that. Most people will experience this in the fall without knowing the name of the technology. They will open Flyover, look at a city they know, and notice it looks different. Real, not rendered. That is the moment Gaussian Splatting stops being a research term and becomes something a billion people use. Bookmark this. It will look prescient by October.
0:24

WOW. 😳 Apple just quietly won the 3D maps war at WWDC. Gaussian Splatting is coming to Apple Maps Flyover this fall. Apple Maps Flyover covers 300+ cities. Until yesterday, every single one was built on standard drone photogrammetry. The technology captures photos from the air and reconstructs 3D geometry from them. Gaussian Splatting does not reconstruct geometry. It represents the scene as millions of tiny 3D ellipsoids, each one carrying its own color and opacity information based on how light actually behaves in that location. The output is not a mesh model. It is a field of light. When you move through it, it does not crumble at the edges. The detail holds because it was never geometry to begin with. Apple has been hiring for this for years. Their SHARP model, published in research last year, generates photorealistic 3D scenes from a single image in under a second. Google has more sensor data than anyone. More Street View cars, more satellites, more capture history. On navigation accuracy and geodata depth, Google Maps is still ahead by most measures. But fidelity in 3D city rendering is a different competition, and Apple just set a bar in that. Most people will experience this in the fall without knowing the name of the technology. They will open Flyover, look at a city they know, and notice it looks different. Real, not rendered. That is the moment Gaussian Splatting stops being a research term and becomes something a billion people use. Bookmark this. It will look prescient by October.

Shruti

19,832 просмотров • 4 месяцев назад

“I woke to a crushing sensation, like if you were on the bottom of a dog pile of people on top of you, and I just wanted to scream, get off me so I can breathe. At that moment I heard, and ‘heard’ is not the right word for it, it was like a sensational sound that shot through my head behind my ear and went inside, not an audible sound, but a different sound that increased in pitch and intensity and ended in a soft pop that felt like it was in the center of my head. That overpressure wave shot through my body from head to toes and I felt every single muscle in my body lock up, like being electrocuted. It was like nothing I’ve ever felt in my life before or after, and I thought, is this one of those sleep paralysis demons, because every single muscle then relaxed and I felt like I was falling through the bed and floor.”
22:27

“I woke to a crushing sensation, like if you were on the bottom of a dog pile of people on top of you, and I just wanted to scream, get off me so I can breathe. At that moment I heard, and ‘heard’ is not the right word for it, it was like a sensational sound that shot through my head behind my ear and went inside, not an audible sound, but a different sound that increased in pitch and intensity and ended in a soft pop that felt like it was in the center of my head. That overpressure wave shot through my body from head to toes and I felt every single muscle in my body lock up, like being electrocuted. It was like nothing I’ve ever felt in my life before or after, and I thought, is this one of those sleep paralysis demons, because every single muscle then relaxed and I felt like I was falling through the bed and floor.”

Shawn Ryan

383,464 просмотров • 7 месяцев назад

New paper from Apple - Sharp Monocular View Synthesis in Less than a Second Mescheder et al. @ Apple just released a very impressive paper (congrats! 🎉🥳). You give it an image and it generates a really great looking 3d Gaussian representation. Uses depth pro. It's really good. The model is about 3GB, and takes ~5-10s on my M1 Max per image. Single feedforward pass network. The video is using "Metal Splatter" to view the .ply from ml-sharp on Apple Vision Pro. Some really wow moments today trying it on different scenes.
0:22

New paper from Apple - Sharp Monocular View Synthesis in Less than a Second Mescheder et al. @ Apple just released a very impressive paper (congrats! 🎉🥳). You give it an image and it generates a really great looking 3d Gaussian representation. Uses depth pro. It's really good. The model is about 3GB, and takes ~5-10s on my M1 Max per image. Single feedforward pass network. The video is using "Metal Splatter" to view the .ply from ml-sharp on Apple Vision Pro. Some really wow moments today trying it on different scenes.

Tim Davison ᯅ

133,076 просмотров • 9 месяцев назад

Is the Vision Pro expensive? Yes. Can it be compared to other headsets? Not at all—at least not in general—because it does a lot of things that others simply don’t. Let me give you an example: I’m a very nostalgic person. That’s why my photo library is one of my most valuable digital assets. With over 100,000 photos, browsing through my past memories can feel like traveling through time. But nothing—really NOTHING—comes close to the experience of reliving these memories on Vision Pro. With Apple’s Machine Learning, you can literally transform any of your old photos into spatial 3D experiences—and it just works. If you haven't tried this out yet with your own memories this will be hard for you to understand. But combined with music, this actually feels like time travelling and completely redefines the way you relive past memories. Honestly, this feature alone would be worth $2K to me. Just being able to feel like you're really there, in that moment is priceless. You might not feel the same way, but that’s why everyone needs to define the value of the Vision Pro for themselves. In the end, it’s always about what you use the technology for.
0:27

Is the Vision Pro expensive? Yes. Can it be compared to other headsets? Not at all—at least not in general—because it does a lot of things that others simply don’t. Let me give you an example: I’m a very nostalgic person. That’s why my photo library is one of my most valuable digital assets. With over 100,000 photos, browsing through my past memories can feel like traveling through time. But nothing—really NOTHING—comes close to the experience of reliving these memories on Vision Pro. With Apple’s Machine Learning, you can literally transform any of your old photos into spatial 3D experiences—and it just works. If you haven't tried this out yet with your own memories this will be hard for you to understand. But combined with music, this actually feels like time travelling and completely redefines the way you relive past memories. Honestly, this feature alone would be worth $2K to me. Just being able to feel like you're really there, in that moment is priceless. You might not feel the same way, but that’s why everyone needs to define the value of the Vision Pro for themselves. In the end, it’s always about what you use the technology for.

Phil Traut ᯅ

23,084 просмотров • 1 год назад