Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Just experienced streamable 4D Gaussian Splatting content on Apple Vision Pro… and it's insane 🤯 Seeing life sized volumetric people performing right in my room is kind of mind blowing. It really feels like real humans are standing in front of you. And it streams online just like regular...

BenGeskin's profile picture

Ben Geskin

351,963 subscribers

1,011,993 Aufrufe • vor 3 Monaten •via X (Twitter)

ReisenKunstWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Gaussian Splatting videos are now streamable, just like regular video. Tried it on Vision Pro today. No app, no download. Just opened Safari and watched from any angle I wanted. It’s pretty cool. Excited for when we can bring these out of the window and into our space.
0:37

Gaussian Splatting videos are now streamable, just like regular video. Tried it on Vision Pro today. No app, no download. Just opened Safari and watched from any angle I wanted. It’s pretty cool. Excited for when we can bring these out of the window and into our space.

Justin Ryan

68,821 Aufrufe • vor 5 Monaten

From 2D video to a very rough 4D Gaussian Splatting POC on the Apple Vision Pro 👀 Took Big Buck Bunny frames, turned them into Gaussian splats with Sharp (Apple), compressed them with PlayCanvas splat transform to SOG, and played all frames via WebXR + spark Still rough and not fully optimized, but wow, dynamic GS in AVP feels wild 🤯 Second part of the video is on my laptop #threejs
0:29

From 2D video to a very rough 4D Gaussian Splatting POC on the Apple Vision Pro 👀 Took Big Buck Bunny frames, turned them into Gaussian splats with Sharp (Apple), compressed them with PlayCanvas splat transform to SOG, and played all frames via WebXR + spark Still rough and not fully optimized, but wow, dynamic GS in AVP feels wild 🤯 Second part of the video is on my laptop #threejs

Stijn Spanhove

20,127 Aufrufe • vor 8 Monaten

People are underestimating Apple in AI. I just ran Apple’s new SHARP model locally and watched my photos turn into 3D Gaussian splats in seconds, then stepped inside them on Vision Pro. This feels like the beginning of something special. You really have to try it.
0:51

People are underestimating Apple in AI. I just ran Apple’s new SHARP model locally and watched my photos turn into 3D Gaussian splats in seconds, then stepped inside them on Vision Pro. This feels like the beginning of something special. You really have to try it.

Justin Ryan

255,483 Aufrufe • vor 8 Monaten

Apple is CHANGING cinema forever. THIS IS INSANE. IT FELS LIKE YOU'RE INSIDE OF THE ACTION. IT'S IMMERSIVE. Submerged will be the first scripted film in Apple Immersive Video. Watch only on Apple Vision Pro on October 10.
0:58

Apple is CHANGING cinema forever. THIS IS INSANE. IT FELS LIKE YOU'RE INSIDE OF THE ACTION. IT'S IMMERSIVE. Submerged will be the first scripted film in Apple Immersive Video. Watch only on Apple Vision Pro on October 10.

Nikias Molina

408,877 Aufrufe • vor 1 Jahr

4D videos, are we cooked? 😳 uses 4D Gaussian Splatting to reconstruct real footage into fully explorable scenes, letting you move the camera freely through a moment after it’s been filmed. Combine it with tools like Seedance for character replacement and motion control, and Beeble for relighting, and you unlock entire cinematic workflows. You can even step inside your scenes in augmented reality with the Apple Vision Pro. #4DVAI #GaussianSplatting #AIVideoWorkflow #CreativeAI #SpatialVideo
0:40

4D videos, are we cooked? 😳 uses 4D Gaussian Splatting to reconstruct real footage into fully explorable scenes, letting you move the camera freely through a moment after it’s been filmed. Combine it with tools like Seedance for character replacement and motion control, and Beeble for relighting, and you unlock entire cinematic workflows. You can even step inside your scenes in augmented reality with the Apple Vision Pro. #4DVAI #GaussianSplatting #AIVideoWorkflow #CreativeAI #SpatialVideo

Rourke Heath

69,139 Aufrufe • vor 1 Monat

Marvel Studios' The Fantastic Four: First Steps is now streaming on Disney+ and watching it in 4K 3D with Spatial Audio on Apple Vision Pro is just awesome 🤩 Feels like sitting in a private cinema with a giant screen and insane clarity. Add AirPods and you’re fully immersed 🍿
0:27

Marvel Studios' The Fantastic Four: First Steps is now streaming on Disney+ and watching it in 4K 3D with Spatial Audio on Apple Vision Pro is just awesome 🤩 Feels like sitting in a private cinema with a giant screen and insane clarity. Add AirPods and you’re fully immersed 🍿

Ben Geskin

166,817 Aufrufe • vor 9 Monaten

New paper from Apple - Sharp Monocular View Synthesis in Less than a Second Mescheder et al. @ Apple just released a very impressive paper (congrats! 🎉🥳). You give it an image and it generates a really great looking 3d Gaussian representation. Uses depth pro. It's really good. The model is about 3GB, and takes ~5-10s on my M1 Max per image. Single feedforward pass network. The video is using "Metal Splatter" to view the .ply from ml-sharp on Apple Vision Pro. Some really wow moments today trying it on different scenes.
0:22

New paper from Apple - Sharp Monocular View Synthesis in Less than a Second Mescheder et al. @ Apple just released a very impressive paper (congrats! 🎉🥳). You give it an image and it generates a really great looking 3d Gaussian representation. Uses depth pro. It's really good. The model is about 3GB, and takes ~5-10s on my M1 Max per image. Single feedforward pass network. The video is using "Metal Splatter" to view the .ply from ml-sharp on Apple Vision Pro. Some really wow moments today trying it on different scenes.

Tim Davison ᯅ

132,924 Aufrufe • vor 8 Monaten

4DGS volumetric video captured with iPhones. 📱 Until now, capturing 4D Gaussian Splats meant million-dollar studios and fixed camera rigs. Radiant just changed the game - genlock-syncing multiple iPhone 17 Pro Max cameras with Tilta Chronos cage and Blackmagic ProDock into one fully wireless mobile capture rig. Pixel-level sync, frame by frame, real time. Apple Vision Pro native playback? We are working on it. But the capture side? Solved (affordable-ish). And it travels. The next great VolCap film could be coming from someone like you! #4DGS #volumetricvideo
0:58

4DGS volumetric video captured with iPhones. 📱 Until now, capturing 4D Gaussian Splats meant million-dollar studios and fixed camera rigs. Radiant just changed the game - genlock-syncing multiple iPhone 17 Pro Max cameras with Tilta Chronos cage and Blackmagic ProDock into one fully wireless mobile capture rig. Pixel-level sync, frame by frame, real time. Apple Vision Pro native playback? We are working on it. But the capture side? Solved (affordable-ish). And it travels. The next great VolCap film could be coming from someone like you! #4DGS #volumetricvideo

Hugh Hou

12,189 Aufrufe • vor 4 Monaten

So, Mark Zuckerberg finally tried the Apple Vision Pro and compared it to the Meta Quest 3 He says: - Quest is 7x less expensive yet way more comfortable - Quest is better for gaming, Xbox, YouTube - "I'm surprised how much better Quest is better for majority of things" My biggest takeaway: The future of ads feels like his IG post. This is real. No marketing talk, just saying it as it is. Zuck's Apple Vision Pro feels like I'm listening to a tech reviewer not a guy worth $165B. I feel like I'm having a convo in a living room with my friend Mark. You feel his enthusiasm. Reminds me of the Kayne Superbowl ad. The guy spent $7M and took a 30s selfie video. Highly effective. He sold $19M of product within 24h of that video. So my point is, if you're creating an "ad" More living room, less high budget. Be real.
3:36

So, Mark Zuckerberg finally tried the Apple Vision Pro and compared it to the Meta Quest 3 He says: - Quest is 7x less expensive yet way more comfortable - Quest is better for gaming, Xbox, YouTube - "I'm surprised how much better Quest is better for majority of things" My biggest takeaway: The future of ads feels like his IG post. This is real. No marketing talk, just saying it as it is. Zuck's Apple Vision Pro feels like I'm listening to a tech reviewer not a guy worth $165B. I feel like I'm having a convo in a living room with my friend Mark. You feel his enthusiasm. Reminds me of the Kayne Superbowl ad. The guy spent $7M and took a 30s selfie video. Highly effective. He sold $19M of product within 24h of that video. So my point is, if you're creating an "ad" More living room, less high budget. Be real.

GREG ISENBERG

11,019,263 Aufrufe • vor 2 Jahren

WOW. 😳 Apple just quietly won the 3D maps war at WWDC. Gaussian Splatting is coming to Apple Maps Flyover this fall. Apple Maps Flyover covers 300+ cities. Until yesterday, every single one was built on standard drone photogrammetry. The technology captures photos from the air and reconstructs 3D geometry from them. Gaussian Splatting does not reconstruct geometry. It represents the scene as millions of tiny 3D ellipsoids, each one carrying its own color and opacity information based on how light actually behaves in that location. The output is not a mesh model. It is a field of light. When you move through it, it does not crumble at the edges. The detail holds because it was never geometry to begin with. Apple has been hiring for this for years. Their SHARP model, published in research last year, generates photorealistic 3D scenes from a single image in under a second. Google has more sensor data than anyone. More Street View cars, more satellites, more capture history. On navigation accuracy and geodata depth, Google Maps is still ahead by most measures. But fidelity in 3D city rendering is a different competition, and Apple just set a bar in that. Most people will experience this in the fall without knowing the name of the technology. They will open Flyover, look at a city they know, and notice it looks different. Real, not rendered. That is the moment Gaussian Splatting stops being a research term and becomes something a billion people use. Bookmark this. It will look prescient by October.
0:24

WOW. 😳 Apple just quietly won the 3D maps war at WWDC. Gaussian Splatting is coming to Apple Maps Flyover this fall. Apple Maps Flyover covers 300+ cities. Until yesterday, every single one was built on standard drone photogrammetry. The technology captures photos from the air and reconstructs 3D geometry from them. Gaussian Splatting does not reconstruct geometry. It represents the scene as millions of tiny 3D ellipsoids, each one carrying its own color and opacity information based on how light actually behaves in that location. The output is not a mesh model. It is a field of light. When you move through it, it does not crumble at the edges. The detail holds because it was never geometry to begin with. Apple has been hiring for this for years. Their SHARP model, published in research last year, generates photorealistic 3D scenes from a single image in under a second. Google has more sensor data than anyone. More Street View cars, more satellites, more capture history. On navigation accuracy and geodata depth, Google Maps is still ahead by most measures. But fidelity in 3D city rendering is a different competition, and Apple just set a bar in that. Most people will experience this in the fall without knowing the name of the technology. They will open Flyover, look at a city they know, and notice it looks different. Real, not rendered. That is the moment Gaussian Splatting stops being a research term and becomes something a billion people use. Bookmark this. It will look prescient by October.

Shruti

19,832 Aufrufe • vor 2 Monaten

Tim Cook: "It's very difficult to replicate culture." "It takes a long time. You have to hire the right people — and then those people have to hire the right people." "Apple is such a unique place [that] it's not possible to replicate it ... Apple is just in a party of one."
1:05

Tim Cook: "It's very difficult to replicate culture." "It takes a long time. You have to hire the right people — and then those people have to hire the right people." "Apple is such a unique place [that] it's not possible to replicate it ... Apple is just in a party of one."

Kevin Carpenter

106,295 Aufrufe • vor 4 Monaten

Apple Vision Pro lets me show you my point of view like no other camera. Here I get a ride in @ScottevestCEO’s Ferrari on a perfect day. Near Valley of Fire state park in Nevada. If you watch it in a Vision Pro it is next level. Will post that link in a minute in reply. Tracking is a problem. Off you want to do this you have to turn on travel mode and do many tries. Often it loses tracking and stops recording.
8:04

Apple Vision Pro lets me show you my point of view like no other camera. Here I get a ride in @ScottevestCEO’s Ferrari on a perfect day. Near Valley of Fire state park in Nevada. If you watch it in a Vision Pro it is next level. Will post that link in a minute in reply. Tracking is a problem. Off you want to do this you have to turn on travel mode and do many tries. Often it loses tracking and stops recording.

Robert Scoble

41,821 Aufrufe • vor 2 Jahren

FreeTimeGS – Free Gaussian Primitives Anywhere, Anytime – has been making waves online over the past two days. You may have already seen it. If not, here’s a great example: a live demo with minimal cleanup and no heavy post-production. What’s remarkable is the simplicity of their setup. This example shows a basic semicircle rig made from smartphones and budget light stands. No complex volumetric or photogrammetry system required—and yet, the result plays smoothly right in a mobile browser. Yes, even on my iPhone. You can also view this on Vision Pro! The next logical step? Let’s bring this into the new Spatial Web standard IEEE IEEE 2874 and make it viewable in Apple Vision Pro, Android XR, and other upcoming headsets via open source XR web browser. Imagine freely flying through AI-powered Gaussian reconstructions directly in spatial environments cross platforms. We’re witnessing a major leap in spatial computing. AI-powered tools like this are reshaping every part of the creative pipeline. Can't wait to see what Apple has to say tomorrow at WWDC 25! Are you ready for it? What use cases excite you most? Drop your thoughts below—let’s discuss.
0:44

FreeTimeGS – Free Gaussian Primitives Anywhere, Anytime – has been making waves online over the past two days. You may have already seen it. If not, here’s a great example: a live demo with minimal cleanup and no heavy post-production. What’s remarkable is the simplicity of their setup. This example shows a basic semicircle rig made from smartphones and budget light stands. No complex volumetric or photogrammetry system required—and yet, the result plays smoothly right in a mobile browser. Yes, even on my iPhone. You can also view this on Vision Pro! The next logical step? Let’s bring this into the new Spatial Web standard IEEE IEEE 2874 and make it viewable in Apple Vision Pro, Android XR, and other upcoming headsets via open source XR web browser. Imagine freely flying through AI-powered Gaussian reconstructions directly in spatial environments cross platforms. We’re witnessing a major leap in spatial computing. AI-powered tools like this are reshaping every part of the creative pipeline. Can't wait to see what Apple has to say tomorrow at WWDC 25! Are you ready for it? What use cases excite you most? Drop your thoughts below—let’s discuss.

Hugh Hou

12,665 Aufrufe • vor 1 Jahr

This will change the way we experience sports forever -- watching the game from a gods eye view. Arcturus is building 4D gaussian splatting tech that can capture every angle of a sporting event and pushes the bar for volumetric video. I tested this in a headset and it makes 360 and 3D 180 video look ancient. This puts you closer to the action than any stadium seat, and it’s genuinely mind blowing.
0:23

This will change the way we experience sports forever -- watching the game from a gods eye view. Arcturus is building 4D gaussian splatting tech that can capture every angle of a sporting event and pushes the bar for volumetric video. I tested this in a headset and it makes 360 and 3D 180 video look ancient. This puts you closer to the action than any stadium seat, and it’s genuinely mind blowing.

Bilawal Sidhu

501,991 Aufrufe • vor 6 Monaten

Metallica announces an Apple Immersive concert experience, available for free only on Apple Vision Pro starting March 14. An extended preview will be available during Apple Vision Pro demos in select Apple Stores. "Apple built a custom stage plot featuring 14 Apple Immersive Video cameras using a mix of stabilized cameras, cable-suspended cameras, and remote-controlled camera dolly systems that moved around the stage." "Filmed during our final M72 stop of 2024 in Mexico City, it features full performances of “Whiplash,” “One,” and “Enter Sandman,” all captured exclusively in Apple Immersive Video." "The songs featured in Metallica will also be available as a new EP, Metallica Live from Mexico City, in Spatial Audio on Apple Music this Friday." "An extended preview of Metallica will be available as part of the Apple Vision Pro demo in Apple Store locations worldwide beginning Friday, March 14. Apple Vision Pro is available in Australia, Canada, France, Germany, Hong Kong, Japan, Singapore, South Korea, Taiwan, the United Arab Emirates, the United Kingdom, and the United States. Customers in those countries can reserve a free Vision Pro demo at their local Apple Store. You must have an Apple account to schedule."
0:32

Metallica announces an Apple Immersive concert experience, available for free only on Apple Vision Pro starting March 14. An extended preview will be available during Apple Vision Pro demos in select Apple Stores. "Apple built a custom stage plot featuring 14 Apple Immersive Video cameras using a mix of stabilized cameras, cable-suspended cameras, and remote-controlled camera dolly systems that moved around the stage." "Filmed during our final M72 stop of 2024 in Mexico City, it features full performances of “Whiplash,” “One,” and “Enter Sandman,” all captured exclusively in Apple Immersive Video." "The songs featured in Metallica will also be available as a new EP, Metallica Live from Mexico City, in Spatial Audio on Apple Music this Friday." "An extended preview of Metallica will be available as part of the Apple Vision Pro demo in Apple Store locations worldwide beginning Friday, March 14. Apple Vision Pro is available in Australia, Canada, France, Germany, Hong Kong, Japan, Singapore, South Korea, Taiwan, the United Arab Emirates, the United Kingdom, and the United States. Customers in those countries can reserve a free Vision Pro demo at their local Apple Store. You must have an Apple account to schedule."

M1

15,476 Aufrufe • vor 1 Jahr

Apple Vision Pro: My Initial Impressions I agree with some others. This is one of the most impressive pieces of tech I’ve ever used, but it's not perfect. The Good: • The eye tracking and hand gestures are simply incredible. The accuracy is like 99%. It’s quite intuitive and feels very natural. You can put your hands almost anywhere and it'll sense them. • I’m not exaggerating when I say Apple’s immersive videos made for the Vision Pro literally make you feel like you’re there in person. I felt like I was literally in the room with Alicia Keys while she sang, or traversing 3,000 feet above Norway’s breathtaking fjords while walking on a rope. My only complaint is that while Apple Immersive Videos are 180-degree 3D 8K recordings, they are still a little blurry. • You can use the Vision Pro while lying down in bed in complete darkness and the hand gestures will still work just fine (just like FaceID does in the dark). • In 2013 Apple introduced TouchID. In 2017 FaceID. With Vision Pro, Apple has introduced OpticID. It scans your iris and unlocks your Vision Pro when you put it on. It’s incredibly quick and accurate. And like FaceID, it's secure. It's what you will use to pay for things on the device as well. • I didn’t experience any vertigo, dizziness, etc while using the device. • I'm a bit of a display nerd. For the first time outside of a theatre, Avatar The Way of Water feels true to the directors creative intent. High frame rate (HFR) wasn’t possible in any other device. The 3D is exactly like the theatre. I went to a dolby cinema to watch it originally, and the Vision Pro gets it about as close to a theatre video quality experience as you can get. • The sound quality is really good. The spacial audio is very convincing. • The Vision Pro is heavy, but I found myself not caring all that much if i used the dual loop headband. • I was skeptical of the productivity side of the Vision pro, but wow does the mac virtual display work insanely well. You can easily edit videos or browse the web. • You can complain about plenty of things, but built quality is not one of them. It's really good and solid. The device feels very dense. • Neck strain was not an issue • I watched John Wick in one of the immersive environments, and the movie was reflecting onto the water perfectly. It’s was incredible. I'm not joking when i saw it literally felt like I was watching a movie on a 4K HDR screen in then middle of the wilderness. • Battery life is fine most of the time. The Not So Good: • The app ecosystem just isn’t there yet, which is understandable. That will happen over time, but currently there are only 600 apps built for the Vision. For developer, It doesn't make sense to make a custom Vision Pro app when there are only ~200k users in the ecosystem. • The field of view is kinda of small, which is disappointing, and sometimes a little distracting. It's not terrible, but I wish the FOV was bigger. • The passthrough video is dissapointinly low quality, though it’s still better than anything else on the market. You can’t read your small text on your phone. Colors are muted, and it's a little jittery. Future versions will be better no doubt. • It is sort of an isolating device. I almost guarantee you future versions of the Vision Pro will be able to connect with one another so two people can be looking at the same virtual safari window, movie, etc. • Price: It's expensive. • As I said above, while heavy, the weight of the VP was not an issue for me, but that doesn't mean I don't want it to be lighter. It does press against your face pretty hard, which can cause minor cheek area fatigue. Future versions will no doubt be lighter. Final Thoughts: Going back to my Mac felt weird. It suddenly felt like a technology of the past. If you have the money and want to be an early adopter, you’ll be happy with the Vision Pro. But I have to say, the second or third generation of this device, I think, will be better and cheaper, so it’s probably worth waiting for that. While it’s one of the greatest pieces of tech I’ve ever tried, I can’t see myself using this in my daily life yet, and for $3,500, I should be able to envision that. I'm going to give it a few more days, but I'll likely be returning it. The app ecosystem needs to improve and expand a lot. That's ultimately what will make or break this thing's success. Apple knocked it out of the park engineering this thing. It's mind blowing, but if i'm already mind blown, Imagine how good future versions will be.
0:37

Apple Vision Pro: My Initial Impressions I agree with some others. This is one of the most impressive pieces of tech I’ve ever used, but it's not perfect. The Good: • The eye tracking and hand gestures are simply incredible. The accuracy is like 99%. It’s quite intuitive and feels very natural. You can put your hands almost anywhere and it'll sense them. • I’m not exaggerating when I say Apple’s immersive videos made for the Vision Pro literally make you feel like you’re there in person. I felt like I was literally in the room with Alicia Keys while she sang, or traversing 3,000 feet above Norway’s breathtaking fjords while walking on a rope. My only complaint is that while Apple Immersive Videos are 180-degree 3D 8K recordings, they are still a little blurry. • You can use the Vision Pro while lying down in bed in complete darkness and the hand gestures will still work just fine (just like FaceID does in the dark). • In 2013 Apple introduced TouchID. In 2017 FaceID. With Vision Pro, Apple has introduced OpticID. It scans your iris and unlocks your Vision Pro when you put it on. It’s incredibly quick and accurate. And like FaceID, it's secure. It's what you will use to pay for things on the device as well. • I didn’t experience any vertigo, dizziness, etc while using the device. • I'm a bit of a display nerd. For the first time outside of a theatre, Avatar The Way of Water feels true to the directors creative intent. High frame rate (HFR) wasn’t possible in any other device. The 3D is exactly like the theatre. I went to a dolby cinema to watch it originally, and the Vision Pro gets it about as close to a theatre video quality experience as you can get. • The sound quality is really good. The spacial audio is very convincing. • The Vision Pro is heavy, but I found myself not caring all that much if i used the dual loop headband. • I was skeptical of the productivity side of the Vision pro, but wow does the mac virtual display work insanely well. You can easily edit videos or browse the web. • You can complain about plenty of things, but built quality is not one of them. It's really good and solid. The device feels very dense. • Neck strain was not an issue • I watched John Wick in one of the immersive environments, and the movie was reflecting onto the water perfectly. It’s was incredible. I'm not joking when i saw it literally felt like I was watching a movie on a 4K HDR screen in then middle of the wilderness. • Battery life is fine most of the time. The Not So Good: • The app ecosystem just isn’t there yet, which is understandable. That will happen over time, but currently there are only 600 apps built for the Vision. For developer, It doesn't make sense to make a custom Vision Pro app when there are only ~200k users in the ecosystem. • The field of view is kinda of small, which is disappointing, and sometimes a little distracting. It's not terrible, but I wish the FOV was bigger. • The passthrough video is dissapointinly low quality, though it’s still better than anything else on the market. You can’t read your small text on your phone. Colors are muted, and it's a little jittery. Future versions will be better no doubt. • It is sort of an isolating device. I almost guarantee you future versions of the Vision Pro will be able to connect with one another so two people can be looking at the same virtual safari window, movie, etc. • Price: It's expensive. • As I said above, while heavy, the weight of the VP was not an issue for me, but that doesn't mean I don't want it to be lighter. It does press against your face pretty hard, which can cause minor cheek area fatigue. Future versions will no doubt be lighter. Final Thoughts: Going back to my Mac felt weird. It suddenly felt like a technology of the past. If you have the money and want to be an early adopter, you’ll be happy with the Vision Pro. But I have to say, the second or third generation of this device, I think, will be better and cheaper, so it’s probably worth waiting for that. While it’s one of the greatest pieces of tech I’ve ever tried, I can’t see myself using this in my daily life yet, and for $3,500, I should be able to envision that. I'm going to give it a few more days, but I'll likely be returning it. The app ecosystem needs to improve and expand a lot. That's ultimately what will make or break this thing's success. Apple knocked it out of the park engineering this thing. It's mind blowing, but if i'm already mind blown, Imagine how good future versions will be.

Sawyer Merritt

1,602,952 Aufrufe • vor 2 Jahren

From 2 second (faster on higher end GPUs) Gaussian splat generations, using Apple's "Sharp Monocular View Synthesis in Less Than a Second" code, running locally on my system. Imported into Octane Render 2026 which has fully path traced rendering of Gaussian splats. Stuff like this is why I've been so excited to see where Gaussian splatting research would go. Combined with a real-time Generative AI "renderer" this stuff could start to get quite insane. Combined with Dreams it would be even better ofc :D Code to the Apple code in the comments below.
0:33

From 2 second (faster on higher end GPUs) Gaussian splat generations, using Apple's "Sharp Monocular View Synthesis in Less Than a Second" code, running locally on my system. Imported into Octane Render 2026 which has fully path traced rendering of Gaussian splats. Stuff like this is why I've been so excited to see where Gaussian splatting research would go. Combined with a real-time Generative AI "renderer" this stuff could start to get quite insane. Combined with Dreams it would be even better ofc :D Code to the Apple code in the comments below.

Martin Nebelong

36,774 Aufrufe • vor 8 Monaten

This is insane!🔥 This is a 720p (2D) video I shot of my kids 15 years ago! I used AI to upscale it, depth-map it, & used the depth map to convert it to 3D SBS, & then converted that to Spatial Video for Apple Vision Pro (MV-HEVC). My son is currently a senior in high school, and my daughter is a sophomore in college. This video has complete spatial depth when viewed in the Apple Vision Pro. Obviously, you can't appreciate that via this post. But it's like I'm there & I can see into this room. Talk about giving you the feels.🥹 This can be done with ANY video. 🤯 I'm working on refining the workflow, as it's a bit cumbersome. I plan to share it, but holy cow! I had to post this.
0:54

This is insane!🔥 This is a 720p (2D) video I shot of my kids 15 years ago! I used AI to upscale it, depth-map it, & used the depth map to convert it to 3D SBS, & then converted that to Spatial Video for Apple Vision Pro (MV-HEVC). My son is currently a senior in high school, and my daughter is a sophomore in college. This video has complete spatial depth when viewed in the Apple Vision Pro. Obviously, you can't appreciate that via this post. But it's like I'm there & I can see into this room. Talk about giving you the feels.🥹 This can be done with ANY video. 🤯 I'm working on refining the workflow, as it's a bit cumbersome. I plan to share it, but holy cow! I had to post this.

Blaine Brown

1,468,678 Aufrufe • vor 2 Jahren

👁️ Kamaru Usman says he was eye-poked in the early rounds, which compromised his vision. "I took kind of like a thumb punch in the eye early on, and that kind of blurred the vision a bit... But no excuses, it is what it is. He's a big boy, and when you start seeing two of the big boys..."
0:32

👁️ Kamaru Usman says he was eye-poked in the early rounds, which compromised his vision. "I took kind of like a thumb punch in the eye early on, and that kind of blurred the vision a bit... But no excuses, it is what it is. He's a big boy, and when you start seeing two of the big boys..."

MMA Pros Pick

181,859 Aufrufe • vor 1 Monat

Spatial video is so underrated. Yeah, we all laughed at that cringey Apple Vision Pro demo.. the dad with a headset strapped on at his kid’s birthday. But this isn’t just video recording.. This is a life moment recording. Watching a spatial video in Apple Vision Pro feels like almost being there. Words can’t do justice- you have to experience it. When we lost our cat Buttercup, it was devastating. But I have spatially recorded videos of him- me petting him and seeing in full 3D. Every hair on his body, the fluffy texture of his fur, even the details in his whiskers- it’s so vivid it feels like you could reach out and touch him. It’s therapeutic. Healing. Almost like a window back into those moments. I used to think we’d have to wait until we were living in spaceships, staring at hologram of loved ones, to be experiencing something like this. But Apple made that a reality- now, in our lifetime. That’s the power of spatial video.
0:54

Spatial video is so underrated. Yeah, we all laughed at that cringey Apple Vision Pro demo.. the dad with a headset strapped on at his kid’s birthday. But this isn’t just video recording.. This is a life moment recording. Watching a spatial video in Apple Vision Pro feels like almost being there. Words can’t do justice- you have to experience it. When we lost our cat Buttercup, it was devastating. But I have spatially recorded videos of him- me petting him and seeing in full 3D. Every hair on his body, the fluffy texture of his fur, even the details in his whiskers- it’s so vivid it feels like you could reach out and touch him. It’s therapeutic. Healing. Almost like a window back into those moments. I used to think we’d have to wait until we were living in spaceships, staring at hologram of loved ones, to be experiencing something like this. But Apple made that a reality- now, in our lifetime. That’s the power of spatial video.

Dylan Bishop

13,909 Aufrufe • vor 1 Jahr