Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Apple and Meta are still missing the point when it comes to spatial productivity. Going monitor-free or showing the weather in 3d space isn't enough. There's not enough value in replacing a frictionless setup like a laptop and mouse unless the spatial environment unlocks something radically more powerful: a... show more

Greg Madisᯅn

9,138 subscribers

75,936 views • 1 year ago •via X (Twitter)

Science & Technology Education Arts

Anya Rossi• Live Now

Private livecam show

11 Comments

Adrian1 year ago

I think about this a lot too! The value proposition has to go beyond “3D for 3D’s sake.” Hybrid approaches (2D + 3D) might be the way forward - leveraging spatial tools where they truly add value, while keeping the best of current systems. I explored this idea in my master thesis

Greg Madisᯅn1 year ago

This is really great Adrian!

UserInterface3 years ago

How to Detect an Apple AirTag Tracker Without an Apple Device

eric provencher1 year ago

Love it Greg!

Frode A. Hegland1 year ago

Nice

Shahryar Qureshi1 year ago

That was awesome

𝕏𝙰𝚍1 year ago

hopefully the #visionOS widgets and spatial persistence across user sessions announced today at #WWDC25 would enables this finally 🤔

Clyde DeSouza1 year ago

Tl;Dr: there's no strain on elbow or triceps when using a mouse. Until apple and @RealityLabs figure out a way to fluidly control "cursor" precision based on index finger (or thumb) tracking while yr wrist is at rest... We never going to replace the joy of a mouse input.

Michael Blix1 year ago

Great stuff!

MadMonkMani1 year ago

Very cool, interesting to see what sort of interactive tools/mediums could exist in this space that don't currently exist physically. Given the progression of generative tools curious if users will be able to prompt and buildout their own tool sets and mediums of interaction. Obviously could see markets for this as users design tools that other users can buy, mutate, or otherwise repurpose.

Intellipedia.AI1 year ago

There needs to be heavy integration of voice and eye commands too offload at least 50% of the work from constant contactless hand and arm waving. Ergonomically that's going to be a stressor on joints and ligaments and muscles. Lots of carpal tunnel type of health risk there.

Related Videos

Spatial computing workstation 🥽✨ ∙ Place apps and webpages anywhere around you ∙ Any size and aspect ratio ∙ Keyboard and mouse support ∙ Work in your room or in a virtual environment I think this is pretty awesome and you can actually get some work done like that. Yes, of course higher resolution screens are welcome, as well as more polished software. But it's still cool. Meta Quest 3 + Fluid app *this low-resolution screen recording doesn't show the actual quality in the headset

Spatial computing workstation 🥽✨ ∙ Place apps and webpages anywhere around you ∙ Any size and aspect ratio ∙ Keyboard and mouse support ∙ Work in your room or in a virtual environment I think this is pretty awesome and you can actually get some work done like that. Yes, of course higher resolution screens are welcome, as well as more polished software. But it's still cool. Meta Quest 3 + Fluid app *this low-resolution screen recording doesn't show the actual quality in the headset

Ben Geskin

893,742 views • 2 years ago

Dark Noise is not going to be ready for visionOS day 1 but ya'll are having so much fun I feel left out! So I'm trying to get a lite version I'm calling "Spatial Noise" released before Friday 🤞 It lets you spawn little windows that play a spatial sound fixed in 3d space

Dark Noise is not going to be ready for visionOS day 1 but ya'll are having so much fun I feel left out! So I'm trying to get a lite version I'm calling "Spatial Noise" released before Friday 🤞 It lets you spawn little windows that play a spatial sound fixed in 3d space

Charlie Chapman

25,932 views • 2 years ago

a demo of using both the gpt-oss-20b and qwen3-coder-480b in the hyperspace agentic browser. this spatial, AI-native UI is designed as an extension of the spatial space of our brain - which places some things more in recency to us, and adjacent to each other. pinch to zoom.

a demo of using both the gpt-oss-20b and qwen3-coder-480b in the hyperspace agentic browser. this spatial, AI-native UI is designed as an extension of the spatial space of our brain - which places some things more in recency to us, and adjacent to each other. pinch to zoom.

Varun

180,438 views • 11 months ago

“Do you know where a sidewalk begins and ends?” — a simple question from Niantic Spatial CEO, Inhi Cho Suh, that gets to the heart of what today’s AI is missing. For robots, this isn’t theoretical. To safely navigate something as everyday as a sidewalk, they need to understand boundaries, context, and change in real time. Learn about how Niantic Spatial is building the missing piece in Physical AI. #NianticSpatial #HumanX #GeospatialAI #Robotics #AI #PhysicalAI

“Do you know where a sidewalk begins and ends?” — a simple question from Niantic Spatial CEO, Inhi Cho Suh, that gets to the heart of what today’s AI is missing. For robots, this isn’t theoretical. To safely navigate something as everyday as a sidewalk, they need to understand boundaries, context, and change in real time. Learn about how Niantic Spatial is building the missing piece in Physical AI. #NianticSpatial #HumanX #GeospatialAI #Robotics #AI #PhysicalAI

Niantic Spatial 🌎

18,656 views • 3 months ago

Excited to share our latest work on 🎧spatial audio-driven human motion generation. We aim to tackle a largely underexplored yet important problem of enabling virtual humans to move naturally in response to spatial audio—capturing not just what is heard, but also where the sound is coming from. To this end, we introduce the Spatial Audio-Driven Human Motion (SAM) dataset—the first comprehensive dataset featuring paired high-quality human motion and spatial audio recordings. For benchmarking, we develop a generative framework for human MOtion generation driven by SPAtial audio, termed MOSPA, which learns to synthesize realistic and diverse human motions conditioned on spatial audio input. We hope this research could provide a foundation for future research in spatial perception, virtual characters, and embodied AI. The dataset and model will be open-sourced soon. A big thank you to our intern, Shuyang Xu, for the wonderful collaboration! Congratulations, Shuyang! Project page: Paper: Video: #Animation #CG #CV #AIGC #DL #Deeplearning #Motion #Graphics #AI #GenerativeAI

Excited to share our latest work on 🎧spatial audio-driven human motion generation. We aim to tackle a largely underexplored yet important problem of enabling virtual humans to move naturally in response to spatial audio—capturing not just what is heard, but also where the sound is coming from. To this end, we introduce the Spatial Audio-Driven Human Motion (SAM) dataset—the first comprehensive dataset featuring paired high-quality human motion and spatial audio recordings. For benchmarking, we develop a generative framework for human MOtion generation driven by SPAtial audio, termed MOSPA, which learns to synthesize realistic and diverse human motions conditioned on spatial audio input. We hope this research could provide a foundation for future research in spatial perception, virtual characters, and embodied AI. The dataset and model will be open-sourced soon. A big thank you to our intern, Shuyang Xu, for the wonderful collaboration! Congratulations, Shuyang! Project page: Paper: Video: #Animation #CG #CV #AIGC #DL #Deeplearning #Motion #Graphics #AI #GenerativeAI

Zhiyang (Frank) Dou

14,610 views • 1 year ago

MC: To get to this point and become such a well-matched partnership, did you have to go through a lot of trial and error? Do you have any rules for working together or for being partners? 💚: For me, I wouldn’t really call them rules. I think it’s more like basic things that should already be there. For example, Love and I give each other space. When it comes to personal matters, we don’t interfere unless we come to each other for advice. We don’t have to ask things like, ‘Hey, what are you doing today?’ or anything like that. It’s not necessary to that extent. When we’re working, we focus on work. But when we’re apart, that’s our personal space, and that’s already okay. That alone is enough. I think if there’s something about work that doesn’t feel right, we just talk about it. #Flex1045xGirlRulesSeries #GirlRulesSeries #MilkLove #มิ้ลค์เลิฟ

MC: To get to this point and become such a well-matched partnership, did you have to go through a lot of trial and error? Do you have any rules for working together or for being partners? 💚: For me, I wouldn’t really call them rules. I think it’s more like basic things that should already be there. For example, Love and I give each other space. When it comes to personal matters, we don’t interfere unless we come to each other for advice. We don’t have to ask things like, ‘Hey, what are you doing today?’ or anything like that. It’s not necessary to that extent. When we’re working, we focus on work. But when we’re apart, that’s our personal space, and that’s already okay. That alone is enough. I think if there’s something about work that doesn’t feel right, we just talk about it. #Flex1045xGirlRulesSeries #GirlRulesSeries #MilkLove #มิ้ลค์เลิฟ

𝗠𝗜𝗩𝗡 - 𝗠𝗶𝗹𝗸 𝗣𝗮𝗻𝘀𝗮 𝟭𝘀𝘁 𝗩𝗡𝗙𝗣

114,453 views • 4 months ago

Demis on why world models are his longest standing passion and explains benefits vs. language models: ▫️ “I think language models are able to understand a lot about the world. More than we expected because language is actually probably richer than we thought. But there's still a lot about the spatial dynamics of the world, spatial awareness and the physical context we're in — and how that works mechanically — that is hard to describe in words and isn't generally described in corpuses of words. Alot of this is allied to learning from experience. There's a lot of things which you can't really describe something. You have to just experience it. Maybe the senses and so on are very hard to put into words. Whether that's motor angles and smell and these kinds of senses, it's very difficult to describe that in any kind of language.”▫️

Demis on why world models are his longest standing passion and explains benefits vs. language models: ▫️ “I think language models are able to understand a lot about the world. More than we expected because language is actually probably richer than we thought. But there's still a lot about the spatial dynamics of the world, spatial awareness and the physical context we're in — and how that works mechanically — that is hard to describe in words and isn't generally described in corpuses of words. Alot of this is allied to learning from experience. There's a lot of things which you can't really describe something. You have to just experience it. Maybe the senses and so on are very hard to put into words. Whether that's motor angles and smell and these kinds of senses, it's very difficult to describe that in any kind of language.”▫️

Bearly AI

78,545 views • 1 month ago

Chatbots aren’t the revolution. They’re the distraction. Fei-Fei Li: “Language is a half-million-year-old luxury. Perception is a half-billion-year-old necessity.” Evolution didn’t optimize for conversation. It optimized for survival in three-dimensional space. Seeing threats, navigating obstacles, predicting what happens when you move. We’ve spent years celebrating AI that can write and summarize. But text processing is narrow. Spatial intelligence is fundamental. An agent that only reads prompts can’t function in a warehouse or a hospital. It needs to parse depth, understand physics, and act on what it sees in real time. We built AI that understands language. Now we’re building AI that understands space. Language models got the attention. Spatial intelligence gets the work done. The world runs on physics, not paragraphs. AI is learning to operate in it.

Chatbots aren’t the revolution. They’re the distraction. Fei-Fei Li: “Language is a half-million-year-old luxury. Perception is a half-billion-year-old necessity.” Evolution didn’t optimize for conversation. It optimized for survival in three-dimensional space. Seeing threats, navigating obstacles, predicting what happens when you move. We’ve spent years celebrating AI that can write and summarize. But text processing is narrow. Spatial intelligence is fundamental. An agent that only reads prompts can’t function in a warehouse or a hospital. It needs to parse depth, understand physics, and act on what it sees in real time. We built AI that understands language. Now we’re building AI that understands space. Language models got the attention. Spatial intelligence gets the work done. The world runs on physics, not paragraphs. AI is learning to operate in it.

Dustin

51,764 views • 5 months ago

This is insane!🔥 This is a 720p (2D) video I shot of my kids 15 years ago! I used AI to upscale it, depth-map it, & used the depth map to convert it to 3D SBS, & then converted that to Spatial Video for Apple Vision Pro (MV-HEVC). My son is currently a senior in high school, and my daughter is a sophomore in college. This video has complete spatial depth when viewed in the Apple Vision Pro. Obviously, you can't appreciate that via this post. But it's like I'm there & I can see into this room. Talk about giving you the feels.🥹 This can be done with ANY video. 🤯 I'm working on refining the workflow, as it's a bit cumbersome. I plan to share it, but holy cow! I had to post this.

This is insane!🔥 This is a 720p (2D) video I shot of my kids 15 years ago! I used AI to upscale it, depth-map it, & used the depth map to convert it to 3D SBS, & then converted that to Spatial Video for Apple Vision Pro (MV-HEVC). My son is currently a senior in high school, and my daughter is a sophomore in college. This video has complete spatial depth when viewed in the Apple Vision Pro. Obviously, you can't appreciate that via this post. But it's like I'm there & I can see into this room. Talk about giving you the feels.🥹 This can be done with ANY video. 🤯 I'm working on refining the workflow, as it's a bit cumbersome. I plan to share it, but holy cow! I had to post this.

Blaine Brown

1,468,349 views • 2 years ago

visionOS 26 quietly introduced a glimpse into the future of how we’ll browse the web: a spatial Reader. Safari can now automatically transform a website’s content into a spatial experience using Spatial Scenes — allowing you to literally look into the rooms of the apartment you’re about to book for your next holiday. It does this by beautifully blending the content with your surroundings and softly tinting your room with the website’s color palette. It's just not possible to capture. I also love that Apple Intelligence lives in a floating window beside the content, ready to summarize the page for you. I can’t wait to see how this evolves into what we’ll one day call the Spatial Web.

visionOS 26 quietly introduced a glimpse into the future of how we’ll browse the web: a spatial Reader. Safari can now automatically transform a website’s content into a spatial experience using Spatial Scenes — allowing you to literally look into the rooms of the apartment you’re about to book for your next holiday. It does this by beautifully blending the content with your surroundings and softly tinting your room with the website’s color palette. It's just not possible to capture. I also love that Apple Intelligence lives in a floating window beside the content, ready to summarize the page for you. I can’t wait to see how this evolves into what we’ll one day call the Spatial Web.

Phil Traut ᯅ

34,250 views • 1 year ago

🇺🇸 TRUMP: I CREATED SPACE FORCE - NOW AMERICA IS NUMBER ONE IN SPACE "In my first term, we created a thing called Space Force. We were losing the race in space very badly to China and to Russia. And now we're far in a way, number one in space. And re-establish Space Com with a mission to protect American space assets and detect any threat to our homeland. And today we're moving forward with what we want to do and the place that we want to have this." Source: Rapid Response 47

🇺🇸 TRUMP: I CREATED SPACE FORCE - NOW AMERICA IS NUMBER ONE IN SPACE "In my first term, we created a thing called Space Force. We were losing the race in space very badly to China and to Russia. And now we're far in a way, number one in space. And re-establish Space Com with a mission to protect American space assets and detect any threat to our homeland. And today we're moving forward with what we want to do and the place that we want to have this." Source: Rapid Response 47

Mario Nawfal

135,285 views • 10 months ago

Here’s a demo of our Agentic Memory system, inspired by how our own brain holds information in a 3D spatial space. This feels, natural. Extending this further, we announced the Agentic Memory Protocol on July 15th in SF - which enables memory to be local, encrypted and available to other agents and apps based on your permission-only. We believe this is the future of memory - not owned by any one app, spatial, and always improving. Aaron Levie Andrej Karpathy

Here’s a demo of our Agentic Memory system, inspired by how our own brain holds information in a 3D spatial space. This feels, natural. Extending this further, we announced the Agentic Memory Protocol on July 15th in SF - which enables memory to be local, encrypted and available to other agents and apps based on your permission-only. We believe this is the future of memory - not owned by any one app, spatial, and always improving. Aaron Levie Andrej Karpathy

Varun

187,489 views • 11 months ago

P.S. To further stir the pot: While benching a big number is impressive… Strength is not fitness. Strong enough is strong enough—beyond that it’s better to focus on staying lean and mobile. If you want a good laugh, take a meathead to a climbing gym, where you need bodyweight/grip strength, endurance, power, balance, coordination, and spatial awareness.

P.S. To further stir the pot: While benching a big number is impressive… Strength is not fitness. Strong enough is strong enough—beyond that it’s better to focus on staying lean and mobile. If you want a good laugh, take a meathead to a climbing gym, where you need bodyweight/grip strength, endurance, power, balance, coordination, and spatial awareness.

Kevin Dahlstrom

37,002 views • 4 months ago

ELON MUSK: If you want million times more energy, then you must go to space "The way to think of AI in space is that in order to achieve any meaningful percentage of a Kardashev Type 2 civilization, where you are using even a millionth of the sun's energy, you must have solar-powered AI satellites in deep space Once you think in terms of a Kardashev Type 2 civilization, which is 'what percentage of the sun's energy are you turning into useful work,' then it becomes obvious that space is overwhelmingly what matters Earth only receives roughly one two-billionth of the sun's energy. So, if you want to have something that is, say, a million times more energy than Earth could possibly produce, you must go into space. And so, it’s kind of handy to have a space company, I guess"

ELON MUSK: If you want million times more energy, then you must go to space "The way to think of AI in space is that in order to achieve any meaningful percentage of a Kardashev Type 2 civilization, where you are using even a millionth of the sun's energy, you must have solar-powered AI satellites in deep space Once you think in terms of a Kardashev Type 2 civilization, which is 'what percentage of the sun's energy are you turning into useful work,' then it becomes obvious that space is overwhelmingly what matters Earth only receives roughly one two-billionth of the sun's energy. So, if you want to have something that is, say, a million times more energy than Earth could possibly produce, you must go into space. And so, it’s kind of handy to have a space company, I guess"

X Freeze

84,033 views • 8 months ago

Americans are coming to the ultimate realization. After the assassination of Charlie Kirk, we can no longer coexist with the Left “The more and more I see today, the more pissed off I get, and the more I see that there's no peaceful way to fix this. I've tried to think of any way that I could, and there's not. You guys created something that you don't understand. When you sit out here and celebrate the death of someone, the assassination of someone, that shows me that you are so far gone that we can't be peaceful with you anymore. And that breaks my heart. Because the thing you idiots never understood is the most dangerous thing is a man that just wanted to be left the f*ck alone. And you wouldn't leave us the f*ck alone. So we're at a point now that it's either time for all of you to sit down and shut up. Or you're going to experience something that you will never be able to fathom. The sh*t that's coming your way, it's not going to be what you think it is. This is not something that you can win. This will be one-sided and you don't have a prayer.”

Sensitive content

Americans are coming to the ultimate realization. After the assassination of Charlie Kirk, we can no longer coexist with the Left “The more and more I see today, the more pissed off I get, and the more I see that there's no peaceful way to fix this. I've tried to think of any way that I could, and there's not. You guys created something that you don't understand. When you sit out here and celebrate the death of someone, the assassination of someone, that shows me that you are so far gone that we can't be peaceful with you anymore. And that breaks my heart. Because the thing you idiots never understood is the most dangerous thing is a man that just wanted to be left the fck alone. And you wouldn't leave us the fck alone. So we're at a point now that it's either time for all of you to sit down and shut up. Or you're going to experience something that you will never be able to fathom. The sh*t that's coming your way, it's not going to be what you think it is. This is not something that you can win. This will be one-sided and you don't have a prayer.”

Wall Street Apes

92,288 views • 10 months ago

Raven Resonance CEO Thomas Suarez explains the 3 beachhead use cases that will allow AR devices to actually scale: "The first is micro interactions. This is something where you're in and out of the display within 5 to 10 seconds. Examples are next navigation direction, phone notifications, changing music, or cooking instructions." "Second is reference material. This is where you can AirPlay your phone screen or pin up relevant information. If you're working on something with your hands, you want something that is hands-free that's going to give you that information. Ideally you can ask an LLM or an AI to help you with that task." "Third is spatial experiences, which is what we've seen from Specs. There's a lot of spatial work that we want to do in the future as well. But I think right now, you want to build toward what is the iPod of AR before you build the iPhone."

Raven Resonance CEO Thomas Suarez explains the 3 beachhead use cases that will allow AR devices to actually scale: "The first is micro interactions. This is something where you're in and out of the display within 5 to 10 seconds. Examples are next navigation direction, phone notifications, changing music, or cooking instructions." "Second is reference material. This is where you can AirPlay your phone screen or pin up relevant information. If you're working on something with your hands, you want something that is hands-free that's going to give you that information. Ideally you can ask an LLM or an AI to help you with that task." "Third is spatial experiences, which is what we've seen from Specs. There's a lot of spatial work that we want to do in the future as well. But I think right now, you want to build toward what is the iPod of AR before you build the iPhone."

TBPN

19,542 views • 29 days ago

Spatial video is so underrated. Yeah, we all laughed at that cringey Apple Vision Pro demo.. the dad with a headset strapped on at his kid’s birthday. But this isn’t just video recording.. This is a life moment recording. Watching a spatial video in Apple Vision Pro feels like almost being there. Words can’t do justice- you have to experience it. When we lost our cat Buttercup, it was devastating. But I have spatially recorded videos of him- me petting him and seeing in full 3D. Every hair on his body, the fluffy texture of his fur, even the details in his whiskers- it’s so vivid it feels like you could reach out and touch him. It’s therapeutic. Healing. Almost like a window back into those moments. I used to think we’d have to wait until we were living in spaceships, staring at hologram of loved ones, to be experiencing something like this. But Apple made that a reality- now, in our lifetime. That’s the power of spatial video.

Spatial video is so underrated. Yeah, we all laughed at that cringey Apple Vision Pro demo.. the dad with a headset strapped on at his kid’s birthday. But this isn’t just video recording.. This is a life moment recording. Watching a spatial video in Apple Vision Pro feels like almost being there. Words can’t do justice- you have to experience it. When we lost our cat Buttercup, it was devastating. But I have spatially recorded videos of him- me petting him and seeing in full 3D. Every hair on his body, the fluffy texture of his fur, even the details in his whiskers- it’s so vivid it feels like you could reach out and touch him. It’s therapeutic. Healing. Almost like a window back into those moments. I used to think we’d have to wait until we were living in spaceships, staring at hologram of loved ones, to be experiencing something like this. But Apple made that a reality- now, in our lifetime. That’s the power of spatial video.

Dylan Bishop

13,894 views • 10 months ago

Pretty cool 3D animation of the underground missile cities that the US are trying to destroy in Iran. If you have any conception of spatial awareness and physics you’ll quickly realise what a fruitless task this is. 🇺🇸🇮🇷🚀

Pretty cool 3D animation of the underground missile cities that the US are trying to destroy in Iran. If you have any conception of spatial awareness and physics you’ll quickly realise what a fruitless task this is. 🇺🇸🇮🇷🚀

Philip Pilkington

17,245 views • 4 months ago

Demis Hassabis says world models are his longest standing passion and explains benefits vs. language models: ▫️ “I think language models are able to understand a lot about the world. More than we expected because language is actually probably richer than we thought. But there's still a lot about the spatial dynamics of the world, spatial awareness and the physical context we're in — and how that works mechanically — that is hard to describe in words and isn't generally described in corpuses of words. Alot of this is allied to learning from experience. There's a lot of things which you can't really describe something. You have to just experience it. Maybe the senses and so on are very hard to put into words. Whether that's motor angles and smell and these kinds of senses, it's very difficult to describe that in any kind of language.”▫️ This is what Demis and Google Deepmind is trying to solve with Genie. He also says that the video models (Veo) will play a part in training the world models and this is all key for AI robotics.

Demis Hassabis says world models are his longest standing passion and explains benefits vs. language models: ▫️ “I think language models are able to understand a lot about the world. More than we expected because language is actually probably richer than we thought. But there's still a lot about the spatial dynamics of the world, spatial awareness and the physical context we're in — and how that works mechanically — that is hard to describe in words and isn't generally described in corpuses of words. Alot of this is allied to learning from experience. There's a lot of things which you can't really describe something. You have to just experience it. Maybe the senses and so on are very hard to put into words. Whether that's motor angles and smell and these kinds of senses, it's very difficult to describe that in any kind of language.”▫️ This is what Demis and Google Deepmind is trying to solve with Genie. He also says that the video models (Veo) will play a part in training the world models and this is all key for AI robotics.

Bearly AI

123,703 views • 7 months ago