Head-tracked “Window Mode.”
@DannyHabibs6,5 тыс. подписчиков
3 950 958 просмотров
96 комментариев
Комментарии из оригинального поста в X (Twitter)

@DannyHabibs
How it works: Estimate head pose relative to the display, then render with head-coupled perspective so near objects shift more than far ones. That motion parallax sells depth even in 2D
2 112 отметок «Нравится»

@DannyHabibs
What you feel: A sense of presence on a flat screen. The view responds like real objects do when you move, so motion parallax sells depth without glasses. Here’s a favorite: Steamboat Willie in 3D with Window Mode on.
1 547 отметок «Нравится»

@DannyHabibs
Why this matters: most 3D on phones collapses to a flat video. Asking viewers to drag the camera fights lean-back behavior. Window Mode adds presence without new habits.
497 отметок «Нравится»

@DannyHabibs
Try it in your browser: (Works on phones and laptop webcams too.)
1 633 отметки «Нравится»

@DannyHabibs
I wrote more on the design goals and tradeoffs. Latency budget, pose smoothing, and when to prefer single-view depth over stereo.
251 отметка «Нравится»

@DannyHabibs
Paying respect: Johnny Lee’s 2007 Wii Remote head-tracking demo sparked this whole idea for many of us. Ours runs on-device with a front camera and lightweight models.
770 отметок «Нравится»

@DannyHabibs
You can try the Steamboat Willie example here:
150 отметок «Нравится»

@DannyHabibs
I’ll post in our Discord when we open source the code in a few weeks.
201 отметка «Нравится»

@DannyHabibs
For those asking: Frontend is spatialjs and the file format for 3D videos ".splv" is in spatialstudio. Going open source in the next few weeks; we’ll post in Discord. Our backend and models are on @modal and @googlecloud. Using Modal & GCP for over a year, both have great docs and simple APIs. Highly recommend Spatial Studio - PyPI:
140 отметок «Нравится»

@DannyHabibs
@googlecloud We also set up a subreddit where people share 3D videos they’ve created and follow along as we build in public:
42 отметки «Нравится»

@DannyHabibs
@googlecloud We just open-sourced Window Mode Video explainer coming soon on our YouTube: Can’t wait to see what people build with it
74 отметки «Нравится»

@pseudoshiro
now i want to see an infinity castle using this haha
225 отметок «Нравится»

@DannyHabibs
just wait....
57 отметок «Нравится»

@AndyDilanchi
Nintendo 3DS did this a while back I miss it every day :(
194 отметки «Нравится»

@DannyHabibs
same :/
31 отметка «Нравится»

@EthanHe_42
Can’t laugh at people who move their head playing video games anymore
142 отметки «Нравится»

@DannyHabibs
im more into 3d video viewing, but i think there is potential for gaming. things are weird until they aren't
71 отметка «Нравится»

@TheUnicornist
3d scan the room and the table and chairs, use that instead of this demo grid stuff, make it so perfect and seamless as if your laptop's display is a see-through glass
91 отметка «Нравится»

@DannyHabibs
check back in in a couple of days
137 отметок «Нравится»

@TheUnicornist
🔥
6 отметок «Нравится»































