Пропустить навигацию
Head-tracked “Window Mode.”
0:00 / 0:39

Head-tracked “Window Mode.”

daniel habib

@DannyHabibs6,5 тыс. подписчиков

Открыть в X
53 656 отметок «Нравится»СкачатьОригинальный пост

3 950 958 просмотров

Head-tracked “Window Mode.” Your front camera finds your head. The view reprojects in real time so the screen feels like a window into the 3D scene. True3D, no glasses.

96 комментариев

Комментарии из оригинального поста в X (Twitter)

  • Фото профиля daniel habib

    @DannyHabibs

    How it works: Estimate head pose relative to the display, then render with head-coupled perspective so near objects shift more than far ones. That motion parallax sells depth even in 2D

    2 112 отметок «Нравится»

  • Фото профиля daniel habib

    @DannyHabibs

    What you feel: A sense of presence on a flat screen. The view responds like real objects do when you move, so motion parallax sells depth without glasses. Here’s a favorite: Steamboat Willie in 3D with Window Mode on.

    1 547 отметок «Нравится»

  • Фото профиля daniel habib

    @DannyHabibs

    Why this matters: most 3D on phones collapses to a flat video. Asking viewers to drag the camera fights lean-back behavior. Window Mode adds presence without new habits.

    497 отметок «Нравится»

  • Фото профиля daniel habib

    @DannyHabibs

    Try it in your browser: (Works on phones and laptop webcams too.)

    1 633 отметки «Нравится»

  • Фото профиля daniel habib

    @DannyHabibs

    I wrote more on the design goals and tradeoffs. Latency budget, pose smoothing, and when to prefer single-view depth over stereo.

    251 отметка «Нравится»

  • Фото профиля daniel habib

    @DannyHabibs

    Paying respect: Johnny Lee’s 2007 Wii Remote head-tracking demo sparked this whole idea for many of us. Ours runs on-device with a front camera and lightweight models.

    770 отметок «Нравится»

  • Фото профиля daniel habib

    @DannyHabibs

    You can try the Steamboat Willie example here:

    150 отметок «Нравится»

  • Фото профиля daniel habib

    @DannyHabibs

    I’ll post in our Discord when we open source the code in a few weeks.

    201 отметка «Нравится»

  • Фото профиля daniel habib

    @DannyHabibs

    For those asking: Frontend is spatialjs and the file format for 3D videos ".splv" is in spatialstudio. Going open source in the next few weeks; we’ll post in Discord. Our backend and models are on @modal and @googlecloud. Using Modal & GCP for over a year, both have great docs and simple APIs. Highly recommend Spatial Studio - PyPI:

    140 отметок «Нравится»

  • Фото профиля daniel habib

    @DannyHabibs

    @googlecloud We also set up a subreddit where people share 3D videos they’ve created and follow along as we build in public:

    42 отметки «Нравится»

  • Фото профиля daniel habib

    @DannyHabibs

    @googlecloud We just open-sourced Window Mode Video explainer coming soon on our YouTube: Can’t wait to see what people build with it

    74 отметки «Нравится»

  • Фото профиля Pseudo

    @pseudoshiro

    now i want to see an infinity castle using this haha

    225 отметок «Нравится»

  • Фото профиля daniel habib

    @DannyHabibs

    just wait....

    57 отметок «Нравится»

  • Фото профиля Dr. Andrew Dilanchian

    @AndyDilanchi

    Nintendo 3DS did this a while back I miss it every day :(

    194 отметки «Нравится»

  • Фото профиля daniel habib

    @DannyHabibs

    same :/

    31 отметка «Нравится»

  • Фото профиля Ethan He

    @EthanHe_42

    Can’t laugh at people who move their head playing video games anymore

    142 отметки «Нравится»

  • Фото профиля daniel habib

    @DannyHabibs

    im more into 3d video viewing, but i think there is potential for gaming. things are weird until they aren't

    71 отметка «Нравится»

  • Фото профиля Babak

    @TheUnicornist

    3d scan the room and the table and chairs, use that instead of this demo grid stuff, make it so perfect and seamless as if your laptop's display is a see-through glass

    91 отметка «Нравится»

  • Фото профиля daniel habib

    @DannyHabibs

    check back in in a couple of days

    137 отметок «Нравится»

  • Фото профиля Babak

    @TheUnicornist

    🔥

    6 отметок «Нравится»