正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Today’s hobby project: Prototyped a real-time room scanning system with live sharing to XR devices. Explore scanned spaces in 3D on XR (not flat 2D screens) and share them with remote users for spatial remote collaboration. #metaquest #augmentedreality

Takashi Yoshinaga

2,705 subscribers

126,635 次观看 • 9 个月前 •via X (Twitter)

科学技术 #metaquest #augmentedreality

Anya Rossi• Live Now

Private livecam show

17 条评论

WebGL / WebGPU 的头像

WebGL / WebGPU9 个月前

Always a pleasure seeing your work

EDIMO PEREIRA 的头像

EDIMO PEREIRA9 个月前

🇯🇵😎

LEO LI 的头像

LEO LI9 个月前

帅气

coolkidhugh67 的头像

coolkidhugh679 个月前

wow cool

tully 的头像

tully9 个月前

Interested to hear if you think you’ll use guassian splatting for this?

tufan han 的头像

tufan han9 个月前

good job

Aazzz 的头像

Aazzz9 个月前

That’s cool. Does scanning a room have any minimum device requirements? For example, does it require a camera with LiDAR?

Sync Kun 的头像

Sync Kun9 个月前

Cool

lullipaw 🔞 的头像

lullipaw 🔞9 个月前

will this be available publicly?

İnşallah bir gün 的头像

İnşallah bir gün9 个月前

I thought this and some other things but Im not talented 🙁

Jérémy Lacoche 的头像

Jérémy Lacoche9 个月前

Do you use a custom solution to get association between captured mesh and colors/texture?

FabianXR | Builder of the future 的头像

FabianXR | Builder of the future9 个月前

That’s cool. I want it 🙌😅

Pierrejunior Simon 的头像

Pierrejunior Simon9 个月前

genius are u

Ganesh Dole 的头像

Ganesh Dole9 个月前

now if we could just get this to work for collaborative meetings where people actually want to share spaces with coworkers

Dmitry Moskowski 的头像

Dmitry Moskowski9 个月前

Cool! How accurate it could be in terms of dimensions?

nuu 的头像

nuu8 个月前

this great

Samuel 的头像

Samuel9 个月前

Collaboration on what?

相关视频

XREAL and Google are extending our strategic partnership in a new multi‑year agreement, with XREAL named a lead hardware partner for the Android XR ecosystem. Building on Project Aura (coming in 2026), we’re aligning our long‑term hardware roadmap with Android XR—bringing it to optical see‑through devices, including wired XR glasses, and expanding support for Android XR development. Read more: Also—peep the Android XR alien lighting up the Vegas Sphere at CES 2026 😎 #AndroidXR #XR #AR #XREAL #Google

XREAL and Google are extending our strategic partnership in a new multi‑year agreement, with XREAL named a lead hardware partner for the Android XR ecosystem. Building on Project Aura (coming in 2026), we’re aligning our long‑term hardware roadmap with Android XR—bringing it to optical see‑through devices, including wired XR glasses, and expanding support for Android XR development. Read more: Also—peep the Android XR alien lighting up the Vegas Sphere at CES 2026 😎 #AndroidXR #XR #AR #XREAL #Google

XREAL 👓

22,199 次观看 • 9 个月前

SharedNeRF: Leveraging Photorealistic and View-dependent Rendering for Real-time and Remote Collaboration Abstract (excerpt): When collaborators are remote, coordinating the sharing of views of their physical environment becomes challenging. Video-conferencing tools often do not provide the desired viewpoints for a remote viewer. While RGB-D cameras offer 3D views, they lack the necessary fidelity. We introduce SharedNeRF, designed to enhance synchronous remote collaboration by leveraging the photorealistic and view-dependent nature of Neural Radiance Field (NeRF). The system complements the higher visual quality of the NeRF rendering with the instantaneity of a point cloud and combines them through carefully accommodating the dynamic elements within the shared space, such as hand gestures and moving objects. The system employs a head-mounted camera for data collection, creating a volumetric task space on the fly and updating it as the task space changes.

SharedNeRF: Leveraging Photorealistic and View-dependent Rendering for Real-time and Remote Collaboration Abstract (excerpt): When collaborators are remote, coordinating the sharing of views of their physical environment becomes challenging. Video-conferencing tools often do not provide the desired viewpoints for a remote viewer. While RGB-D cameras offer 3D views, they lack the necessary fidelity. We introduce SharedNeRF, designed to enhance synchronous remote collaboration by leveraging the photorealistic and view-dependent nature of Neural Radiance Field (NeRF). The system complements the higher visual quality of the NeRF rendering with the instantaneity of a point cloud and combines them through carefully accommodating the dynamic elements within the shared space, such as hand gestures and moving objects. The system employs a head-mounted camera for data collection, creating a volumetric task space on the fly and updating it as the task space changes.

MrNeRF

10,615 次观看 • 1 年前

From your wrist to your car to your TV, Android is where you see the future first. Now, with Gemini, we're making your devices truly intelligent— and Android XR is leading the way! We just wrapped up The Android Show: XR Edition with some major updates: ✅New on Galaxy XR: Desktop linking with PC Connect, Inflight Travel Mode, and realistic "Likeness" avatars. ✅Sneak Peek: XREAL’s "Project Aura" portable AR glasses. ✅Next-Gen AI Glasses: Partnerships with Samsung, Gentle Monster, and Warby Parker coming next year. ✅Devs: Android XR SDK Preview 3 is open for business, start building for next gen glasses! I’m super excited about AI glasses – it’s a great form factor for your personal assistant. Looking forward to sharing more next year! Check out our blog post to learn more: And be sure to catch up on today’s The Android Show: XR Edition here:

From your wrist to your car to your TV, Android is where you see the future first. Now, with Gemini, we're making your devices truly intelligent— and Android XR is leading the way! We just wrapped up The Android Show: XR Edition with some major updates: ✅New on Galaxy XR: Desktop linking with PC Connect, Inflight Travel Mode, and realistic "Likeness" avatars. ✅Sneak Peek: XREAL’s "Project Aura" portable AR glasses. ✅Next-Gen AI Glasses: Partnerships with Samsung, Gentle Monster, and Warby Parker coming next year. ✅Devs: Android XR SDK Preview 3 is open for business, start building for next gen glasses! I’m super excited about AI glasses – it’s a great form factor for your personal assistant. Looking forward to sharing more next year! Check out our blog post to learn more: And be sure to catch up on today’s The Android Show: XR Edition here:

Sameer Samat

14,645 次观看 • 10 个月前

Combining 2D and 3D in After Effects. In Foldspace, not every surface needs to be bent. Keep one flat for 2D artwork, and let the others exist in 3D space. This allows you to combine 2D and 3D objects in a single animation with no masks or tricks needed.

Combining 2D and 3D in After Effects. In Foldspace, not every surface needs to be bent. Keep one flat for 2D artwork, and let the others exist in 3D space. This allows you to combine 2D and 3D objects in a single animation with no masks or tricks needed.

Motion Princess

22,007 次观看 • 6 个月前

Hello everyone 👋 It is pretty excited to know that Unity released a new VR Multiplayer template 🚀🥳! This template integrates Unity Gaming Services, Netcode for GameObjects, and the XR Interaction Toolkit, enabling you to quickly launch your next social VR game. 📌 Key features include: 👉 XR Hands 1.4.1: Access hand tracking data from devices that support it. 👉 XR Interaction Toolkit v3.0.1: A high-level, component-based system for creating XR experiences, facilitating 3D and UI interactions from Unity input events. 👉 XR Plugin Management 4.4.1: Streamlines XR plug-in lifecycle management and offers a build-time UI through Unity Unified Settings. 👉 Netcode for GameObjects 1.8.1: Provides networking capabilities for GameObject and MonoBehaviour workflows. 👉 OpenXR 1.10.0: An open standard by Khronos that simplifies AR/VR development across various devices. ☁️ Unity Cloud Multiplayer Services: - Authentication 3.3.1: Offers anonymous and platform-specific authentication solutions. - Lobby 1.2.0: Facilitates player discovery and connection for various multiplayer scenarios. - Relay 1.6.0: Ensures secure player connectivity via a join code system, eliminating the need for third-party solutions or dedicated servers. - Vivox 16.0.0: Enhances multiplayer experiences with in-game voice and text chat capabilities. ℹ️ To access the template and additional documentation check out: #unity #multiplayer #xr

Hello everyone 👋 It is pretty excited to know that Unity released a new VR Multiplayer template 🚀🥳! This template integrates Unity Gaming Services, Netcode for GameObjects, and the XR Interaction Toolkit, enabling you to quickly launch your next social VR game. 📌 Key features include: 👉 XR Hands 1.4.1: Access hand tracking data from devices that support it. 👉 XR Interaction Toolkit v3.0.1: A high-level, component-based system for creating XR experiences, facilitating 3D and UI interactions from Unity input events. 👉 XR Plugin Management 4.4.1: Streamlines XR plug-in lifecycle management and offers a build-time UI through Unity Unified Settings. 👉 Netcode for GameObjects 1.8.1: Provides networking capabilities for GameObject and MonoBehaviour workflows. 👉 OpenXR 1.10.0: An open standard by Khronos that simplifies AR/VR development across various devices. ☁️ Unity Cloud Multiplayer Services: - Authentication 3.3.1: Offers anonymous and platform-specific authentication solutions. - Lobby 1.2.0: Facilitates player discovery and connection for various multiplayer scenarios. - Relay 1.6.0: Ensures secure player connectivity via a join code system, eliminating the need for third-party solutions or dedicated servers. - Vivox 16.0.0: Enhances multiplayer experiences with in-game voice and text chat capabilities. ℹ️ To access the template and additional documentation check out: #unity #multiplayer #xr

Dilmer

12,048 次观看 • 2 年前

This is the latest Google research on XR Interaction: World Mouse. Instead of using hand rays or gestures to point at things in the physical space, you move a cursor with a mouse and the system figures out where that cursor should sit in the 3D world. It works in two main ways: - On an object, the cursor follows the surface, so you can move precisely across walls, screens, furniture, or virtual objects. - Between objects, the system creates a smooth bridge through space, so the cursor can travel from one surface to another. That means you can go from a 2D panel to a 3D object, place content on a real wall, manipulate virtual objects, or interact with physical devices through digital proxies. This is the type of news, tools and product updates I share weekly in my newsletter. If you are into 3D XR and AI make sure to check it out (link on top of my profile). Based on “World Mouse: Exploring Interactions with a Cross-Reality Cursor” by Esen K. Tütüncü, Mar Gonzalez-Franco, Khushman Patel, and Eric J. Gonzalez

Gabriele Romagnoli

29,043 次观看 • 6 个月前

Meet the Redwood Battery Bin: a patented system designed to safely collect mixed batteries and devices at scale, with remote monitoring and fire safety at the core. With automated sensing and real-time telemetry, it unlocks the critical minerals sitting in America’s junk drawers and makes public battery recycling simple and scalable.

Meet the Redwood Battery Bin: a patented system designed to safely collect mixed batteries and devices at scale, with remote monitoring and fire safety at the core. With automated sensing and real-time telemetry, it unlocks the critical minerals sitting in America’s junk drawers and makes public battery recycling simple and scalable.

Redwood Materials

136,021 次观看 • 9 个月前

Sharing a small personal project I’ve been slowly building over the past couple of years, mostly on weekends and in spare moments: Cosmic XR, a mixed reality experience that brings space and the universe into your own room. This project began from my deep love for space, and the desire to let people not just observe, but reach out and interact with planets, moons, and other celestial wonders — to touch, rotate, and scale them with their hands, as if they were right in front of them. For those familiar with HoloLens, many parts of this app are inspired by the open-source Galaxy Explorer project, which played a key role in building many parts of the experience. I’m grateful to build on that foundation. As a single-person project, there’s still much to improve — technically, visually, and content-wise. But I wanted to share it now, in hopes that it brings a sense of curiosity and wonder to anyone who tries it. If you're into space and immersive experiences, I’d love for you to give it a try — you can explore it without purchasing through the “Try Before You Buy” feature on Meta Quest Store: I hope this experience reminds us of how small we are — and how precious each moment is, a fleeting blink in the vast timeline of the universe. Disclaimer: Cosmic XR was designed and developed entirely in my personal time using personal resources as a passion project. It is not affiliated with or endorsed by my employer. #CosmicXR #MixedReality #AugmentedReality #VR #MetaQuest #Cosmos #Space #NASA #galaxy #milkyway #Quest3 #Quest3S #Quest2 #QuestPro #HandTracking #SpatialComputing #SpatialInteraction #SpaceApp #STEM #XRforEducation #PassionProject #Astrophysics #JWST #STEMLearning #EdTech #Astronomy #SpaceScience #JamesWebb #Hubble #SpaceExploration

Sharing a small personal project I’ve been slowly building over the past couple of years, mostly on weekends and in spare moments: Cosmic XR, a mixed reality experience that brings space and the universe into your own room. This project began from my deep love for space, and the desire to let people not just observe, but reach out and interact with planets, moons, and other celestial wonders — to touch, rotate, and scale them with their hands, as if they were right in front of them. For those familiar with HoloLens, many parts of this app are inspired by the open-source Galaxy Explorer project, which played a key role in building many parts of the experience. I’m grateful to build on that foundation. As a single-person project, there’s still much to improve — technically, visually, and content-wise. But I wanted to share it now, in hopes that it brings a sense of curiosity and wonder to anyone who tries it. If you're into space and immersive experiences, I’d love for you to give it a try — you can explore it without purchasing through the “Try Before You Buy” feature on Meta Quest Store: I hope this experience reminds us of how small we are — and how precious each moment is, a fleeting blink in the vast timeline of the universe. Disclaimer: Cosmic XR was designed and developed entirely in my personal time using personal resources as a passion project. It is not affiliated with or endorsed by my employer. #CosmicXR #MixedReality #AugmentedReality #VR #MetaQuest #Cosmos #Space #NASA #galaxy #milkyway #Quest3 #Quest3S #Quest2 #QuestPro #HandTracking #SpatialComputing #SpatialInteraction #SpaceApp #STEM #XRforEducation #PassionProject #Astrophysics #JWST #STEMLearning #EdTech #Astronomy #SpaceScience #JamesWebb #Hubble #SpaceExploration

Yoon Park (박동윤)

13,076 次观看 • 1 年前

Major announcements from Google AR & VR this morning including Android XR platform supporting both headsets and glasses. 👇🏽 👾 Android XR is an operating system for spatial computing devices bringing together years of investment in AI, AR, and VR. ♊️ Gemini will be available on devices as an always-ready AI agent to assist your needs. 🥽 Samsung mixed-reality headset, considered to be a mashup of the Meta Quest and Apple Vision Pro, to launch in 2025. 🕶️ Smart glasses, akin to Ray-Ban Meta, including an AR heads-up display actively being field-tested. More at:

Major announcements from Google AR & VR this morning including Android XR platform supporting both headsets and glasses. 👇🏽 👾 Android XR is an operating system for spatial computing devices bringing together years of investment in AI, AR, and VR. ♊️ Gemini will be available on devices as an always-ready AI agent to assist your needs. 🥽 Samsung mixed-reality headset, considered to be a mashup of the Meta Quest and Apple Vision Pro, to launch in 2025. 🕶️ Smart glasses, akin to Ray-Ban Meta, including an AR heads-up display actively being field-tested. More at:

asim ᯅ

28,112 次观看 • 1 年前

Don’t just rock out with your remote - vote with it, too! Tune in to the Jonas Brothers livestream on Samsung TV Plus tonight, and vote for which song you want them to perform LIVE.

Don’t just rock out with your remote - vote with it, too! Tune in to the Jonas Brothers livestream on Samsung TV Plus tonight, and vote for which song you want them to perform LIVE.

Samsung TV Plus

114,542 次观看 • 11 个月前

Runway Characters now supports camera and screen sharing. Users can share a live feed and the Character will see, understand and respond to what's on screen. All in real time via the Runway API.

Runway Characters now supports camera and screen sharing. Users can share a live feed and the Character will see, understand and respond to what's on screen. All in real time via the Runway API.

Runway

21,321 次观看 • 6 个月前

Hi everyone, here's my showreel! I recently graduated with a Bachelor's degree in 3D&VFX and I am now actively looking for a job as a 3D generalist. I'm open to full-time, part-time or freelance opportunities, remote or not. Feel free to reach out here or at: peefvfx@gmail.com

Hi everyone, here's my showreel! I recently graduated with a Bachelor's degree in 3D&VFX and I am now actively looking for a job as a 3D generalist. I'm open to full-time, part-time or freelance opportunities, remote or not. Feel free to reach out here or at: [email protected]

Peef

19,373 次观看 • 7 个月前

With Insta360's Spatial Capture officially released in the US today, we can finally announce our partnership with Insta360. Yes — Insta360’s Spatial Capture feature is powered by KIRI Engine. By combining 360° cameras with KIRI Engine’s 3D Gaussian Splatting technology, we’re making it dramatically easier to capture large real-world environments and turn them into immersive 3D spaces. One of the biggest breakthroughs here is the capture workflow. Compared with existing 360° Gaussian Splatting workflows, Spatial Capture is dramatically simpler We believe 360 cameras can become one of the most natural ways to capture the world in 3D — and this collaboration is a big step toward making that happen.

With Insta360's Spatial Capture officially released in the US today, we can finally announce our partnership with Insta360. Yes — Insta360’s Spatial Capture feature is powered by KIRI Engine. By combining 360° cameras with KIRI Engine’s 3D Gaussian Splatting technology, we’re making it dramatically easier to capture large real-world environments and turn them into immersive 3D spaces. One of the biggest breakthroughs here is the capture workflow. Compared with existing 360° Gaussian Splatting workflows, Spatial Capture is dramatically simpler We believe 360 cameras can become one of the most natural ways to capture the world in 3D — and this collaboration is a big step toward making that happen.

KIRI Engine - 3D Scanner App

17,857 次观看 • 12 天前

Announcing Project Hail Mary: Journey Among the Stars for Android XR and XREAL AURA. Developed in partnership with Amazon MGM Studios and Maze Theory, and featuring an original chapter co-created with Andy Weir, this experience brings spatial storytelling to Android XR. Step into the role of Ryland Grace to diagnose failing ship systems using precise hand tracking, while the Hail Mary spacecraft bleeds seamlessly into your real-world environment through AURA’s optical see-through display. Get an early look at the gameplay below 👇 #XREALAURA #ProjectHailMaryVR #AndroidXR #SpatialComputing

Announcing Project Hail Mary: Journey Among the Stars for Android XR and XREAL AURA. Developed in partnership with Amazon MGM Studios and Maze Theory, and featuring an original chapter co-created with Andy Weir, this experience brings spatial storytelling to Android XR. Step into the role of Ryland Grace to diagnose failing ship systems using precise hand tracking, while the Hail Mary spacecraft bleeds seamlessly into your real-world environment through AURA’s optical see-through display. Get an early look at the gameplay below 👇 #XREALAURA #ProjectHailMaryVR #AndroidXR #SpatialComputing

XREAL 👓

27,264 次观看 • 3 个月前

We were thrilled to have Niantic Spatial 🌎's Project Jade demo on Spectacles at Lens Fest 2025 to show the bleeding edge of what spatial, location-based experiences can be. Voices of VR host Kent Bye (Voices of VR) sat down with the team to talk how it came together, the role Snap’s tech stack plays in development, and what’s next for XR.

We were thrilled to have Niantic Spatial 🌎's Project Jade demo on Spectacles at Lens Fest 2025 to show the bleeding edge of what spatial, location-based experiences can be. Voices of VR host Kent Bye (Voices of VR) sat down with the team to talk how it came together, the role Snap’s tech stack plays in development, and what’s next for XR.

Spectacles

15,259 次观看 • 11 个月前

"More Doggo than Doggo" Motion scanned @ 60fps. Playing back @ 20fps. Meet our inhouse tech Doggo "Rolo". Since July we've been redesigning our scanning pipeline to work with the new 3D Gaussian Splatting for Real-Time Radiance Field Rendering method from Inria. GS has reignited our passion for 3D/4D scanning. Thank you to the team at Inria IR's AeonX capture system has been designed to capture "Spatial" memories for the future. We've built on a custom version of Inria's Sibr viewer to handle the playback of our multiple processed 4D frames. Our next goal is to optimize the player to be multi-threaded to improve performance over 60fps. GS has reignited our passion for 3D/4D scanning. Thank you to the team at Inria More content to come. #guassiansplatting #ir #aeonx #4d #motionscanning #inria #ximea #idatronic #spatial #youth83

"More Doggo than Doggo" Motion scanned @ 60fps. Playing back @ 20fps. Meet our inhouse tech Doggo "Rolo". Since July we've been redesigning our scanning pipeline to work with the new 3D Gaussian Splatting for Real-Time Radiance Field Rendering method from Inria. GS has reignited our passion for 3D/4D scanning. Thank you to the team at Inria IR's AeonX capture system has been designed to capture "Spatial" memories for the future. We've built on a custom version of Inria's Sibr viewer to handle the playback of our multiple processed 4D frames. Our next goal is to optimize the player to be multi-threaded to improve performance over 60fps. GS has reignited our passion for 3D/4D scanning. Thank you to the team at Inria More content to come. #guassiansplatting #ir #aeonx #4d #motionscanning #inria #ximea #idatronic #spatial #youth83

Infinite-Realities

48,330 次观看 • 3 年前

Large-scale Gaussian splats have reached a new level of realism. This is a well-known temple in Bangkok, reconstructed as a high-fidelity 3D environment from 360 captures. At this level, the boundary between video and 3D starts to disappear. But what you’re looking at is not a video. It’s a dense spatial representation of a real place, where geometry, texture, and structure are preserved and made machine-readable. This kind of 3D data can power Visual AI, Robotics navigation, VPS localization, XR experiences, world models, and next-generation spatial computing systems. Built with Over the Reality.

Large-scale Gaussian splats have reached a new level of realism. This is a well-known temple in Bangkok, reconstructed as a high-fidelity 3D environment from 360 captures. At this level, the boundary between video and 3D starts to disappear. But what you’re looking at is not a video. It’s a dense spatial representation of a real place, where geometry, texture, and structure are preserved and made machine-readable. This kind of 3D data can power Visual AI, Robotics navigation, VPS localization, XR experiences, world models, and next-generation spatial computing systems. Built with Over the Reality.

Over the Reality 🌐

347,424 次观看 • 4 个月前