Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Playing with depth and layering—using the Mixed Reality + Diffusion prototype to explore concepts, styles, and moods. #MixedReality #MR #AI #StableDiffusion #Quest3

Hugues Bruyère

7,123 subscribers

17,145 views • 1 year ago •via X (Twitter)

Science & Technology #MixedReality #MR #AI #StableDiffusion #Quest3

Anya Rossi• Live Now

Private livecam show

11 Comments

Daniel Trujillo1 year ago

Plz share 😭

PowerBeatsVR3 years ago

Get ready for a full-body VR workout that’s fun, fast, and intuitive — Play PowerBeatsVR (Now on Meta Quest) 🔥

James Ryan1 year ago

Cool stuff

Eric Wescott1 year ago

The diffusion modeling isn't running on the headset is it? If not what hardware and how long does it take a "plane" to generate?

chris rogers1 year ago

supercool! this is one of the things im looking to do with my new quest3. i guess youre sending passthrough images to stable diffusion running on a desktop?

Renardjean1 year ago

Même si la focale est pas top Tu peux pas en étape 1 réaliser un panoramique en tournant la tête puis en étape 2 transformer ce panoramique ? Ça serait plus long mais le résultat serait plus cohérent?

VRCatalans1 year ago

"turn my room into a cubist nightmare"

Unity Eagle1 year ago

This looks so cool 😎

Egon1 year ago

Damn! Not a fan of AI at all, but this is really cool!

hmm1 year ago

WE BURNING THE EARTH WITH THIS ONE 🔥🔥🔥

Kitty.International1 year ago

Sick

Related Videos

Early test run with freshly added depth estimation — Mixed Reality + Diffusion prototype to explore concepts, styles, and moods. #MixedReality #MR #AI #StableDiffusion #Quest3

Early test run with freshly added depth estimation — Mixed Reality + Diffusion prototype to explore concepts, styles, and moods. #MixedReality #MR #AI #StableDiffusion #Quest3

Hugues Bruyère

13,054 views • 1 year ago

Mixed Reality + Diffusion prototype as a tool for exploring concepts, styles, and moods by transforming real-world surroundings into alternate realities. #MixedReality #MR #AI #StableDiffusion #Quest3

Mixed Reality + Diffusion prototype as a tool for exploring concepts, styles, and moods by transforming real-world surroundings into alternate realities. #MixedReality #MR #AI #StableDiffusion #Quest3

Hugues Bruyère

52,492 views • 1 year ago

This time, I took the prototype to the backyard—opening portals, transforming my surroundings into a series of alternate realities. #MixedReality #MR #AI #StableDiffusion #Quest3

This time, I took the prototype to the backyard—opening portals, transforming my surroundings into a series of alternate realities. #MixedReality #MR #AI #StableDiffusion #Quest3

Hugues Bruyère

33,469 views • 1 year ago

Why yes, I did turn my bedroom into an underwater aquarium using mixed reality on the Quest 3. #quest3 #mixedreality

Why yes, I did turn my bedroom into an underwater aquarium using mixed reality on the Quest 3. #quest3 #mixedreality

Matt - BMFVR

108,085 views • 2 years ago

Practice your zombie apocalypse tactics defending your home in Drop Dead's Mixed Reality mode using Meta Quest 3. See more: #games #mixedreality #MR #VR #AR #tech #technews #technology #Quest3 #MetaQuest3

Practice your zombie apocalypse tactics defending your home in Drop Dead's Mixed Reality mode using Meta Quest 3. See more: #games #mixedreality #MR #VR #AR #tech #technews #technology #Quest3 #MetaQuest3

80 LEVEL

96,286 views • 2 years ago

Hands-on Hallucination session: Focusing the diffusion process with the Hallucination Scope.⁣ Experimenting with new ways to explore and transform a scene.⁣ ⁣ #AI #StableDiffusion #Realtime

Hands-on Hallucination session: Focusing the diffusion process with the Hallucination Scope.⁣ Experimenting with new ways to explore and transform a scene.⁣ ⁣ #AI #StableDiffusion #Realtime

Hugues Bruyère

15,377 views • 11 months ago

Time to update my Quest MR + Gen AI prototype now that Meta Quest Camera API is out — This proto is using a workaround to capture passthrough snapshots, processes them with Stable Diffusion, and displays the results back in their exact physical location. #MR #AI

Time to update my Quest MR + Gen AI prototype now that Meta Quest Camera API is out — This proto is using a workaround to capture passthrough snapshots, processes them with Stable Diffusion, and displays the results back in their exact physical location. #MR #AI

Hugues Bruyère

11,744 views • 1 year ago

Meta Quest 3 with high resolution color mixed reality ✨ Experiences preview I’m definitely interested in boxing and local multiplayer shooter / fighting 🙌 #MetaQuest3 #VR #MixedReality #MR #XR #MetaReality

Meta Quest 3 with high resolution color mixed reality ✨ Experiences preview I’m definitely interested in boxing and local multiplayer shooter / fighting 🙌 #MetaQuest3 #VR #MixedReality #MR #XR #MetaReality

Ben Geskin

14,288 views • 3 years ago

It won't take long before we'll be able to "reskin reality" in real-time. I had the chance to try this prototype that combines the #MixedReality view on a Quest device with Stable Diffusion AI and it feels like all the pieces are about to fit together... Special thanks to Hugues Bruyère , Chief of Innovation at Dpt. for sharing this early version.

It won't take long before we'll be able to "reskin reality" in real-time. I had the chance to try this prototype that combines the #MixedReality view on a Quest device with Stable Diffusion AI and it feels like all the pieces are about to fit together... Special thanks to Hugues Bruyère , Chief of Innovation at Dpt. for sharing this early version.

Gabriele Romagnoli

33,899 views • 1 year ago

As you know I'm obsessed with XR tangible illusions🧙‍♂️ The new Laura Mingail's UploadVR piece delves into why magic principles are mixed reality's best friend. #Quest3 #MixedReality

As you know I'm obsessed with XR tangible illusions🧙‍♂️ The new Laura Mingail's UploadVR piece delves into why magic principles are mixed reality's best friend. #Quest3 #MixedReality

Greg Madisᯅn

20,389 views • 2 years ago

🎲✨ Quick and dirty prototype of All On Board in mixed reality mode! 🌍🕹️ Tabletop games in XR might be something really cool! Is this something you'll be willing to try out? Share your thoughts! #VRgaming #MixedReality #AllOnBoard

🎲✨ Quick and dirty prototype of All On Board in mixed reality mode! 🌍🕹️ Tabletop games in XR might be something really cool! Is this something you'll be willing to try out? Share your thoughts! #VRgaming #MixedReality #AllOnBoard

All On Board!

11,562 views • 2 years ago

Immersive Diffusion -endless AI possibilities. Working with Blockade Labs to bring you content like this. #texttoskybox #vr #stablediffusion

Immersive Diffusion -endless AI possibilities. Working with Blockade Labs to bring you content like this. #texttoskybox #vr #stablediffusion

ScottieFox

438,499 views • 3 years ago

Exploring animated intros with text/logo #warpfusion Stable Diffusion #midjourney #ai #stablediffusion #controlnet #animation #aiar

Mrboofy

179,991 views • 3 years ago

playing around with AnimateDiff #stablediffusion #AIイラスト #txt2vid #AnimateDiff

playing around with AnimateDiff #stablediffusion #AIイラスト #txt2vid #AnimateDiff

Neuron Massage

13,045 views • 2 years ago

This is my first time using multiple AI tools and traditional tools to create an AI music video #Suno #StableDiffusion

This is my first time using multiple AI tools and traditional tools to create an AI music video #Suno #StableDiffusion

Komi

33,179 views • 2 years ago

In collaboration with Intel, our Depth Fusion showcases the power of our LDM3D diffusion model in generating 360° views from text prompts provided by the user. The LDM3D diffusion model generates a 2D RGB image and its corresponding relative depth map providing a complete RGBD representation corresponding to the text prompt. The LDM 3D model is a specialized version of the stable diffusion V 1.4 model that has been modified to fit both image and depth map data.The model was then fine tuned on a subset of the Laion400M data set - large scale image caption data set. The depth maps used to fine tune our model were generated by the DPTBeiT large 512 depth estimation model that provides highly accurate relative depth estimates for each pixel. We take the generated 2D RGB image and depth map and use them to compute a 360° projection using touchdesigner. Touchdesigner is a versatile platform that allows for the creation of immersive and interactive multimedia experiences. Our application harnesses the power of touchdesigner to bring the generated 360° views to life, providing users with a unique and engaging way to experience their text prompts, whether it’s a description of a tranquil forest, a noisy cityscape or a futuristic sci fi world. Our depth fusion can bring these concepts to life in a vivid and immersive detail. - Scottie Fox, VP Engineering Blockade Labs ScottieFox #AI #VR #3D #gamedev #stablediffusion

In collaboration with Intel, our Depth Fusion showcases the power of our LDM3D diffusion model in generating 360° views from text prompts provided by the user. The LDM3D diffusion model generates a 2D RGB image and its corresponding relative depth map providing a complete RGBD representation corresponding to the text prompt. The LDM 3D model is a specialized version of the stable diffusion V 1.4 model that has been modified to fit both image and depth map data.The model was then fine tuned on a subset of the Laion400M data set - large scale image caption data set. The depth maps used to fine tune our model were generated by the DPTBeiT large 512 depth estimation model that provides highly accurate relative depth estimates for each pixel. We take the generated 2D RGB image and depth map and use them to compute a 360° projection using touchdesigner. Touchdesigner is a versatile platform that allows for the creation of immersive and interactive multimedia experiences. Our application harnesses the power of touchdesigner to bring the generated 360° views to life, providing users with a unique and engaging way to experience their text prompts, whether it’s a description of a tranquil forest, a noisy cityscape or a futuristic sci fi world. Our depth fusion can bring these concepts to life in a vivid and immersive detail. - Scottie Fox, VP Engineering Blockade Labs ScottieFox #AI #VR #3D #gamedev #stablediffusion

Blockade Labs

11,439 views • 3 years ago

3D Crowd Generation with Stable-Diffusion and Blender. A thread exploring current simplest approaches, limitations and possible improvements. #stablediffusion #crowdgen #b3d

3D Crowd Generation with Stable-Diffusion and Blender. A thread exploring current simplest approaches, limitations and possible improvements. #stablediffusion #crowdgen #b3d

Alex Martinelli

156,964 views • 3 years ago

🏁 Unveiling the first glimpse of Rallyman GT by Synapses Games in mixed reality! 🏎️💨 Are you ready to outsmart your opponents on and off the track? #VirtualReality #MRGaming #AugmentedReality #Quest3

🏁 Unveiling the first glimpse of Rallyman GT by Synapses Games in mixed reality! 🏎️💨 Are you ready to outsmart your opponents on and off the track? #VirtualReality #MRGaming #AugmentedReality #Quest3

All On Board!

10,965 views • 2 years ago

"DVD: Dynamic Video Depth" TL;DR: Recovers temporally consistent depth from monocular videos using diffusion priors + geometric constraints, handling dynamic scenes and motion robustly.

"DVD: Dynamic Video Depth" TL;DR: Recovers temporally consistent depth from monocular videos using diffusion priors + geometric constraints, handling dynamic scenes and motion robustly.

Alexandre Morgand

11,804 views • 2 months ago

Generative AI and WebAR are so powerful 🤩 In this experiment I used Stable Diffusion Depth2img, Three.js and 8thwall Visual Positioning System. #8thwall #niantic #stablediffusion #threejs

Generative AI and WebAR are so powerful 🤩 In this experiment I used Stable Diffusion Depth2img, Three.js and 8thwall Visual Positioning System. #8thwall #niantic #stablediffusion #threejs

Stijn Spanhove

113,895 views • 3 years ago