Загрузка видео...

Не удалось загрузить видео

На главную

Accessibility is the magic here. Anyone with a phone can do this. Capture > upload > process > boom - you’ve got a real environment stored as a 3DGS asset. Right before HalfRez in Chicago, I shot a few quick videos while walking around the city. Nothing planned, nothing...

19,831 просмотров • 8 месяцев назад •via X (Twitter)

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Fast Company just published a great piece on World Labs , Fei-Fei Li , Marble, and the idea that spatial intelligence / world models may be one of the next big shifts in AI. I was happy to be quoted in the article, but I also wanted to share more context about my own experience with World Labs and Marble, and why this direction is especially interesting to me. My starting point: volumetric capture — For the past few years I’ve been exploring and using volumetric capture and reconstruction (photogrammetry, NeRFs, 3D Gaussian Splats) mostly capturing locations around Montreal. Alleys, museums, urban interiors. I love every step of it: the capture itself, the pipeline, and what can be done with the output. Turning real spaces into real-time explorable systems. I do this personally, sharing explorations here, and professionally as chief technologist, and co-founder of Dpt. Physical reality + generative manipulation — In my work I’m especially drawn to mixing physical reality with generative and digital manipulation: using physical interfaces (light, clay, ink, ... ) to drive generative AI pipelines, building mixed reality prototypes that reshape your surroundings, or starting from real captured spaces and transforming them using tools like Marble. Like many people, I saw the World Labs announcement on Twitter in September 2024, and Marble when it surfaced in early December. But by then, I already had a sense something was coming. The first conversation — As someone deep into volumetric capture and radiance fields, I obviously knew about Ben Mildenhall and his pioneering work on NeRF. To my surprise, Ben reached out to me in late June 2024. He’d been following some of my experiments and wanted to chat about my process and workflows and how I was using this “stuff” creatively. At that point he didn’t share what he was building, but we had a genuinely great conversation about radiance fields, AI, and my work. He was curious about the creative perspective, not just the technical one. When the World Labs announcement dropped a few months later, it all made sense. I understood what Ben had been working on, and why the creative angle mattered to them. Then in August 2025, he invited me to try the Marble beta, and I’ve been experimenting with it since. Experimenting with Marble — The first thing I used Marble for was materializing scene and world concepts during ideation at the studio, and seeing if and how it could fit into our production pipeline. In parallel, I dove into a series of experiments focused on world manipulation: starting from real captured spaces and transforming them using Marble. I’d already been exploring that idea using img2img diffusion with ControlNet on NeRF renders, real-time video streams, and even mixed reality using headset camera feeds. But Marble brings something different. It generates persistent, spatially cohesive 3D worlds that can be rendered in real time across a wide range of devices. That’s a real shift. Experiment 01: Parallel Realities — The first experiment, Parallel Realities, starts from a volumetric capture of a real location, reconstructed as 3D Gaussian Splats. Using Marble, I generate an alternate version of that same space, something informed by the original architecture: abandoned, nature-reclaimed, alternate era. Then, using Spark (World Labs’ 3D Gaussian Splatting renderer for THREE.js) I make both realities coexist in the same spatial coordinate system. From there, I use a portal UX mechanic to let the user step between the real reconstruction and the Marble-generated version. Experiment 02: Hidden Depth The second experiment, Hidden Depth, does not transform a space as much as expand it. A captured location has a visual boundary (a mural, a doorway, a dark corridor) and Marble generates what exists beyond it. For example: a Montreal alley has a painted mural; step through it and you’re inside a world informed by what is actually depicted there. World Labs showcased part of this work here: And in their Spark 2.0 post: The project page is here: Why this matters to me — Being able to start from a real 3D Gaussian Splat scene and manipulate it with Marble opens up a lot of ideas. The 3DGS pipeline is becoming an increasingly compelling foundation for exploration, experimentation, and storytelling. What matters most to me right now is more control. The more I can steer the generated scene or world, the more useful the tool becomes. I want more features like the already existing multiple input images and Chisel, the blockout-based approach. I would like better local control, the ability to expand a generated world more and more while preserving coherence, and the ability to directly import 3D Gaussian Splat scenes to be used as a starting point. I want more ways to shape the result, not just a “prompt and hope” approach. — It is exciting to see this field moving from research and demos toward actual creative workflows.

Hugues Bruyère

69,960 просмотров • 1 месяц назад

my new song “BREAKDOWN.” is out on the 21st of June!!! 🖤🖤🖤 I wrote this poem because it’s been the hardest year for my mental health. In my life I’ve always never felt good enough, it’s just the thing that’s eaten me up. For as long as I can remember i have felt constantly afraid of how quickly my head can turn dark. It’s always been so hard to fight the darkness that i inevitably have. A lot of people will say it’s a phase and it will go away. But it doesn’t and the reality of the situation is I have to find strategies to deal with it. To put it plainly the things I don’t like about myself will probably never change, people tell me one day I’ll come-to terms with them one day but I want that day to be FUCKING NOW. This song is a message to myself to try and exist alongside my insecurities and my darkness by grounding myself and remembering what is real in life and the world is so much bigger than me. Try and get out of your head and notice the world around you, notice the things and people around you. Connect with them, the chances are they probably feel the same. Don’t let the bullshit inside your head consume you. It just wastes precious time. Remember what is real. Help people, be kind, help the world, help yourself. If you think you can’t do it, you can. You can get through this, trust me. Use this poem in a mornin to get u out of bed, use it when youre about to back out of something last minute, use it when you’re at your darkest. It’s got a little bit of light in it. Don’t forget to put your feet in the grass … Mind

YUNGBLUD

66,420 просмотров • 2 лет назад

𝗗𝗼𝗿𝗺𝗮𝗻𝘁 𝗠𝗲𝗺𝗼𝗿𝘆 𝗩𝗶𝗲𝘄𝗲𝗿: Because I almost always have some gear with me—a drone, a mirrorless camera, or at least a phone—I can capture scenes on the spur of the moment. Here I am freely flying through 3D Gaussian Splats scenes trained from these impromptu captures. It has been several years now since I've developed a real passion for 3D scanning, photogrammetry, and—for the last two and a half years—radiance fields. We actively use these technologies on a professional level at Dpt. , but this is also a personal passion of mine. I love capturing scenes, places, people, moments in time—memories. I enjoy the process of doing it; yes, capturing several hundreds of photos at a time, going in circles around a 'subject' for 15 minutes—all of which can drive my family nuts when they're with me. I have fun pre-processing, aligning, and using datasets to finally see those memories form and then be able to explore them freely in real-time. This week, Meta announced Hyperscape during this year's Meta Connect event… "𝘈𝘯𝘥 𝘴𝘱𝘦𝘢𝘬𝘪𝘯𝘨 𝘰𝘧 𝘱𝘳𝘦𝘴𝘦𝘯𝘤𝘦, 𝘸𝘦’𝘳𝘦 𝘪𝘮𝘱𝘳𝘰𝘷𝘪𝘯𝘨 𝘵𝘩𝘢𝘵, 𝘵𝘰𝘰. 𝘞𝘦’𝘳𝘦 𝘸𝘰𝘳𝘬𝘪𝘯𝘨 𝘵𝘰 𝘣𝘳𝘪𝘯𝘨 𝘱𝘩𝘰𝘵𝘰𝘳𝘦𝘢𝘭𝘪𝘴𝘵𝘪𝘤 𝘴𝘱𝘢𝘤𝘦𝘴 𝘪𝘯𝘵𝘰 𝘵𝘩𝘦 𝘮𝘦𝘵𝘢𝘷𝘦𝘳𝘴𝘦, 𝘦𝘯𝘢𝘣𝘭𝘪𝘯𝘨 𝘢 𝘱𝘳𝘰𝘧𝘰𝘶𝘯𝘥 𝘯𝘦𝘸 𝘸𝘢𝘺 𝘵𝘰 𝘣𝘦 𝘵𝘰𝘨𝘦𝘵𝘩𝘦𝘳 𝘪𝘯 𝘴𝘱𝘢𝘤𝘦𝘴 𝘵𝘩𝘢𝘵 𝘭𝘰𝘰𝘬 𝘢𝘯𝘥 𝘧𝘦𝘦𝘭 𝘭𝘪𝘬𝘦 𝘺𝘰𝘶’𝘳𝘦 𝘱𝘩𝘺𝘴𝘪𝘤𝘢𝘭𝘭𝘺 𝘵𝘩𝘦𝘳𝘦—𝘸𝘦 𝘤𝘢𝘭𝘭 𝘪𝘵 𝘏𝘺𝘱𝘦𝘳𝘴𝘤𝘢𝘱𝘦." …it's exciting to see major players like Meta pushing the boundaries of immersive experiences. Their announcement of Hyperscape resonates deeply with the work I've been doing and my passion for capturing and recreating photorealistic environments and memories. It feels like we're all moving toward a future where the lines between the physical and digital worlds blur, allowing us to share spaces and moments in unprecedented ways. I'm thrilled to be contributing my own explorations to this ever-evolving field. The attached video is a screen recording of myself exploring and flying through volumetric captures—dormant memories—in real-time using an app I crafted for this purpose. The first part shows me moving from one memory to another (btw, this works in tethered VR), and in the second part of the video at , I explore two memories simultaneously, rendering two 3D Gaussian Splats of the same location onto two monitors. #gaussiansplatting #radiancefield #digitaltwin #hyperscape #memories

Hugues Bruyère

16,304 просмотров • 1 год назад