Loading video...

Video Failed to Load

Go Home

Last Friday I joined World Labs' first hackathon around Marble. In three hours, I built a rough prototype called Directed. Generate a world. Create characters. Move through it with your phone like you’re on a real set. Frame shots. Capture images. Use them as seeds for video generation. This...

54,826 views • 4 months ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Fast Company just published a great piece on World Labs , Fei-Fei Li , Marble, and the idea that spatial intelligence / world models may be one of the next big shifts in AI. I was happy to be quoted in the article, but I also wanted to share more context about my own experience with World Labs and Marble, and why this direction is especially interesting to me. My starting point: volumetric capture — For the past few years I’ve been exploring and using volumetric capture and reconstruction (photogrammetry, NeRFs, 3D Gaussian Splats) mostly capturing locations around Montreal. Alleys, museums, urban interiors. I love every step of it: the capture itself, the pipeline, and what can be done with the output. Turning real spaces into real-time explorable systems. I do this personally, sharing explorations here, and professionally as chief technologist, and co-founder of Dpt. Physical reality + generative manipulation — In my work I’m especially drawn to mixing physical reality with generative and digital manipulation: using physical interfaces (light, clay, ink, ... ) to drive generative AI pipelines, building mixed reality prototypes that reshape your surroundings, or starting from real captured spaces and transforming them using tools like Marble. Like many people, I saw the World Labs announcement on Twitter in September 2024, and Marble when it surfaced in early December. But by then, I already had a sense something was coming. The first conversation — As someone deep into volumetric capture and radiance fields, I obviously knew about Ben Mildenhall and his pioneering work on NeRF. To my surprise, Ben reached out to me in late June 2024. He’d been following some of my experiments and wanted to chat about my process and workflows and how I was using this “stuff” creatively. At that point he didn’t share what he was building, but we had a genuinely great conversation about radiance fields, AI, and my work. He was curious about the creative perspective, not just the technical one. When the World Labs announcement dropped a few months later, it all made sense. I understood what Ben had been working on, and why the creative angle mattered to them. Then in August 2025, he invited me to try the Marble beta, and I’ve been experimenting with it since. Experimenting with Marble — The first thing I used Marble for was materializing scene and world concepts during ideation at the studio, and seeing if and how it could fit into our production pipeline. In parallel, I dove into a series of experiments focused on world manipulation: starting from real captured spaces and transforming them using Marble. I’d already been exploring that idea using img2img diffusion with ControlNet on NeRF renders, real-time video streams, and even mixed reality using headset camera feeds. But Marble brings something different. It generates persistent, spatially cohesive 3D worlds that can be rendered in real time across a wide range of devices. That’s a real shift. Experiment 01: Parallel Realities — The first experiment, Parallel Realities, starts from a volumetric capture of a real location, reconstructed as 3D Gaussian Splats. Using Marble, I generate an alternate version of that same space, something informed by the original architecture: abandoned, nature-reclaimed, alternate era. Then, using Spark (World Labs’ 3D Gaussian Splatting renderer for THREE.js) I make both realities coexist in the same spatial coordinate system. From there, I use a portal UX mechanic to let the user step between the real reconstruction and the Marble-generated version. Experiment 02: Hidden Depth The second experiment, Hidden Depth, does not transform a space as much as expand it. A captured location has a visual boundary (a mural, a doorway, a dark corridor) and Marble generates what exists beyond it. For example: a Montreal alley has a painted mural; step through it and you’re inside a world informed by what is actually depicted there. World Labs showcased part of this work here: And in their Spark 2.0 post: The project page is here: Why this matters to me — Being able to start from a real 3D Gaussian Splat scene and manipulate it with Marble opens up a lot of ideas. The 3DGS pipeline is becoming an increasingly compelling foundation for exploration, experimentation, and storytelling. What matters most to me right now is more control. The more I can steer the generated scene or world, the more useful the tool becomes. I want more features like the already existing multiple input images and Chisel, the blockout-based approach. I would like better local control, the ability to expand a generated world more and more while preserving coherence, and the ability to directly import 3D Gaussian Splat scenes to be used as a starting point. I want more ways to shape the result, not just a “prompt and hope” approach. — It is exciting to see this field moving from research and demos toward actual creative workflows.

Hugues Bruyère

61,494 views • 24 days ago

my new song “BREAKDOWN.” is out on the 21st of June!!! 🖤🖤🖤 I wrote this poem because it’s been the hardest year for my mental health. In my life I’ve always never felt good enough, it’s just the thing that’s eaten me up. For as long as I can remember i have felt constantly afraid of how quickly my head can turn dark. It’s always been so hard to fight the darkness that i inevitably have. A lot of people will say it’s a phase and it will go away. But it doesn’t and the reality of the situation is I have to find strategies to deal with it. To put it plainly the things I don’t like about myself will probably never change, people tell me one day I’ll come-to terms with them one day but I want that day to be FUCKING NOW. This song is a message to myself to try and exist alongside my insecurities and my darkness by grounding myself and remembering what is real in life and the world is so much bigger than me. Try and get out of your head and notice the world around you, notice the things and people around you. Connect with them, the chances are they probably feel the same. Don’t let the bullshit inside your head consume you. It just wastes precious time. Remember what is real. Help people, be kind, help the world, help yourself. If you think you can’t do it, you can. You can get through this, trust me. Use this poem in a mornin to get u out of bed, use it when youre about to back out of something last minute, use it when you’re at your darkest. It’s got a little bit of light in it. Don’t forget to put your feet in the grass … Mind

YUNGBLUD

66,420 views • 2 years ago

Remote Viewer Warns of a Terrifying Coordinated Attack on a Major US City?! Remote Viewer, Daz Smith, looked at April world events and what he got back is potentially concerning... "...So it was large structures, weirdly higher than any of containership. I shouldn't have looked at that a bit more detail, but I didn't. Maybe I just thought it was appropriate, moved it to one side, but definitely large structures." "And it felt like the structures were on fire. So I, you know, asked the question why here? And I felt like there was a ground based attack, that was going to happen in, in, in this city location. And it felt like it was like a bomb attack. And I had, like, this very strong visual of a, white truck or van that might be involved, which I tried to draw here. So the, you know, they had these kind of, modern looking van in front of a, multi-level structure, almost like this, like the entranceway or something of the structure." "So it felt like it was a kinetic event, of lots of explosive energy. It was very loud. There was wide dispersal. Definitely had a terror attack feel. It feels like it was a driven vehicle parts and then detonated, as an act of retaliation. The vehicle fills, larger than a car. Felt very van like, possibly white, possibly have branding on it as well." "...It was strategically positioned, in front of an important structure. The whole thing felt very US based. Just not that weird kind of U.S filled me, getting targets. And I also have a dang tang feel to this as well, so it felt like it was in a large U.S urban city, which gave me the idea of New York. Because maybe because I've been to New York and, you know, just had that, but definitely had an East Coast feel to this..." "...it was definitely driven, implanted..." "...it felt like it was in planning. So they were planning or rehearsing for a future event, which is, you know, what we're looking for, a month ahead. And I had a weird I had a well here, weirdly, of Holy Cross... it starts with fear and panic, and it's like they're just implanting a message.... Trying to timeline this site here. You know, again, this is all very experimental..."

Future Forecasting Group

14,822 views • 3 months ago

I am stocked to announce that I won the OpenAI Developers Codex x Mollie Hacka Worldwide Hackathon in Paris. 60+ builders, every one of us working solo, one day to ship. I built mine around a single question: who gets to own intelligence? The default answer is scary. You hand your data to a handful of labs, they train the model, they own it, and you rent back a thin slice of what your own data made possible. That is the bargain on the table today. I do not accept it. So I built Lensemble: a Tapestry like distributed training platform for JEPA based World Models. What does it enable: World Models that a community improves together, keeps sovereign, and co-owns. Two bets sit underneath it. First, the paradigm. Language models predict the next token. Powerful for text, a dead end for the physical world. A robot does not need to autocomplete sentences, it needs to predict what happens next in the world. That is what JEPA does: it learns by predicting representations instead of pixels or tokens. I am convinced world models are the most underrated paradigm in AI right now, and the closest thing we have to a ChatGPT moment for robotics. Second, the politics. Your raw trajectories never leave your machine. Each participant trains locally against a shared protocol and ships only an update, never the data. A federated round folds those updates into one shared world model, a LeWorldModel based model, and the gain is measured, not claimed: a 12k-parameter adapter on a frozen backbone, held-out prediction error down about 12 percent, the model measurably less surprised by the world. Then the upside is split by contribution weight, so the people who improved the model own a share of what it earns. This is the thesis behind Project Tapestry, the AI Alliance and Yann LeCun's push for federated, sovereign frontier AI, carried into world models and robotics. Call it Tapestry for the physical world. All of it built solo, in a single day, with Codex as my pair the whole way. Thank you to OpenAI Codex and Mollie for backing builders who ship real things, and to Boris and the organizing crew for the room and the standard you set. Intelligence the world improves, and the world owns. That is the future I want for my kids, and the one I will keep building.

abdel

17,134 views • 20 days ago