Загрузка видео...

Не удалось загрузить видео

На главную

Experimenting with environment styles in my off-axis projection demo. These are Gaussian splats rendered in the browser, switching via keyboard. -> Blender basic layout -> World Labs (chisel) -> three.js / Spark 2.0 -> Mediapipe (face-tracking)

86,675 просмотров • 4 месяцев назад •via X (Twitter)

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

🏎️ | 260624 | Since yesterday, a mysterious figure has been spotted at Zhuhai. My initial assumption was that he had been behind the wheel, as he was wearing racing boots in the photos shared by YIBO OFFICIAL. However, no videos or photos showed him getting in or out of the car just yet; all footage just showed him interacting with Yibo, Rio, and the rest of the UNO Racing team. Now, after research, I can confirm that the Mercedes-AMG factory driver accompanying UNO Racing during these private test sessions is Ralf Aron. He is also using his 2023 helmet for the practice sessions. Ralf Aron is an Estonian professional racing driver and Mercedes-AMG Performance Driver with experience across single-seater, endurance, and GT3 competition. After beginning his career in karting at the age of six, he rose through the junior formula ranks, winning the 2015 Italian Formula 4 Championship before competing in the FIA Formula 3 European Championship. Following his single-seater career, Aron expanded his expertise by taking on management and technical roles with Prema Racing and Sauber Motorsport, contributing to championship-winning campaigns in Formula Regional and the European Le Mans Series. In 2023, he returned to full-time competition as a Mercedes-AMG Junior Driver, finishing runner-up in the ADAC GT Masters and competing in the GT World Challenge Europe Endurance Cup. Promoted to Mercedes-AMG Performance Driver in 2024, Aron has since competed in major international endurance events, including the Nürburgring 24 Hours, the 24 Hours of Spa, the Macau GT World Cup, and the Rolex 24 at Daytona. His current racing program includes GT World Challenge Asia, the Nürburgring 24 Hours, GT Open, and the Asian Le Mans Series, representing teams such as GetSpeed, Climax Racing, and Lone Star Racing. #WangYibo #WangYibo王一博 #王一博 #หวังอี้ป๋อ #ワンイーボー #왕이보 #85RACING #YIBO85

YIBO85: The Archives 🐍

12,755 просмотров • 1 месяц назад

Fast Company just published a great piece on World Labs , Fei-Fei Li , Marble, and the idea that spatial intelligence / world models may be one of the next big shifts in AI. I was happy to be quoted in the article, but I also wanted to share more context about my own experience with World Labs and Marble, and why this direction is especially interesting to me. My starting point: volumetric capture — For the past few years I’ve been exploring and using volumetric capture and reconstruction (photogrammetry, NeRFs, 3D Gaussian Splats) mostly capturing locations around Montreal. Alleys, museums, urban interiors. I love every step of it: the capture itself, the pipeline, and what can be done with the output. Turning real spaces into real-time explorable systems. I do this personally, sharing explorations here, and professionally as chief technologist, and co-founder of Dpt. Physical reality + generative manipulation — In my work I’m especially drawn to mixing physical reality with generative and digital manipulation: using physical interfaces (light, clay, ink, ... ) to drive generative AI pipelines, building mixed reality prototypes that reshape your surroundings, or starting from real captured spaces and transforming them using tools like Marble. Like many people, I saw the World Labs announcement on Twitter in September 2024, and Marble when it surfaced in early December. But by then, I already had a sense something was coming. The first conversation — As someone deep into volumetric capture and radiance fields, I obviously knew about Ben Mildenhall and his pioneering work on NeRF. To my surprise, Ben reached out to me in late June 2024. He’d been following some of my experiments and wanted to chat about my process and workflows and how I was using this “stuff” creatively. At that point he didn’t share what he was building, but we had a genuinely great conversation about radiance fields, AI, and my work. He was curious about the creative perspective, not just the technical one. When the World Labs announcement dropped a few months later, it all made sense. I understood what Ben had been working on, and why the creative angle mattered to them. Then in August 2025, he invited me to try the Marble beta, and I’ve been experimenting with it since. Experimenting with Marble — The first thing I used Marble for was materializing scene and world concepts during ideation at the studio, and seeing if and how it could fit into our production pipeline. In parallel, I dove into a series of experiments focused on world manipulation: starting from real captured spaces and transforming them using Marble. I’d already been exploring that idea using img2img diffusion with ControlNet on NeRF renders, real-time video streams, and even mixed reality using headset camera feeds. But Marble brings something different. It generates persistent, spatially cohesive 3D worlds that can be rendered in real time across a wide range of devices. That’s a real shift. Experiment 01: Parallel Realities — The first experiment, Parallel Realities, starts from a volumetric capture of a real location, reconstructed as 3D Gaussian Splats. Using Marble, I generate an alternate version of that same space, something informed by the original architecture: abandoned, nature-reclaimed, alternate era. Then, using Spark (World Labs’ 3D Gaussian Splatting renderer for THREE.js) I make both realities coexist in the same spatial coordinate system. From there, I use a portal UX mechanic to let the user step between the real reconstruction and the Marble-generated version. Experiment 02: Hidden Depth The second experiment, Hidden Depth, does not transform a space as much as expand it. A captured location has a visual boundary (a mural, a doorway, a dark corridor) and Marble generates what exists beyond it. For example: a Montreal alley has a painted mural; step through it and you’re inside a world informed by what is actually depicted there. World Labs showcased part of this work here: And in their Spark 2.0 post: The project page is here: Why this matters to me — Being able to start from a real 3D Gaussian Splat scene and manipulate it with Marble opens up a lot of ideas. The 3DGS pipeline is becoming an increasingly compelling foundation for exploration, experimentation, and storytelling. What matters most to me right now is more control. The more I can steer the generated scene or world, the more useful the tool becomes. I want more features like the already existing multiple input images and Chisel, the blockout-based approach. I would like better local control, the ability to expand a generated world more and more while preserving coherence, and the ability to directly import 3D Gaussian Splat scenes to be used as a starting point. I want more ways to shape the result, not just a “prompt and hope” approach. — It is exciting to see this field moving from research and demos toward actual creative workflows.

Hugues Bruyère

69,960 просмотров • 1 месяц назад

📢 Our lab has been exploring 3D world models for years — and we’re thrilled to share **PhysTwin**: a milestone that reconstructs object appearance, geometry, and dynamics from just a few seconds of interaction! Led by the amazing Hanxiao Jiang 👉 PhysTwin combines **Gaussian splatting** with **inverse dynamics optimization** based on simple **spring-mass** systems. ⚙️ The result? Real-time, action-conditioned 3D video prediction under novel interactions (i.e., 3D world models). 🔑 A few key takeaways: 1. Having the right structure (e.g., particles/masses) helps navigate the trade-off between sample efficiency, generalization, and broad applicability. 2. Visual foundation models (VFMs) have matured to the point where they can provide rich supervision for world modeling (e.g., tracking, shape completion). 3. Beyond VFMs, many crucial components have come together in recent years: Gaussian splats for rendering, NVIDIA Warp for high-performance simulation, and scene/asset generation from a wide range of labs and companies. The future of 3D world models is looking bright! ✨ 4. The resulting digital twin supports a wide range of downstream applications—especially in data generation and policy evaluation, thanks to its realistic rendering and simulation capabilities. 🎥 All code and data to reproduce the results, along with interactive demos, are available on the website. Check the following visualizations of: (1) observations, (2) reconstructed state/actions, (3) interactive digital twins, and (4) the overlays between real-world robot teleoperation and our model’s open-loop predictions.

Yunzhu Li

25,279 просмотров • 1 год назад

I've been experimenting with Seedance 2.0 to create seamless extensions. I created this sequence called UBUMBE FOREST. Seamless extensions can actually be quite tricky to do and requires some precise magic with editing to connect them. There is no shortcut here, you must experiment until you find the sweet spot to make the transition seamless. Ubumbe Forest - During a routine foraging trip deep in the Ubumbe forest in Tanzania, a father guides his daughter off the beaten path. Here, hidden from the rest of their tribe, she steps into a breathtaking new world and comes face-to-face with insects and creatures she has never seen before, even encountering a rare Peafox. 🟢Extending a scene however is fairly simple: - Generate your first sequence. - Upload that video as an Omni reference. - Type this at the start of the prompt "Naturally continue the movement and momentum from the previous clip. Keep the exact same art style, lighting, character appearance, and physics." and then explain what happens next in this sequence. - Congrats, you now have a scene extension that naturally flows from where the last video ended. However this is only the start of the puzzle, you need to join these clips so they're seamless. Seedance 2.0 is able to match the pacing, remember the characters and even their voices using this technique. The hard part is the extension but check my second post to see how I'm doing it in Capcut.

Travis Davids

14,087 просмотров • 2 месяцев назад

Everyone's talking, reading, or writing about how much is changing in how we build products in the future, but very few people have actually experienced what the most cutting edge tools are capable of. In a new series on my podcast, I'm going to sit down with the founders of the most advanced product development tools to live demo what these tools can do, and then talk about the implications of this on product people's careers and lives. To kick things off, I sat down with Amjad Masad (Amjad Masad), co-founder and CEO of Replit ⠕, a browser-based coding environment that allows anyone to write and deploy code. Replit has 34 million users globally and is one of the fastest-growing developer communities in the world. In our conversation, Amjad shares: 🔸 A live demo of Replit building a full-stack web app from a text prompt 🔸 The implications of AI-powered development for product managers, designers, and engineers 🔸 What skills will matter more, and less, in the future 🔸 How this might reshape companies and careers 🔸 Why being “generative” will become an increasingly valuable skill 🔸 “Amjad’s law” and how learning to debug AI-generated code is becoming ever more valuable 🔸 Much more Listen now 👇 - YouTube: - Spotify: - Apple: Thank you to our wonderful sponsors for supporting the podcast: 🏆 WorkOS — Modern identity platform for B2B SaaS, free up to 1 million MAUs: 🏆 — A global leader in digital identity verification: 🏆 @LinkedInMktg — Reach professionals and drive results for your business:

Lenny Rachitsky

81,955 просмотров • 1 год назад

The truth is getting out! Sacred medicines will be a topic of discussion for the collective healing and transformation of consciousness. True connection to the divine beyond all religions, dogma, and fear based programs. I have done extensive work with all of these sacred medicines. Ibogaine is not for the faint of heart. It's intense, confronting, profound, and liberating. My first ceremony was 24hrs and my second was 37hrs long. I share some of my experiences on my YouTube videos. I had my life review, I went through my families lives as well seeing all the trauma they endured and how it shaped who they were. I saw the karmic cycles playing out between my soul and others in my life even being shown past lives where they had abused others which is why they endured it in this one. I traveled the cosmos, I interacted and was physically healed by ETs. Archangel Michael was standing by my bedside the whole time. I was remote viewing watching myself and the nurses from above while also in other visions. I was shown how many lives I had on Earth and beyond that, where my mind couldn't comprehend. I was in the living movie of many lifetimes and my deaths. Killed in the Coliseum, a Knight killed off my horse, crushed by a stone catapult, burned alive as a witch, building the pyramids with our minds and sound, a powerful female priestess, growing from seed to sunflower, embodying jaguars and other animals and more. I was shown the history of Earth back to Neanderthals. I was shown different eras of far more advanced beings on Earth. I was shown future potential events both in my personal life and collective. All of which came to fruition with some soon to come. I also had to face the darkest parts of myself, my deepest soul fears, witness the harvesting of humans, DNA experiments creating creatures with no soul spark, darkness and evil of this world, countless wars and destruction, and some of it may make someone go insane if they are not mentally and emotionally strong and able to witness without taking it on. This is why it's not for everyone. One must be called and ready for it. Spirit will meet you where you are at, but some are not ready to truly look within and see the truth beyond the illusions and programming of this world. This is also why one must get their heart checked and a liver panel to make sure they are healthy enough to handle it. You also need to check for contraindications if you are on medications and may need to ween off prior to sitting. This is not a medicine I would advise most do for their first time. Once you break through you are in it until it's done which typically is 16hrs to 24hrs. Other medicines I work with which are just as powerful and potent but shorter lived are better for beginners and give you the experience of learning to surrender and navigate these realms. The ego and mind tend to get in the way and it requires the ability to connect to the breath and let go and surrender without constricting or going into fear and creating a traumatic experience. Feel free to reach out if you feel called to sit with these sacred medicines. If I can't help you, I may be able to point you in the right direction. Do not waste my time please, only reach out if you are serious and sincerely doing this for personal and spiritual growth. I'm not here to help people do these medicines recreationally. Respect and reverence is required, spirit knows all and when you show up with honesty, integrity, and with sincerity, spirit will meet you.
1:31

Sensitive content

The truth is getting out! Sacred medicines will be a topic of discussion for the collective healing and transformation of consciousness. True connection to the divine beyond all religions, dogma, and fear based programs. I have done extensive work with all of these sacred medicines. Ibogaine is not for the faint of heart. It's intense, confronting, profound, and liberating. My first ceremony was 24hrs and my second was 37hrs long. I share some of my experiences on my YouTube videos. I had my life review, I went through my families lives as well seeing all the trauma they endured and how it shaped who they were. I saw the karmic cycles playing out between my soul and others in my life even being shown past lives where they had abused others which is why they endured it in this one. I traveled the cosmos, I interacted and was physically healed by ETs. Archangel Michael was standing by my bedside the whole time. I was remote viewing watching myself and the nurses from above while also in other visions. I was shown how many lives I had on Earth and beyond that, where my mind couldn't comprehend. I was in the living movie of many lifetimes and my deaths. Killed in the Coliseum, a Knight killed off my horse, crushed by a stone catapult, burned alive as a witch, building the pyramids with our minds and sound, a powerful female priestess, growing from seed to sunflower, embodying jaguars and other animals and more. I was shown the history of Earth back to Neanderthals. I was shown different eras of far more advanced beings on Earth. I was shown future potential events both in my personal life and collective. All of which came to fruition with some soon to come. I also had to face the darkest parts of myself, my deepest soul fears, witness the harvesting of humans, DNA experiments creating creatures with no soul spark, darkness and evil of this world, countless wars and destruction, and some of it may make someone go insane if they are not mentally and emotionally strong and able to witness without taking it on. This is why it's not for everyone. One must be called and ready for it. Spirit will meet you where you are at, but some are not ready to truly look within and see the truth beyond the illusions and programming of this world. This is also why one must get their heart checked and a liver panel to make sure they are healthy enough to handle it. You also need to check for contraindications if you are on medications and may need to ween off prior to sitting. This is not a medicine I would advise most do for their first time. Once you break through you are in it until it's done which typically is 16hrs to 24hrs. Other medicines I work with which are just as powerful and potent but shorter lived are better for beginners and give you the experience of learning to surrender and navigate these realms. The ego and mind tend to get in the way and it requires the ability to connect to the breath and let go and surrender without constricting or going into fear and creating a traumatic experience. Feel free to reach out if you feel called to sit with these sacred medicines. If I can't help you, I may be able to point you in the right direction. Do not waste my time please, only reach out if you are serious and sincerely doing this for personal and spiritual growth. I'm not here to help people do these medicines recreationally. Respect and reverence is required, spirit knows all and when you show up with honesty, integrity, and with sincerity, spirit will meet you.

AwakenedVeteran22

19,681 просмотров • 1 год назад