Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Excited to share a new Simulon workflow video, showcasing real-time environment meshing, multi-surface object placement and persistent AR - allowing you to save & revisit 3D scenes in the real world 🌐✨ Beginning with a cloud-rendered sequence, we then break down the process.

Divesh Naidoo

8,004 subscribers

57,878 views • 2 years ago •via X (Twitter)

Science & Technology Education

Anya Rossi• Live Now

Private livecam show

11 Comments

Divesh Naidoo2 years ago

This video skips the HDRI lighting process as we showcased this functionality last week. See this post if you're curious about how we achieve realistic real world lighting 👇

Tom Blake2 years ago

@Simulon That meshing is so smooth! Being able to come back to it like that is next-level!

BiGSHOT2 years ago

@Simulon Oh man, this is so good

Retropunk2 years ago

@Scobleizer @Simulon WOW

Yellow Citrine2 years ago

@Simulon When will you release simulon? I can’t wait for it to become available 😄

Divesh Naidoo2 years ago

@Simulon Thank you for your excitement. We will release more details about the roadmap/timelines this week!

Milan David Cucuk2 years ago

@Simulon I cannot wait to try this whenever it's available 😍🤤

Wyls☼n2 years ago

@Scobleizer @Simulon @Odd_Jayy

Money Plane2 years ago

@Scobleizer @Simulon That mesh is crazy. Insane work

William Lamkin2 years ago

@Simulon Sweet! Any eta on beta access rollout?

Divesh Naidoo2 years ago

@Simulon Hey William. I will share some details on the roadmap/timelines this week!

Related Videos

To showcase Simulon's capability with high-fidelity assets and to highlight the difference between what you see in real-time AR versus the precision of offline cloud rendering, we've made a video using a detailed human scan by 3D Scanstore. Our workflow was designed to closely align the visuals in real-time AR with our offline cloud renders. The video below demonstrates this, transitioning between the AR preview and the final cloud render. This preview lets creators foresee the final VFX shot, reducing guesswork in lighting and composition.

To showcase Simulon's capability with high-fidelity assets and to highlight the difference between what you see in real-time AR versus the precision of offline cloud rendering, we've made a video using a detailed human scan by 3D Scanstore. Our workflow was designed to closely align the visuals in real-time AR with our offline cloud renders. The video below demonstrates this, transitioning between the AR preview and the final cloud render. This preview lets creators foresee the final VFX shot, reducing guesswork in lighting and composition.

Divesh Naidoo

265,562 views • 2 years ago

Let me share a long-awaited behind-the-scenes video of how Simulon works. It all starts with setting up a scene. You set the location, lighting conditions and capture the light map with a few turns. After that, you can capture the environment mesh using the Lidar scanner. That's the moment the fun begins. You can bring in your #3D models with animations and capture a video of up to 50" using the #AR preview on screen. After that is done, you send the footage to the cloud and in a couple of minutes you get back an incredible #CGI shot. And this is just the beginning. Follow Gabriele Romagnoli to see how Simulon integrates with #Blender and in a full #VFX workflow. A special thanks to Divesh Naidoo for sharing early access and for building something 🤯

Let me share a long-awaited behind-the-scenes video of how Simulon works. It all starts with setting up a scene. You set the location, lighting conditions and capture the light map with a few turns. After that, you can capture the environment mesh using the Lidar scanner. That's the moment the fun begins. You can bring in your #3D models with animations and capture a video of up to 50" using the #AR preview on screen. After that is done, you send the footage to the cloud and in a couple of minutes you get back an incredible #CGI shot. And this is just the beginning. Follow Gabriele Romagnoli to see how Simulon integrates with #Blender and in a full #VFX workflow. A special thanks to Divesh Naidoo for sharing early access and for building something 🤯

Gabriele Romagnoli

142,530 views • 2 years ago

How lighting works in Simulon Using a professional on-set VFX kit, we showcase our unique Image Based Lighting system. Simulon employs ML to create a 360° HDRI from just one LDR shot, aligning it perfectly with scene data. Our virtual camera replicates the physical camera’s response to light, syncing seamlessly with the HDR info. Notice how the dynamic exposure changes on the virtual VFX kit closely match the real one. Bonus: At the end of the video I place a 3D Dragon in the scene and make a capture, this capture is then rendered in the cloud to produce a photorealistic VFX video 🐉 More on the capture and render process in upcoming videos!

How lighting works in Simulon Using a professional on-set VFX kit, we showcase our unique Image Based Lighting system. Simulon employs ML to create a 360° HDRI from just one LDR shot, aligning it perfectly with scene data. Our virtual camera replicates the physical camera’s response to light, syncing seamlessly with the HDR info. Notice how the dynamic exposure changes on the virtual VFX kit closely match the real one. Bonus: At the end of the video I place a 3D Dragon in the scene and make a capture, this capture is then rendered in the cloud to produce a photorealistic VFX video 🐉 More on the capture and render process in upcoming videos!

Divesh Naidoo

275,088 views • 2 years ago

"near real-time method for 6-DoF tracking of an unknown object from a monocular RGBD video sequence [...] a Neural Object Field that is learned concurrently with a pose graph optimization process in order to robustly accumulate information into a consistent 3D representation"

"near real-time method for 6-DoF tracking of an unknown object from a monocular RGBD video sequence [...] a Neural Object Field that is learned concurrently with a pose graph optimization process in order to robustly accumulate information into a consistent 3D representation"

Fabien Benetou

222,914 views • 3 years ago

🤩 We're so excited to share this with you: We and our friends at Cloudflare are bringing real-time voice AI to developers around the globe. 🌐 To learn how Deepgram and Cloudflare are solving real-world problems together, check out this blog:

🤩 We're so excited to share this with you: We and our friends at Cloudflare are bringing real-time voice AI to developers around the globe. 🌐 To learn how Deepgram and Cloudflare are solving real-world problems together, check out this blog:

Deepgram

19,811 views • 6 months ago

Capture your space. Create worlds. Use Marble 1.1 to reconstruct real-world locations from a few images, then restyle them however you want. Go from a real place to a custom persistent 3D world in minutes.

Capture your space. Create worlds. Use Marble 1.1 to reconstruct real-world locations from a few images, then restyle them however you want. Go from a real place to a custom persistent 3D world in minutes.

World Labs

64,527 views • 2 months ago

We figured you needed to see LiquiGen today. The simulation, rendering, and meshing are all real-time.

We figured you needed to see LiquiGen today. The simulation, rendering, and meshing are all real-time.

JangaFX Software

109,941 views • 3 years ago

✨ Added background sounds 🐥🍃🌴 to the World Labs viewer in Interior AI for a more immersive environment This is my new Bali interior style that I then designed living rooms and bathroom with That I then made into a 3d world with [ 🌐 Make 3d world ] that I can walk through with WASD + audio

✨ Added background sounds 🐥🍃🌴 to the World Labs viewer in Interior AI for a more immersive environment This is my new Bali interior style that I then designed living rooms and bathroom with That I then made into a 3d world with [ 🌐 Make 3d world ] that I can walk through with WASD + audio

@levelsio

60,712 views • 8 months ago

Nano Banana 2, new state of the art in image generation and editing combined with Gemini’s real-world knowledge! You can simulate 3D CAD models purely through images. From sketch to real object!

Nano Banana 2, new state of the art in image generation and editing combined with Gemini’s real-world knowledge! You can simulate 3D CAD models purely through images. From sketch to real object!

koray kavukcuoglu

85,564 views • 4 months ago

Introducing RTFM (Real-Time Frame Model): a highly efficient World Model that generates video frames in real time as you interact with it, powered by a single H100 GPU. RTFM renders persistent and 3D consistent worlds, both real and imaginary. Try our demo of RTFM today!

Introducing RTFM (Real-Time Frame Model): a highly efficient World Model that generates video frames in real time as you interact with it, powered by a single H100 GPU. RTFM renders persistent and 3D consistent worlds, both real and imaginary. Try our demo of RTFM today!

World Labs

340,567 views • 8 months ago

We want to share with you some more scenes showcasing the improvements we're implementing in the scenery, environment, mechanics, and much more! You won't want to miss what's coming next... 👀 #pixelart #indiedev #gamedev

We want to share with you some more scenes showcasing the improvements we're implementing in the scenery, environment, mechanics, and much more! You won't want to miss what's coming next... 👀 #pixelart #indiedev #gamedev

Scavland

17,907 views • 1 month ago

HOARFROST | Official Title Sequence Incredibly excited to share the title sequence of a brand new world that I have been working on. This story is inspired by real events and will take us to the South Pole. Generated with Runway Gen-3 Alpha. More details to come.

Nicolas Neubert

68,127 views • 1 year ago

My advice is to spend more time offline. Meet new people, dance, laugh, drink, share stories with a stranger, TRAVEL! I promise you, life can be amazing in the real world when you put your phone down ✨

My advice is to spend more time offline. Meet new people, dance, laugh, drink, share stories with a stranger, TRAVEL! I promise you, life can be amazing in the real world when you put your phone down ✨

Calista Diamandis 👑 TORONTO

85,359 views • 1 year ago

The Potion Shop is a game-ready 3D environment optimized for real-time and rendered in UE5.3 🏪 3D Environment Artist Felix Riehle created everything from scratch apart from the foliage and the lady sitting in the scene, who was created by Character Artist Ilias Morscher.

The Potion Shop is a game-ready 3D environment optimized for real-time and rendered in UE5.3 🏪 3D Environment Artist Felix Riehle created everything from scratch apart from the foliage and the lady sitting in the scene, who was created by Character Artist Ilias Morscher.

Unreal Engine

22,139 views • 2 years ago

A few months back, we teased clips from our upcoming VFX app, Simulon. We've since been hard at work making Simulon the most powerful, robust, and intuitive VFX workflow available. This weekend, we'll begin granting access to select creators. Simulon is now able to produce videos that are indistinguishable from reality - can you spot which objects on the table are real and which were added with Simulon? Watch to the end to see if you're right. A thread 🧵

A few months back, we teased clips from our upcoming VFX app, Simulon. We've since been hard at work making Simulon the most powerful, robust, and intuitive VFX workflow available. This weekend, we'll begin granting access to select creators. Simulon is now able to produce videos that are indistinguishable from reality - can you spot which objects on the table are real and which were added with Simulon? Watch to the end to see if you're right. A thread 🧵

Divesh Naidoo

119,267 views • 2 years ago

🌐Using Lightship's Meshing capabilities, we can transform the physical world around us by applying digital textures to real-world objects and surfaces. 💻Lightship 3.0's Meshing technology is faster, more accurate, and works further, than ever before.

🌐Using Lightship's Meshing capabilities, we can transform the physical world around us by applying digital textures to real-world objects and surfaces. 💻Lightship 3.0's Meshing technology is faster, more accurate, and works further, than ever before.

Niantic

21,672 views • 2 years ago

Ever wish a robot could just move to any goal in any environment—avoiding all collisions and reacting in real time? 🚀Excited to share our #CoRL2025 paper, Deep Reactive Policy (DRP), a learning-based motion planner that navigates complex scenes with moving obstacles—directly from point cloud input. w/ Jiahui(Jim) Yang (1/N)

Ever wish a robot could just move to any goal in any environment—avoiding all collisions and reacting in real time? 🚀Excited to share our #CoRL2025 paper, Deep Reactive Policy (DRP), a learning-based motion planner that navigates complex scenes with moving obstacles—directly from point cloud input. w/ Jiahui(Jim) Yang (1/N)

Jason Liu

72,269 views • 10 months ago

We’re excited to share LuxRemix: interactive light editing for indoor scenes! 🏠💡 Capture a room once, then turn individual lights on/off, change colors, and adjust intensity – all in real-time 3D from any viewpoint. 💡 📄

We’re excited to share LuxRemix: interactive light editing for indoor scenes! 🏠💡 Capture a room once, then turn individual lights on/off, change colors, and adjust intensity – all in real-time 3D from any viewpoint. 💡 📄

Christian Richardt

10,507 views • 5 months ago

Large-scale 3D Scene Generation (all scenes are real-time rendered)!! Physically-grounded generative data without hallucinations is the missing link for robot learning and testing at scale. We introduce a method that directly generates large-scale 3D driving scenes with accurate geometry, allowing for causal view synthesis and generation with object permanence and explicit 3D geometry. This also allows for extreme trajectory extrapolation without failure! We also show that we can build fully data-driven simulators for end-to-end learning with this approach. Project: with the amazing team of Julian Ost, Amogh Joshi , Andrea Ramazzina, Maximilian Bömer, Mario Bijelic.

Large-scale 3D Scene Generation (all scenes are real-time rendered)!! Physically-grounded generative data without hallucinations is the missing link for robot learning and testing at scale. We introduce a method that directly generates large-scale 3D driving scenes with accurate geometry, allowing for causal view synthesis and generation with object permanence and explicit 3D geometry. This also allows for extreme trajectory extrapolation without failure! We also show that we can build fully data-driven simulators for end-to-end learning with this approach. Project: with the amazing team of Julian Ost, Amogh Joshi , Andrea Ramazzina, Maximilian Bömer, Mario Bijelic.

Felix Heide

27,763 views • 10 months ago

Life is a game…pick your world skin 🎮✨ We’re only scratching the surface of video-to-video. Imagine seeing this in real-time through smart glasses!

Life is a game…pick your world skin 🎮✨ We’re only scratching the surface of video-to-video. Imagine seeing this in real-time through smart glasses!

Justine Moore

55,694 views • 1 year ago