Video wird geladen...
Video konnte nicht geladen werden
Lighting is key to creating believable VFX. Simulon generates accurate 360 hdr lighting in seconds. But there’s something much stranger going on in this video. The chrome ball is being moved through the world as if it is actually there. How do you think this is possible? 👀 We’ve... show more
119,375 Aufrufe • vor 11 Monaten •via X (Twitter)
36 Kommentare

@Simulon Projecting color onto a rough depth estimation.

The spatially-variant reflections and bounce are achieved through a combination of textured mesh reconstruction with layered video projection over this mesh. The question however is how do you think the sphere is being moved through the scene? Hint: it has something to do with your favourite 3D software.

@Simulon Not sure if the question is a rhetorical one, but - collision detection based on the ARKit-powered world mesh reconstruction?:) Looks great!

@michae1becker @Simulon Thanks! The how is much more interesting and powerful than that.

@Simulon Obviously it's a baby UFO, finally caught on camera!

@Simulon Absurd 👏🔮

@Simulon Ian let’s do some reality bending with Simulon and @theworldlabs!

@Simulon @theworldlabs Just need that splat upload option 🙏😉

@Simulon Damn bro that's confusing and damn good but is it realtime?

@Simulon The render isn’t real-time but a part of the workflow is.

@Simulon Pretty excited to see how it's done

@Simulon Super curious to know more about this! In awe but a bit confused and yet excited to see innovations. Bring it on.

@Simulon Glad you’re still around on this nascent age of Ai!

@Simulon We need revolutionary tools that empower human intention. AI will play a big role in the future of creative software, but it must serve as an amplifier of authentic vision. Implicit prompt based creation works for fun social media videos but explicit control has real world value.

@Scobleizer @Simulon Wow. This blows my mind

@Simulon This looks phenomenal

@Simulon This is mind blowing! 🤯

@Simulon This part right here… how?! 😳 Is the Mac Studio a 3d model as well?

@Simulon The real world is reconstructed as a 3D mesh.

@Simulon And the reflective caustics on the surface of the Mac Studio? Does the world mesh have PBR passes like a shadow or reflection catcher? That reflection on the the Mac Studio looks so good 👏✨

@Simulon The whole things are 3D. Mystery solved.

@Simulon Keeeewwwwl

@Simulon sick

@Simulon this is so good

@Simulon @twominutepapers

@Simulon I’m confused 🤯

@Simulon Insane

@Simulon

@Simulon

@Simulon there might be some rbd for fun haha 🔥

@Simulon lidar?

@Simulon Localized IBLs have entered a chat. Something that have been implemented for more than 10 years.

@Simulon So this is AR? It's picking up reflections from what's out of the view? Front cam?

@Simulon A part of the workflow is in real-time AR but the rendering quality is achieved through path tracing in the cloud with our connected workflow.

@Simulon Guessing you pre-film the environment and then the video into a 3D model using gaussian splats. Is not pretty in the raw format but enough to get the 3D spatial relations between scene objects + virtual objects

@Simulon Its a LIDAR scan with texture map, your video its converted into a 3D scene with camera allready animated?
