Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Unity published Holo-Gen! It's a method that can generate physically-based rendering (PBR) material properties for 3D objects.

Dreaming Tulpa 🥓👑

54,921 subscribers

47,729 views • 2 years ago •via X (Twitter)

Science & Technology Gaming Education

Anya Rossi• Live Now

Private livecam show

10 Comments

Dreaming Tulpa 🥓👑2 years ago

If you like Tweets like this, you might enjoy my weekly newsletter, #aiartweekly. A free, once–weekly e-mail round-up of the latest AI art news, interviews with artists and useful tools & resources. Join 3300+ subscribers here:

Nick.H2 years ago

Interesting... will try

Dustin Hollywood2 years ago

This is amazing

Pixo Motion Ai2 years ago

Interesting stuff! Not an hour ago I discovered one "Meshy ai" with similar capabilities. Worth checking out.

jakedowns2 years ago

@andrewpprice 🤩 woah check this out!!! generative pbr materials

AmliArt2 years ago

What does that mean in normal person speak?

lynk2 years ago

@instiinct_defi 💨💨💨💨💨

high_byte2 years ago

it doesn't work great for humans :(

Dreaming Tulpa 🥓👑2 years ago

Take it as a glimpse into the future

Andre🍼2 years ago

Unity? You mean game engine?

Related Videos

With Gen-4 References you can use 3D models to quickly position objects exactly where you want them. With just three images: a location, a 3D asset and a style reference, you can generate highly refined outputs without any rigging, texturing or rendering.

With Gen-4 References you can use 3D models to quickly position objects exactly where you want them. With just three images: a location, a 3D asset and a style reference, you can generate highly refined outputs without any rigging, texturing or rendering.

Runway

77,225 views • 1 year ago

Adobe is entering the image-to-3D game! Their new method, LRM, can create high-fidelity 3D meshes from a single image in just 5 seconds 🔥 It's trained on 1 million objects and is able to generate objects from real-world images and generative AI models.

Adobe is entering the image-to-3D game! Their new method, LRM, can create high-fidelity 3D meshes from a single image in just 5 seconds 🔥 It's trained on 1 million objects and is able to generate objects from real-world images and generative AI models.

Dreaming Tulpa 🥓👑

270,942 views • 2 years ago

You can now generate PBR materials within Omma using the /material command. - Diffuse - Normal - Height (for displacement) - Roughness

You can now generate PBR materials within Omma using the /material command. - Diffuse - Normal - Height (for displacement) - Roughness

Omma AI

34,886 views • 3 months ago

Elon Musk Grok xAI This is incredible! Grok can understand the internal relationships between objects, and when combined with Rodin Gen-2, it can directly generate .urdf ready for production. This will revolutionize 3D Gen, video games, embodied AI, robotics, and even 3D printing. #Grok4

Elon Musk Grok xAI This is incredible! Grok can understand the internal relationships between objects, and when combined with Rodin Gen-2, it can directly generate .urdf ready for production. This will revolutionize 3D Gen, video games, embodied AI, robotics, and even 3D printing. #Grok4

Hyper3D by Deemos

391,186 views • 1 year ago

Introducing “VOODOO 3D: VOlumetric pOrtrait Disentanglement fOr One-shot 3D head reenactment”. We present a real-time 3D aware one-shot head reenactment method that can generate consistent views from any angle MBZUAI ETH Zürich VinAI Pinscreen URL

Introducing “VOODOO 3D: VOlumetric pOrtrait Disentanglement fOr One-shot 3D head reenactment”. We present a real-time 3D aware one-shot head reenactment method that can generate consistent views from any angle MBZUAI ETH Zürich VinAI Pinscreen URL

Hao Li

16,037 views • 2 years ago

Thank you, Ready At Dawn, for providing all game artists the blueprint for 'Physically Based Rendering' graphics a decade ago.

Thank you, Ready At Dawn, for providing all game artists the blueprint for 'Physically Based Rendering' graphics a decade ago.

Del

138,917 views • 1 year ago

📢 IntrinsiX: High-Quality PBR Generation using Image Priors 📢 From text input, we generate renderable PBR maps! Next to editable image generation, our predictions can be distilled into room-scale scenes using SDS for large-scale PBR texture generation. We first train separate LoRA modules for the intrinsic properties of albedo, rough/metal, normal. Then, we introduce cross-intrinsic attention using a rerendering loss with importance-weighted light sampling to enable coherent PBR generation. Our method outperforms text -> image -> PBR methods both in generalization and quality, since directly generating PBR maps does not suffer from the inherent ambiguity of intrinsic image decomposition. In addition, our design choice facilitates SDS-based PBR texture distillation. 🌍 🎥 Great work by Peter Kocsis, Lukas Höllein

📢 IntrinsiX: High-Quality PBR Generation using Image Priors 📢 From text input, we generate renderable PBR maps! Next to editable image generation, our predictions can be distilled into room-scale scenes using SDS for large-scale PBR texture generation. We first train separate LoRA modules for the intrinsic properties of albedo, rough/metal, normal. Then, we introduce cross-intrinsic attention using a rerendering loss with importance-weighted light sampling to enable coherent PBR generation. Our method outperforms text -> image -> PBR methods both in generalization and quality, since directly generating PBR maps does not suffer from the inherent ambiguity of intrinsic image decomposition. In addition, our design choice facilitates SDS-based PBR texture distillation. 🌍 🎥 Great work by Peter Kocsis, Lukas Höllein

Matthias Niessner

21,891 views • 1 year ago

GPT-4o Image Generation to Part-based 3D Characters with PBR, in under 10 minutes ⚡️ Workflow: 🎨 Prompt GPT-4o to get an image (e.g., "3D asset of a styled character with all parts laid on a sheet for image to 3D") 🧩 Use CSM AI's Part-based tool to generate parts and assemble in Blender.

GPT-4o Image Generation to Part-based 3D Characters with PBR, in under 10 minutes ⚡️ Workflow: 🎨 Prompt GPT-4o to get an image (e.g., "3D asset of a styled character with all parts laid on a sheet for image to 3D") 🧩 Use CSM AI's Part-based tool to generate parts and assemble in Blender.

Common Sense Machines

441,761 views • 1 year ago

📣 New research from GenAI at Meta, introducing Meta 3D Gen: A new system for end-to-end generation of 3D assets from text in <1min. Meta 3D Gen is a new combined AI system that can generate high-quality 3D assets, with both high-resolution textures and material maps end-to-end, producing results that are superior to existing solutions — at 3-10x the speed of existing work in this space. Details in the technical report ➡️

📣 New research from GenAI at Meta, introducing Meta 3D Gen: A new system for end-to-end generation of 3D assets from text in <1min. Meta 3D Gen is a new combined AI system that can generate high-quality 3D assets, with both high-resolution textures and material maps end-to-end, producing results that are superior to existing solutions — at 3-10x the speed of existing work in this space. Details in the technical report ➡️

AI at Meta

408,783 views • 2 years ago

It's happening... Google DeepMind is about to drop Genie 3 This AI can generate interactive 3D worlds with just text... And you can interact with objects in real time 🤯

It's happening... Google DeepMind is about to drop Genie 3 This AI can generate interactive 3D worlds with just text... And you can interact with objects in real time 🤯

Min Choi

727,514 views • 5 months ago

MetaHumans are cool, but they might be soon obsolete! UltrAvatar can generate realistic and animatable 3D avatars with PBR textures from only a text prompt or a single image.

MetaHumans are cool, but they might be soon obsolete! UltrAvatar can generate realistic and animatable 3D avatars with PBR textures from only a text prompt or a single image.

Dreaming Tulpa 🥓👑

28,152 views • 2 years ago

Made an atlas-based PBR landscape Uber material. UV breakup eliminates tiling repetition. Atlases can be as big as you like for endless variation. Paint splatmaps to reveal PBR textures. Massive variation with just 3 textures. #b3d #blender #blender3d #cgi

Made an atlas-based PBR landscape Uber material. UV breakup eliminates tiling repetition. Atlases can be as big as you like for endless variation. Paint splatmaps to reveal PBR textures. Massive variation with just 3 textures. #b3d #blender #blender3d #cgi

OfNodesAndNoodles

36,106 views • 3 months ago

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!

Santiago

65,446 views • 3 months ago

🚀BREAKING: Rodin Gen-1.5 is HERE! 🚀 With a brand new 3D representation, Rodin Gen-1.5 achieves: - Clean Topology - AI Quad Mesh - Pro Mode Triangles - Stunning PBR Textures One small step for 3D industry, one giant leap for us! #3DModeling #AI #3D #GenerativeAI #Rodin

Hyper3D🔜SIGGRAPH26

253,028 views • 1 year ago

📢 Intrinsic Image Fusion for Multi-View 3D Material Reconstruction 📢 We combine generative material priors with inverse path tracing: 1) define a parametric texture space 2) fuse monocular predictions across views into consistent textures 3) optimize low-dimensional parameters for physically-grounded reconstructions. The results are relightable PBR textures for 3D scenes: check out the result on a real-world 3D scan from the ScanNet++ dataset! 🌍 🎥 Great work by Peter Kocsis Lukas Höllein!

📢 Intrinsic Image Fusion for Multi-View 3D Material Reconstruction 📢 We combine generative material priors with inverse path tracing: 1) define a parametric texture space 2) fuse monocular predictions across views into consistent textures 3) optimize low-dimensional parameters for physically-grounded reconstructions. The results are relightable PBR textures for 3D scenes: check out the result on a real-world 3D scan from the ScanNet++ dataset! 🌍 🎥 Great work by Peter Kocsis Lukas Höllein!

Matthias Niessner

23,087 views • 7 months ago

adobe just released a method that can generate transparent videos from text and images 👀

adobe just released a method that can generate transparent videos from text and images 👀

Dreaming Tulpa 🥓👑

77,051 views • 1 year ago

Can we learn a 3D world model that predicts object dynamics directly from videos? Introducing Particle-Grid Neural Dynamics: a learning-based simulator for deformable objects that trains from real-world videos. Website: ArXiv: Code: Demo: To appear at #RSS2025

Can we learn a 3D world model that predicts object dynamics directly from videos? Introducing Particle-Grid Neural Dynamics: a learning-based simulator for deformable objects that trains from real-world videos. Website: ArXiv: Code: Demo: To appear at #RSS2025

Kaifeng Zhang

45,971 views • 1 year ago

THERES AN AI THAT CAN MAKE LAYERS FROM A VIDEO?? LIKE SEPARATE THEM BASED ON OBJECTS FOR COMPOSITING??? WHAT???????

THERES AN AI THAT CAN MAKE LAYERS FROM A VIDEO?? LIKE SEPARATE THEM BASED ON OBJECTS FOR COMPOSITING??? WHAT???????

Jakeneutron

125,266 views • 1 year ago