正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

📢 IntrinsiX: High-Quality PBR Generation using Image Priors 📢 From text input, we generate renderable PBR maps! Next to editable image generation, our predictions can be distilled into room-scale scenes using SDS for large-scale PBR texture generation. We first train separate LoRA modules for the intrinsic properties of albedo,... rough/metal, normal. Then, we introduce cross-intrinsic attention using a rerendering loss with importance-weighted light sampling to enable coherent PBR generation. Our method outperforms text -> image -> PBR methods both in generalization and quality, since directly generating PBR maps does not suffer from the inherent ambiguity of intrinsic image decomposition. In addition, our design choice facilitates SDS-based PBR texture distillation. 🌍 🎥 Great work by Peter Kocsis, Lukas Hölleinshow more

Matthias Niessner

47,476 subscribers

21,874 次观看 • 1 年前 •via X (Twitter)

教育科学技术艺术

Anya Rossi• Live Now

Private livecam show

2 条评论

Redmond Hosting 的头像

Redmond Hosting1 年前

Very cool, but not very useful in any production if you have to generate all output from a text prompt. Being able to drop in an image and have these layers extracted would be amazing.

Matt Figdore 的头像

Matt Figdore2 年前

This is the biggest productivity cheat code right now. Kiss reading documents goodbye. You can get an instant summary of any document with this tool.

相关视频

3DTopia-XL High-Quality 3D PBR Asset Generation via Primitive Diffusion demo: model: 3DTopia-XL scales high-quality 3D asset generation using Diffusion Transformer (DiT) built upon an expressive and efficient 3D representation, PrimX. The denoising process takes 5 seconds to generate a 3D PBR asset from text/image input which is ready for the graphics pipeline to use.

3DTopia-XL High-Quality 3D PBR Asset Generation via Primitive Diffusion demo: model: 3DTopia-XL scales high-quality 3D asset generation using Diffusion Transformer (DiT) built upon an expressive and efficient 3D representation, PrimX. The denoising process takes 5 seconds to generate a 3D PBR asset from text/image input which is ready for the graphics pipeline to use.

AK

87,086 次观看 • 1 年前

📢 Intrinsic Image Fusion for Multi-View 3D Material Reconstruction 📢 We combine generative material priors with inverse path tracing: 1) define a parametric texture space 2) fuse monocular predictions across views into consistent textures 3) optimize low-dimensional parameters for physically-grounded reconstructions. The results are relightable PBR textures for 3D scenes: check out the result on a real-world 3D scan from the ScanNet++ dataset! 🌍 🎥 Great work by Peter Kocsis Lukas Höllein!

📢 Intrinsic Image Fusion for Multi-View 3D Material Reconstruction 📢 We combine generative material priors with inverse path tracing: 1) define a parametric texture space 2) fuse monocular predictions across views into consistent textures 3) optimize low-dimensional parameters for physically-grounded reconstructions. The results are relightable PBR textures for 3D scenes: check out the result on a real-world 3D scan from the ScanNet++ dataset! 🌍 🎥 Great work by Peter Kocsis Lukas Höllein!

Matthias Niessner

19,833 次观看 • 5 个月前

📢 Automatic PBR : Image-to-material (I2M) 👉Textured Mesh in > Full PBR Mesh out Our latest foundation model for enriching existing 3D assets with the full array of PBR materials, whilst maintaining the same mesh geometry and UV unwrap. #I2M #PBR #CV #Marso #texturing #gamedev #computervision M-XR

📢 Automatic PBR : Image-to-material (I2M) 👉Textured Mesh in > Full PBR Mesh out Our latest foundation model for enriching existing 3D assets with the full array of PBR materials, whilst maintaining the same mesh geometry and UV unwrap. #I2M #PBR #CV #Marso #texturing #gamedev #computervision M-XR

Elliott Round

13,353 次观看 • 1 个月前

I'm thrilled to officially annouce🤩 📢 Automatic PBR : Image-to-material (I2M) 👉Textured Mesh in > Full PBR Mesh out Our latest foundation model for enriching existing 3D assets with the full array of PBR materials, whilst maintaining the same mesh geometry and UV unwrap. 🧵A thread : 1 of 7 👇 #I2M #PBR #CV #Marso #texturing #gamedev #computervision M-XR

I'm thrilled to officially annouce🤩 📢 Automatic PBR : Image-to-material (I2M) 👉Textured Mesh in > Full PBR Mesh out Our latest foundation model for enriching existing 3D assets with the full array of PBR materials, whilst maintaining the same mesh geometry and UV unwrap. 🧵A thread : 1 of 7 👇 #I2M #PBR #CV #Marso #texturing #gamedev #computervision M-XR

Elliott Round

36,221 次观看 • 1 个月前

🥳 What's Improved in Meshy 5 from Preview? - NEW high-quality PBR textures - More reliable results - Kontext for multi-view & A/T pose generation - Smarter prompt helper & real-time texture edit - Stronger image alignment New Model, Half the Price – Start Pro for 50% Off Today!

🥳 What's Improved in Meshy 5 from Preview? - NEW high-quality PBR textures - More reliable results - Kontext for multi-view & A/T pose generation - Smarter prompt helper & real-time texture edit - Stronger image alignment New Model, Half the Price – Start Pro for 50% Off Today!

MeshyAI

16,720 次观看 • 9 个月前

Using Uni-1 by Luma to create consistent and correct PBR/Normal/Displacement map, combining with triplanar/image projections to boost asset creation speed while maintaining quality. Made by: Tony Hou

Using Uni-1 by Luma to create consistent and correct PBR/Normal/Displacement map, combining with triplanar/image projections to boost asset creation speed while maintaining quality. Made by: Tony Hou

Luma | Dream Lab

26,257 次观看 • 2 个月前

An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusion discuss: We introduce a new approach for generating realistic 3D models with UV maps through a representation termed "Object Images." This approach encapsulates surface geometry, appearance, and patch structures within a 64x64 pixel image, effectively converting complex 3D shapes into a more manageable 2D format. By doing so, we address the challenges of both geometric and semantic irregularity inherent in polygonal meshes. This method allows us to use image generation models, such as Diffusion Transformers, directly for 3D shape generation. Evaluated on the ABO dataset, our generated shapes with patch structures achieve point cloud FID comparable to recent 3D generative models, while naturally supporting PBR material generation.

An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusion discuss: We introduce a new approach for generating realistic 3D models with UV maps through a representation termed "Object Images." This approach encapsulates surface geometry, appearance, and patch structures within a 64x64 pixel image, effectively converting complex 3D shapes into a more manageable 2D format. By doing so, we address the challenges of both geometric and semantic irregularity inherent in polygonal meshes. This method allows us to use image generation models, such as Diffusion Transformers, directly for 3D shape generation. Evaluated on the ABO dataset, our generated shapes with patch structures achieve point cloud FID comparable to recent 3D generative models, while naturally supporting PBR material generation.

AK

66,409 次观看 • 1 年前

Oh wow! "[SIGGRAPH '24] DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models" Paper: Project: Code (MIT) :

Oh wow! "[SIGGRAPH '24] DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models" Paper: Project: Code (MIT) :

MrNeRF

59,480 次观看 • 2 年前

GPT-4o Image Generation to Part-based 3D Characters with PBR, in under 10 minutes ⚡️ Workflow: 🎨 Prompt GPT-4o to get an image (e.g., "3D asset of a styled character with all parts laid on a sheet for image to 3D") 🧩 Use CSM AI's Part-based tool to generate parts and assemble in Blender.

GPT-4o Image Generation to Part-based 3D Characters with PBR, in under 10 minutes ⚡️ Workflow: 🎨 Prompt GPT-4o to get an image (e.g., "3D asset of a styled character with all parts laid on a sheet for image to 3D") 🧩 Use CSM AI's Part-based tool to generate parts and assemble in Blender.

Common Sense Machines

441,536 次观看 • 1 年前

Beeble has released #SwitchLight 3.0, the new version of its video-to-PBR AI model It extracts #PBR texture maps from video, making it possible to relight live footage - and is now available for use offline, as well as in Beeble's browser app Beeble

Beeble has released #SwitchLight 3.0, the new version of its video-to-PBR AI model It extracts #PBR texture maps from video, making it possible to relight live footage - and is now available for use offline, as well as in Beeble's browser app Beeble

CG Channel

92,955 次观看 • 7 个月前

“I think Sean Gleason is running a good league.” “We learned from PBR bunkhouse 🤠🐂🌟, a PBR blog.” “The PBR bulls are rockstars of the show.” “The bulls are born & bred to buck, training to be the bulls in the PBR.” “It’s the rules to wear a helmet if born after October 1994. Pat McAfee | #PMSLIVE

“I think Sean Gleason is running a good league.” “We learned from PBR bunkhouse 🤠🐂🌟, a PBR blog.” “The PBR bulls are rockstars of the show.” “The bulls are born & bred to buck, training to be the bulls in the PBR.” “It’s the rules to wear a helmet if born after October 1994. Pat McAfee | #PMSLIVE

PBR bunkhouse 🤠🐂🌟

13,483 次观看 • 2 年前

Learn how to make this low poly sushi scene using Uniform for iPad. The final result can be directly exported to a game engine including UVs, textures, PBR and normal maps.

Learn how to make this low poly sushi scene using Uniform for iPad. The final result can be directly exported to a game engine including UVs, textures, PBR and normal maps.

Sparseal

108,932 次观看 • 2 年前

"codex, pull up the pbr texture swatchbook"

"codex, pull up the pbr texture swatchbook"

Codetaur

22,051 次观看 • 1 个月前

You can now generate PBR materials within Omma using the /material command. - Diffuse - Normal - Height (for displacement) - Roughness

You can now generate PBR materials within Omma using the /material command. - Diffuse - Normal - Height (for displacement) - Roughness

Omma

34,738 次观看 • 1 个月前

TurboEdit Instant text-based image editing discuss: We address the challenges of precise image inversion and disentangled image editing in the context of few-step diffusion models. We introduce an encoder based iterative inversion technique. The inversion network is conditioned on the input image and the reconstructed image from the previous step, allowing for correction of the next reconstruction towards the input image. We demonstrate that disentangled controls can be easily achieved in the few-step diffusion model by conditioning on an (automatically generated) detailed text prompt. To manipulate the inverted image, we freeze the noise maps and modify one attribute in the text prompt (either manually or via instruction based editing driven by an LLM), resulting in the generation of a new image similar to the input image with only one attribute changed. It can further control the editing strength and accept instructive text prompt. Our approach facilitates realistic text-guided image edits in real-time, requiring only 8 number of functional evaluations (NFEs) in inversion (one-time cost) and 4 NFEs per edit. Our method is not only fast, but also significantly outperforms state-of-the-art multi-step diffusion editing techniques.

TurboEdit Instant text-based image editing discuss: We address the challenges of precise image inversion and disentangled image editing in the context of few-step diffusion models. We introduce an encoder based iterative inversion technique. The inversion network is conditioned on the input image and the reconstructed image from the previous step, allowing for correction of the next reconstruction towards the input image. We demonstrate that disentangled controls can be easily achieved in the few-step diffusion model by conditioning on an (automatically generated) detailed text prompt. To manipulate the inverted image, we freeze the noise maps and modify one attribute in the text prompt (either manually or via instruction based editing driven by an LLM), resulting in the generation of a new image similar to the input image with only one attribute changed. It can further control the editing strength and accept instructive text prompt. Our approach facilitates realistic text-guided image edits in real-time, requiring only 8 number of functional evaluations (NFEs) in inversion (one-time cost) and 4 NFEs per edit. Our method is not only fast, but also significantly outperforms state-of-the-art multi-step diffusion editing techniques.

AK

16,062 次观看 • 1 年前

Unity published Holo-Gen! It's a method that can generate physically-based rendering (PBR) material properties for 3D objects.

Unity published Holo-Gen! It's a method that can generate physically-based rendering (PBR) material properties for 3D objects.

Dreaming Tulpa 🥓👑

47,729 次观看 • 2 年前

Another gem-TRELLIS.2: Native 3D generation via structured latents; - full PBR assets up to 1536³; - outperforms TRELLIS & Direct3D-S2.

Another gem-TRELLIS.2: Native 3D generation via structured latents; - full PBR assets up to 1536³; - outperforms TRELLIS & Direct3D-S2.

Wildminder

56,275 次观看 • 5 个月前

We’re taking the ride to The CW Tune in SATURDAYS and SUNDAYS to The CW to watch PBR Teams starting August 9 👀

We’re taking the ride to The CW Tune in SATURDAYS and SUNDAYS to The CW to watch PBR Teams starting August 9 👀

PBR

14,931 次观看 • 10 个月前

People are getting crazy over 4.0’s seamless texture generation! 🫨 It’s impressive, but control is limited, and some outputs aren’t quite seamless or lack adjustable PBR settings. Here’s a better way to AI-generate high-quality materials with full control – THREAD 👇🧵

People are getting crazy over 4.0’s seamless texture generation! 🫨 It’s impressive, but control is limited, and some outputs aren’t quite seamless or lack adjustable PBR settings. Here’s a better way to AI-generate high-quality materials with full control – THREAD 👇🧵

Emm | scenario.com

56,882 次观看 • 1 年前

The winner of Lovable's weekend competition: Kolbo ai - A powerful tool to help make all sorts of social media content with AI Features of the winning app: - Supabase for backend - Project-based organization system - OpenAI for text & image generation - Anthropic for text generation - Google Gemini for text generation - Midjourney for image generation - for image generation - Text-to-speech - Speech-to-text - Stripe for payments - mu for music generation Built by Zohar Vanunu 👇

The winner of Lovable's weekend competition: Kolbo ai - A powerful tool to help make all sorts of social media content with AI Features of the winning app: - Supabase for backend - Project-based organization system - OpenAI for text & image generation - Anthropic for text generation - Google Gemini for text generation - Midjourney for image generation - for image generation - Text-to-speech - Speech-to-text - Stripe for payments - mu for music generation Built by Zohar Vanunu 👇

Lovable

35,841 次观看 • 1 年前