Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

📢 IntrinsiX: High-Quality PBR Generation using Image Priors 📢 From text input, we generate renderable PBR maps! Next to editable image generation, our predictions can be distilled into room-scale scenes using SDS for large-scale PBR texture generation. We first train separate LoRA modules for the intrinsic properties of albedo,...

MattNiessner's profile picture

Matthias Niessner

47,858 subscribers

21,885 Aufrufe • vor 1 Jahr •via X (Twitter)

BildungWissenschaft & TechnologieKunst
LIVE

Anya Rossi• Live Now

Private livecam show

2 Kommentare

Profilbild von Redmond Hosting
Redmond Hostingvor 1 Jahr

Very cool, but not very useful in any production if you have to generate all output from a text prompt. Being able to drop in an image and have these layers extracted would be amazing.

Profilbild von Matt Figdore
Matt Figdorevor 2 Jahren

This is the biggest productivity cheat code right now. Kiss reading documents goodbye. You can get an instant summary of any document with this tool.

Ähnliche Videos

3DTopia-XL High-Quality 3D PBR Asset Generation via Primitive Diffusion demo: model: 3DTopia-XL scales high-quality 3D asset generation using Diffusion Transformer (DiT) built upon an expressive and efficient 3D representation, PrimX. The denoising process takes 5 seconds to generate a 3D PBR asset from text/image input which is ready for the graphics pipeline to use.
0:41

3DTopia-XL High-Quality 3D PBR Asset Generation via Primitive Diffusion demo: model: 3DTopia-XL scales high-quality 3D asset generation using Diffusion Transformer (DiT) built upon an expressive and efficient 3D representation, PrimX. The denoising process takes 5 seconds to generate a 3D PBR asset from text/image input which is ready for the graphics pipeline to use.

AK

87,086 Aufrufe • vor 1 Jahr

📢 Intrinsic Image Fusion for Multi-View 3D Material Reconstruction 📢 We combine generative material priors with inverse path tracing: 1) define a parametric texture space 2) fuse monocular predictions across views into consistent textures 3) optimize low-dimensional parameters for physically-grounded reconstructions. The results are relightable PBR textures for 3D scenes: check out the result on a real-world 3D scan from the ScanNet++ dataset! 🌍 🎥 Great work by Peter Kocsis Lukas Höllein!
0:31

📢 Intrinsic Image Fusion for Multi-View 3D Material Reconstruction 📢 We combine generative material priors with inverse path tracing: 1) define a parametric texture space 2) fuse monocular predictions across views into consistent textures 3) optimize low-dimensional parameters for physically-grounded reconstructions. The results are relightable PBR textures for 3D scenes: check out the result on a real-world 3D scan from the ScanNet++ dataset! 🌍 🎥 Great work by Peter Kocsis Lukas Höllein!

Matthias Niessner

22,897 Aufrufe • vor 6 Monaten

📢 Automatic PBR : Image-to-material (I2M) 👉Textured Mesh in > Full PBR Mesh out Our latest foundation model for enriching existing 3D assets with the full array of PBR materials, whilst maintaining the same mesh geometry and UV unwrap. #I2M #PBR #CV #Marso #texturing #gamedev #computervision M-XR
0:20

📢 Automatic PBR : Image-to-material (I2M) 👉Textured Mesh in > Full PBR Mesh out Our latest foundation model for enriching existing 3D assets with the full array of PBR materials, whilst maintaining the same mesh geometry and UV unwrap. #I2M #PBR #CV #Marso #texturing #gamedev #computervision M-XR

Elliott Round

13,353 Aufrufe • vor 2 Monaten

I'm thrilled to officially annouce🤩 📢 Automatic PBR : Image-to-material (I2M) 👉Textured Mesh in > Full PBR Mesh out Our latest foundation model for enriching existing 3D assets with the full array of PBR materials, whilst maintaining the same mesh geometry and UV unwrap. 🧵A thread : 1 of 7 👇 #I2M #PBR #CV #Marso #texturing #gamedev #computervision M-XR
1:15

I'm thrilled to officially annouce🤩 📢 Automatic PBR : Image-to-material (I2M) 👉Textured Mesh in > Full PBR Mesh out Our latest foundation model for enriching existing 3D assets with the full array of PBR materials, whilst maintaining the same mesh geometry and UV unwrap. 🧵A thread : 1 of 7 👇 #I2M #PBR #CV #Marso #texturing #gamedev #computervision M-XR

Elliott Round

36,221 Aufrufe • vor 1 Monat

🥳 What's Improved in Meshy 5 from Preview? - NEW high-quality PBR textures - More reliable results - Kontext for multi-view & A/T pose generation - Smarter prompt helper & real-time texture edit - Stronger image alignment New Model, Half the Price – Start Pro for 50% Off Today!
0:42

🥳 What's Improved in Meshy 5 from Preview? - NEW high-quality PBR textures - More reliable results - Kontext for multi-view & A/T pose generation - Smarter prompt helper & real-time texture edit - Stronger image alignment New Model, Half the Price – Start Pro for 50% Off Today!

MeshyAI

16,720 Aufrufe • vor 10 Monaten

Using Uni-1 by Luma to create consistent and correct PBR/Normal/Displacement map, combining with triplanar/image projections to boost asset creation speed while maintaining quality. Made by: Tony Hou
0:28

Using Uni-1 by Luma to create consistent and correct PBR/Normal/Displacement map, combining with triplanar/image projections to boost asset creation speed while maintaining quality. Made by: Tony Hou

Luma | Dream Lab

26,257 Aufrufe • vor 3 Monaten

An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusion discuss: We introduce a new approach for generating realistic 3D models with UV maps through a representation termed "Object Images." This approach encapsulates surface geometry, appearance, and patch structures within a 64x64 pixel image, effectively converting complex 3D shapes into a more manageable 2D format. By doing so, we address the challenges of both geometric and semantic irregularity inherent in polygonal meshes. This method allows us to use image generation models, such as Diffusion Transformers, directly for 3D shape generation. Evaluated on the ABO dataset, our generated shapes with patch structures achieve point cloud FID comparable to recent 3D generative models, while naturally supporting PBR material generation.
0:34

An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusion discuss: We introduce a new approach for generating realistic 3D models with UV maps through a representation termed "Object Images." This approach encapsulates surface geometry, appearance, and patch structures within a 64x64 pixel image, effectively converting complex 3D shapes into a more manageable 2D format. By doing so, we address the challenges of both geometric and semantic irregularity inherent in polygonal meshes. This method allows us to use image generation models, such as Diffusion Transformers, directly for 3D shape generation. Evaluated on the ABO dataset, our generated shapes with patch structures achieve point cloud FID comparable to recent 3D generative models, while naturally supporting PBR material generation.

AK

66,412 Aufrufe • vor 1 Jahr

Oh wow! "[SIGGRAPH '24] DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models" Paper: Project: Code (MIT) :
1:04

Oh wow! "[SIGGRAPH '24] DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models" Paper: Project: Code (MIT) :

MrNeRF

59,480 Aufrufe • vor 2 Jahren

GPT-4o Image Generation to Part-based 3D Characters with PBR, in under 10 minutes ⚡️ Workflow: 🎨 Prompt GPT-4o to get an image (e.g., "3D asset of a styled character with all parts laid on a sheet for image to 3D") 🧩 Use CSM AI's Part-based tool to generate parts and assemble in Blender.
0:48

GPT-4o Image Generation to Part-based 3D Characters with PBR, in under 10 minutes ⚡️ Workflow: 🎨 Prompt GPT-4o to get an image (e.g., "3D asset of a styled character with all parts laid on a sheet for image to 3D") 🧩 Use CSM AI's Part-based tool to generate parts and assemble in Blender.

Common Sense Machines

441,683 Aufrufe • vor 1 Jahr

Beeble has released #SwitchLight 3.0, the new version of its video-to-PBR AI model It extracts #PBR texture maps from video, making it possible to relight live footage - and is now available for use offline, as well as in Beeble's browser app Beeble
0:28

Beeble has released #SwitchLight 3.0, the new version of its video-to-PBR AI model It extracts #PBR texture maps from video, making it possible to relight live footage - and is now available for use offline, as well as in Beeble's browser app Beeble

CG Channel

92,955 Aufrufe • vor 7 Monaten

“I think Sean Gleason is running a good league.” “We learned from PBR bunkhouse 🤠🐂🌟, a PBR blog.” “The PBR bulls are rockstars of the show.” “The bulls are born & bred to buck, training to be the bulls in the PBR.” “It’s the rules to wear a helmet if born after October 1994. Pat McAfee | #PMSLIVE
1:29

“I think Sean Gleason is running a good league.” “We learned from PBR bunkhouse 🤠🐂🌟, a PBR blog.” “The PBR bulls are rockstars of the show.” “The bulls are born & bred to buck, training to be the bulls in the PBR.” “It’s the rules to wear a helmet if born after October 1994. Pat McAfee | #PMSLIVE

PBR bunkhouse 🤠🐂🌟

13,483 Aufrufe • vor 2 Jahren

Learn how to make this low poly sushi scene using Uniform for iPad. The final result can be directly exported to a game engine including UVs, textures, PBR and normal maps.
0:44

Learn how to make this low poly sushi scene using Uniform for iPad. The final result can be directly exported to a game engine including UVs, textures, PBR and normal maps.

Sparseal

108,976 Aufrufe • vor 2 Jahren

"codex, pull up the pbr texture swatchbook"
0:45

"codex, pull up the pbr texture swatchbook"

Codetaur

22,051 Aufrufe • vor 1 Monat

You can now generate PBR materials within Omma using the /material command. - Diffuse - Normal - Height (for displacement) - Roughness
0:27

You can now generate PBR materials within Omma using the /material command. - Diffuse - Normal - Height (for displacement) - Roughness

Omma AI

34,840 Aufrufe • vor 2 Monaten

TurboEdit Instant text-based image editing discuss: We address the challenges of precise image inversion and disentangled image editing in the context of few-step diffusion models. We introduce an encoder based iterative inversion technique. The inversion network is conditioned on the input image and the reconstructed image from the previous step, allowing for correction of the next reconstruction towards the input image. We demonstrate that disentangled controls can be easily achieved in the few-step diffusion model by conditioning on an (automatically generated) detailed text prompt. To manipulate the inverted image, we freeze the noise maps and modify one attribute in the text prompt (either manually or via instruction based editing driven by an LLM), resulting in the generation of a new image similar to the input image with only one attribute changed. It can further control the editing strength and accept instructive text prompt. Our approach facilitates realistic text-guided image edits in real-time, requiring only 8 number of functional evaluations (NFEs) in inversion (one-time cost) and 4 NFEs per edit. Our method is not only fast, but also significantly outperforms state-of-the-art multi-step diffusion editing techniques.
0:22

TurboEdit Instant text-based image editing discuss: We address the challenges of precise image inversion and disentangled image editing in the context of few-step diffusion models. We introduce an encoder based iterative inversion technique. The inversion network is conditioned on the input image and the reconstructed image from the previous step, allowing for correction of the next reconstruction towards the input image. We demonstrate that disentangled controls can be easily achieved in the few-step diffusion model by conditioning on an (automatically generated) detailed text prompt. To manipulate the inverted image, we freeze the noise maps and modify one attribute in the text prompt (either manually or via instruction based editing driven by an LLM), resulting in the generation of a new image similar to the input image with only one attribute changed. It can further control the editing strength and accept instructive text prompt. Our approach facilitates realistic text-guided image edits in real-time, requiring only 8 number of functional evaluations (NFEs) in inversion (one-time cost) and 4 NFEs per edit. Our method is not only fast, but also significantly outperforms state-of-the-art multi-step diffusion editing techniques.

AK

16,062 Aufrufe • vor 1 Jahr

Unity published Holo-Gen! It's a method that can generate physically-based rendering (PBR) material properties for 3D objects.
0:33

Unity published Holo-Gen! It's a method that can generate physically-based rendering (PBR) material properties for 3D objects.

Dreaming Tulpa 🥓👑

47,729 Aufrufe • vor 2 Jahren

Another gem-TRELLIS.2: Native 3D generation via structured latents; - full PBR assets up to 1536³; - outperforms TRELLIS & Direct3D-S2.
0:24

Another gem-TRELLIS.2: Native 3D generation via structured latents; - full PBR assets up to 1536³; - outperforms TRELLIS & Direct3D-S2.

Wildminder

56,275 Aufrufe • vor 6 Monaten

We’re taking the ride to The CW Tune in SATURDAYS and SUNDAYS to The CW to watch PBR Teams starting August 9 👀
0:30

We’re taking the ride to The CW Tune in SATURDAYS and SUNDAYS to The CW to watch PBR Teams starting August 9 👀

PBR

14,931 Aufrufe • vor 11 Monaten

People are getting crazy over 4.0’s seamless texture generation! 🫨 It’s impressive, but control is limited, and some outputs aren’t quite seamless or lack adjustable PBR settings. Here’s a better way to AI-generate high-quality materials with full control – THREAD 👇🧵
0:25

People are getting crazy over 4.0’s seamless texture generation! 🫨 It’s impressive, but control is limited, and some outputs aren’t quite seamless or lack adjustable PBR settings. Here’s a better way to AI-generate high-quality materials with full control – THREAD 👇🧵

Emm | scenario.com

56,882 Aufrufe • vor 1 Jahr

Presto! Distilling Steps and Layers for Accelerating Music Generation Despite advances in diffusion-based text-to-music (TTM) methods, efficient, high-quality generation remains a challenge. We introduce Presto!, an approach to inference acceleration for score-based diffusion transformers via reducing both sampling steps and cost per step. To reduce steps, we develop a new score-based distribution matching distillation (DMD) method for the EDM-family of diffusion models, the first GAN-based distillation method for TTM. To reduce the cost per step, we develop a simple, but powerful improvement to a recent layer distillation method that improves learning via better preserving hidden state variance. Finally, we combine our step and layer distillation methods together for a dual-faceted approach. We evaluate our step and layer distillation methods independently and show each yield best-in-class performance. Our combined distillation method can generate high-quality outputs with improved diversity, accelerating our base model by 10-18x (230/435ms latency for 32 second mono/stereo 44.1kHz, 15x faster than comparable SOTA) -- the fastest high-quality TTM to our knowledge.
1:20

Presto! Distilling Steps and Layers for Accelerating Music Generation Despite advances in diffusion-based text-to-music (TTM) methods, efficient, high-quality generation remains a challenge. We introduce Presto!, an approach to inference acceleration for score-based diffusion transformers via reducing both sampling steps and cost per step. To reduce steps, we develop a new score-based distribution matching distillation (DMD) method for the EDM-family of diffusion models, the first GAN-based distillation method for TTM. To reduce the cost per step, we develop a simple, but powerful improvement to a recent layer distillation method that improves learning via better preserving hidden state variance. Finally, we combine our step and layer distillation methods together for a dual-faceted approach. We evaluate our step and layer distillation methods independently and show each yield best-in-class performance. Our combined distillation method can generate high-quality outputs with improved diversity, accelerating our base model by 10-18x (230/435ms latency for 32 second mono/stereo 44.1kHz, 15x faster than comparable SOTA) -- the fastest high-quality TTM to our knowledge.

AK

30,430 Aufrufe • vor 1 Jahr