Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Comfy3D Update: (v0.1.5.alpha, dev branch) - Integrated TripoSG (Plus scribble model) - MV-Adapter for high quality texture gen coming next ‼️NeuralAI We are hiring skilled ML researchers & engineers (VAE, diffusion model, 3D/texture gen/editing) to join us on a mission to revolutionize 3D virtual production 🫰If you want to... show more

Mr. For Example

5,501 subscribers

14,716 views • 1 year ago •via X (Twitter)

Arts Science & Technology Education

Anya Rossi• Live Now

Private livecam show

8 Comments

Mr. For Example1 year ago

TripoSG Scribble Model also works

ksminnovation1 year ago

AI is transforming healthcare! A KSM-led study shows AI can detect Celiac disease 4 years earlier @TalPatalon @MedPredict

Tripo1 year ago

@GoNeuralAI thanks for what you have built for the community!

Mr. For Example1 year ago

@GoNeuralAI My pleasure🍻

pite-chen1 year ago

@GoNeuralAI nice

0xNano1 year ago

@GoNeuralAI 🔥🔥🔥

David1 year ago

@GoNeuralAI $NEURAL 🔥

Skiny36041 year ago

@GoNeuralAI Future of #ai #gaming $NEURAL 🔥🚀

Related Videos

Comfy3D Update: (v0.1.5.beta, dev branch) by our newly joined ML engineer: Denis⚡️ - Updated Hunyuan3D-2: * Hunyuan3D-DiT-v2-0-Fast * Hunyuan3D-2mini * Hunyuan3D-2mv * Hunyuan3D-2-Turbo * Hunyuan3D-2mini-Turbo and FlashVDM * Hunyuan3D-Paint-v2-0-Turbo ‼️NeuralAI We are hiring skilled ML researchers & engineers (VAE, diffusion model, 3D/texture gen/editing) to join us on a mission to revolutionize 3D virtual production 🤌If you want to work on open-source projects (Not only Comfy3D), make an impact in the industry all while getting paid handsomely, hit me up in DM! (English | 中文 | 日本語)🆗 田中義弘 | taziku CEO / AI × Creative -Zho- toyxyz Robin Huang ComfyUI Tencent Hy Neuro

Comfy3D Update: (v0.1.5.beta, dev branch) by our newly joined ML engineer: Denis⚡️ - Updated Hunyuan3D-2: * Hunyuan3D-DiT-v2-0-Fast * Hunyuan3D-2mini * Hunyuan3D-2mv * Hunyuan3D-2-Turbo * Hunyuan3D-2mini-Turbo and FlashVDM * Hunyuan3D-Paint-v2-0-Turbo ‼️NeuralAI We are hiring skilled ML researchers & engineers (VAE, diffusion model, 3D/texture gen/editing) to join us on a mission to revolutionize 3D virtual production 🤌If you want to work on open-source projects (Not only Comfy3D), make an impact in the industry all while getting paid handsomely, hit me up in DM! (English | 中文 | 日本語)🆗 田中義弘 | taziku CEO / AI × Creative -Zho- toyxyz Robin Huang ComfyUI Tencent Hy Neuro

Mr. For Example

30,803 views • 1 year ago

#ComfyUI #Comfy3D Lovis Odin toyxyz Jesse Metcalfe 🐰 @ZHOZHO672070 Koke_Cacao BennyKok Comfy3D Update: - Integrated Stable Fast 3D (released from Stability AI) - Added resize image foreground node - Support Hugging Face user token for automatic download restricted model card Github link:

#ComfyUI #Comfy3D Lovis Odin toyxyz Jesse Metcalfe 🐰 @ZHOZHO672070 Koke_Cacao BennyKok Comfy3D Update: - Integrated Stable Fast 3D (released from Stability AI) - Added resize image foreground node - Support Hugging Face user token for automatic download restricted model card Github link:

Mr. For Example

27,847 views • 1 year ago

#ComfyUI #Comfy3D @ZHOZHO672070 Yanpei Cao Comfy3D Update: - 3D Visualization for Gaussians & Mesh - First single image to 3D full pipeline - Coordinate system axis re-mapping I know, currently DMTet is not good enough😝 Future Development Roadmap:

#ComfyUI #Comfy3D @ZHOZHO672070 Yanpei Cao Comfy3D Update: - 3D Visualization for Gaussians & Mesh - First single image to 3D full pipeline - Coordinate system axis re-mapping I know, currently DMTet is not good enough😝 Future Development Roadmap:

Mr. For Example

13,063 views • 2 years ago

Comfy3D Update: (v0.1.4.alpha) - Integrated Hunyuan3D-2 (I did bunch of work including rewrote its mesh processor from C++ to Python to make sure only one additional custom package is required) - Support newest Comfy UI v0.3.12, py12, cu124, torch 2.5.1, Windows 10/11 (Pre-built wheels are available) * I'll spent my free time in next few days to do some robustness update, check the issues and merge pull requests GitHub Link: #ComfyUI #Comfy3D ComfyUI toad Neuro 青龍聖者 -Zho- toyxyz

Comfy3D Update: (v0.1.4.alpha) - Integrated Hunyuan3D-2 (I did bunch of work including rewrote its mesh processor from C++ to Python to make sure only one additional custom package is required) - Support newest Comfy UI v0.3.12, py12, cu124, torch 2.5.1, Windows 10/11 (Pre-built wheels are available) * I'll spent my free time in next few days to do some robustness update, check the issues and merge pull requests GitHub Link: #ComfyUI #Comfy3D ComfyUI toad Neuro 青龍聖者 -Zho- toyxyz

Mr. For Example

34,620 views • 1 year ago

We’re also publishing two research papers on the approaches we used for high quality 3D model generation & texture generation based on text prompts that are behind the Meta 3D Gen system. Meta 3D AssetGen ➡️ Meta 3D TextureGen ➡️

We’re also publishing two research papers on the approaches we used for high quality 3D model generation & texture generation based on text prompts that are behind the Meta 3D Gen system. Meta 3D AssetGen ➡️ Meta 3D TextureGen ➡️

AI at Meta

72,914 views • 1 year ago

📢Tripo Doodle is now OPEN-SOURCED! Accepted at #SIGGRAPHAsia 2024, we unveiled #TripoDoodle (aka TripoSG Scribble), an interactive tool that allows users "doodle" their way to detailed 3D assets in real-time. VAST AI Research Check out the Live clip below👇

📢Tripo Doodle is now OPEN-SOURCED! Accepted at #SIGGRAPHAsia 2024, we unveiled #TripoDoodle (aka TripoSG Scribble), an interactive tool that allows users "doodle" their way to detailed 3D assets in real-time. VAST AI Research Check out the Live clip below👇

Tripo

13,022 views • 1 year ago

#ComfyUI #Comfy3D Comfy3D Update: - Integrated Unique3D all stages workflow - Support Era3D + Unique3D workflow - All workflow breakdown to its core functions Project GitHub page:

#ComfyUI #Comfy3D Comfy3D Update: - Integrated Unique3D all stages workflow - Support Era3D + Unique3D workflow - All workflow breakdown to its core functions Project GitHub page:

Mr. For Example

16,505 views • 1 year ago

Hunyuan 3D 3.0 is now available in ComfyUI via Partner Nodes! We are bringing more models & tools into ComfyUI, starting with state-of-the-art asset generation from text, images, or sketches. Coming soon in ComfyUI: - texture editing - semantic UV unwrapping - intelligent 3D part decomposition The goal isn’t to replace 3D artists. It’s to remove the non-creative friction so real creative moments can happen faster.

Hunyuan 3D 3.0 is now available in ComfyUI via Partner Nodes! We are bringing more models & tools into ComfyUI, starting with state-of-the-art asset generation from text, images, or sketches. Coming soon in ComfyUI: - texture editing - semantic UV unwrapping - intelligent 3D part decomposition The goal isn’t to replace 3D artists. It’s to remove the non-creative friction so real creative moments can happen faster.

ComfyUI

126,090 views • 3 months ago

Big news from Tripo! We’re open-sourcing TripoSG & TripoSF—next-level 3D GenAI models for high-fidelity 3D generation. Code, weights, demos—all yours now. Let’s shape the future of 3D AI together! Bonus: More open-source goodies drop next month!

Big news from Tripo! We’re open-sourcing TripoSG & TripoSF—next-level 3D GenAI models for high-fidelity 3D generation. Code, weights, demos—all yours now. Let’s shape the future of 3D AI together! Bonus: More open-source goodies drop next month!

Yanpei Cao

132,102 views • 1 year ago

Rodin Gen-2 API node, Rodin’s most powerful image-to-3D tool, is now live in ComfyUI! Turn any image into a 3D model with one click. It supports 4× Mesh Quality, T/A Pose, PBR textures, and Multiview to 3D model. 👇 Try it now in ComfyUI!

Rodin Gen-2 API node, Rodin’s most powerful image-to-3D tool, is now live in ComfyUI! Turn any image into a 3D model with one click. It supports 4× Mesh Quality, T/A Pose, PBR textures, and Multiview to 3D model. 👇 Try it now in ComfyUI!

ComfyUI

19,076 views • 8 months ago

⚙️ 404—GEN has released the WORLD'S LARGEST open-source 3D model dataset ⚙️ • 21.5M+ AI-generated 3d models • Open-source and attribution-ready • Larger than all existing 3D datasets combined This is an unmatched scale for Gaussian Splatting research. More details below 🧵 ⬇️

⚙️ 404—GEN has released the WORLD'S LARGEST open-source 3D model dataset ⚙️ • 21.5M+ AI-generated 3d models • Open-source and attribution-ready • Larger than all existing 3D datasets combined This is an unmatched scale for Gaussian Splatting research. More details below 🧵 ⬇️

404

44,735 views • 1 year ago

Here's a look behind the scenes of how I used a 3d model, generated from an image, as a "driver" for ai animation. In the near future we'll see more 3d tools that support these types of workflows, with much more emphasis on enhancing user input instead of just letting the ai do everything. I used the 3d model to generate keyframes that I then animated in Luma Dream. By using a 3d model with a diffusion "layer" done with Krea, I got quite high quality frames with a relatively high consistency as well since the AI didn't have to "hallucinate" that much. I upscaled and detailed the frames using Magnific. Using semi-detailed 3d models as drivers for gen ai is very powerful, and it allows us to use models that are sculpted in a more free-flowing type of workflow that doesn't rely so much on high surface detailing or very time-consuming finish, but instead relies more on gestural 3d sculpting. #art #ai

Here's a look behind the scenes of how I used a 3d model, generated from an image, as a "driver" for ai animation. In the near future we'll see more 3d tools that support these types of workflows, with much more emphasis on enhancing user input instead of just letting the ai do everything. I used the 3d model to generate keyframes that I then animated in Luma Dream. By using a 3d model with a diffusion "layer" done with Krea, I got quite high quality frames with a relatively high consistency as well since the AI didn't have to "hallucinate" that much. I upscaled and detailed the frames using Magnific. Using semi-detailed 3d models as drivers for gen ai is very powerful, and it allows us to use models that are sculpted in a more free-flowing type of workflow that doesn't rely so much on high surface detailing or very time-consuming finish, but instead relies more on gestural 3d sculpting. #art #ai

Martin Nebelong

48,200 views • 1 year ago

MV-Adapter 3D texture generation apps just dropped on Hugging Face

MV-Adapter 3D texture generation apps just dropped on Hugging Face

AK

135,407 views • 1 year ago

I see your text prompt and raise you my 3d to anything.. It's all about control if we want Gen ai to be a useful creative tool. Keep reading to see the finished images based on this technique.🧵 #ai #art

I see your text prompt and raise you my 3d to anything.. It's all about control if we want Gen ai to be a useful creative tool. Keep reading to see the finished images based on this technique.🧵 #ai #art

Martin Nebelong

128,959 views • 2 years ago

DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior paper page: present DreamCraft3D, a hierarchical 3D content generation method that produces high-fidelity and coherent 3D objects. We tackle the problem by leveraging a 2D reference image to guide the stages of geometry sculpting and texture boosting. A central focus of this work is to address the consistency issue that existing works encounter. To sculpt geometries that render coherently, we perform score distillation sampling via a view-dependent diffusion model. This 3D prior, alongside several training strategies, prioritizes the geometry consistency but compromises the texture fidelity. We further propose Bootstrapped Score Distillation to specifically boost the texture. We train a personalized diffusion model, Dreambooth, on the augmented renderings of the scene, imbuing it with 3D knowledge of the scene being optimized. The score distillation from this 3D-aware diffusion prior provides view-consistent guidance for the scene. Notably, through an alternating optimization of the diffusion prior and 3D scene representation, we achieve mutually reinforcing improvements: the optimized 3D scene aids in training the scene-specific diffusion model, which offers increasingly view-consistent guidance for 3D optimization. The optimization is thus bootstrapped and leads to substantial texture boosting. With tailored 3D priors throughout the hierarchical generation, DreamCraft3D generates coherent 3D objects with photorealistic renderings, advancing the state-of-the-art in 3D content generation.

DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior paper page: present DreamCraft3D, a hierarchical 3D content generation method that produces high-fidelity and coherent 3D objects. We tackle the problem by leveraging a 2D reference image to guide the stages of geometry sculpting and texture boosting. A central focus of this work is to address the consistency issue that existing works encounter. To sculpt geometries that render coherently, we perform score distillation sampling via a view-dependent diffusion model. This 3D prior, alongside several training strategies, prioritizes the geometry consistency but compromises the texture fidelity. We further propose Bootstrapped Score Distillation to specifically boost the texture. We train a personalized diffusion model, Dreambooth, on the augmented renderings of the scene, imbuing it with 3D knowledge of the scene being optimized. The score distillation from this 3D-aware diffusion prior provides view-consistent guidance for the scene. Notably, through an alternating optimization of the diffusion prior and 3D scene representation, we achieve mutually reinforcing improvements: the optimized 3D scene aids in training the scene-specific diffusion model, which offers increasingly view-consistent guidance for 3D optimization. The optimization is thus bootstrapped and leads to substantial texture boosting. With tailored 3D priors throughout the hierarchical generation, DreamCraft3D generates coherent 3D objects with photorealistic renderings, advancing the state-of-the-art in 3D content generation.

AK

161,400 views • 2 years ago

📣 New research from GenAI at Meta, introducing Meta 3D Gen: A new system for end-to-end generation of 3D assets from text in <1min. Meta 3D Gen is a new combined AI system that can generate high-quality 3D assets, with both high-resolution textures and material maps end-to-end, producing results that are superior to existing solutions — at 3-10x the speed of existing work in this space. Details in the technical report ➡️

📣 New research from GenAI at Meta, introducing Meta 3D Gen: A new system for end-to-end generation of 3D assets from text in <1min. Meta 3D Gen is a new combined AI system that can generate high-quality 3D assets, with both high-resolution textures and material maps end-to-end, producing results that are superior to existing solutions — at 3-10x the speed of existing work in this space. Details in the technical report ➡️

AI at Meta

408,708 views • 1 year ago

3D animator uses ComfyUI + Stable Diffusion + custom LoRA trained on their own 3D renders to create this beautiful AI realism. Also uses a huge 20TB skin texture refs + Qwen for anime-ish styling; video is stitched from ~6s stable clips.

3D animator uses ComfyUI + Stable Diffusion + custom LoRA trained on their own 3D renders to create this beautiful AI realism. Also uses a huge 20TB skin texture refs + Qwen for anime-ish styling; video is stitched from ~6s stable clips.

Rohan Paul

23,142 views • 5 months ago

Hello AI enthusiasts!👋 I’d like to share that we’re introducing the latest 3D foundation AI model AssetGen 2.0, which was designed to create high-quality 3D assets from text and image prompts. 💡AssetGen 2.0 consist of 2 models: one to generate the 3D Mesh, & a second one to generate textures. ℹ️ Technological Advancements: - Utilizes a single-stage 3D diffusion model for geometry estimation, leading to improved detail and fidelity compared to its predecessor, AssetGen 1.0. - TextureGen introduces methods for enhanced view consistency, texture in-painting, and higher texture resolution. 📌 Current Use and Future Plans: - Currently employed internally for creating 3D worlds. - Planned rollout to Horizon creators later this year. 👉 More details about this announcement: #Meta #AI #GenAI

Hello AI enthusiasts!👋 I’d like to share that we’re introducing the latest 3D foundation AI model AssetGen 2.0, which was designed to create high-quality 3D assets from text and image prompts. 💡AssetGen 2.0 consist of 2 models: one to generate the 3D Mesh, & a second one to generate textures. ℹ️ Technological Advancements: - Utilizes a single-stage 3D diffusion model for geometry estimation, leading to improved detail and fidelity compared to its predecessor, AssetGen 1.0. - TextureGen introduces methods for enhanced view consistency, texture in-painting, and higher texture resolution. 📌 Current Use and Future Plans: - Currently employed internally for creating 3D worlds. - Planned rollout to Horizon creators later this year. 👉 More details about this announcement: #Meta #AI #GenAI

Dilmer Valecillos

28,153 views • 1 year ago

Speedsculpt + AI image gen. What an incredibly powerful combo compared to text to image. Made using Dreams on my PS5, by far the fastest way to sculpt in 3d anywhere. Transformed with Krea ai. Imagine when it's possible to convert this to an actual 3d model, to animate it, and to integrate it into projects. #ThePowerofDreams #kreaai

Speedsculpt + AI image gen. What an incredibly powerful combo compared to text to image. Made using Dreams on my PS5, by far the fastest way to sculpt in 3d anywhere. Transformed with Krea ai. Imagine when it's possible to convert this to an actual 3d model, to animate it, and to integrate it into projects. #ThePowerofDreams #kreaai

Martin Nebelong

56,580 views • 2 years ago