Loading video...

Video Failed to Load

Go Home

Microsoft open-sourced a 4B model that turns any image into a production-ready 3D asset in 3 seconds. It’s called TRELLIS.2, a fully textured, physically accurate 3D models with PBR textures out of the box. → Full PBR (base color, roughness, metallic, opacity) → Handles hair, cloth, glass, non-manifold geometry...

283,528 views • 1 month ago •via X (Twitter)

35 Comments

Superman's profile picture
Superman1 month ago

Repo:

RedRising's profile picture
RedRising1 month ago

i have seen a few posts similar to this, and i decided to play around with all the AI tools to see how they can't make actual cad models. Not one has produced anything close to an object that you could actually use. Making a AI video like this isn't the same thing!CADcanIIan

Jett Insight's profile picture
Jett Insight1 month ago

topology is probably a mess

System of Catgirl Idealism e/acc's profile picture
System of Catgirl Idealism e/acc1 month ago

that came out 7 months ago

androo's profile picture
androo1 month ago

This is a bullshit model that requires another GATED model DinoV3 that you need to get META to approve. Open my ass.

Derek Fossier's profile picture
Derek Fossier1 month ago

*cries in

Riz's profile picture
Riz1 month ago

Tell me you haven’t used it without tell me

Hopper's profile picture
Hopper1 month ago

Does it work for 3D printing?

Walid Aliouche's profile picture
Walid Aliouche1 month ago

That was released a while ago

Alejandro Maestre | AI's profile picture
Alejandro Maestre | AI1 month ago

TRELLIS.2 suena prometedor pero 3 segundos para un asset 3D con PBR completo es un salto enorme. Me pregunto qué tan bien escala con geometría compleja o si solo funciona para objetos simples.

Vlad Oreshkov's profile picture
Vlad Oreshkov1 month ago

The gaming industry will take a hit with this one. More and more people are testing AI’s on abilities to clone games. If this becomes the standard, I wouldn’t know the difference between hand made games and AI made games. Both will be amazing to play though.

Aaron Wacker's profile picture
Aaron Wacker1 month ago

This is Epic. Thanks @Microsoft Trellis is the best png to glb 2d to 3d model transformer and will be the rise to generative 3d models from image generation with #threejs and #aiuiuxjs apps and sims.

Magicfit's profile picture
Magicfit1 month ago

open source is doing the heavy lifting

Johnny Utah's profile picture
Johnny Utah1 month ago

hey cool thanks for sharing a 6 month old repo this is the equivalent of 2,000 human years in the world of AI

Kilgor Trout's profile picture
Kilgor Trout1 month ago

@threejs It is good before you see topology :)

K8r's profile picture
K8r1 month ago

waiting on these things to get animated. I am good with tripo3d for now and meshyAI

Matthew Mombrea's profile picture
Matthew Mombrea1 month ago

Prerequisites System: The code is currently tested only on Linux. Hardware: An NVIDIA GPU with at least 24GB of memory is necessary. The code has been verified on NVIDIA A100 and H100 GPUs. Let me just grab my $8k - 30k GPU quick.

星川 ✨ StarFlow's profile picture
星川 ✨ StarFlow1 month ago

Has anyone tried running this locally yet? Wondering how much VRAM it needs.

Abides's profile picture
Abides1 month ago

@Spectromachina thought of you as soon as I saw this

Quantum Homeboy's profile picture
Quantum Homeboy1 month ago

Production ready? Lmao. Guess china can just take a picture of a raptor engine and spacex edge is gone

Vyacheslav Ops's profile picture
Vyacheslav Ops1 month ago

"Runs locally, fully open training codebase" is the detail worth highlighting more than the speed — no cloud dependency, no data leaving your machine for asset generation. That's a meaningfully different trust model than most generative tools shipping right now

Modly's profile picture
Modly1 month ago

This can be use directly in Modly 👀

Anthon Noire's profile picture
Anthon Noire1 month ago

@SpaceXAI this is exactly the asset extraction feature I was suggesting for @grok imagine images and videos. Basically you begin with a prompt to produce an image and refine it. Each image is a sample run. The right image is then a reference point for an animation scene. The extrusion of the 2D asset to a timeline in motion produces extrapolated logical 3D geometry. That scene/video acts as the basis for multiple 3D assets which can be selected extracted and saved as .STL .obj .NC .gcode .ply .f3z .rvt and .dxf for example. (Autodesk, Gaussian splats, 3D printer, 360 fusion etc.) The combined outputs would be physicalization and phygital or virtualization products, such a chair, scale figure, or partially/wholly complete hypercar, scaling detail with iterative models. I'm surprised 4B already gets close.

Slew Shy's profile picture
Slew Shy1 month ago

goodbye to yet another profession and market

Zimeng Xiong's profile picture
Zimeng Xiong1 month ago

this gets posted like every two weeks

kalos's profile picture
kalos1 month ago

Can it do anatomy?

Derek Fossier's profile picture
Derek Fossier1 month ago

@loktar00 may be helpful with your characters.

Pearl AI's profile picture
Pearl AI1 month ago

fine tuning on your own assets is the real flex

VeyrAshka's profile picture
VeyrAshka1 month ago

Necessary. Now we can divide logic and tasks up to engage multiple resins types and tools completing a synchronized project with a data centre, functioning as a digital brain running a gyroscopic masterpiece of biomimicry. Modeled after a tree, an octopus, a spider…or fungi

α Sagittarius ✨'s profile picture
α Sagittarius ✨1 month ago

In then meantime they also shipped Windows 11 and Cortana.

Bally_AgenticAI's profile picture
Bally_AgenticAI1 month ago

Image-to-3D is a reasoning problem, not pixel generation - the model infers geometry it never sees. Shipping it at 4B open-weights is the real story: it drops into a local creative pipeline with no cloud round-trip. #GenAI #AITools @Microsoft

Camaleón Raro's profile picture
Camaleón Raro1 month ago

Open-weights 4B models running locally on consumer GPUs disrupt traditional asset pipelines. Sub-second inference with PBR textures eliminates the 0-00 per-asset API cost from proprietary cloudservices. How is VRAM consumption holding up during batch processing?

Devil Cloud's profile picture
Devil Cloud1 month ago

Ah older news

Gluteus Maximus 🇹🇯🇰🇬🇺🇿🇰🇿🍣🥩🏋️'s profile picture
Gluteus Maximus 🇹🇯🇰🇬🇺🇿🇰🇿🍣🥩🏋️1 month ago

Can’t wait for @machineviolence to go 3d 😁

Nils's profile picture
Nils1 month ago

pretty cool

Related Videos

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Santiago

164,162 views • 2 years ago