Загрузка видео...

Не удалось загрузить видео

На главную

Microsoft open-sourced a 4B model that turns any image into a production-ready 3D asset in 3 seconds. It’s called TRELLIS.2, a fully textured, physically accurate 3D models with PBR textures out of the box. → Full PBR (base color, roughness, metallic, opacity) → Handles hair, cloth, glass, non-manifold geometry...

283,528 просмотров • 1 месяц назад •via X (Twitter)

Комментарии: 35

Фото профиля Superman
Superman1 месяц назад

Repo:

Фото профиля RedRising
RedRising1 месяц назад

i have seen a few posts similar to this, and i decided to play around with all the AI tools to see how they can't make actual cad models. Not one has produced anything close to an object that you could actually use. Making a AI video like this isn't the same thing!CADcanIIan

Фото профиля Jett Insight
Jett Insight1 месяц назад

topology is probably a mess

Фото профиля System of Catgirl Idealism e/acc
System of Catgirl Idealism e/acc1 месяц назад

that came out 7 months ago

Фото профиля androo
androo1 месяц назад

This is a bullshit model that requires another GATED model DinoV3 that you need to get META to approve. Open my ass.

Фото профиля Derek Fossier
Derek Fossier1 месяц назад

*cries in

Фото профиля Riz
Riz1 месяц назад

Tell me you haven’t used it without tell me

Фото профиля Hopper
Hopper1 месяц назад

Does it work for 3D printing?

Фото профиля Walid Aliouche
Walid Aliouche1 месяц назад

That was released a while ago

Фото профиля Alejandro Maestre | AI
Alejandro Maestre | AI1 месяц назад

TRELLIS.2 suena prometedor pero 3 segundos para un asset 3D con PBR completo es un salto enorme. Me pregunto qué tan bien escala con geometría compleja o si solo funciona para objetos simples.

Фото профиля Vlad Oreshkov
Vlad Oreshkov1 месяц назад

The gaming industry will take a hit with this one. More and more people are testing AI’s on abilities to clone games. If this becomes the standard, I wouldn’t know the difference between hand made games and AI made games. Both will be amazing to play though.

Фото профиля Aaron Wacker
Aaron Wacker1 месяц назад

This is Epic. Thanks @Microsoft Trellis is the best png to glb 2d to 3d model transformer and will be the rise to generative 3d models from image generation with #threejs and #aiuiuxjs apps and sims.

Фото профиля Magicfit
Magicfit1 месяц назад

open source is doing the heavy lifting

Фото профиля Johnny Utah
Johnny Utah1 месяц назад

hey cool thanks for sharing a 6 month old repo this is the equivalent of 2,000 human years in the world of AI

Фото профиля Kilgor Trout
Kilgor Trout1 месяц назад

@threejs It is good before you see topology :)

Фото профиля K8r
K8r1 месяц назад

waiting on these things to get animated. I am good with tripo3d for now and meshyAI

Фото профиля Matthew Mombrea
Matthew Mombrea1 месяц назад

Prerequisites System: The code is currently tested only on Linux. Hardware: An NVIDIA GPU with at least 24GB of memory is necessary. The code has been verified on NVIDIA A100 and H100 GPUs. Let me just grab my $8k - 30k GPU quick.

Фото профиля 星川 ✨ StarFlow
星川 ✨ StarFlow1 месяц назад

Has anyone tried running this locally yet? Wondering how much VRAM it needs.

Фото профиля Abides
Abides1 месяц назад

@Spectromachina thought of you as soon as I saw this

Фото профиля Quantum Homeboy
Quantum Homeboy1 месяц назад

Production ready? Lmao. Guess china can just take a picture of a raptor engine and spacex edge is gone

Фото профиля Vyacheslav Ops
Vyacheslav Ops1 месяц назад

"Runs locally, fully open training codebase" is the detail worth highlighting more than the speed — no cloud dependency, no data leaving your machine for asset generation. That's a meaningfully different trust model than most generative tools shipping right now

Фото профиля Modly
Modly1 месяц назад

This can be use directly in Modly 👀

Фото профиля Anthon Noire
Anthon Noire1 месяц назад

@SpaceXAI this is exactly the asset extraction feature I was suggesting for @grok imagine images and videos. Basically you begin with a prompt to produce an image and refine it. Each image is a sample run. The right image is then a reference point for an animation scene. The extrusion of the 2D asset to a timeline in motion produces extrapolated logical 3D geometry. That scene/video acts as the basis for multiple 3D assets which can be selected extracted and saved as .STL .obj .NC .gcode .ply .f3z .rvt and .dxf for example. (Autodesk, Gaussian splats, 3D printer, 360 fusion etc.) The combined outputs would be physicalization and phygital or virtualization products, such a chair, scale figure, or partially/wholly complete hypercar, scaling detail with iterative models. I'm surprised 4B already gets close.

Фото профиля Slew Shy
Slew Shy1 месяц назад

goodbye to yet another profession and market

Фото профиля Zimeng Xiong
Zimeng Xiong1 месяц назад

this gets posted like every two weeks

Фото профиля kalos
kalos1 месяц назад

Can it do anatomy?

Фото профиля Derek Fossier
Derek Fossier1 месяц назад

@loktar00 may be helpful with your characters.

Фото профиля Pearl AI
Pearl AI1 месяц назад

fine tuning on your own assets is the real flex

Фото профиля VeyrAshka
VeyrAshka1 месяц назад

Necessary. Now we can divide logic and tasks up to engage multiple resins types and tools completing a synchronized project with a data centre, functioning as a digital brain running a gyroscopic masterpiece of biomimicry. Modeled after a tree, an octopus, a spider…or fungi

Фото профиля α Sagittarius ✨
α Sagittarius ✨1 месяц назад

In then meantime they also shipped Windows 11 and Cortana.

Фото профиля Bally_AgenticAI
Bally_AgenticAI1 месяц назад

Image-to-3D is a reasoning problem, not pixel generation - the model infers geometry it never sees. Shipping it at 4B open-weights is the real story: it drops into a local creative pipeline with no cloud round-trip. #GenAI #AITools @Microsoft

Фото профиля Camaleón Raro
Camaleón Raro1 месяц назад

Open-weights 4B models running locally on consumer GPUs disrupt traditional asset pipelines. Sub-second inference with PBR textures eliminates the 0-00 per-asset API cost from proprietary cloudservices. How is VRAM consumption holding up during batch processing?

Фото профиля Devil Cloud
Devil Cloud1 месяц назад

Ah older news

Фото профиля Gluteus Maximus 🇹🇯🇰🇬🇺🇿🇰🇿🍣🥩🏋️
Gluteus Maximus 🇹🇯🇰🇬🇺🇿🇰🇿🍣🥩🏋️1 месяц назад

Can’t wait for @machineviolence to go 3d 😁

Фото профиля Nils
Nils1 месяц назад

pretty cool

Похожие видео

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Santiago

164,162 просмотров • 2 лет назад