Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

MICROSOFT DROPPED A 4B PARAMETER MODEL THAT TURNS ONE IMAGE INTO A 3D ASSET IN 3 SECONDS and it's open source TRELLIS.2 fully textured, physically accurate 3D models with PBR textures out of the box not a rough mesh..not a placeholder roughness, metallic, opacity the kind of detail that... show more

Vaishnavi

20,790 subscribers

353,879 Aufrufe • vor 2 Monaten •via X (Twitter)

Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Microsoft has released a 4B parameter model that turns any image into a 3D asset in 3 seconds. It uses a new geometry format called O-Voxel that converts to a textured mesh in under 100ms on CUDA. Outputs GLB files with full PBR textures, ready for Blender, Unity, and Unreal. 100% Open Source.

Microsoft has released a 4B parameter model that turns any image into a 3D asset in 3 seconds. It uses a new geometry format called O-Voxel that converts to a textured mesh in under 100ms on CUDA. Outputs GLB files with full PBR textures, ready for Blender, Unity, and Unreal. 100% Open Source.

How To Prompt

255,616 Aufrufe • vor 1 Monat

Rodin Gen-2 API node, Rodin’s most powerful image-to-3D tool, is now live in ComfyUI! Turn any image into a 3D model with one click. It supports 4× Mesh Quality, T/A Pose, PBR textures, and Multiview to 3D model. 👇 Try it now in ComfyUI!

Rodin Gen-2 API node, Rodin’s most powerful image-to-3D tool, is now live in ComfyUI! Turn any image into a 3D model with one click. It supports 4× Mesh Quality, T/A Pose, PBR textures, and Multiview to 3D model. 👇 Try it now in ComfyUI!

ComfyUI

19,076 Aufrufe • vor 9 Monaten

MICROSOFT OPEN SOURCED A 7B PARAMETER MODEL THAT TRANSCRIBES 60 MINUTES OF AUDIO IN A SINGLE PASS and it's completely free VIBEVOICE ASR no chunking, no context loss, full speaker diarization baked in not just speech to text..not a basic wrapper who spoke, when they spoke, exactly what they said..all in one shot and it handles the hard stuff too..50+ languages, custom hotwords, long form audio that breaks every other tool the model doesn't know what "context window" means apparently Available on macOS and Windows right now. Free to use. Free to fine tune. Free to build on.

MICROSOFT OPEN SOURCED A 7B PARAMETER MODEL THAT TRANSCRIBES 60 MINUTES OF AUDIO IN A SINGLE PASS and it's completely free VIBEVOICE ASR no chunking, no context loss, full speaker diarization baked in not just speech to text..not a basic wrapper who spoke, when they spoke, exactly what they said..all in one shot and it handles the hard stuff too..50+ languages, custom hotwords, long form audio that breaks every other tool the model doesn't know what "context window" means apparently Available on macOS and Windows right now. Free to use. Free to fine tune. Free to build on.

Rahul

1,371,872 Aufrufe • vor 2 Monaten

Microsoft just dropped TRELLIS.2 This AI turns image into photoreal-ish 3D with full PBR Now with higher definition and hyper realism Code + live demo below 👇

Microsoft just dropped TRELLIS.2 This AI turns image into photoreal-ish 3D with full PBR Now with higher definition and hyper realism Code + live demo below 👇

Min Choi

103,328 Aufrufe • vor 6 Monaten

I prompted Omma to build a #threejs app with real dynamic lighting on a 3D mesh - generated from a single image, using Depth Anything v2 + Transformers from Hugging Face ⚡ Depth estimation in the browser 🫧 3D mesh from the depth map 💡 Dynamic lighting reacting to the geometry No manual code. Pure AI prompting. The future of 3D on the web feels wide open.

I prompted Omma to build a #threejs app with real dynamic lighting on a 3D mesh - generated from a single image, using Depth Anything v2 + Transformers from Hugging Face ⚡ Depth estimation in the browser 🫧 3D mesh from the depth map 💡 Dynamic lighting reacting to the geometry No manual code. Pure AI prompting. The future of 3D on the web feels wide open.

Joseph Azar

14,041 Aufrufe • vor 2 Monaten

✨ Made a new mini feature on Photo AI: [ Grab from 3d model ] So the problem is we're at that stage in time (typical for AI) where image-to-3d models are not good enough but are fun to play with, but we know they'll be good enough in 1-2 years With [ Make 3d model ] you already can turn any Photo AI pic into a 3d model but it still looks hyper clunky and deformed, but it works! One cool idea I had to make that more useful and made now: Let people make a 3d model then change the view of the it with the 3d viewer, then press [ o ] and it grabs a frame of the 3d That image you can then [ Remix ] (img2img), and it becomes a real photo again and that in turn you can then turn into a video again with [ Make video ] So that essentially gives you a fully freeform camera position control to take photos with One thing I need to fix is the background/skybox, I kinda need to take the original photo and remove the person and just get the background for the 3d model viewer, in this case it should be white, but it's a start!

✨ Made a new mini feature on Photo AI: [ Grab from 3d model ] So the problem is we're at that stage in time (typical for AI) where image-to-3d models are not good enough but are fun to play with, but we know they'll be good enough in 1-2 years With [ Make 3d model ] you already can turn any Photo AI pic into a 3d model but it still looks hyper clunky and deformed, but it works! One cool idea I had to make that more useful and made now: Let people make a 3d model then change the view of the it with the 3d viewer, then press [ o ] and it grabs a frame of the 3d That image you can then [ Remix ] (img2img), and it becomes a real photo again and that in turn you can then turn into a video again with [ Make video ] So that essentially gives you a fully freeform camera position control to take photos with One thing I need to fix is the background/skybox, I kinda need to take the original photo and remove the person and just get the background for the 3d model viewer, in this case it should be white, but it's a start!

@levelsio

119,210 Aufrufe • vor 1 Jahr

📢 Automatic PBR : Image-to-material (I2M) 👉Textured Mesh in > Full PBR Mesh out Our latest foundation model for enriching existing 3D assets with the full array of PBR materials, whilst maintaining the same mesh geometry and UV unwrap. #I2M #PBR #CV #Marso #texturing #gamedev #computervision M-XR

📢 Automatic PBR : Image-to-material (I2M) 👉Textured Mesh in > Full PBR Mesh out Our latest foundation model for enriching existing 3D assets with the full array of PBR materials, whilst maintaining the same mesh geometry and UV unwrap. #I2M #PBR #CV #Marso #texturing #gamedev #computervision M-XR

Elliott Round

13,353 Aufrufe • vor 2 Monaten

I'm thrilled to officially annouce🤩 📢 Automatic PBR : Image-to-material (I2M) 👉Textured Mesh in > Full PBR Mesh out Our latest foundation model for enriching existing 3D assets with the full array of PBR materials, whilst maintaining the same mesh geometry and UV unwrap. 🧵A thread : 1 of 7 👇 #I2M #PBR #CV #Marso #texturing #gamedev #computervision M-XR

I'm thrilled to officially annouce🤩 📢 Automatic PBR : Image-to-material (I2M) 👉Textured Mesh in > Full PBR Mesh out Our latest foundation model for enriching existing 3D assets with the full array of PBR materials, whilst maintaining the same mesh geometry and UV unwrap. 🧵A thread : 1 of 7 👇 #I2M #PBR #CV #Marso #texturing #gamedev #computervision M-XR

Elliott Round

36,221 Aufrufe • vor 2 Monaten

3D-R1 is out on Hugging Face Enhancing Reasoning in 3D VLMs for Unified Scene Understanding 3D-R1 is an open-source generalist model that enhances the reasoning of 3D VLMs for unified scene understanding

3D-R1 is out on Hugging Face Enhancing Reasoning in 3D VLMs for Unified Scene Understanding 3D-R1 is an open-source generalist model that enhances the reasoning of 3D VLMs for unified scene understanding

AK

34,729 Aufrufe • vor 11 Monaten

Microsoft just dropped MineWorld on Hugging Face a Real-Time and Open-Source Interactive World Model on Minecraft

Microsoft just dropped MineWorld on Hugging Face a Real-Time and Open-Source Interactive World Model on Minecraft

AK

95,035 Aufrufe • vor 1 Jahr

Microsoft released Trellis! Trellis is a new 3D model that generates high-quality 3D assets in formats like Radiance Fields, 3D Gaussians, and meshes.

Microsoft released Trellis! Trellis is a new 3D model that generates high-quality 3D assets in formats like Radiance Fields, 3D Gaussians, and meshes.

Dreaming Tulpa 🥓👑

85,115 Aufrufe • vor 1 Jahr

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!

Santiago

65,446 Aufrufe • vor 2 Monaten

InstantSplat++ is now open source. It is a lightweight library that connects foundation models (VGGT, MASt3R, MAP-Anything, etc.) with the Gaussian splatting family. Given uncalibrated images, it optimizes a 3D scene in a few seconds. Try the demo and code here:

InstantSplat++ is now open source. It is a lightweight library that connects foundation models (VGGT, MASt3R, MAP-Anything, etc.) with the Gaussian splatting family. Given uncalibrated images, it optimizes a 3D scene in a few seconds. Try the demo and code here:

Zhiwen(Aaron) Fan

31,835 Aufrufe • vor 4 Monaten

Currently testing Hunyuan brand new 2.5 model for image to 3D. YUP! It's MAJOR improvement over 2.0, especially with making details look sharper, it can also reconstruct more detail. It also generates PBR materials now and you can automatically rig the character on the website. It's much better than Trellis and Tripo from my testing! Took it into Blender as well to compare Hunyuan 2.5 (on the left) and Hunyuan 2.0 (on the right). I wanted to see the mesh with a solid and material preview. If you're doing 3D printing, these would probably work very well. However...the biggest issue here is still topology which is a complete and utter mess, there's also still issues with texture projection...and the entire model is a single mesh, there needs to be a method to generate the model in parts BUT this tech is certainly improving. As someone that is also a 3D artist, I actually want to see what this tech is capable of generating to output 3D models.

Travis Davids

45,357 Aufrufe • vor 1 Jahr

WOW. 😳 Apple just quietly won the 3D maps war at WWDC. Gaussian Splatting is coming to Apple Maps Flyover this fall. Apple Maps Flyover covers 300+ cities. Until yesterday, every single one was built on standard drone photogrammetry. The technology captures photos from the air and reconstructs 3D geometry from them. Gaussian Splatting does not reconstruct geometry. It represents the scene as millions of tiny 3D ellipsoids, each one carrying its own color and opacity information based on how light actually behaves in that location. The output is not a mesh model. It is a field of light. When you move through it, it does not crumble at the edges. The detail holds because it was never geometry to begin with. Apple has been hiring for this for years. Their SHARP model, published in research last year, generates photorealistic 3D scenes from a single image in under a second. Google has more sensor data than anyone. More Street View cars, more satellites, more capture history. On navigation accuracy and geodata depth, Google Maps is still ahead by most measures. But fidelity in 3D city rendering is a different competition, and Apple just set a bar in that. Most people will experience this in the fall without knowing the name of the technology. They will open Flyover, look at a city they know, and notice it looks different. Real, not rendered. That is the moment Gaussian Splatting stops being a research term and becomes something a billion people use. Bookmark this. It will look prescient by October.

WOW. 😳 Apple just quietly won the 3D maps war at WWDC. Gaussian Splatting is coming to Apple Maps Flyover this fall. Apple Maps Flyover covers 300+ cities. Until yesterday, every single one was built on standard drone photogrammetry. The technology captures photos from the air and reconstructs 3D geometry from them. Gaussian Splatting does not reconstruct geometry. It represents the scene as millions of tiny 3D ellipsoids, each one carrying its own color and opacity information based on how light actually behaves in that location. The output is not a mesh model. It is a field of light. When you move through it, it does not crumble at the edges. The detail holds because it was never geometry to begin with. Apple has been hiring for this for years. Their SHARP model, published in research last year, generates photorealistic 3D scenes from a single image in under a second. Google has more sensor data than anyone. More Street View cars, more satellites, more capture history. On navigation accuracy and geodata depth, Google Maps is still ahead by most measures. But fidelity in 3D city rendering is a different competition, and Apple just set a bar in that. Most people will experience this in the fall without knowing the name of the technology. They will open Flyover, look at a city they know, and notice it looks different. Real, not rendered. That is the moment Gaussian Splatting stops being a research term and becomes something a billion people use. Bookmark this. It will look prescient by October.

Shruti

19,784 Aufrufe • vor 1 Monat

Open source models are crazy. Alibaba just dropped Wan 2.2 Animate, a new model that can animate any character based on a simple souce image. It handles facial expressions and body movements like no other model. 10 insane examples: (sound on)

Open source models are crazy. Alibaba just dropped Wan 2.2 Animate, a new model that can animate any character based on a simple souce image. It handles facial expressions and body movements like no other model. 10 insane examples: (sound on)

Angry Tom

4,257,919 Aufrufe • vor 9 Monaten

converts single 2D images into interactable 3D models; with MonoArt. Interior designers will definitely appreciate this one. - Snap one photo of any furniture - Get a working 3D model in 20 seconds - jointly predicts geometry, part segments, and motion; - built on TRELLIS. Drawers actually slide, doors open.. Test room clearances in VR before buying a thing

converts single 2D images into interactable 3D models; with MonoArt. Interior designers will definitely appreciate this one. - Snap one photo of any furniture - Get a working 3D model in 20 seconds - jointly predicts geometry, part segments, and motion; - built on TRELLIS. Drawers actually slide, doors open.. Test room clearances in VR before buying a thing

Wildminder

25,185 Aufrufe • vor 3 Monaten

🚀 Hunyuan 3D 2.1 is here! The first fully open-source, production-ready PBR 3D generative model! ✅Cinema-grade visuals: PBR material synthesis brings leather, bronze, and more to life with stunning light interactions. ✅ Fully open-source: Model weights, training/inference code, data pipelines, and architecture—yours to fine-tune! ✅ Runs on consumer GPUs, empowering creators, devs, and small teams. Be the first to shape the future of 3D! Download now and build something epic. Model: Demo: Github: Hunyuan 3D Creation Engine: #Hunyuan3D #OpenSource #3DCreation

🚀 Hunyuan 3D 2.1 is here! The first fully open-source, production-ready PBR 3D generative model! ✅Cinema-grade visuals: PBR material synthesis brings leather, bronze, and more to life with stunning light interactions. ✅ Fully open-source: Model weights, training/inference code, data pipelines, and architecture—yours to fine-tune! ✅ Runs on consumer GPUs, empowering creators, devs, and small teams. Be the first to shape the future of 3D! Download now and build something epic. Model: Demo: Github: Hunyuan 3D Creation Engine: #Hunyuan3D #OpenSource #3DCreation

Tencent Hy

236,271 Aufrufe • vor 1 Jahr

You can now generate, edit, and convert a reference image into 3D inside one tool. Tripo's Image Generation runs Nano Banana and GPT to build the reference, then turns it into a model. Text or photo in, 3D out. One pipeline, zero handoffs.

You can now generate, edit, and convert a reference image into 3D inside one tool. Tripo's Image Generation runs Nano Banana and GPT to build the reference, then turns it into a model. Text or photo in, 3D out. One pipeline, zero handoffs.

Alvaro Cintas

56,191 Aufrufe • vor 28 Tagen

This is a pretty wild model! You can use it to turn an image into a 3D object with texture. The quality is out of this world! I'm not even a designer, and I've been using this nonstop for the last 2 hours. The model is Hunyuan 3D 2.1. It's open source. You'll find model weights, training/inference code, data pipelines, and architecture on their repository. You can even fine-tune it if you want! GitHub Repository: By the way, the model runs on consumer-grade GPUs. You don't need a datacenter for this! I've been using the model from the HuggingFace demo page: To use it, go to the link and upload an image. That's it! Check out the video I recorded for a couple of examples.

This is a pretty wild model! You can use it to turn an image into a 3D object with texture. The quality is out of this world! I'm not even a designer, and I've been using this nonstop for the last 2 hours. The model is Hunyuan 3D 2.1. It's open source. You'll find model weights, training/inference code, data pipelines, and architecture on their repository. You can even fine-tune it if you want! GitHub Repository: By the way, the model runs on consumer-grade GPUs. You don't need a datacenter for this! I've been using the model from the HuggingFace demo page: To use it, go to the link and upload an image. That's it! Check out the video I recorded for a couple of examples.

Santiago

44,783 Aufrufe • vor 1 Jahr