Loading video...

Video Failed to Load

Go Home

So much exciting open-source 2d-to-3d research being shared open-source. Here is VAST AI Research implementation of Zehuan-Huang’s paper on Hugging Face Gradio MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generation

MattHartman's profile picture

Matt Hartman

8,931 subscribers

24,215 views • 1 year ago •via X (Twitter)

MusicScience & TechnologyEducation
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Is open source 3D generation finally solved ? This is from Unique3D @gradio demo 🤯
0:19

Is open source 3D generation finally solved ? This is from Unique3D @gradio demo 🤯

Sylvain Filoni

76,097 views • 2 years ago

Static 3D generation isn't enough. We need assets ready for animation. Our new #SIGGRAPH work, AniGen, takes a single image and generates the 3D shape, skeleton, and skinning weights all at once. Code is fully open-sourced! Kudos to Yihua and VAST AI Research 🧵(1/4)
0:15

Static 3D generation isn't enough. We need assets ready for animation. Our new #SIGGRAPH work, AniGen, takes a single image and generates the 3D shape, skeleton, and skinning weights all at once. Code is fully open-sourced! Kudos to Yihua and VAST AI Research 🧵(1/4)

Yanpei Cao

143,978 views • 2 months ago

Editing facial expressions in real time now on Hugging Face Spaces 👨‍🎤🔀 A Grog converted Cog image to Gradio running a ComfyUI backend - magic of open source 🤝 ▶️
0:10

Editing facial expressions in real time now on Hugging Face Spaces 👨‍🎤🔀 A Grog converted Cog image to Gradio running a ComfyUI backend - magic of open source 🤝 ▶️

apolinario 🌐

71,633 views • 1 year ago

We are proud to announce our first contribution to open source Computer Vision research! 🚀 Today, we’re publishing on Hugging Face a 1,000 3D Maps Dataset under CC-BY-NC license, designed to accelerate progress in 3D perception and spatial AI. Our way to give back to the global AI community and show how DePIN can make an impact. 🧵 👉
0:10

We are proud to announce our first contribution to open source Computer Vision research! 🚀 Today, we’re publishing on Hugging Face a 1,000 3D Maps Dataset under CC-BY-NC license, designed to accelerate progress in 3D perception and spatial AI. Our way to give back to the global AI community and show how DePIN can make an impact. 🧵 👉

Over the Reality 🌐

88,627 views • 6 months ago

Microsoft TRELLIS.2 is here 🔥 • Single image → textured 3D mesh • 4B params, flow-matching transformer • Up to 1536³ resolution • Open weights, MIT licensed ⬇️ Demo available on Hugging Face
0:12

Microsoft TRELLIS.2 is here 🔥 • Single image → textured 3D mesh • 4B params, flow-matching transformer • Up to 1536³ resolution • Open weights, MIT licensed ⬇️ Demo available on Hugging Face

Victor M

194,309 views • 5 months ago

Progressive Rendering Distillation released on Hugging Face Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Data
0:20

Progressive Rendering Distillation released on Hugging Face Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Data

AK

12,586 views • 1 year ago

Krea 2 is now on Artificial Analysis #1 image model from an independent research lab and #6 globally on text-to-image leaderboard. open-source cooking and coming soon.
0:13

Krea 2 is now on Artificial Analysis #1 image model from an independent research lab and #6 globally on text-to-image leaderboard. open-source cooking and coming soon.

Krea

80,676 views • 11 days ago

The speech on the FREE open source Sesame text to speech is astonishing. It just killed Google’s voice project for podcasts and the monetization they hoped for. Here is a Hugging Face Gradio link to test: But download it and clone your voice!
0:17

The speech on the FREE open source Sesame text to speech is astonishing. It just killed Google’s voice project for podcasts and the monetization they hoped for. Here is a Hugging Face Gradio link to test: But download it and clone your voice!

Brian Roemmele

87,908 views • 1 year ago

This AI model turns a single image + audio into a talking avatar video of infinite length. StableAvatar is built on Wan 2.1, and MIT Licensed. Open-source AI video is accelerating, and it’s exciting to watch!
0:19

This AI model turns a single image + audio into a talking avatar video of infinite length. StableAvatar is built on Wan 2.1, and MIT Licensed. Open-source AI video is accelerating, and it’s exciting to watch!

Miguel | AP

35,804 views • 10 months ago

Here’s how to create this cool 3D scene from a single image! 📸 Midjourney (isometric image generation) Trellis (Image to 3D Gaussian Splat) Browser Lab (3D Editor Splat Import)
0:13

Here’s how to create this cool 3D scene from a single image! 📸 Midjourney (isometric image generation) Trellis (Image to 3D Gaussian Splat) Browser Lab (3D Editor Splat Import)

Ian Curtis

117,646 views • 1 year ago

Lightplane Highly-Scalable Components for Neural 3D Fields Contemporary 3D research, particularly in reconstruction and generation, heavily relies on 2D images for inputs or supervision. However, current designs for these 2D-3D mapping are memory-intensive, posing a
0:12

Lightplane Highly-Scalable Components for Neural 3D Fields Contemporary 3D research, particularly in reconstruction and generation, heavily relies on 2D images for inputs or supervision. However, current designs for these 2D-3D mapping are memory-intensive, posing a

AK

18,896 views • 2 years ago

Relightify: Relightable 3D Faces from a Single Image via Diffusion Models abs: paper page:
0:10

Relightify: Relightable 3D Faces from a Single Image via Diffusion Models abs: paper page:

AK

85,893 views • 3 years ago

Create a 3D model from a single image, set of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”
0:18

Create a 3D model from a single image, set of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”

Bilawal Sidhu

92,760 views • 2 years ago

With Hunyuan3D World Model 1.0 now released and open-sourced, we're excited to showcase the technical highlights behind this impressive innovation: ✅360° Panoramic Generation: Creates complete, immersive “world scenes”, far beyond localized views. ✅Explorable 3D Scene Generation: Generates diverse, spatially consistent 3D worlds from text/image for truly immersive exploration. ✅Interactive/Editable: Achieves separation of foreground objects, background terrain, ground, and sky, for seamless secondary editing. ✅Exportable Mesh: Generated scenes can be exported as 3D meshes for direct import into mainstream game engines and modeling software. ✅Industry-Leading SOTA Evaluation: Surpasses state-of-the-art open-source models in generation quality. As the industry's first open-source model for physical simulation and explorable world generation, Hunyuan3D World Model 1.0 aims to foster a collaborative community ecosystem with developers and enthusiasts. ✨ Try it now: 🤗 Hugging Face:
0:07

With Hunyuan3D World Model 1.0 now released and open-sourced, we're excited to showcase the technical highlights behind this impressive innovation: ✅360° Panoramic Generation: Creates complete, immersive “world scenes”, far beyond localized views. ✅Explorable 3D Scene Generation: Generates diverse, spatially consistent 3D worlds from text/image for truly immersive exploration. ✅Interactive/Editable: Achieves separation of foreground objects, background terrain, ground, and sky, for seamless secondary editing. ✅Exportable Mesh: Generated scenes can be exported as 3D meshes for direct import into mainstream game engines and modeling software. ✅Industry-Leading SOTA Evaluation: Surpasses state-of-the-art open-source models in generation quality. As the industry's first open-source model for physical simulation and explorable world generation, Hunyuan3D World Model 1.0 aims to foster a collaborative community ecosystem with developers and enthusiasts. ✨ Try it now: 🤗 Hugging Face:

Tencent Hy

23,150 views • 10 months ago

As announced in partnership with NVIDIA at CES, we’re excited to introduce Stable Point Aware 3D (SPAR3D), setting a new standard in 3D generation. Ideal for running on NVIDIA RTX AI PCs, SPAR3D enables real-time editing and complete structure generation of 3D objects from a single image in under a second. You can download the weights on Hugging Face and code on GitHub, or access the model through the Stability AI API. Learn more here: (1/3)
0:13

As announced in partnership with NVIDIA at CES, we’re excited to introduce Stable Point Aware 3D (SPAR3D), setting a new standard in 3D generation. Ideal for running on NVIDIA RTX AI PCs, SPAR3D enables real-time editing and complete structure generation of 3D objects from a single image in under a second. You can download the weights on Hugging Face and code on GitHub, or access the model through the Stability AI API. Learn more here: (1/3)

Stability AI

181,402 views • 1 year ago

We are building “Open Source Nano Banana for Video” - here is open source demo v0.1 We are open sourcing Lucy Edit, the first foundation model for text-guided video editing! Get the model on Hugging Face 🤗, API on @FAL, and nodes on ComfyUI 🧵
0:17

We are building “Open Source Nano Banana for Video” - here is open source demo v0.1 We are open sourcing Lucy Edit, the first foundation model for text-guided video editing! Get the model on Hugging Face 🤗, API on @FAL, and nodes on ComfyUI 🧵

Decart

413,665 views • 8 months ago

Hi3DGen 🔥 High-fidelity 3D geometry generation from a single image by leveraging normal maps as an intermediate representation
0:15

Hi3DGen 🔥 High-fidelity 3D geometry generation from a single image by leveraging normal maps as an intermediate representation

Gradio

50,996 views • 1 year ago

We are continuing to advance open-source AI. Just announced -- new tools for speech, safety, and autonomous driving. Learn about the open models, datasets, and research we’re releasing at #NeurIPS2025:
0:10

We are continuing to advance open-source AI. Just announced -- new tools for speech, safety, and autonomous driving. Learn about the open models, datasets, and research we’re releasing at #NeurIPS2025:

NVIDIA

68,556 views • 6 months ago