Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Introducing 𝐒𝐀𝐑𝟑𝐃, which tokenizes 3D objects into multiscale tokens and generates 3D objects by autoregressive next-scale prediction. 𝐒𝐀𝐑𝟑𝐃 enables fast 3D generation and comprehensive 3D understanding. arXiv: Project:

XingangP's profile picture

Xingang Pan

3,057 subscribers

28,248 görüntüleme • 1 yıl önce •via X (Twitter)

EğitimSanatBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

3 Yorum

Xingang Pan profil fotoğrafı
Xingang Pan1 yıl önce

This work is mainly done by @yongweichen001

Toad profil fotoğrafı
Toad1 yıl önce

how many Mac minis do I need to run it?

E Schneider profil fotoğrafı
E Schneider1 yıl önce

Impressive work on SAR3D! I'm excited to see how this novel framework will advance 3D object generation and understanding.

Benzer Videolar

Introducing 3D Projections & Noise Effects - Wrap layers into 3D objects - Perspective and lighting - Noise Glass + Distortion Available on Spline Hana now.
0:36

Introducing 3D Projections & Noise Effects - Wrap layers into 3D objects - Perspective and lighting - Noise Glass + Distortion Available on Spline Hana now.

Spline

63,270 görüntüleme • 11 ay önce

Introducing SAM 3D, the newest addition to the SAM collection, bringing common sense 3D understanding of everyday images. SAM 3D includes two models: 🛋️ SAM 3D Objects for object and scene reconstruction 🧑‍🤝‍🧑 SAM 3D Body for human pose and shape estimation Both models achieve state-of-the-art performance transforming static 2D images into vivid, accurate reconstructions. 🔗 Learn more:
0:50

Introducing SAM 3D, the newest addition to the SAM collection, bringing common sense 3D understanding of everyday images. SAM 3D includes two models: 🛋️ SAM 3D Objects for object and scene reconstruction 🧑‍🤝‍🧑 SAM 3D Body for human pose and shape estimation Both models achieve state-of-the-art performance transforming static 2D images into vivid, accurate reconstructions. 🔗 Learn more:

AI at Meta

859,533 görüntüleme • 8 ay önce

SAM 3D enables accurate 3D reconstruction from a single image, supporting real-world applications in editing, robotics, and interactive scene generation. Matt, a SAM 3D researcher, explains how the two-model design makes this possible for both people and complex environments. 🔗 Read the SAM 3D Objects research paper: 🔗 Read the SAM 3D Body research paper:
1:54

SAM 3D enables accurate 3D reconstruction from a single image, supporting real-world applications in editing, robotics, and interactive scene generation. Matt, a SAM 3D researcher, explains how the two-model design makes this possible for both people and complex environments. 🔗 Read the SAM 3D Objects research paper: 🔗 Read the SAM 3D Body research paper:

AI at Meta

17,858 görüntüleme • 8 ay önce

3D Gaussian Splats are cool, but they're static (Part 25). DG-Mesh can reconstruct high-quality and time-consistent 3D meshes from a single video and track mesh vertices over time, which enables texture editing on dynamic objects.
0:22

3D Gaussian Splats are cool, but they're static (Part 25). DG-Mesh can reconstruct high-quality and time-consistent 3D meshes from a single video and track mesh vertices over time, which enables texture editing on dynamic objects.

Dreaming Tulpa 🥓👑

79,033 görüntüleme • 2 yıl önce

We are thrilled to announce a major upgrade to our open-source 3D generation model, introducing two groundbreaking new versions: 3D 2.0 MV (Multi-View Generation) and 3D 2.0 Mini! 3D 2.0 MV : 3D 2.0Mini:
0:39

We are thrilled to announce a major upgrade to our open-source 3D generation model, introducing two groundbreaking new versions: 3D 2.0 MV (Multi-View Generation) and 3D 2.0 Mini! 3D 2.0 MV : 3D 2.0Mini:

Tencent HY

134,410 görüntüleme • 1 yıl önce

3D arrived to Krea. this new feature lets you turn images into 3D objects and use them in our Real-time tool. free for everyone.
0:26

3D arrived to Krea. this new feature lets you turn images into 3D objects and use them in our Real-time tool. free for everyone.

Krea

665,686 görüntüleme • 1 yıl önce

LLaVA-3D A Simple yet Effective Pathway to Empowering LMMs with 3D-awareness Recent advancements in Large Multimodal Models (LMMs) have greatly enhanced their proficiency in 2D visual understanding tasks, enabling them to effectively process and understand images and videos. However, the development of LMMs with 3D-awareness for 3D scene understanding has been hindered by the lack of large-scale 3D vision-language datasets and powerful 3D encoders. In this paper, we introduce a simple yet effective framework called LLaVA-3D. Leveraging the strong 2D understanding priors from LLaVA, our LLaVA-3D efficiently adapts LLaVA for 3D scene understanding without compromising 2D understanding capabilities. To achieve this, we employ a simple yet effective representation, 3D Patch, which connects 2D CLIP patch features with their corresponding positions in 3D space. By integrating the 3D Patches into 2D LMMs and employing joint 2D and 3D vision-language instruction tuning, we establish a unified architecture for both 2D image understanding and 3D scene understanding. Experimental results show that LLaVA-3D converges 3.5x faster than existing 3D LMMs when trained on 3D vision-language datasets. Moreover, LLaVA-3D not only achieves state-of-the-art performance across various 3D tasks but also maintains comparable 2D image understanding and vision-language conversation capabilities with LLaVA.
0:31

LLaVA-3D A Simple yet Effective Pathway to Empowering LMMs with 3D-awareness Recent advancements in Large Multimodal Models (LMMs) have greatly enhanced their proficiency in 2D visual understanding tasks, enabling them to effectively process and understand images and videos. However, the development of LMMs with 3D-awareness for 3D scene understanding has been hindered by the lack of large-scale 3D vision-language datasets and powerful 3D encoders. In this paper, we introduce a simple yet effective framework called LLaVA-3D. Leveraging the strong 2D understanding priors from LLaVA, our LLaVA-3D efficiently adapts LLaVA for 3D scene understanding without compromising 2D understanding capabilities. To achieve this, we employ a simple yet effective representation, 3D Patch, which connects 2D CLIP patch features with their corresponding positions in 3D space. By integrating the 3D Patches into 2D LMMs and employing joint 2D and 3D vision-language instruction tuning, we establish a unified architecture for both 2D image understanding and 3D scene understanding. Experimental results show that LLaVA-3D converges 3.5x faster than existing 3D LMMs when trained on 3D vision-language datasets. Moreover, LLaVA-3D not only achieves state-of-the-art performance across various 3D tasks but also maintains comparable 2D image understanding and vision-language conversation capabilities with LLaVA.

AK

41,736 görüntüleme • 1 yıl önce

Today we’re excited to unveil a new generation of Segment Anything Models: 1️⃣ SAM 3 enables detecting, segmenting and tracking of objects across images and videos, now with short text phrases and exemplar prompts. 🔗 Learn more about SAM 3: 2️⃣ SAM 3D brings the model collection into the 3rd dimension to enable precise reconstruction of 3D objects and people from a single 2D image. 🔗 Learn more about SAM 3D: These models offer innovative capabilities and unique tools for developers and researchers to create, experiment and uplevel media workflows.
0:34

Today we’re excited to unveil a new generation of Segment Anything Models: 1️⃣ SAM 3 enables detecting, segmenting and tracking of objects across images and videos, now with short text phrases and exemplar prompts. 🔗 Learn more about SAM 3: 2️⃣ SAM 3D brings the model collection into the 3rd dimension to enable precise reconstruction of 3D objects and people from a single 2D image. 🔗 Learn more about SAM 3D: These models offer innovative capabilities and unique tools for developers and researchers to create, experiment and uplevel media workflows.

AI at Meta

1,089,231 görüntüleme • 8 ay önce

Ruven Bals 3D prints objects inspired by origami and science. This is a gear ball. [📹 ruven_bals]
0:36

Ruven Bals 3D prints objects inspired by origami and science. This is a gear ball. [📹 ruven_bals]

Massimo

598,227 görüntüleme • 2 yıl önce

Your next 3D photo shoot will be done with AI 3D Scenes generates full environments from any image → Place your objects in the scene → Move the camera like a real shoot → Consistent lightning and detail across every angle Available now on Freepik 👇
0:26

Your next 3D photo shoot will be done with AI 3D Scenes generates full environments from any image → Place your objects in the scene → Move the camera like a real shoot → Consistent lightning and detail across every angle Available now on Freepik 👇

Magnific

325,688 görüntüleme • 4 ay önce

VAST AI releases Triplane Meets Gaussian Splatting on Hugging Face Fast and Generalizable Single-View 3D Reconstruction with Transformers demo: TGS enables fast reconstruction from single-view image. It builds the 3D representation upon a hybrid Triplane-Gaussian representation by evaluating a transformer-based framework, from which 3D Gaussians would be decoded
0:23

VAST AI releases Triplane Meets Gaussian Splatting on Hugging Face Fast and Generalizable Single-View 3D Reconstruction with Transformers demo: TGS enables fast reconstruction from single-view image. It builds the 3D representation upon a hybrid Triplane-Gaussian representation by evaluating a transformer-based framework, from which 3D Gaussians would be decoded

AK

113,226 görüntüleme • 2 yıl önce

DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior paper page: present DreamCraft3D, a hierarchical 3D content generation method that produces high-fidelity and coherent 3D objects. We tackle the problem by leveraging a 2D reference image to guide the stages of geometry sculpting and texture boosting. A central focus of this work is to address the consistency issue that existing works encounter. To sculpt geometries that render coherently, we perform score distillation sampling via a view-dependent diffusion model. This 3D prior, alongside several training strategies, prioritizes the geometry consistency but compromises the texture fidelity. We further propose Bootstrapped Score Distillation to specifically boost the texture. We train a personalized diffusion model, Dreambooth, on the augmented renderings of the scene, imbuing it with 3D knowledge of the scene being optimized. The score distillation from this 3D-aware diffusion prior provides view-consistent guidance for the scene. Notably, through an alternating optimization of the diffusion prior and 3D scene representation, we achieve mutually reinforcing improvements: the optimized 3D scene aids in training the scene-specific diffusion model, which offers increasingly view-consistent guidance for 3D optimization. The optimization is thus bootstrapped and leads to substantial texture boosting. With tailored 3D priors throughout the hierarchical generation, DreamCraft3D generates coherent 3D objects with photorealistic renderings, advancing the state-of-the-art in 3D content generation.
2:32

DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior paper page: present DreamCraft3D, a hierarchical 3D content generation method that produces high-fidelity and coherent 3D objects. We tackle the problem by leveraging a 2D reference image to guide the stages of geometry sculpting and texture boosting. A central focus of this work is to address the consistency issue that existing works encounter. To sculpt geometries that render coherently, we perform score distillation sampling via a view-dependent diffusion model. This 3D prior, alongside several training strategies, prioritizes the geometry consistency but compromises the texture fidelity. We further propose Bootstrapped Score Distillation to specifically boost the texture. We train a personalized diffusion model, Dreambooth, on the augmented renderings of the scene, imbuing it with 3D knowledge of the scene being optimized. The score distillation from this 3D-aware diffusion prior provides view-consistent guidance for the scene. Notably, through an alternating optimization of the diffusion prior and 3D scene representation, we achieve mutually reinforcing improvements: the optimized 3D scene aids in training the scene-specific diffusion model, which offers increasingly view-consistent guidance for 3D optimization. The optimization is thus bootstrapped and leads to substantial texture boosting. With tailored 3D priors throughout the hierarchical generation, DreamCraft3D generates coherent 3D objects with photorealistic renderings, advancing the state-of-the-art in 3D content generation.

AK

161,530 görüntüleme • 2 yıl önce

Our Robotic Foundation Model, trained on data from real-world warehouse operations and simulated scenarios, enables our robots to identify objects, understand 3D spaces, and predict optimal grasping and placement.
0:28

Our Robotic Foundation Model, trained on data from real-world warehouse operations and simulated scenarios, enables our robots to identify objects, understand 3D spaces, and predict optimal grasping and placement.

Covariant

33,706 görüntüleme • 1 yıl önce

Current 3D generative models are slow and low quality. We present GRM, a large-scale model that reconstructs 3D Gaussians in 0.1s and generates high-quality 3D assets from text or single images in a few seconds. Demo: 1/4
0:37

Current 3D generative models are slow and low quality. We present GRM, a large-scale model that reconstructs 3D Gaussians in 0.1s and generates high-quality 3D assets from text or single images in a few seconds. Demo: 1/4

Gordon Wetzstein

19,210 görüntüleme • 2 yıl önce

Amodal3R: Amodal 3D Reconstruction from Occluded 2D Images TL;DR: Given partially visible objects within images, Amodal3R reconstructs semantically meaningful 3D assets with reasonable geometry and plausible appearance.
1:16

Amodal3R: Amodal 3D Reconstruction from Occluded 2D Images TL;DR: Given partially visible objects within images, Amodal3R reconstructs semantically meaningful 3D assets with reasonable geometry and plausible appearance.

Alexandre Morgand

23,300 görüntüleme • 1 yıl önce

If you’ve been curious about the intersection of AI, 3D and gaming, then this 18 min video is for you: 0:00 Status Quo 1:54 Next Gen 2:55 Dynamic 3D Scenes 6:01 Large Scale 3D 11:10 Interactive 3D Worlds 14:07 Films 🤝 Games 16:35 Jensen's Prediction
18:00

If you’ve been curious about the intersection of AI, 3D and gaming, then this 18 min video is for you: 0:00 Status Quo 1:54 Next Gen 2:55 Dynamic 3D Scenes 6:01 Large Scale 3D 11:10 Interactive 3D Worlds 14:07 Films 🤝 Games 16:35 Jensen's Prediction

Bilawal Sidhu

61,498 görüntüleme • 1 yıl önce

Gemini 3.0 Pro is at great 3D design and front-end. It can generate complex 3D scenes and Three.js objects from text prompts. Here's a nice retro-future example from cris.
0:37

Gemini 3.0 Pro is at great 3D design and front-end. It can generate complex 3D scenes and Three.js objects from text prompts. Here's a nice retro-future example from cris.

Addy Osmani

90,189 görüntüleme • 7 ay önce

📢Introducing 360Anything, our method for lifting any perspective image or video to gravity-aligned 360° panoramas without using any camera or 3D information. This enables consistent novel view synthesis and 3D scene reconstruction. Project page: 🧵
1:05

📢Introducing 360Anything, our method for lifting any perspective image or video to gravity-aligned 360° panoramas without using any camera or 3D information. This enables consistent novel view synthesis and 3D scene reconstruction. Project page: 🧵

Ziyi Wu

62,594 görüntüleme • 6 ay önce

.Dedouze 🧢 Andry has previewed a new Blender add-on for animating 3D objects and armatures, inspired by traditional 2D animation. See more and try it out in beta: #blender #blender3d #b3d #blendercommunity #3danimation #animation #3d #3dart #3dcg
0:25

.Dedouze 🧢 Andry has previewed a new Blender add-on for animating 3D objects and armatures, inspired by traditional 2D animation. See more and try it out in beta: #blender #blender3d #b3d #blendercommunity #3danimation #animation #3d #3dart #3dcg

80 LEVEL

40,063 görüntüleme • 1 yıl önce

How good is Tencent HY 3D 2.1 - Tencent’s new generative 3D model? Honestly, it’s impressive. I generated these 16 objects and rendered them in Blender, check out the results below! 👇
0:56

How good is Tencent HY 3D 2.1 - Tencent’s new generative 3D model? Honestly, it’s impressive. I generated these 16 objects and rendered them in Blender, check out the results below! 👇

Emm | scenario.com

43,157 görüntüleme • 1 yıl önce