Загрузка видео...

Не удалось загрузить видео

Возникла проблема при загрузке этого видео. Это может быть связано с временными проблемами сети или видео может быть недоступно.

На главную

C++ code is out! The Signed Heat Method has been added to geometry-central. In 3D, compute generalized SDFs to point clouds, triangle meshes, and polygon meshes. The method should "just work" on geometry with holes, intersections, nonmanifold-ness, etc. Links below 🔽

Nicole Feng

1,573 subscribers

56,909 просмотров • 2 лет назад •via X (Twitter)

Образование Наука и технологии

Anya Rossi• Live Now

Private livecam show

Комментарии: 10

Фото профиля Nicole Feng

Nicole Feng2 лет назад

Demo projects here: The demo projects let you try things out right away: load your own data, play around with constraints, export solutions. I also included a Blender file with the shader I used to make our paper figures. Enjoy!

Фото профиля Nicole Feng

Nicole Feng2 лет назад

Main X thread here: Paper and project here:

Фото профиля Nicole Feng

Nicole Feng2 лет назад

FYI shoutout to Chris Yu and Nick Sharp (@nmwsharp) for developing the awesome volume grid/tet visualization features in Polyscope.

Фото профиля Hayden

Hayden2 лет назад

sick

Фото профиля Hugo Elias

Hugo Elias2 лет назад

very cool, I love the idea & the paper! SDFs 💞

Фото профиля Dan Brickley

Dan Brickley2 лет назад

Do the point cloud methods make sense for 3D Gaussian splats?

Фото профиля Nicole Feng

Nicole Feng2 лет назад

Haven't tried gaussian splats, but in principle the method should work as you have normals for the geometry - which for gaussians might be done by taking a gradient where you've deemed your zero level set surface to be. Might be some finicky details to figure out.

Фото профиля Ronal Dragon

Ronal Dragon2 лет назад

incredible! I'll see if I can replace CGAL's AlphaWrap with it (for offset surfaces)

Фото профиля Kiaran Ritchie

Kiaran Ritchie2 лет назад

Amazing. I could use this.

Фото профиля 木十

木十2 лет назад

wow

Похожие видео

Nvidia presents EdgeRunner! The method can generate high-quality 3D meshes with up to 4,000 faces at a spatial resolution of 512 from images and point-clouds.

Nvidia presents EdgeRunner! The method can generate high-quality 3D meshes with up to 4,000 faces at a spatial resolution of 512 from images and point-clouds.

Dreaming Tulpa 🥓👑

173,236 просмотров • 1 год назад

Super clean and efficient meshes by an AI? YES! The typical 3D Generative AI solutions produce lots of artifacts and usually way to many polygons due to volumetric approaches. In comparison “MeshGPT creates triangle meshes by autoregressively sampling from a transformer model that has been trained to produce tokens from a learned geometric vocabulary. These tokens can then be decoded into the faces of a triangle mesh. This method generates clean, coherent, and compact meshes, characterized by sharp edges and high fidelity.” Surely it is limited by the trained vocabulary but various versions can be trained for specific sets to create generative model libraries for certain object groups. Very promising approach with the high quality.

Super clean and efficient meshes by an AI? YES! The typical 3D Generative AI solutions produce lots of artifacts and usually way to many polygons due to volumetric approaches. In comparison “MeshGPT creates triangle meshes by autoregressively sampling from a transformer model that has been trained to produce tokens from a learned geometric vocabulary. These tokens can then be decoded into the faces of a triangle mesh. This method generates clean, coherent, and compact meshes, characterized by sharp edges and high fidelity.” Surely it is limited by the trained vocabulary but various versions can be trained for specific sets to create generative model libraries for certain object groups. Very promising approach with the high quality.

René Schulte

20,772 просмотров • 2 лет назад

Adobe is entering the image-to-3D game! Their new method, LRM, can create high-fidelity 3D meshes from a single image in just 5 seconds 🔥 It's trained on 1 million objects and is able to generate objects from real-world images and generative AI models.

Adobe is entering the image-to-3D game! Their new method, LRM, can create high-fidelity 3D meshes from a single image in just 5 seconds 🔥 It's trained on 1 million objects and is able to generate objects from real-world images and generative AI models.

Dreaming Tulpa 🥓👑

270,942 просмотров • 2 лет назад

🔥 HUGE: Today, we are thrilled to unveil a massive breakthrough in AI and 3D: ✨Introducing Primfusion v0 💫 For the first time ever in 3D, easily convert your 3D meshes, scans, and high-poly models into easy-to-edit, goopy primitives in Womp. Trained solely on geometry principles, never your style. Join the waitlist ➡️ Questions/Concerns? Check out our FAQ ➡️ #womp3d #3dmodeling

🔥 HUGE: Today, we are thrilled to unveil a massive breakthrough in AI and 3D: ✨Introducing Primfusion v0 💫 For the first time ever in 3D, easily convert your 3D meshes, scans, and high-poly models into easy-to-edit, goopy primitives in Womp. Trained solely on geometry principles, never your style. Join the waitlist ➡️ Questions/Concerns? Check out our FAQ ➡️ #womp3d #3dmodeling

Womp

136,303 просмотров • 2 лет назад

DeepMesh is out on Hugging Face Auto-Regressive Artist-mesh Creation with Reinforcement Learning Conditioned on point clouds and images, DeepMesh generates meshes with intricate details and precise topology, outperforming state-of-the-art methods in both precision and quality.

DeepMesh is out on Hugging Face Auto-Regressive Artist-mesh Creation with Reinforcement Learning Conditioned on point clouds and images, DeepMesh generates meshes with intricate details and precise topology, outperforming state-of-the-art methods in both precision and quality.

AK

109,272 просмотров • 1 год назад

Restricted: Sublevel Quarantine is an environment project by Lead Environment Artist Doru Bogdan and inspired by the Metro game series. The creation utilizes UE5's MegaLights, Nanite Displacement, Texture Blending and more 🚧 "My spline-based tunnel modular meshes kept flickering and distorting from a distance. I thought it needed more geometry, but no matter how many subdivisions I added, it stayed broken. Nothing worked. Turns out, the meshes were too straight and uniform! Nanite didn't like the perfectly flat surfaces. Adding a little random noise to the mesh geometry fixed the breakdown completely. Sometimes, perfection is the problem" - Doru Bogdan

Restricted: Sublevel Quarantine is an environment project by Lead Environment Artist Doru Bogdan and inspired by the Metro game series. The creation utilizes UE5's MegaLights, Nanite Displacement, Texture Blending and more 🚧 "My spline-based tunnel modular meshes kept flickering and distorting from a distance. I thought it needed more geometry, but no matter how many subdivisions I added, it stayed broken. Nothing worked. Turns out, the meshes were too straight and uniform! Nanite didn't like the perfectly flat surfaces. Adding a little random noise to the mesh geometry fixed the breakdown completely. Sometimes, perfection is the problem" - Doru Bogdan

Unreal Engine

19,732 просмотров • 12 дней назад

To support massive, high-fidelity worlds, our engine implements an efficient LOD strategy with a cloud transcoding system that streams meshes and textures, even on lower end mobile devices. We are expanding this framework to AI upsampling of 3D worlds from prompts. In this preview video below, with a single user prompt, our 3D upsampling technology updates the geometry and texture to transform the classic Roblox game Crossroads into a fantasy world with rich organic detail. 3/4

To support massive, high-fidelity worlds, our engine implements an efficient LOD strategy with a cloud transcoding system that streams meshes and textures, even on lower end mobile devices. We are expanding this framework to AI upsampling of 3D worlds from prompts. In this preview video below, with a single user prompt, our 3D upsampling technology updates the geometry and texture to transform the classic Roblox game Crossroads into a fantasy world with rich organic detail. 3/4

Roblox

1,424,534 просмотров • 7 месяцев назад

📢Happy to present Convex Splatting, a novel way for 3D reconstruction based on 3D smooth convexes. For the first time, a splatting-based method reaches the quality of NeRF sota methods but with real-time rendering and few primitives!! I expect this to replace Gaussian splatting for 3D in the coming months. CODE RELEASED TODAY! joint work with collaborators from Université de Liège Visual Geometry Group (VGG) , KAUST Computer Vision Lab (IVUL) a thread 🧵 1/n

📢Happy to present Convex Splatting, a novel way for 3D reconstruction based on 3D smooth convexes. For the first time, a splatting-based method reaches the quality of NeRF sota methods but with real-time rendering and few primitives!! I expect this to replace Gaussian splatting for 3D in the coming months. CODE RELEASED TODAY! joint work with collaborators from Université de Liège Visual Geometry Group (VGG) , KAUST Computer Vision Lab (IVUL) a thread 🧵 1/n

Abdullah Hamdi

71,661 просмотров • 1 год назад

Curve hair, but you can set different meshes per curve strand! And have options to adjust them. And its using the flat wrapping method so its easy to work with! This is the hair workflow i've wanted for over 7 years, and it can finally be built #b3d

Curve hair, but you can set different meshes per curve strand! And have options to adjust them. And its using the flat wrapping method so its easy to work with! This is the hair workflow i've wanted for over 7 years, and it can finally be built #b3d

aVersionOfReality

147,973 просмотров • 3 лет назад

Introducing V-DPM, for 4D reconstruction of in-the-wild videos. We build on top of VGGT, using Dynamic Point Maps for jointly representing 3D and motion. Joint work with: Eldar Insafutdinov , Lai Zihang , and Andrea Vedaldi. Visual Geometry Group (VGG). Check out the demo and code 👇

Introducing V-DPM, for 4D reconstruction of in-the-wild videos. We build on top of VGGT, using Dynamic Point Maps for jointly representing 3D and motion. Joint work with: Eldar Insafutdinov , Lai Zihang , and Andrea Vedaldi. Visual Geometry Group (VGG). Check out the demo and code 👇

Edgar Sucar

25,818 просмотров • 8 месяцев назад

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!

Santiago

65,446 просмотров • 5 месяцев назад

An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusion discuss: We introduce a new approach for generating realistic 3D models with UV maps through a representation termed "Object Images." This approach encapsulates surface geometry, appearance, and patch structures within a 64x64 pixel image, effectively converting complex 3D shapes into a more manageable 2D format. By doing so, we address the challenges of both geometric and semantic irregularity inherent in polygonal meshes. This method allows us to use image generation models, such as Diffusion Transformers, directly for 3D shape generation. Evaluated on the ABO dataset, our generated shapes with patch structures achieve point cloud FID comparable to recent 3D generative models, while naturally supporting PBR material generation.

An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusion discuss: We introduce a new approach for generating realistic 3D models with UV maps through a representation termed "Object Images." This approach encapsulates surface geometry, appearance, and patch structures within a 64x64 pixel image, effectively converting complex 3D shapes into a more manageable 2D format. By doing so, we address the challenges of both geometric and semantic irregularity inherent in polygonal meshes. This method allows us to use image generation models, such as Diffusion Transformers, directly for 3D shape generation. Evaluated on the ABO dataset, our generated shapes with patch structures achieve point cloud FID comparable to recent 3D generative models, while naturally supporting PBR material generation.

AK

66,717 просмотров • 2 лет назад

"#AI will never create clean meshes" AI 👇 This is the new #AI model from NVIDIA called Meshtron (jeez what a name 😅). It generates meshes of complex 3D objects closely resembling those created by professional artists. It opens the door to a more realistic generation of detailed 3D assets for animation, gaming, and virtual environments. The current version accepts the following control inputs: - Point cloud: Determines the shape of the output mesh. - Face count: Determines the density of the output mesh. - Quad ratio: Switches between quad and triangle tessellation. - Creativity: Can be adjusted to generate extra details in the model. Meshtron can either serve as a stand-alone remesher to improve the quality of existing models, or be used in tandem with a text-to-3D or image-to-3D model to generate artist-grade meshes from scratch.

"#AI will never create clean meshes" AI 👇 This is the new #AI model from NVIDIA called Meshtron (jeez what a name 😅). It generates meshes of complex 3D objects closely resembling those created by professional artists. It opens the door to a more realistic generation of detailed 3D assets for animation, gaming, and virtual environments. The current version accepts the following control inputs: - Point cloud: Determines the shape of the output mesh. - Face count: Determines the density of the output mesh. - Quad ratio: Switches between quad and triangle tessellation. - Creativity: Can be adjusted to generate extra details in the model. Meshtron can either serve as a stand-alone remesher to improve the quality of existing models, or be used in tandem with a text-to-3D or image-to-3D model to generate artist-grade meshes from scratch.

Gabriele Romagnoli

2,177,587 просмотров • 1 год назад

Unreal Engine asset packs are about to be worthless. Tencent just shipped HY-World 2.0. You type one sentence. It outputs a real 3D scene with meshes, point clouds, and 3DGS that drags straight into your game engine. Renders in real time on a consumer GPU. Phone video in, digital twin out, one forward pass. The marketplace economy of selling 3D assets just had its Napster moment.

Unreal Engine asset packs are about to be worthless. Tencent just shipped HY-World 2.0. You type one sentence. It outputs a real 3D scene with meshes, point clouds, and 3DGS that drags straight into your game engine. Renders in real time on a consumer GPU. Phone video in, digital twin out, one forward pass. The marketplace economy of selling 3D assets just had its Napster moment.

Ihtesham Ali

45,956 просмотров • 4 месяцев назад

🦊Fara Rex V3 Mod is out! - Updated to 1.5 Rex - Quest Compatible - Reduced triangle count - Improved crotch weight and geometry - Body fluff - Corrective blend shapes Get it for FREE on the Rexouium Discord! Links and more on my Gumroad page

🦊Fara Rex V3 Mod is out! - Updated to 1.5 Rex - Quest Compatible - Reduced triangle count - Improved crotch weight and geometry - Body fluff - Corrective blend shapes Get it for FREE on the Rexouium Discord! Links and more on my Gumroad page

Fara

35,801 просмотров • 3 лет назад

Thrilled to share our new work on Reconviagen✨! A key challenge in 3D creation is the alignment of generative 3D with observational input. Our method solves this by grounding the generative process in 3D reconstruction. Try it at: #Reconstruction #AIGC

Thrilled to share our new work on Reconviagen✨! A key challenge in 3D creation is the alignment of generative 3D with observational input. Our method solves this by grounding the generative process in 3D reconstruction. Try it at: #Reconstruction #AIGC

Chongjie Ye

11,624 просмотров • 1 год назад

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.

MrNeRF

27,354 просмотров • 2 лет назад

"Generate in Parts" just got better with "Split in Parts"! 🥹😇 Hervé Nivon added a toggle in the Scenario 3D viewer that instantly splits generated meshes into an exploded view. See how PartCrafted breaks down your model - no need to download and check in Blender anymore.

"Generate in Parts" just got better with "Split in Parts"! 🥹😇 Hervé Nivon added a toggle in the Scenario 3D viewer that instantly splits generated meshes into an exploded view. See how PartCrafted breaks down your model - no need to download and check in Blender anymore.

Emm | scenario.com

16,492 просмотров • 1 год назад

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors paper page: present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images.

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors paper page: present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images.

AK

305,704 просмотров • 3 лет назад