Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

DeepMesh is out on Hugging Face Auto-Regressive Artist-mesh Creation with Reinforcement Learning Conditioned on point clouds and images, DeepMesh generates meshes with intricate details and precise topology, outperforming state-of-the-art methods in both precision and quality.

AK

511,572 subscribers

109,201 views • 1 year ago •via X (Twitter)

Education Science & Technology

Anya Rossi• Live Now

Private livecam show

7 Comments

AK1 year ago

discuss:

AK1 year ago

model:

Yang1 year ago

Want to learn how practical AI skills and automations for your business and work? Check out our step-by-step video tutorials 100% FREE Hours of AI and Automation goodness absolutely free 🥳

Andrew R1 year ago

Get ready for a new 3d printing wave. Text to physical part

Tom Bennet1 year ago

DeepMesh on Hugging Face? Sounds like AI's new favorite toy! 🤖🎨 Testing a theory: Can this tech revolutionize not just art, but also how we approach complex problem-solving in business? What if we could 'mesh' our ideas with the same precision? Share your thoughts!

Universa1 year ago

@_akhaliq The integration of DeepMesh on Hugging Face is a significant milestone in the field of AI-driven mesh creation. Universa Earth is also exploring innovative applications of AI in various domains, including computer vision and machine learning.

Martin Høst Normark1 year ago

This seems almost identical to NVIDIA’s Meshtron paper by @davidwromero among others.

Related Videos

🚀Introducing Hunyuan3D-PolyGen, our newly upgraded and industry-first art-grade 3D generative model. It brings effortless intelligent retopology, making AI-generated models ready for professional art pipelines. ✅ Superior Mesh Topology: Our self-developed mesh autoregressive model ensures higher-quality mesh topology that meets stringent art standards. ✅ Complex Object Modeling: Leveraging our high-compression BPT representation, we can generate models with 10K+ faces, enabling more complex geometry, higher topology precision, and better detail. ✅ Flexible Output: Supports both tri and quad meshes, meeting diverse pipeline requirements. Hunyuan3D-PolyGen enables direct application of AI-generated 3D assets in game development and significantly boosts artist modeling efficiency. It's a robust foundation for the future of 3D content creation. 👉Try it now:

🚀Introducing Hunyuan3D-PolyGen, our newly upgraded and industry-first art-grade 3D generative model. It brings effortless intelligent retopology, making AI-generated models ready for professional art pipelines. ✅ Superior Mesh Topology: Our self-developed mesh autoregressive model ensures higher-quality mesh topology that meets stringent art standards. ✅ Complex Object Modeling: Leveraging our high-compression BPT representation, we can generate models with 10K+ faces, enabling more complex geometry, higher topology precision, and better detail. ✅ Flexible Output: Supports both tri and quad meshes, meeting diverse pipeline requirements. Hunyuan3D-PolyGen enables direct application of AI-generated 3D assets in game development and significantly boosts artist modeling efficiency. It's a robust foundation for the future of 3D content creation. 👉Try it now:

Tencent Hy

161,189 views • 1 year ago

Nvidia presents EdgeRunner! The method can generate high-quality 3D meshes with up to 4,000 faces at a spatial resolution of 512 from images and point-clouds.

Nvidia presents EdgeRunner! The method can generate high-quality 3D meshes with up to 4,000 faces at a spatial resolution of 512 from images and point-clouds.

Dreaming Tulpa 🥓👑

173,103 views • 1 year ago

LFM2-Audio just dropped! It's a 1.5B model that understands and generates both text and audio Inference 10x faster + quality on par with models 10x larger Available today on Hugging Face and our playground 🥳

LFM2-Audio just dropped! It's a 1.5B model that understands and generates both text and audio Inference 10x faster + quality on par with models 10x larger Available today on Hugging Face and our playground 🥳

Maxime Labonne

84,952 views • 9 months ago

🚀🚀🚀Hunyuan 3D Studio just leveled up to 1.1! We've integrated the art-grade 3D generative model, Hunyuan 3D-PolyGen 1.5, to deliver the industry's most advanced mesh quality directly to your workflow. 🎨 🖌️ Art-Grade Quad Mesh: We've pioneered an end-to-end native quad mesh generation method. Unlike older methods that generated only tri-meshes, PolyGen 1.5 directly learns quad topology to produce cleaner, continuous edge loops and superior wireframe quality. 🎮 Professional Viability: Achieving this topology standard makes models instantly production-ready for game artists, 3D designers, and developers across game development, animation, and VR content creation. ⚙️ Flexible Output: PolyGen 1.5 supports both Quad and Triangular Topology, ensuring viability for both soft-surface and hard-surface models in professional pipelines. PolyGen 1.5 sets a new SOTA in stability, detail, and wireframe quality. Explore Hunyuan 3D Studio 1.1 and see the results:

🚀🚀🚀Hunyuan 3D Studio just leveled up to 1.1! We've integrated the art-grade 3D generative model, Hunyuan 3D-PolyGen 1.5, to deliver the industry's most advanced mesh quality directly to your workflow. 🎨 🖌️ Art-Grade Quad Mesh: We've pioneered an end-to-end native quad mesh generation method. Unlike older methods that generated only tri-meshes, PolyGen 1.5 directly learns quad topology to produce cleaner, continuous edge loops and superior wireframe quality. 🎮 Professional Viability: Achieving this topology standard makes models instantly production-ready for game artists, 3D designers, and developers across game development, animation, and VR content creation. ⚙️ Flexible Output: PolyGen 1.5 supports both Quad and Triangular Topology, ensuring viability for both soft-surface and hard-surface models in professional pipelines. PolyGen 1.5 sets a new SOTA in stability, detail, and wireframe quality. Explore Hunyuan 3D Studio 1.1 and see the results:

Tencent Hy

146,221 views • 7 months ago

StarVector is out on Hugging Face StarVector is a foundation model for generating Scalable Vector Graphics (SVG) code from images and text. It utilizes a Vision-Language Modeling architecture to understand both visual and textual inputs, enabling high-quality vectorization and text-guided SVG creation.

StarVector is out on Hugging Face StarVector is a foundation model for generating Scalable Vector Graphics (SVG) code from images and text. It utilizes a Vision-Language Modeling architecture to understand both visual and textual inputs, enabling high-quality vectorization and text-guided SVG creation.

AK

254,300 views • 1 year ago

Meta just released MusicGen, a simple and controllable model for music generation MusicGen is a single stage auto-regressive Transformer model trained over a 32kHz EnCodec tokenizer with 4 codebooks sampled at 50 Hz. Unlike existing methods like MusicLM, MusicGen doesn't not require a self-supervised semantic representation, and it generates all 4 codebooks in one pass. By introducing a small delay between the codebooks, can predict them in parallel, thus having only 50 auto-regressive steps per second of audio try out the Gradio demo: Models on Hugging Face: github:

Sensitive content

Meta just released MusicGen, a simple and controllable model for music generation MusicGen is a single stage auto-regressive Transformer model trained over a 32kHz EnCodec tokenizer with 4 codebooks sampled at 50 Hz. Unlike existing methods like MusicLM, MusicGen doesn't not require a self-supervised semantic representation, and it generates all 4 codebooks in one pass. By introducing a small delay between the codebooks, can predict them in parallel, thus having only 50 auto-regressive steps per second of audio try out the Gradio demo: Models on Hugging Face: github:

AK

627,450 views • 3 years ago

Want high-quality 3D meshes with sharp geometric details? Try our newly released MeshFormer! It only takes 8 GPUs for two days of training, outperforming state-of-the-art models that use over a hundred GPUs! With 3D-native input guidance, representations, supervision, and post-processing, we significantly improve the training efficiency and geometric quality of feed-forward reconstruction models! Project page: Chong Zeng

Want high-quality 3D meshes with sharp geometric details? Try our newly released MeshFormer! It only takes 8 GPUs for two days of training, outperforming state-of-the-art models that use over a hundred GPUs! With 3D-native input guidance, representations, supervision, and post-processing, we significantly improve the training efficiency and geometric quality of feed-forward reconstruction models! Project page: Chong Zeng

Minghua Liu

16,340 views • 1 year ago

Introducing ChatGPT Images 2.0 A state-of-the-art image model that can take on complex visual tasks and produce precise, immediately usable visuals, with sharper editing, richer layouts, and thinking-level intelligence. Video made with ChatGPT Images

Introducing ChatGPT Images 2.0 A state-of-the-art image model that can take on complex visual tasks and produce precise, immediately usable visuals, with sharper editing, richer layouts, and thinking-level intelligence. Video made with ChatGPT Images

OpenAI

12,889,774 views • 2 months ago

New AI research from Meta – CoTracker3 Simpler and Better Point Tracking by Pseudo-Labelling Real Videos. More details ➡️ Demo on Hugging Face ➡️ Building on our previous work on CoTracker, this new model demonstrates impressive tracking results where points can be tracked for a long time even when they're occluded or leave the field of view. CoTracker3 achieves state-of-the-art, outperforming all recent point tracking approaches on standard benchmarks — often by a substantial margin. We've released the research paper, code and a demo on Hugging Face — along with models available under an A-NC license to support further research in this space.

New AI research from Meta – CoTracker3 Simpler and Better Point Tracking by Pseudo-Labelling Real Videos. More details ➡️ Demo on Hugging Face ➡️ Building on our previous work on CoTracker, this new model demonstrates impressive tracking results where points can be tracked for a long time even when they're occluded or leave the field of view. CoTracker3 achieves state-of-the-art, outperforming all recent point tracking approaches on standard benchmarks — often by a substantial margin. We've released the research paper, code and a demo on Hugging Face — along with models available under an A-NC license to support further research in this space.

AI at Meta

218,966 views • 1 year ago

$Released my new Blender addon. Extrude simple vertex guides on a mesh and it generates piping with clean intersections and topology. Used it to model webbing in a fraction of the time it takes manually. Does most of the work and has hella shaping options.$

Released my new Blender addon. Extrude simple vertex guides on a mesh and it generates piping with clean intersections and topology. Used it to model webbing in a fraction of the time it takes manually. Does most of the work and has hella shaping options.

Agro

40,201 views • 14 days ago

C++ code is out! The Signed Heat Method has been added to geometry-central. In 3D, compute generalized SDFs to point clouds, triangle meshes, and polygon meshes. The method should "just work" on geometry with holes, intersections, nonmanifold-ness, etc. Links below 🔽

C++ code is out! The Signed Heat Method has been added to geometry-central. In 3D, compute generalized SDFs to point clouds, triangle meshes, and polygon meshes. The method should "just work" on geometry with holes, intersections, nonmanifold-ness, etc. Links below 🔽

Nicole Feng

56,725 views • 1 year ago

We are thrilled to release the next leap in art-grade 3D generative models. Our single-click model pipeline gives unprecedented mesh outputs, with mesh parts-based topology. It is available now for all Cube tiers to start for free. ☑️ Our multi-stage hierarchical AI models produce a fully assembled 3D mesh with adaptive poly-counts, providing the clean, separated topology you need. ✅ A parts-based approach enables high-resolution meshes. 🌐 Quad and Triangle mesh support. Access now:

We are thrilled to release the next leap in art-grade 3D generative models. Our single-click model pipeline gives unprecedented mesh outputs, with mesh parts-based topology. It is available now for all Cube tiers to start for free. ☑️ Our multi-stage hierarchical AI models produce a fully assembled 3D mesh with adaptive poly-counts, providing the clean, separated topology you need. ✅ A parts-based approach enables high-resolution meshes. 🌐 Quad and Triangle mesh support. Access now:

Common Sense Machines

420,323 views • 1 year ago

"#AI will never create clean meshes" AI 👇 This is the new #AI model from NVIDIA called Meshtron (jeez what a name 😅). It generates meshes of complex 3D objects closely resembling those created by professional artists. It opens the door to a more realistic generation of detailed 3D assets for animation, gaming, and virtual environments. The current version accepts the following control inputs: - Point cloud: Determines the shape of the output mesh. - Face count: Determines the density of the output mesh. - Quad ratio: Switches between quad and triangle tessellation. - Creativity: Can be adjusted to generate extra details in the model. Meshtron can either serve as a stand-alone remesher to improve the quality of existing models, or be used in tandem with a text-to-3D or image-to-3D model to generate artist-grade meshes from scratch.

"#AI will never create clean meshes" AI 👇 This is the new #AI model from NVIDIA called Meshtron (jeez what a name 😅). It generates meshes of complex 3D objects closely resembling those created by professional artists. It opens the door to a more realistic generation of detailed 3D assets for animation, gaming, and virtual environments. The current version accepts the following control inputs: - Point cloud: Determines the shape of the output mesh. - Face count: Determines the density of the output mesh. - Quad ratio: Switches between quad and triangle tessellation. - Creativity: Can be adjusted to generate extra details in the model. Meshtron can either serve as a stand-alone remesher to improve the quality of existing models, or be used in tandem with a text-to-3D or image-to-3D model to generate artist-grade meshes from scratch.

Gabriele Romagnoli

2,176,749 views • 1 year ago

LiveCC just dropped on Hugging Face Learning Video LLM with Streaming Speech Transcription at Scale video LLM capable of real-time commentary, trained with a novel video-ASR streaming method, SOTA on both streaming and offline benchmarks.

LiveCC just dropped on Hugging Face Learning Video LLM with Streaming Speech Transcription at Scale video LLM capable of real-time commentary, trained with a novel video-ASR streaming method, SOTA on both streaming and offline benchmarks.

AK

45,967 views • 1 year ago

In order to get the best out of your data, you'll need to evaluate its quality 🔎 RealityScan 2.0 gives you access to the Quality Analysis feature, allowing you to assess tie point and mesh quality to identify areas where more images or attention is needed.

In order to get the best out of your data, you'll need to evaluate its quality 🔎 RealityScan 2.0 gives you access to the Quality Analysis feature, allowing you to assess tie point and mesh quality to identify areas where more images or attention is needed.

Unreal Engine

13,545 views • 1 year ago

From GMA: Meet the artist behind the NFL’s Super Bowl logo design 🙌🏾 Tahj Williams is showcasing Black Masking Indian culture and New Orleans culture with her intricate, hand-beaded creation of the Super Bowl LIX logo. #SuperBowl #art #culture #blackwomen #BlackExcellence

Black, Beautiful, & Blessed

12,141 views • 1 year ago

The way Source does decal projections on meshes is insane. They literally generate a subset overlay of the mesh being impacted on the spot. I want to try and do something like this with Roblox's EditableMesh feature.

The way Source does decal projections on meshes is insane. They literally generate a subset overlay of the mesh being impacted on the spot. I want to try and do something like this with Roblox's EditableMesh feature.

Max ¯\_(ツ)_/¯

12,015 views • 1 year ago

Introducing ✨RigidFormer: Learning Rigid Dynamics with Transformers - our attempt to scale learning-based physical dynamics with Transformers. RigidFormer learns rigid dynamics with Transformers. It is a mesh-free, object-centric Transformer for multi-object rigid-body contact dynamics from point clouds. Learning physics with purely neural simulators, without relying on traditional physics engines, is an important and widely studied problem. Prior SOTA methods often use graph neural networks for accuracy and generalization, but still struggle with efficient, high-fidelity simulation at scale. RigidFormer uses only point inputs, matches or outperforms mesh-based baselines on standard benchmarks, runs much faster, generalizes across point resolutions and datasets, and scales to 200+ objects. We also show a preliminary extension to command-conditioned articulated bodies by treating body parts as interacting object-level components. RigidFormer is mesh-free: it does not require mesh connectivity, SDFs, or vertex-level message passing, making it well-suited for point-cloud observations and scalable simulation. This architecture can also be adapted to learn soft-body dynamics by replacing the rigid-body module (differentiable Kabsch alignment). 🎬See our video for more details. Many thanks to my amazing collaborators: Minghao Guo Minghao Guo, Haixu Wu Haixu Wu 吴海旭, Doug Roble, Tuur Stuyck Tuur Stuyck, and Wojciech Matusik Wojciech Matusik. Project page: Paper:

Introducing ✨RigidFormer: Learning Rigid Dynamics with Transformers - our attempt to scale learning-based physical dynamics with Transformers. RigidFormer learns rigid dynamics with Transformers. It is a mesh-free, object-centric Transformer for multi-object rigid-body contact dynamics from point clouds. Learning physics with purely neural simulators, without relying on traditional physics engines, is an important and widely studied problem. Prior SOTA methods often use graph neural networks for accuracy and generalization, but still struggle with efficient, high-fidelity simulation at scale. RigidFormer uses only point inputs, matches or outperforms mesh-based baselines on standard benchmarks, runs much faster, generalizes across point resolutions and datasets, and scales to 200+ objects. We also show a preliminary extension to command-conditioned articulated bodies by treating body parts as interacting object-level components. RigidFormer is mesh-free: it does not require mesh connectivity, SDFs, or vertex-level message passing, making it well-suited for point-cloud observations and scalable simulation. This architecture can also be adapted to learn soft-body dynamics by replacing the rigid-body module (differentiable Kabsch alignment). 🎬See our video for more details. Many thanks to my amazing collaborators: Minghao Guo Minghao Guo, Haixu Wu Haixu Wu 吴海旭, Doug Roble, Tuur Stuyck Tuur Stuyck, and Wojciech Matusik Wojciech Matusik. Project page: Paper:

Zhiyang (Frank) Dou

571,726 views • 2 months ago

VIDEO | The PM SHRI Scheme is reshaping government school education in Gujarat by creating modern, future-ready learning environments aligned with the National Education Policy. With 463 PM SHRI schools across the state, students are benefiting from quality education, upgraded infrastructure, air-conditioned classrooms, modern sports facilities, solar-powered campuses, and a strong focus on holistic development. By combining academic excellence with sports, arts, music, and digital learning, Gujarat is preparing the next generation with the knowledge and skills needed for the future. #Gujarat

VIDEO | The PM SHRI Scheme is reshaping government school education in Gujarat by creating modern, future-ready learning environments aligned with the National Education Policy. With 463 PM SHRI schools across the state, students are benefiting from quality education, upgraded infrastructure, air-conditioned classrooms, modern sports facilities, solar-powered campuses, and a strong focus on holistic development. By combining academic excellence with sports, arts, music, and digital learning, Gujarat is preparing the next generation with the knowledge and skills needed for the future. #Gujarat

Press Trust of India

14,141 views • 16 days ago