正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Introducing Meta Locate 3D: a model for accurate object localization in 3D environments. Learn how Meta Locate 3D can help robots accurately understand their surroundings and interact more naturally with humans. You can download the model and dataset, read our research paper, and even try a demo!

AI at Meta

797,908 subscribers

81,287 次观看 • 1 年前 •via X (Twitter)

科学技术新闻政治教育

Anya Rossi• Live Now

Private livecam show

11 条评论

Arunachalam B 的头像

Arunachalam B1 年前

YES! This is exactly what we need! 🙌 Accurate 3D object localization will revolutionize robotics and human-robot interaction! Going to download the model and try it now!

Rainmaker 的头像

Rainmaker2 年前

Which Machine Learning model delivers stronger trading results? Check out this free Substack post where I compare several powerful models that beat the market and show yearly returns of over 20%.

Reji Modiyil 的头像

Reji Modiyil1 年前

@AIatMeta, exciting advancements like meta locate 3d transform how we connect machines and humans.

-T3ch- 的头像

-T3ch-1 年前

is this built on meta perception?

Casey Ash 的头像

Casey Ash1 年前

Nice model for local context; it makes me wonder how it could enable more user-friendly applications.

Melina Flow 的头像

Melina Flow1 年前

Curious how this model adapts across diverse environments. Will download and evaluate your insights.

Faruk Guney 的头像

Faruk Guney1 年前

This could very well be a great addition to SLAM toolbox in robotics if proven effective.

Alejandro Toro 的头像

Alejandro Toro1 年前

Pretty awesome. I have to check it out

TrainLabsAI 的头像

TrainLabsAI1 年前

THE TRAIN also helps, but it helps humans

o-mega.ai 的头像

o-mega.ai1 年前

Meta Locate 3D revolutionizes 3D object localization using natural language queries. The model's 3D-JEPA algorithm processes 3D point clouds with 2D foundation models like CLIP and DINO, operating on sensor streams for real-time deployment. Backed by a 130,000+ annotation dataset, it's poised to transform robot-human interactions. The open-source codebase on GitHub opens doors for developers to push AR and robotics capabilities further, paving the way for AI systems that navigate and interpret physical spaces based on human instructions. This marks a significant leap towards more intuitive and capable AI-driven environmental understanding.

DeBarra Shaw 的头像

DeBarra Shaw1 年前

Nice.

相关视频

🚀 Meta FAIR is releasing several new research artifacts on our road to advanced machine intelligence (AMI). These latest advancements are transforming our understanding of perception. 1️⃣ Meta Perception Encoder: A large-scale vision encoder that excels across several image & video tasks. 2️⃣ Meta Perception Language Model: A fully open & reproducible vision-language model designed to tackle visual recognition tasks. 3️⃣ Meta Locate 3D: An end-to-end model for accurate object localization in 3D environments. 4️⃣ Releasing model weights for our 8B-parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability. 5️⃣Collaborative Reasoner: A framework for evaluating & improving collaborative reasoning skills in language models. Download the code, datasets, and research papers and learn more about how these artifacts are paving the way for more efficient and accurate AI systems.➡️

🚀 Meta FAIR is releasing several new research artifacts on our road to advanced machine intelligence (AMI). These latest advancements are transforming our understanding of perception. 1️⃣ Meta Perception Encoder: A large-scale vision encoder that excels across several image & video tasks. 2️⃣ Meta Perception Language Model: A fully open & reproducible vision-language model designed to tackle visual recognition tasks. 3️⃣ Meta Locate 3D: An end-to-end model for accurate object localization in 3D environments. 4️⃣ Releasing model weights for our 8B-parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability. 5️⃣Collaborative Reasoner: A framework for evaluating & improving collaborative reasoning skills in language models. Download the code, datasets, and research papers and learn more about how these artifacts are paving the way for more efficient and accurate AI systems.➡️

AI at Meta

163,214 次观看 • 1 年前

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:

AI at Meta

93,811 次观看 • 1 年前

SAM 3D enables accurate 3D reconstruction from a single image, supporting real-world applications in editing, robotics, and interactive scene generation. Matt, a SAM 3D researcher, explains how the two-model design makes this possible for both people and complex environments. 🔗 Read the SAM 3D Objects research paper: 🔗 Read the SAM 3D Body research paper:

SAM 3D enables accurate 3D reconstruction from a single image, supporting real-world applications in editing, robotics, and interactive scene generation. Matt, a SAM 3D researcher, explains how the two-model design makes this possible for both people and complex environments. 🔗 Read the SAM 3D Objects research paper: 🔗 Read the SAM 3D Body research paper:

AI at Meta

17,858 次观看 • 6 个月前

oh my.. hows this even possible Meta just dropped SAM 3D, you can auto select any object in still image and.. turn them into high quality 3D model the model is free to download and test in playground link in comments

oh my.. hows this even possible Meta just dropped SAM 3D, you can auto select any object in still image and.. turn them into high quality 3D model the model is free to download and test in playground link in comments

el.cine

794,001 次观看 • 6 个月前

Introducing Meta Perception Encoder: a vision encoder setting new standards in image & video tasks. It excels in zero-shot classification & retrieval, surpassing existing models. Learn more about Meta Perception Encoder, read the research paper, and download the code and dataset

Introducing Meta Perception Encoder: a vision encoder setting new standards in image & video tasks. It excels in zero-shot classification & retrieval, surpassing existing models. Learn more about Meta Perception Encoder, read the research paper, and download the code and dataset

AI at Meta

74,392 次观看 • 1 年前

Introducing Substance 3D Viewer (beta) a new 3D desktop app that can open, view, and render 70+ file formats. In Adobe Photoshop (beta), drag & drop a 3D model on your canvas, and it becomes an editable Smart Object. Download it for free and give it a try!

Introducing Substance 3D Viewer (beta) a new 3D desktop app that can open, view, and render 70+ file formats. In Adobe Photoshop (beta), drag & drop a 3D model on your canvas, and it becomes an editable Smart Object. Download it for free and give it a try!

Adobe Substance 3D

89,134 次观看 • 1 年前

🔥 New Feature: Multi-Image to 3D! Now you can upload multiple images of the same object to generate a more complete and accurate 3D model. 😉 More improvements coming soon! Try it out and let us know what you think. #3dmodeling #ai

🔥 New Feature: Multi-Image to 3D! Now you can upload multiple images of the same object to generate a more complete and accurate 3D model. 😉 More improvements coming soon! Try it out and let us know what you think. #3dmodeling #ai

MeshyAI

59,314 次观看 • 1 年前

We’re also publishing two research papers on the approaches we used for high quality 3D model generation & texture generation based on text prompts that are behind the Meta 3D Gen system. Meta 3D AssetGen ➡️ Meta 3D TextureGen ➡️

We’re also publishing two research papers on the approaches we used for high quality 3D model generation & texture generation based on text prompts that are behind the Meta 3D Gen system. Meta 3D AssetGen ➡️ Meta 3D TextureGen ➡️

AI at Meta

72,914 次观看 • 1 年前

Multi-modal #LLMs understand a lot about humans. But do they understand our 3D pose? We train #PoseGPT to estimate, generate, and reason about 3D human pose (#SMPL) in images and text. This is the first true foundation model for understanding 3D humans.

Multi-modal #LLMs understand a lot about humans. But do they understand our 3D pose? We train #PoseGPT to estimate, generate, and reason about 3D human pose (#SMPL) in images and text. This is the first true foundation model for understanding 3D humans.

Michael Black

81,365 次观看 • 2 年前

Introducing RTFM (Real-Time Frame Model): a highly efficient World Model that generates video frames in real time as you interact with it, powered by a single H100 GPU. RTFM renders persistent and 3D consistent worlds, both real and imaginary. Try our demo of RTFM today!

Introducing RTFM (Real-Time Frame Model): a highly efficient World Model that generates video frames in real time as you interact with it, powered by a single H100 GPU. RTFM renders persistent and 3D consistent worlds, both real and imaginary. Try our demo of RTFM today!

World Labs

339,636 次观看 • 7 个月前

Introducing Objaverse-XL, an open dataset of over 10 million 3D objects! With it, we train Zero123-XL, a foundation model for 3D, observing incredible 3D generalization abilities: 🧵👇 📝 Paper:

Introducing Objaverse-XL, an open dataset of over 10 million 3D objects! With it, we train Zero123-XL, a foundation model for 3D, observing incredible 3D generalization abilities: 🧵👇 📝 Paper:

Matt Deitke

368,656 次观看 • 2 年前

📣 New research from GenAI at Meta, introducing Meta 3D Gen: A new system for end-to-end generation of 3D assets from text in <1min. Meta 3D Gen is a new combined AI system that can generate high-quality 3D assets, with both high-resolution textures and material maps end-to-end, producing results that are superior to existing solutions — at 3-10x the speed of existing work in this space. Details in the technical report ➡️

📣 New research from GenAI at Meta, introducing Meta 3D Gen: A new system for end-to-end generation of 3D assets from text in <1min. Meta 3D Gen is a new combined AI system that can generate high-quality 3D assets, with both high-resolution textures and material maps end-to-end, producing results that are superior to existing solutions — at 3-10x the speed of existing work in this space. Details in the technical report ➡️

AI at Meta

408,708 次观看 • 1 年前

🏗️ Build #3D scenes from a single input view based on the latest #NVIDIAResearch paper accepted at #ICCV2023. 👀 This 3D-aware #generativeAI model can build diverse and plausible views. research paper: project page:

🏗️ Build #3D scenes from a single input view based on the latest #NVIDIAResearch paper accepted at #ICCV2023. 👀 This 3D-aware #generativeAI model can build diverse and plausible views. research paper: project page:

NVIDIA AI Developer

113,873 次观看 • 2 年前

🔥 Introducing Genie 1.0, our first step towards building multimodal AI. Genie is a text-to-3d model capable of creating any 3d object you can dream of in under 10 seconds with materials, quad mesh retopology, variable polycount, and in all standard formats! Try it on web and in Luma’s iOS app now → #generativeai #textto3d #multimodalai

🔥 Introducing Genie 1.0, our first step towards building multimodal AI. Genie is a text-to-3d model capable of creating any 3d object you can dream of in under 10 seconds with materials, quad mesh retopology, variable polycount, and in all standard formats! Try it on web and in Luma’s iOS app now → #generativeai #textto3d #multimodalai

Luma

1,241,857 次观看 • 2 年前

We were in a room with BonnieDolcexXx and... You can even see the nsfw sample video here: #bonniedolce #bonnie #czechvr #checkvr #vrpor #3D #meta #vr #virtualreality

We were in a room with BonnieDolcexXx and... You can even see the nsfw sample video here: #bonniedolce #bonnie #czechvr #checkvr #vrpor #3D #meta #vr #virtualreality

Czech VR Network 2.0

38,864 次观看 • 2 年前

New from Meta FAIR: Code World Model (CWM), a 32B-parameter research model designed to explore how world models can transform code generation and reasoning about code. We believe in advancing research in world modeling and are sharing CWM under a research license to help empower the community to build upon our work. ➡️ Read the technical report: ➡️Download the open weights: ➡️Download the code:

New from Meta FAIR: Code World Model (CWM), a 32B-parameter research model designed to explore how world models can transform code generation and reasoning about code. We believe in advancing research in world modeling and are sharing CWM under a research license to help empower the community to build upon our work. ➡️ Read the technical report: ➡️Download the open weights: ➡️Download the code:

AI at Meta

312,889 次观看 • 8 个月前

SAM 2 from Meta FAIR is the first unified model for real-time, promptable object segmentation in images & videos. Using the model in our web-based demo you can segment, track and apply effects to objects in video in just a few clicks. Try SAM 2 ➡️

SAM 2 from Meta FAIR is the first unified model for real-time, promptable object segmentation in images & videos. Using the model in our web-based demo you can segment, track and apply effects to objects in video in just a few clicks. Try SAM 2 ➡️

AI at Meta

88,918 次观看 • 1 年前

Phidias A Generative Model for Creating 3D Content from Text, Image, and 3D Conditions with Reference-Augmented Diffusion discuss: In 3D modeling, designers often use an existing 3D model as a reference to create new ones. This practice has inspired the development of Phidias, a novel generative model that uses diffusion for reference-augmented 3D generation. Given an image, our method leverages a retrieved or user-provided 3D reference model to guide the generation process, thereby enhancing the generation quality, generalization ability, and controllability. Our model integrates three key components: 1) meta-ControlNet that dynamically modulates the conditioning strength, 2) dynamic reference routing that mitigates misalignment between the input image and 3D reference, and 3) self-reference augmentations that enable self-supervised training with a progressive curriculum. Collectively, these designs result in a clear improvement over existing methods. Phidias establishes a unified framework for 3D generation using text, image, and 3D conditions with versatile applications.

Phidias A Generative Model for Creating 3D Content from Text, Image, and 3D Conditions with Reference-Augmented Diffusion discuss: In 3D modeling, designers often use an existing 3D model as a reference to create new ones. This practice has inspired the development of Phidias, a novel generative model that uses diffusion for reference-augmented 3D generation. Given an image, our method leverages a retrieved or user-provided 3D reference model to guide the generation process, thereby enhancing the generation quality, generalization ability, and controllability. Our model integrates three key components: 1) meta-ControlNet that dynamically modulates the conditioning strength, 2) dynamic reference routing that mitigates misalignment between the input image and 3D reference, and 3) self-reference augmentations that enable self-supervised training with a progressive curriculum. Collectively, these designs result in a clear improvement over existing methods. Phidias establishes a unified framework for 3D generation using text, image, and 3D conditions with versatile applications.

AK

25,120 次观看 • 1 年前

Love these old meets new vfx workflows 1. extract a still of the object you want to augment 2. use image-to-3d to make a 3d model of the object 3. use that 3d geometry for classical object tracking Then you can go wild with complete control

Love these old meets new vfx workflows 1. extract a still of the object you want to augment 2. use image-to-3d to make a 3d model of the object 3. use that 3d geometry for classical object tracking Then you can go wild with complete control

Bilawal Sidhu

33,824 次观看 • 1 年前

In their latest video, Boston Dynamics’s AI team explains how they make the Atlas humanoid perceive and interact with the world. Atlas uses an agile perception system to understand both the shape and context of objects in complex environments. Atlas combines 2D and 3D awareness, keypoint-based localization, and an object pose tracking system that fuses vision, kinematics, and object knowledge to handle occlusion and uncertainty. Accurate calibration ensures precise hand–eye coordination for reliable manipulation. The team is now working toward a unified model that merges perception and control – pushing beyond spatial AI toward physical intelligence.

In their latest video, Boston Dynamics’s AI team explains how they make the Atlas humanoid perceive and interact with the world. Atlas uses an agile perception system to understand both the shape and context of objects in complex environments. Atlas combines 2D and 3D awareness, keypoint-based localization, and an object pose tracking system that fuses vision, kinematics, and object knowledge to handle occlusion and uncertainty. Accurate calibration ensures precise hand–eye coordination for reliable manipulation. The team is now working toward a unified model that merges perception and control – pushing beyond spatial AI toward physical intelligence.

The Humanoid Hub

49,655 次观看 • 1 年前