Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

🚀New from Meta FAIR: today we’re introducing Seamless Interaction, a research project dedicated to modeling interpersonal dynamics. The project features a family of audiovisual behavioral models, developed in collaboration with Meta’s Codec Avatars lab + Core AI lab, that render speech between two individuals into diverse, expressive full-body gestures... show more

AI at Meta

810,678 subscribers

48,410 görüntüleme • 1 yıl önce •via X (Twitter)

Bilim & Teknoloji Eğitim

Anya Rossi• Live Now

Private livecam show

10 Yorum

AI at Meta profil fotoğrafı

AI at Meta1 yıl önce

We’re also publicly releasing the Seamless Interaction Dataset, with 4,000+ participants and 4,000+ hours of interactions, making it the largest known video dataset of its kind. This dataset enables our audiovisual behavioral models to understand and generate human-like social behaviors, and represents a crucial stepping stone to understanding and modeling how people communicate and behave when they’re together. We’re sharing it here to help the research community advance their work:

AI at Meta profil fotoğrafı

AI at Meta1 yıl önce

One more thing… you can also check out this technical report detailing our methodology to build motion models on the dataset, along with an evaluation framework for this type of model:

AI at Meta profil fotoğrafı

AI at Meta1 yıl önce

Head to our blog to go deeper on the full story:

Rehan Momin profil fotoğrafı

Rehan Momin1 yıl önce

I have thoughts on it @Meta maybe get my hands on to bring the one o one human to human online interaction alive and starting with the combine reality Help me to get in to make the tech better and I wanna talk to this guy for a bit on it @finkd

BlackZitoune ττ profil fotoğrafı

BlackZitoune ττ1 yıl önce

Totally useless

Stefan profil fotoğrafı

Stefan1 yıl önce

lol the video reminds me of wwdc when Vision Pro was launched

Emily profil fotoğrafı

Emily1 yıl önce

This is a good start for the end game, where digital humans can be used in the VR world 😀

Tom Bennet profil fotoğrafı

Tom Bennet1 yıl önce

Modeling family dynamics? Meta's about to learn how *real* families operate 🍿

Saitoshi profil fotoğrafı

Saitoshi1 yıl önce

The focus on the 'Seamless Interaction Dataset' and its scale is precisely what will drive truly human-like AI behavior. That's the key.

Nathaniel profil fotoğrafı

Nathaniel1 yıl önce

Elomeni. You are a year behind kiddos 😉 took ya long enough 😆

Benzer Videolar

Wrapping up the year and coinciding with #NeurIPS2024, today at Meta FAIR we’re releasing a collection of nine new open source AI research artifacts across our work in developing agents, robustness & safety and new architectures. More in the video from Joelle Pineau. All of this work is part of FAIR’s continued work towards the goal of achieving advanced machine intelligence A few highlights from what we’re releasing today: • Meta Motivo: A first-of-its-kind behavioral foundation model that controls the movements of a virtual embodied humanoid agent to perform complex tasks. • Meta Video Seal: a state-of-the art comprehensive framework for neural video watermarking. • Meta Explore Theory-of-Mind: A program-guided adversarial data generation for theory of mind reasoning. • Meta Large Concept Models: A fundamentally different training paradigm for language modeling that decouples reasoning from language representation. And much more! We’re excited to share this work with the research community and look forward to seeing how it inspires new innovation across the field. Details and access to everything released by FAIR today ➡️

Wrapping up the year and coinciding with #NeurIPS2024, today at Meta FAIR we’re releasing a collection of nine new open source AI research artifacts across our work in developing agents, robustness & safety and new architectures. More in the video from Joelle Pineau. All of this work is part of FAIR’s continued work towards the goal of achieving advanced machine intelligence A few highlights from what we’re releasing today: • Meta Motivo: A first-of-its-kind behavioral foundation model that controls the movements of a virtual embodied humanoid agent to perform complex tasks. • Meta Video Seal: a state-of-the art comprehensive framework for neural video watermarking. • Meta Explore Theory-of-Mind: A program-guided adversarial data generation for theory of mind reasoning. • Meta Large Concept Models: A fundamentally different training paradigm for language modeling that decouples reasoning from language representation. And much more! We’re excited to share this work with the research community and look forward to seeing how it inspires new innovation across the field. Details and access to everything released by FAIR today ➡️

AI at Meta

156,008 görüntüleme • 1 yıl önce

We’re also publicly releasing the Seamless Interaction Dataset, with 4,000+ participants and 4,000+ hours of interactions, making it the largest known video dataset of its kind. This dataset enables our audiovisual behavioral models to understand and generate human-like social behaviors, and represents a crucial stepping stone to understanding and modeling how people communicate and behave when they’re together. We’re sharing it here to help the research community advance their work:

We’re also publicly releasing the Seamless Interaction Dataset, with 4,000+ participants and 4,000+ hours of interactions, making it the largest known video dataset of its kind. This dataset enables our audiovisual behavioral models to understand and generate human-like social behaviors, and represents a crucial stepping stone to understanding and modeling how people communicate and behave when they’re together. We’re sharing it here to help the research community advance their work:

AI at Meta

11,956 görüntüleme • 1 yıl önce

Meta FAIR recently released the Seamless Interaction Dataset, the largest known high-quality video dataset of its kind, with: 4,000+ diverse participants 4,000+ hours of footage 65k+ interactions 5,000+ annotated samples This dataset of full-body, in-person, face-to-face interaction videos represents a crucial stepping stone to understanding and modeling how people communicate and behave when they’re together—advancing AI's ability to generate more natural conversations and human-like gestures. Download the dataset on Hugging Face: Learn more about the dataset:

Meta FAIR recently released the Seamless Interaction Dataset, the largest known high-quality video dataset of its kind, with: 4,000+ diverse participants 4,000+ hours of footage 65k+ interactions 5,000+ annotated samples This dataset of full-body, in-person, face-to-face interaction videos represents a crucial stepping stone to understanding and modeling how people communicate and behave when they’re together—advancing AI's ability to generate more natural conversations and human-like gestures. Download the dataset on Hugging Face: Learn more about the dataset:

AI at Meta

23,836 görüntüleme • 11 ay önce

New release from Meta FAIR — Meta Motivo is a first-of-its-kind behavioral foundation model for controlling virtual physics-based humanoid agents for a wide range of complex whole-body tasks. The model is capable of expressing human-like behaviors and achieves performance competitive with task-specific methods and outperforms state-of-the-art unsupervised RL and model-based baselines. Try the demo ➡️ Get the model and code ➡️ We’re excited about how this research could pave the way for fully embodied agents, leading to more lifelike NPCs, democratization of character animation and new types of immersive experiences.

New release from Meta FAIR — Meta Motivo is a first-of-its-kind behavioral foundation model for controlling virtual physics-based humanoid agents for a wide range of complex whole-body tasks. The model is capable of expressing human-like behaviors and achieves performance competitive with task-specific methods and outperforms state-of-the-art unsupervised RL and model-based baselines. Try the demo ➡️ Get the model and code ➡️ We’re excited about how this research could pave the way for fully embodied agents, leading to more lifelike NPCs, democratization of character animation and new types of immersive experiences.

AI at Meta

129,055 görüntüleme • 1 yıl önce

Introducing Genie 2: our AI model that can create an endless variety of playable 3D worlds - all from a single image. 🖼️ These types of large-scale foundation world models could enable future agents to be trained and evaluated in an endless number of virtual environments. →

Introducing Genie 2: our AI model that can create an endless variety of playable 3D worlds - all from a single image. 🖼️ These types of large-scale foundation world models could enable future agents to be trained and evaluated in an endless number of virtual environments. →

Google DeepMind

1,440,806 görüntüleme • 1 yıl önce

Meta AI strikes again, with Relightable Gaussian Codec Avatars This is an update to the Meta Codec Avatars 2.0, building on 3D Gaussian Splatting. As a result, we get fully relightable real-time avatars, accurate at the hair strand level 🤯 More details below ⬇️⬇️

Meta AI strikes again, with Relightable Gaussian Codec Avatars This is an update to the Meta Codec Avatars 2.0, building on 3D Gaussian Splatting. As a result, we get fully relightable real-time avatars, accurate at the hair strand level 🤯 More details below ⬇️⬇️

Alex Carlier

445,646 görüntüleme • 2 yıl önce

Introducing Project Ceiba, a groundbreaking collaboration between #AWS and @NVIDIA, that aims to push the boundaries of #AI by constructing the largest AI supercomputer in the cloud. ☁️ ⚙️ 💻 Learn more. ➡️

Introducing Project Ceiba, a groundbreaking collaboration between #AWS and @NVIDIA, that aims to push the boundaries of #AI by constructing the largest AI supercomputer in the cloud. ☁️ ⚙️ 💻 Learn more. ➡️

Amazon Web Services

16,201 görüntüleme • 1 yıl önce

Today we're sharing the next milestone in our Seamless Communication research — a new family of AI translation models that preserve expression and deliver near-real time streaming translations. More on this new work ➡️ More on the individual models 🧵

Today we're sharing the next milestone in our Seamless Communication research — a new family of AI translation models that preserve expression and deliver near-real time streaming translations. More on this new work ➡️ More on the individual models 🧵

AI at Meta

728,765 görüntüleme • 2 yıl önce

the micro1 robotics lab: real world data for intelligent models that co-exist in the physical world. we’re in-the-wild across 75 countries in 6,000+ unique environments collecting data. diverse movements, objects, and settings. the future of AI is as human as you can imagine. join us to start training robots today (link in comments).

the micro1 robotics lab: real world data for intelligent models that co-exist in the physical world. we’re in-the-wild across 75 countries in 6,000+ unique environments collecting data. diverse movements, objects, and settings. the future of AI is as human as you can imagine. join us to start training robots today (link in comments).

Ali Ansari

207,453 görüntüleme • 3 ay önce

Introducing General World Models. We believe the next major advancement in AI will come from systems that understand the visual world and its dynamics, which is why we’re starting a new long-term research effort around general world models. Learn more:

Introducing General World Models. We believe the next major advancement in AI will come from systems that understand the visual world and its dynamics, which is why we’re starting a new long-term research effort around general world models. Learn more:

Runway

714,233 görüntüleme • 2 yıl önce

Today we’re excited to unveil a new generation of Segment Anything Models: 1️⃣ SAM 3 enables detecting, segmenting and tracking of objects across images and videos, now with short text phrases and exemplar prompts. 🔗 Learn more about SAM 3: 2️⃣ SAM 3D brings the model collection into the 3rd dimension to enable precise reconstruction of 3D objects and people from a single 2D image. 🔗 Learn more about SAM 3D: These models offer innovative capabilities and unique tools for developers and researchers to create, experiment and uplevel media workflows.

Today we’re excited to unveil a new generation of Segment Anything Models: 1️⃣ SAM 3 enables detecting, segmenting and tracking of objects across images and videos, now with short text phrases and exemplar prompts. 🔗 Learn more about SAM 3: 2️⃣ SAM 3D brings the model collection into the 3rd dimension to enable precise reconstruction of 3D objects and people from a single 2D image. 🔗 Learn more about SAM 3D: These models offer innovative capabilities and unique tools for developers and researchers to create, experiment and uplevel media workflows.

AI at Meta

1,088,064 görüntüleme • 7 ay önce

🎉🎉🎉Super excited to announce that we launched a joint lab of Embodied AI and Humanoid Robot between UniTree and BIGAI! I will direct the lab to foster the research in integrating the 3D scene understanding capability to Humanoid robot. Hope to see more generalist Humanoid robots in our home very soon😁

🎉🎉🎉Super excited to announce that we launched a joint lab of Embodied AI and Humanoid Robot between UniTree and BIGAI! I will direct the lab to foster the research in integrating the 3D scene understanding capability to Humanoid robot. Hope to see more generalist Humanoid robots in our home very soon😁

Siyuan Huang

42,122 görüntüleme • 2 yıl önce

Celebrating the first reveal of YogaPetz NFTs! A human type Petz fully 3D. Meet this AI-driven pink beauty, featuring AI Motion Capture & Body Tracking, fully animated and powered by WELLAIOS and marking the beginning of a new AI Identity revolution. A vast collection of EGGs 🥚 will be revealed soon—get ready for a wave of unique, intelligent avatars! 🌐 Your AI identity is coming to life—AI agent-driven, on-chain, and fully customizable. This is just a taste of how our platform connects AI agents with avatars, redefining digital identity. ✨ Beyond just avatars—unlock limitless possibilities: 🎥 Live streaming & reels with AI-powered motion capture 🕶 VR-ready 3D avatars for immersive interactions 🌍 Intelligent AI agents expanding virtual engagement 🚀 WELLAIOS is leading the 3D + AI evolution. Your AI Identity starts here. Let's cook! #WELLAIOS #Web3 #YogaPetz #AI #AIAgent #WELL3 #NJZ #NewJeans #3DHuman

Celebrating the first reveal of YogaPetz NFTs! A human type Petz fully 3D. Meet this AI-driven pink beauty, featuring AI Motion Capture & Body Tracking, fully animated and powered by WELLAIOS and marking the beginning of a new AI Identity revolution. A vast collection of EGGs 🥚 will be revealed soon—get ready for a wave of unique, intelligent avatars! 🌐 Your AI identity is coming to life—AI agent-driven, on-chain, and fully customizable. This is just a taste of how our platform connects AI agents with avatars, redefining digital identity. ✨ Beyond just avatars—unlock limitless possibilities: 🎥 Live streaming & reels with AI-powered motion capture 🕶 VR-ready 3D avatars for immersive interactions 🌍 Intelligent AI agents expanding virtual engagement 🚀 WELLAIOS is leading the 3D + AI evolution. Your AI Identity starts here. Let's cook! #WELLAIOS #Web3 #YogaPetz #AI #AIAgent #WELL3 #NJZ #NewJeans #3DHuman

WELL3

14,689 görüntüleme • 1 yıl önce

Introducing 2D Avatars! 🎨✨ This ongoing project focuses on turning drawings into avatars, perfect for illustrators who prefer not to model in 3D. It supports pixel art, sketches, and freehand drawings bringing your 2D characters to life! 🚀 ⁠#DXlab #VRChat #Avatar

DX

499,885 görüntüleme • 1 yıl önce

Big news! Our AI Agent mona is leveling up ⬆️ Through our partnership with Holoworld AI, the audiovisual layer for AI Agents, Mona is coming to life in ways you’ve never seen before—expressive 3D avatars, immersive videos, and a brand-new way to engage. Here’s how 👇

Heurist

26,185 görüntüleme • 1 yıl önce

With enough data, robots and AI can learn “world models” that let them predict the results of their actions. These models are a way to learn how embodied AI agents can perform a wide variety of useful tasks — but they require a huge amount of data. The team at General Intuition General Intuition has a solution: use data from video games! Games teach movement, problem solving, and complex spatial reasoning, and they come in a staggering diversity of forms, covering a wide variety of problems. What’s more, the captured data is high-quality, without the noise or annotation error that can come from We sat down with Pim de Witte and Adam Jelley from the General Intuition team to learn more about their history, their plans, and their philosophy.

With enough data, robots and AI can learn “world models” that let them predict the results of their actions. These models are a way to learn how embodied AI agents can perform a wide variety of useful tasks — but they require a huge amount of data. The team at General Intuition General Intuition has a solution: use data from video games! Games teach movement, problem solving, and complex spatial reasoning, and they come in a staggering diversity of forms, covering a wide variety of problems. What’s more, the captured data is high-quality, without the noise or annotation error that can come from We sat down with Pim de Witte and Adam Jelley from the General Intuition team to learn more about their history, their plans, and their philosophy.

RoboPapers

85,927 görüntüleme • 7 ay önce

🚨🚨Can agents earn money, run a business, or even self-organize a society in the physical social world? 🤖🤖 Can agents learn continually to survive and thrive in embodied environments, like how human babies grow? 👶 Super excited to introduce SimWorld, an open-ended simulator of LLM agents in infinite, realistic embodied worlds. SimWorld features 3 key designs: 1⃣Open-ended realistic world simulation - built on Unreal Engine 5, with accurate physical social dynamics - 100+ built-in environments (city, island, wilderness ...) - language-controllable procedural generation - text-to-3D asset generation 2⃣Native interface for LLM/VLM agents - Gym-like agent-environment interaction APIs - plug in any LLMs/VLMs (GPTs, Gemini, Qwen ...) - rich multi-modal perception - open-vocabulary natural-language action outputs 3⃣Diverse physical and social reasoning scenarios - long-horizon embodied reasoning - multi-agent collaboration / competition - easily customizable for any reasoning tasks SimWorld is fully open-sourced, with a hope to become a foundational infrastructure for real-world agent research across disciplines: robotics, economy, public health, education, etc. Project website + more details in the thread👇 ...1/

🚨🚨Can agents earn money, run a business, or even self-organize a society in the physical social world? 🤖🤖 Can agents learn continually to survive and thrive in embodied environments, like how human babies grow? 👶 Super excited to introduce SimWorld, an open-ended simulator of LLM agents in infinite, realistic embodied worlds. SimWorld features 3 key designs: 1⃣Open-ended realistic world simulation - built on Unreal Engine 5, with accurate physical social dynamics - 100+ built-in environments (city, island, wilderness ...) - language-controllable procedural generation - text-to-3D asset generation 2⃣Native interface for LLM/VLM agents - Gym-like agent-environment interaction APIs - plug in any LLMs/VLMs (GPTs, Gemini, Qwen ...) - rich multi-modal perception - open-vocabulary natural-language action outputs 3⃣Diverse physical and social reasoning scenarios - long-horizon embodied reasoning - multi-agent collaboration / competition - easily customizable for any reasoning tasks SimWorld is fully open-sourced, with a hope to become a foundational infrastructure for real-world agent research across disciplines: robotics, economy, public health, education, etc. Project website + more details in the thread👇 ...1/

Lianhui Qin

64,864 görüntüleme • 7 ay önce

🌎A New Era in Virtual Creation Neural recently gained attention with the reveal of SentiOS, but there’s much more underway. We’re advancing our Bittensor Subnet for high-quality 3D mesh outputs and nearing key milestones that have attracted top validators. SentiOS, our no-code AI agent platform, will enable multichain agents, advanced customization, and 3D AI tool integrations. Additionally, our AI game dev tools for Unreal and Unity, now in beta, offer seamless engine integration for richer features. These efforts lead to the World Engine, an agent-driven platform for creating fully realized virtual worlds with minimal effort, shaping the future of virtual creation. 🖥 Discover the full details in the video!

🌎A New Era in Virtual Creation Neural recently gained attention with the reveal of SentiOS, but there’s much more underway. We’re advancing our Bittensor Subnet for high-quality 3D mesh outputs and nearing key milestones that have attracted top validators. SentiOS, our no-code AI agent platform, will enable multichain agents, advanced customization, and 3D AI tool integrations. Additionally, our AI game dev tools for Unreal and Unity, now in beta, offer seamless engine integration for richer features. These efforts lead to the World Engine, an agent-driven platform for creating fully realized virtual worlds with minimal effort, shaping the future of virtual creation. 🖥 Discover the full details in the video!

NeuralAI

15,234 görüntüleme • 1 yıl önce

Today we’re celebrating 10 years of the Meta FAIR lab in Paris by sharing a collection of new models, datasets and some exciting milestones in the impacts of open source — all laddering up to our ongoing work to achieve Advanced Machine Intelligence (AMI). 1️⃣ Meta PARTNR is a framework for human-robot collaboration that builds on our existing work in this space with a new dataset and a large planning model enabling robots to accomplish complex tasks alongside humans. 2️⃣ Meta Audiobox Aesthetics enables the automatic evaluation of audio aesthetics, providing a comprehensive assessment of audio quality across speech, music and sound. 3️⃣ Open Source Machine Translation Benchmark is a carefully crafted collection with the aim of building an unprecedented multilingual machine translation benchmark for the community. 4️⃣ Two new breakthrough studies using AI to further our understanding of language in the brain.

Today we’re celebrating 10 years of the Meta FAIR lab in Paris by sharing a collection of new models, datasets and some exciting milestones in the impacts of open source — all laddering up to our ongoing work to achieve Advanced Machine Intelligence (AMI). 1️⃣ Meta PARTNR is a framework for human-robot collaboration that builds on our existing work in this space with a new dataset and a large planning model enabling robots to accomplish complex tasks alongside humans. 2️⃣ Meta Audiobox Aesthetics enables the automatic evaluation of audio aesthetics, providing a comprehensive assessment of audio quality across speech, music and sound. 3️⃣ Open Source Machine Translation Benchmark is a carefully crafted collection with the aim of building an unprecedented multilingual machine translation benchmark for the community. 4️⃣ Two new breakthrough studies using AI to further our understanding of language in the brain.

AI at Meta

85,774 görüntüleme • 1 yıl önce