Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Today we're introducing TRIBE v2 (Trimodal Brain Encoder), a foundation model trained to predict how the human brain responds to almost any sight or sound. Building on our Algonauts 2025 award-winning architecture, TRIBE v2 draws on 500+ hours of fMRI recordings from 700+ people to create a digital twin... show more

AI at Meta

805,945 subscribers

6,920,942 views • 2 months ago •via X (Twitter)

Education Health & Wellness Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Meta's new AI can predict your brain better than a brain scan. TRIBE v2 is a foundation model trained on 1,000+ hours of brain imaging data from 720 people. You feed it a video, sound clip, or text, and it predicts: > Which brain regions light up > How strongly > And in what order When tested on people it had never seen, the model's predictions were actually more accurate than most real brain scans (which get distorted by heartbeats, breathing, and movement). Researchers then replicated decades of classic neuroscience experiments entirely inside the software. No scanner, no human subjects. The model correctly identified the brain's face recognition center, language network, and emotional processing regions on its own. But look at what else Meta has been building: > Ray-Ban smart glasses that see and hear what you do > A wristband that reads nerve signals > And now a model that predicts how your brain responds to any piece of content There's no evidence these are all connected... but Meta now has a complete picture of attention, from the stimulus to the neural response.

Meta's new AI can predict your brain better than a brain scan. TRIBE v2 is a foundation model trained on 1,000+ hours of brain imaging data from 720 people. You feed it a video, sound clip, or text, and it predicts: > Which brain regions light up > How strongly > And in what order When tested on people it had never seen, the model's predictions were actually more accurate than most real brain scans (which get distorted by heartbeats, breathing, and movement). Researchers then replicated decades of classic neuroscience experiments entirely inside the software. No scanner, no human subjects. The model correctly identified the brain's face recognition center, language network, and emotional processing regions on its own. But look at what else Meta has been building: > Ray-Ban smart glasses that see and hear what you do > A wristband that reads nerve signals > And now a model that predicts how your brain responds to any piece of content There's no evidence these are all connected... but Meta now has a complete picture of attention, from the stimulus to the neural response.

Rowan Cheung

29,511 views • 2 months ago

Starting today you can try our new foundation research model for audio generation. The demo includes Zero shot TTS, Text to sound effects, Infilling and more! Try Audiobox ➡️

Starting today you can try our new foundation research model for audio generation. The demo includes Zero shot TTS, Text to sound effects, Infilling and more! Try Audiobox ➡️

AI at Meta

515,618 views • 2 years ago

🏗️ Policy Adaptation from Foundation Model Feedback #CVPR2023 Instead of using foundation model as a pre-trained encoder (generator), we use it as a Teacher (discriminator) to tell where our policy did wrong and helps it adapts to new envs and tasks.

🏗️ Policy Adaptation from Foundation Model Feedback #CVPR2023 Instead of using foundation model as a pre-trained encoder (generator), we use it as a Teacher (discriminator) to tell where our policy did wrong and helps it adapts to new envs and tasks.

Xiaolong Wang

24,396 views • 3 years ago

The Segment Anything Model (SAM) by Meta AI is a step toward the first foundation model for image segmentation. SAM is capable of one-click segmentation of any object from photos or videos + zero-shot transfer to other segmentation tasks. Try the demo ➡️

The Segment Anything Model (SAM) by Meta AI is a step toward the first foundation model for image segmentation. SAM is capable of one-click segmentation of any object from photos or videos + zero-shot transfer to other segmentation tasks. Try the demo ➡️

AI at Meta

186,324 views • 3 years ago

Using monkey brain data to operate robotic arms! 🙉 Project Jenkins explores brain-computer interfaces by decoding neural activity into robotic movement and generating synthetic brain data from motion patterns. Using neural recordings from a macaque monkey named Jenkins, researchers developed models to decode brain signals into robotic arm movements and encode movement data into simulated neural activity. The project utilizes robotic arms and an interactive web console for real-time brain data generation from joystick inputs. The research paves the way for adaptive brain-computer interfaces by modeling brain activity more flexibly. Congrats to authors Dima Yanovsky, and Andrii Zahorodnii! 🦾

Using monkey brain data to operate robotic arms! 🙉 Project Jenkins explores brain-computer interfaces by decoding neural activity into robotic movement and generating synthetic brain data from motion patterns. Using neural recordings from a macaque monkey named Jenkins, researchers developed models to decode brain signals into robotic arm movements and encode movement data into simulated neural activity. The project utilizes robotic arms and an interactive web console for real-time brain data generation from joystick inputs. The research paves the way for adaptive brain-computer interfaces by modeling brain activity more flexibly. Congrats to authors Dima Yanovsky, and Andrii Zahorodnii! 🦾

Lukas Ziegler

21,504 views • 1 year ago

Here is the first look Kendo AI V2! V2 adds the ability for teams to onboard and manage users, the ability to create fully customizable agents for any offer, sales cycle, or niche, and even adds a call review section for training and feedback + massive updates to our model

Here is the first look Kendo AI V2! V2 adds the ability for teams to onboard and manage users, the ability to create fully customizable agents for any offer, sales cycle, or niche, and even adds a call review section for training and feedback + massive updates to our model

Luke Alexander

13,339 views • 1 year ago

Introducing Meta Perception Encoder: a vision encoder setting new standards in image & video tasks. It excels in zero-shot classification & retrieval, surpassing existing models. Learn more about Meta Perception Encoder, read the research paper, and download the code and dataset

Introducing Meta Perception Encoder: a vision encoder setting new standards in image & video tasks. It excels in zero-shot classification & retrieval, surpassing existing models. Learn more about Meta Perception Encoder, read the research paper, and download the code and dataset

AI at Meta

74,392 views • 1 year ago

Gold on digital rails can open more than access. It can create new ways for people to enter, exit, learn, and participate in the world of finance. Most RWA tokens focus on providing exposure to an asset, but Ubuntu Tribe is building a community that empowers financial literacy and rewards participants. Together we rise!

Gold on digital rails can open more than access. It can create new ways for people to enter, exit, learn, and participate in the world of finance. Most RWA tokens focus on providing exposure to an asset, but Ubuntu Tribe is building a community that empowers financial literacy and rewards participants. Together we rise!

Ubuntu Tribe

10,309 views • 1 month ago

NEW: Higgs Audio V2 from BosonAI open, unified TTS model w/ voice cloning, beats GPT 4o mini tts and ElevenLabs v2 🔥 > Trained on 10M hours (speech, music, events) > Built on top of Llama 3.2 3B > Works real-time and on edge > Beats GPT-4o-mini-tts, ElevenLabs v2 in prosody & emotion Multi-speaker dialog > Zero-shot voice cloning 🤩 > Available on Hugging Face Kudos to folks at Boson AI for releasing such a brilliant work and all the details around the model! 🤗

NEW: Higgs Audio V2 from BosonAI open, unified TTS model w/ voice cloning, beats GPT 4o mini tts and ElevenLabs v2 🔥 > Trained on 10M hours (speech, music, events) > Built on top of Llama 3.2 3B > Works real-time and on edge > Beats GPT-4o-mini-tts, ElevenLabs v2 in prosody & emotion Multi-speaker dialog > Zero-shot voice cloning 🤩 > Available on Hugging Face Kudos to folks at Boson AI for releasing such a brilliant work and all the details around the model! 🤗

Vaibhav (VB) Srivastav

79,585 views • 10 months ago

We're building a surgical robot capable of reaching any brain region. The goal: a generalized neural interface to help solve any condition that originates in the brain.

We're building a surgical robot capable of reaching any brain region. The goal: a generalized neural interface to help solve any condition that originates in the brain.

Neuralink

22,068,826 views • 1 month ago

Introducing Empathic Voice Interface 2 (EVI 2), our new voice-to-voice foundation model. EVI 2 merges language and voice into a single model trained specifically for emotional intelligence. You can try it and start building today.

Introducing Empathic Voice Interface 2 (EVI 2), our new voice-to-voice foundation model. EVI 2 merges language and voice into a single model trained specifically for emotional intelligence. You can try it and start building today.

Hume AI

165,597 views • 1 year ago

Introducing: Loyalty League v2 ⚡ Building on v1's key insights, we're thrilled to unveil a new standard, the Layer 2 of LST incentives 🧵

Introducing: Loyalty League v2 ⚡ Building on v1's key insights, we're thrilled to unveil a new standard, the Layer 2 of LST incentives 🧵

Hubra | Solana staking

22,967 views • 1 year ago

We are back. After one year of quiet building. Introducing GENE-26.5, our first robotic brain that takes a major step toward human-level capability. For years, robotics has struggled to learn from the world’s largest and valuable data source: Humans. Solving it means rethinking the whole stack from the ground up: - A robotics-native foundation model. - A 1:1 human-like robotic hand. - A noninvasive data collection glove for motion, force, and touch. - A simulator that turns weeks of experiments into minutes. GENE-26.5 is trained across language, vision, proprioception, tactile, and action. We designed a set of tasks to test how far we can go with this new paradigm. Fully autonomous, 1x speed, one model, same weights. (Enjoy with sound on) We are approaching the endgame for robotics. And this is just a beginning.

We are back. After one year of quiet building. Introducing GENE-26.5, our first robotic brain that takes a major step toward human-level capability. For years, robotics has struggled to learn from the world’s largest and valuable data source: Humans. Solving it means rethinking the whole stack from the ground up: - A robotics-native foundation model. - A 1:1 human-like robotic hand. - A noninvasive data collection glove for motion, force, and touch. - A simulator that turns weeks of experiments into minutes. GENE-26.5 is trained across language, vision, proprioception, tactile, and action. We designed a set of tasks to test how far we can go with this new paradigm. Fully autonomous, 1x speed, one model, same weights. (Enjoy with sound on) We are approaching the endgame for robotics. And this is just a beginning.

Genesis AI

2,688,060 views • 1 month ago

Introducing Eleven Multilingual v2: our new AI speech model supporting 28 languages! v2 comes with enhanced conversational capability, higher output quality & the ability to better preserve unique voice characteristics across languages. Read more:

Introducing Eleven Multilingual v2: our new AI speech model supporting 28 languages! v2 comes with enhanced conversational capability, higher output quality & the ability to better preserve unique voice characteristics across languages. Read more:

ElevenLabs

293,329 views • 2 years ago

🔉 Introducing SAM Audio, the first unified model that isolates any sound from complex audio mixtures using text, visual, or span prompts. We’re sharing SAM Audio with the community, along with a perception encoder model, benchmarks and research papers, to empower others to explore new forms of expression and build applications that were previously out of reach. 🔗 Learn more:

🔉 Introducing SAM Audio, the first unified model that isolates any sound from complex audio mixtures using text, visual, or span prompts. We’re sharing SAM Audio with the community, along with a perception encoder model, benchmarks and research papers, to empower others to explore new forms of expression and build applications that were previously out of reach. 🔗 Learn more:

AI at Meta

1,247,722 views • 5 months ago

Introducing v2 of our SFX model. Generate any sound effect directly from a prompt, via UI or API. • Higher SFX quality • New: seamlessly looping sound effects • Maximum duration extended from 22s to 30s • Sample rate increased from 44.1kHz to 48kHz • Refreshed SFX Library

Introducing v2 of our SFX model. Generate any sound effect directly from a prompt, via UI or API. • Higher SFX quality • New: seamlessly looping sound effects • Maximum duration extended from 22s to 30s • Sample rate increased from 44.1kHz to 48kHz • Refreshed SFX Library

ElevenLabs

144,717 views • 9 months ago

Today, we released our new brand, vision and products to set a new foundation for the future on-chain economy. Hear the story of Injective, how we got here and how we are building an entirely new future for finance.

Injective 🥷

60,801 views • 1 year ago

Our vision is for AI that uses world models to adapt in new and dynamic environments and efficiently learn new skills. We’re sharing V-JEPA 2, a new world model with state-of-the-art performance in visual understanding and prediction. V-JEPA 2 is a 1.2 billion-parameter model, trained on video, that can enable zero-shot planning in robots—allowing them to plan and execute tasks in unfamiliar environments. Learn more about V-JEPA 2 ➡️ As we continue working toward our goal of achieving advanced machine intelligence (AMI), we’re also releasing three new benchmarks for evaluating how well existing models can reason about the physical world from video. Learn more and download the new benchmarks ➡️

Our vision is for AI that uses world models to adapt in new and dynamic environments and efficiently learn new skills. We’re sharing V-JEPA 2, a new world model with state-of-the-art performance in visual understanding and prediction. V-JEPA 2 is a 1.2 billion-parameter model, trained on video, that can enable zero-shot planning in robots—allowing them to plan and execute tasks in unfamiliar environments. Learn more about V-JEPA 2 ➡️ As we continue working toward our goal of achieving advanced machine intelligence (AMI), we’re also releasing three new benchmarks for evaluating how well existing models can reason about the physical world from video. Learn more and download the new benchmarks ➡️

AI at Meta

309,704 views • 1 year ago

🚨Science nerds are going to lose their minds. Kai Rowan just open sourced a framework that predicts how your brain responds to any text, audio, or video by simulating cortical fMRI activity with 30% more accuracy than Meta's own model. No fMRI scanner. No neuroscience PhD. No million-dollar lab. It's called NForge. Here's what this thing actually does: → Feed it any combination of text, audio, or video and it predicts cortical surface activity across ~20,484 brain vertices → Extracts deep features via LLaMA 3.2, V-JEPA2, and Wav2Vec-BERT simultaneously → Generates ROI attention maps showing exactly which brain regions fire hardest at which moments → Runs real-time streaming predictions from live feature streams -- no pre-loading the full clip → Breaks down exactly how much text vs audio vs video drove each prediction with per-vertex modality attribution scores → Adapts to entirely new subjects with just a few calibration scans -- no full retraining required Here's the wildest part: Built on Meta's TRIBE v2 foundation but adds 6 major capabilities Meta never shipped. Cross-subject generalization. Streaming inference. Modality attribution. torch.compile support. Full test coverage. Professional src/ package layout. You literally point this at a movie clip and it tells you which parts of the human cortex light up -- broken down by what your eyes, ears, and language centers each contributed. That sentence shouldn't be real in 2026. But here we are. 100% Open Source. pip install nforge. (Link in the comments)

🚨Science nerds are going to lose their minds. Kai Rowan just open sourced a framework that predicts how your brain responds to any text, audio, or video by simulating cortical fMRI activity with 30% more accuracy than Meta's own model. No fMRI scanner. No neuroscience PhD. No million-dollar lab. It's called NForge. Here's what this thing actually does: → Feed it any combination of text, audio, or video and it predicts cortical surface activity across ~20,484 brain vertices → Extracts deep features via LLaMA 3.2, V-JEPA2, and Wav2Vec-BERT simultaneously → Generates ROI attention maps showing exactly which brain regions fire hardest at which moments → Runs real-time streaming predictions from live feature streams -- no pre-loading the full clip → Breaks down exactly how much text vs audio vs video drove each prediction with per-vertex modality attribution scores → Adapts to entirely new subjects with just a few calibration scans -- no full retraining required Here's the wildest part: Built on Meta's TRIBE v2 foundation but adds 6 major capabilities Meta never shipped. Cross-subject generalization. Streaming inference. Modality attribution. torch.compile support. Full test coverage. Professional src/ package layout. You literally point this at a movie clip and it tells you which parts of the human cortex light up -- broken down by what your eyes, ears, and language centers each contributed. That sentence shouldn't be real in 2026. But here we are. 100% Open Source. pip install nforge. (Link in the comments)

Guri Singh

244,515 views • 2 months ago

$Introducing Brain Credits 🧠 Representing a new approach to decentralized AI ownership and participation, Brain Credits function as digital tokens, redeemable for full or fractional ownership of a Brain. To obtain Brain Credits, burn $PepeCoin. (Pepecoin) 🔥 9.30.24 🔥$

Introducing Brain Credits 🧠 Representing a new approach to decentralized AI ownership and participation, Brain Credits function as digital tokens, redeemable for full or fractional ownership of a Brain. To obtain Brain Credits, burn $PepeCoin. (Pepecoin) 🔥 9.30.24 🔥

BasedAI

162,756 views • 1 year ago