Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Evo: a foundation model for genomics! Using a well suited architecture, Evo learns from billions of bp of genomic sequence and performs well on several zero-shot prediction tasks on RNA, DNA and protein. Beautiful paper from Brian Hie & Patrick Hsu at Arc Institute

Julia Bauman

10,448 subscribers

52,365 Aufrufe • vor 2 Jahren •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

14 Kommentare

Profilbild von Julia Bauman

Julia Baumanvor 2 Jahren

Preprint link here:

Profilbild von ksminnovation

ksminnovationvor 1 Jahr

Dr. Tal Patalon explores how AI mega initiatives like the $500B Stargate project & AI-powered genomic analysis by Illumina & NVIDIA are transforming healthcare. @TalPatalon @forbes @edengallery_ #AIinHealthcare #PrecisionMedicine #Multiomics #HealthTech

Profilbild von Matt Durrant

Matt Durrantvor 2 Jahren

@BrianHie @pdhsu @arcinstitute Thank you for highlighting our work!

Profilbild von Dmitry Penzar

Dmitry Penzarvor 2 Jahren

@BrianHie @pdhsu @arcinstitute What are you about the fact their model do activity prediction worse than gc-content?

Profilbild von Misha

Mishavor 2 Jahren

@BrianHie @pdhsu @arcinstitute very good presentation

Profilbild von Ashton C Trotman-Grant

Ashton C Trotman-Grantvor 2 Jahren

@BrianHie @pdhsu @arcinstitute Yes! Awesome summary Julia. This paper is so cool

Profilbild von Nishant Jha

Nishant Jhavor 2 Jahren

@BrianHie @pdhsu @arcinstitute Been noodling on a playground for evo here:

Profilbild von ريان

ريانvor 2 Jahren

@BrianHie @pdhsu @arcinstitute Julia — what do you think about the fact that they claim to generate functional CRISPR-Cas systems without experimental validation?

Profilbild von Julia Bauman

Julia Baumanvor 2 Jahren

@BrianHie @pdhsu @arcinstitute I think that they’re going to do the experimental validation :)

Profilbild von Dr Rob Leigh

Dr Rob Leighvor 2 Jahren

@BrianHie @pdhsu @arcinstitute Paging Dr @Cian_Smyth

Profilbild von Neuropunk

Neuropunkvor 2 Jahren

@BrianHie @pdhsu @arcinstitute Its about time we move to fully synthetic biology. This is where all the cures, improvements and the most deadly weapons of humanity lie

Profilbild von Ryan Metz

Ryan Metzvor 2 Jahren

@BrianHie @pdhsu @arcinstitute Great work

Profilbild von Sean Jackewicz, MD 🧬🛠️

Sean Jackewicz, MD 🧬🛠️vor 2 Jahren

@BrianHie @pdhsu @arcinstitute Oooooo this could be so cool

Profilbild von Bin Shao

Bin Shaovor 2 Jahren

Very nice video! I do hope some day people can create a similar one for our language model…

Ähnliche Videos

"Everybody is thirsty for him to bring home the Evo title." From Best of Arc System Works on Evo Events.

"Everybody is thirsty for him to bring home the Evo title." From Best of Arc System Works on Evo Events.

Evo

34,016 Aufrufe • vor 3 Monaten

Evo 2, our fully open-source biological foundation model trained on trillions of DNA tokens spanning the entire tree of life, is out in nature today We & the scientific community have done a lot with this Arc Institute NVIDIA model in the last year! 🧵👇

Evo 2, our fully open-source biological foundation model trained on trillions of DNA tokens spanning the entire tree of life, is out in nature today We & the scientific community have done a lot with this Arc Institute NVIDIA model in the last year! 🧵👇

Patrick Hsu

247,099 Aufrufe • vor 3 Monaten

🚀 We're thrilled to introduce Orthrus 🧬🐕—a groundbreaking mature RNA foundation model designed to push the boundaries of RNA property prediction! 🔬 What is Orthrus? Orthrus is a Mamba-based RNA foundation model, pre-trained using a novel self-supervised contrastive learning objective with biologically inspired augmentations. It optimizes the similarity between splicing isoforms and orthologous transcripts, capturing functional and evolutionary relationships to enhance mature RNA property prediction accuracy. 📑 Preprint: 💻 Code: 🌐 Project Page: 📦 Model Weights: 🧠 Why Orthrus? Decoding the RNA regulatory code is key to understanding biology, but traditional experimental approaches are slow and costly. Existing genomic foundation models rely on techniques like masked language modeling or next-token prediction, which aren't fully aligned with the complexities of genomic data—leading to suboptimal results. 🌟 Orthrus Highlights: - Biologically-Informed Contrastive Learning 🧪: A novel contrastive learning objective designed specifically for genomics, maximizing similarity between splicing isoforms and orthologous transcripts across species. - Extensive Pre-training 📊: Trained on splicing annotations from 10 species and orthologous alignments from 400+ mammalian species (Zoonomia Project), with a focus on sequences of high functional importance. - Superior Representations🏅: Orthrus outperforms existing genomic models on 5 mRNA property prediction tasks, often surpassing supervised methods with just a simple linear transformation. - Efficiency in Low-Data Settings📉: Orthrus excels in low-data regimes, achieving state-of-the-art results with as few as 45 labeled examples for fine-tuning on RNA half-life prediction. Shoutout to the amazing leading authors Phil (Phil Fradkin) and Ian (Ian Shi)! Also the work is impossible without an outstanding collaboration by Karina (Karin(a) Isaev), Brendan (Brendan Frey) , Quaid (Quaid Morris), Leo J. Lee! Vector Institute University Health Network U of T Department of Computer Science Temerty Centre for AI in Medicine (T-CAIREM) Department of Laboratory Medicine & Pathobiology

🚀 We're thrilled to introduce Orthrus 🧬🐕—a groundbreaking mature RNA foundation model designed to push the boundaries of RNA property prediction! 🔬 What is Orthrus? Orthrus is a Mamba-based RNA foundation model, pre-trained using a novel self-supervised contrastive learning objective with biologically inspired augmentations. It optimizes the similarity between splicing isoforms and orthologous transcripts, capturing functional and evolutionary relationships to enhance mature RNA property prediction accuracy. 📑 Preprint: 💻 Code: 🌐 Project Page: 📦 Model Weights: 🧠 Why Orthrus? Decoding the RNA regulatory code is key to understanding biology, but traditional experimental approaches are slow and costly. Existing genomic foundation models rely on techniques like masked language modeling or next-token prediction, which aren't fully aligned with the complexities of genomic data—leading to suboptimal results. 🌟 Orthrus Highlights: - Biologically-Informed Contrastive Learning 🧪: A novel contrastive learning objective designed specifically for genomics, maximizing similarity between splicing isoforms and orthologous transcripts across species. - Extensive Pre-training 📊: Trained on splicing annotations from 10 species and orthologous alignments from 400+ mammalian species (Zoonomia Project), with a focus on sequences of high functional importance. - Superior Representations🏅: Orthrus outperforms existing genomic models on 5 mRNA property prediction tasks, often surpassing supervised methods with just a simple linear transformation. - Efficiency in Low-Data Settings📉: Orthrus excels in low-data regimes, achieving state-of-the-art results with as few as 45 labeled examples for fine-tuning on RNA half-life prediction. Shoutout to the amazing leading authors Phil (Phil Fradkin) and Ian (Ian Shi)! Also the work is impossible without an outstanding collaboration by Karina (Karin(a) Isaev), Brendan (Brendan Frey) , Quaid (Quaid Morris), Leo J. Lee! Vector Institute University Health Network U of T Department of Computer Science Temerty Centre for AI in Medicine (T-CAIREM) Department of Laboratory Medicine & Pathobiology

Bo Wang

114,621 Aufrufe • vor 1 Jahr

From sequence to structure, in one sentence.⚡ Today’s Agent Spotlight: Boltz-2 Structure Prediction Agent on ASI:One. Built on Massachusetts Institute of Technology (MIT)’s cutting-edge Boltz-2 model and deployed via NVIDIA's API, this agent generates 3D biomolecular structures just from a natural language prompt. Supports proteins, DNA, RNA, ligands, constraints, and even MSA data. Ideal for drug discovery, molecular biology, and biotech research. Try now: Link to Agent: Watch 👇

From sequence to structure, in one sentence.⚡ Today’s Agent Spotlight: Boltz-2 Structure Prediction Agent on ASI:One. Built on Massachusetts Institute of Technology (MIT)’s cutting-edge Boltz-2 model and deployed via NVIDIA's API, this agent generates 3D biomolecular structures just from a natural language prompt. Supports proteins, DNA, RNA, ligands, constraints, and even MSA data. Ideal for drug discovery, molecular biology, and biotech research. Try now: Link to Agent: Watch 👇

Fetch.ai

13,972 Aufrufe • vor 11 Monaten

watch me realize in realtime that Greg Brockman is deadly serious about character-level tokenization and it's already working well for Patrick Hsu, Silvana Konermann, and Patrick Collison's Arc Institute 's 40B model that is the "GPT-1 of DNA" with biological language models (instead of natural language), we may finally be able to understand the causes of genetic conditions like Ehlers-Danlos syndrome, scanning the billions of base pairs of individual human DNA in a massively scaled up way only AI can do. Superintelligent healthcare may be the one thing that excites me more than superintelligent coding agents.

watch me realize in realtime that Greg Brockman is deadly serious about character-level tokenization and it's already working well for Patrick Hsu, Silvana Konermann, and Patrick Collison's Arc Institute 's 40B model that is the "GPT-1 of DNA" with biological language models (instead of natural language), we may finally be able to understand the causes of genetic conditions like Ehlers-Danlos syndrome, scanning the billions of base pairs of individual human DNA in a massively scaled up way only AI can do. Superintelligent healthcare may be the one thing that excites me more than superintelligent coding agents.

swyx

75,685 Aufrufe • vor 10 Monaten

Meet BFM-Zero: A Promptable Humanoid Behavioral Foundation Model w/ Unsupervised RL👉 🧩ONE latent space for ALL tasks ⚡Zero-shot goal reaching, tracking, and reward optimization (any reward at test time), from ONE policy 🤖Natural recovery & transition

Meet BFM-Zero: A Promptable Humanoid Behavioral Foundation Model w/ Unsupervised RL👉 🧩ONE latent space for ALL tasks ⚡Zero-shot goal reaching, tracking, and reward optimization (any reward at test time), from ONE policy 🤖Natural recovery & transition

Yitang Li

81,375 Aufrufe • vor 7 Monaten

.Justin Wong and his crew are back for Round 2 of Evo Connections Rock, Paper, Scissors Presented by AT&T. This time tasty steve comes out on top with some old fashion rock play.

.Justin Wong and his crew are back for Round 2 of Evo Connections Rock, Paper, Scissors Presented by AT&T. This time tasty steve comes out on top with some old fashion rock play.

Evo

145,676 Aufrufe • vor 11 Monaten

Fantastic news for genome engineers: Bridge recombinases work in human cells!!🧬 And they can make really big insertions, deletions, and inversions with impressive efficiency. From Arc Institute Patrick Hsu Nicholas Perry & team

Fantastic news for genome engineers: Bridge recombinases work in human cells!!🧬 And they can make really big insertions, deletions, and inversions with impressive efficiency. From Arc Institute Patrick Hsu Nicholas Perry & team

Julia Bauman

16,341 Aufrufe • vor 1 Jahr

Today we're introducing TRIBE v2 (Trimodal Brain Encoder), a foundation model trained to predict how the human brain responds to almost any sight or sound. Building on our Algonauts 2025 award-winning architecture, TRIBE v2 draws on 500+ hours of fMRI recordings from 700+ people to create a digital twin of neural activity and enable zero-shot predictions for new subjects, languages, and tasks. Try the demo and learn more here:

Today we're introducing TRIBE v2 (Trimodal Brain Encoder), a foundation model trained to predict how the human brain responds to almost any sight or sound. Building on our Algonauts 2025 award-winning architecture, TRIBE v2 draws on 500+ hours of fMRI recordings from 700+ people to create a digital twin of neural activity and enable zero-shot predictions for new subjects, languages, and tasks. Try the demo and learn more here:

AI at Meta

6,930,920 Aufrufe • vor 3 Monaten

The Wazzler delivered and secured the victory for Team Justin Wong in Evo Connections Rock, Paper, Scissors Presented by AT&T. Thank you to all of competitors and everyone that participated at home.

The Wazzler delivered and secured the victory for Team Justin Wong in Evo Connections Rock, Paper, Scissors Presented by AT&T. Thank you to all of competitors and everyone that participated at home.

Evo

183,702 Aufrufe • vor 11 Monaten

Excited to release METAGENE-1, a 7B parameter metagenomic foundation model, built to aid in pathogen detection & pandemic monitoring. Pretrained on 1.5 trillion base pairs of DNA/RNA sequenced from wastewater. A collab w/ USC, Prime Intellect, & the Nucleic Acid Observatory. 🧵

Excited to release METAGENE-1, a 7B parameter metagenomic foundation model, built to aid in pathogen detection & pandemic monitoring. Pretrained on 1.5 trillion base pairs of DNA/RNA sequenced from wastewater. A collab w/ USC, Prime Intellect, & the Nucleic Acid Observatory. 🧵

Willie Neiswanger

13,375 Aufrufe • vor 1 Jahr

🏗️ Policy Adaptation from Foundation Model Feedback #CVPR2023 Instead of using foundation model as a pre-trained encoder (generator), we use it as a Teacher (discriminator) to tell where our policy did wrong and helps it adapts to new envs and tasks.

🏗️ Policy Adaptation from Foundation Model Feedback #CVPR2023 Instead of using foundation model as a pre-trained encoder (generator), we use it as a Teacher (discriminator) to tell where our policy did wrong and helps it adapts to new envs and tasks.

Xiaolong Wang

24,396 Aufrufe • vor 3 Jahren

What is it actually like to build on Arc? At Arc Studio, early builders from Bu Finance, Dynamic, and Sequence shared how they’re using Arc to power wallets, interoperability, and better UX for real applications. From embedded wallets to crosschain coordination, this is what’s being built on Arc today.

What is it actually like to build on Arc? At Arc Studio, early builders from Bu Finance, Dynamic, and Sequence shared how they’re using Arc to power wallets, interoperability, and better UX for real applications. From embedded wallets to crosschain coordination, this is what’s being built on Arc today.

Arc

11,747 Aufrufe • vor 2 Monaten

‘INSIDIOUS’: Even if you didn’t get the COVID shot, you COULD be producing the spike protein. “We're finding individuals that never received the vaccine that are still producing spike protein and we're finding the messenger RNA in those individuals as well.” Watch today’s episode of ‘Doctors and Scientists’ with Brian Hooker and Polly Tommey on CHDTV ⬇️

‘INSIDIOUS’: Even if you didn’t get the COVID shot, you COULD be producing the spike protein. “We're finding individuals that never received the vaccine that are still producing spike protein and we're finding the messenger RNA in those individuals as well.” Watch today’s episode of ‘Doctors and Scientists’ with Brian Hooker and Polly Tommey on CHDTV ⬇️

Dr Dave Cartland BMedSc MBChB Ex-MRCGP

40,509 Aufrufe • vor 7 Monaten

The Segment Anything Model (SAM) by Meta AI is a step toward the first foundation model for image segmentation. SAM is capable of one-click segmentation of any object from photos or videos + zero-shot transfer to other segmentation tasks. Try the demo ➡️

The Segment Anything Model (SAM) by Meta AI is a step toward the first foundation model for image segmentation. SAM is capable of one-click segmentation of any object from photos or videos + zero-shot transfer to other segmentation tasks. Try the demo ➡️

AI at Meta

186,324 Aufrufe • vor 3 Jahren

“Another Evo. Another year of greatness. Another year of history.” #Evo2026 is this weekend! Join us tonight at 6PM PDT on Twitch on YouTube, where we’ll be hanging out to talk about this year’s 12 featured tournaments and more of what to expect from the event in the official Evo 2026 Preview Show!

“Another Evo. Another year of greatness. Another year of history.” #Evo2026 is this weekend! Join us tonight at 6PM PDT on Twitch on YouTube, where we’ll be hanging out to talk about this year’s 12 featured tournaments and more of what to expect from the event in the official Evo 2026 Preview Show!

Evo

21,880 Aufrufe • vor 7 Tagen

On the Tekken 8 side, Team Vitality 🐝 player VIT JEonDDing is well aware of the level of competition at Evo France and knows he can’t afford to make any mistakes.

On the Tekken 8 side, Team Vitality 🐝 player VIT JEonDDing is well aware of the level of competition at Evo France and knows he can’t afford to make any mistakes.

Evo France

35,736 Aufrufe • vor 8 Monaten

New to the ecosystem? Here's a quick primer on Polkadot's history and architecture, from Bill Laboon | Web3 Foundation, Head of Education & Governance Initiatives at Web3 Foundation (Plus, why Web3 resonates in LATAM) Watch now ⤵️

New to the ecosystem? Here's a quick primer on Polkadot's history and architecture, from Bill Laboon | Web3 Foundation, Head of Education & Governance Initiatives at Web3 Foundation (Plus, why Web3 resonates in LATAM) Watch now ⤵️

Polkadot

67,814 Aufrufe • vor 1 Jahr

🚨David Friedberg: AI is starting to identify and solve problems on its own “I'll give you a science corner example: there's this Evo 2 model that they publish at the Arc Institute, which Patrick Collison, you know, is the main funder and chairman.” “So that Evo 2 model, they just ingested all the DNA data they could find in the world.” “Trillions and trillions of base paired data that they ingested and then they looked at patterns in DNA. And that's it.” “They had no context for what the DNA represented, they had no context for the concept of genes, none of the structured understanding of what that DNA does, what it is, and you know what it did?” “They fed in the BRCA gene variant and the thing output a warning saying, ‘I think that this is a pathogenic variant to DNA,’ without having any context.” “This is the breast cancer allele.” “And it didn't have any knowledge and it wasn't trained on that at all.” “It had no knowledge that there are pathogenic variants for cancer, and it identified that this was a genetic variant that can cause some sort of pathogenic outcome in the organism.” “That's a great example where there's a lack of understanding at the human level on what really drives some of the patterns in nature, the patterns in society, the patterns in behavior that are kind of emergent phenomena perhaps, that these AI models are starting to identify.”

🚨David Friedberg: AI is starting to identify and solve problems on its own “I'll give you a science corner example: there's this Evo 2 model that they publish at the Arc Institute, which Patrick Collison, you know, is the main funder and chairman.” “So that Evo 2 model, they just ingested all the DNA data they could find in the world.” “Trillions and trillions of base paired data that they ingested and then they looked at patterns in DNA. And that's it.” “They had no context for what the DNA represented, they had no context for the concept of genes, none of the structured understanding of what that DNA does, what it is, and you know what it did?” “They fed in the BRCA gene variant and the thing output a warning saying, ‘I think that this is a pathogenic variant to DNA,’ without having any context.” “This is the breast cancer allele.” “And it didn't have any knowledge and it wasn't trained on that at all.” “It had no knowledge that there are pathogenic variants for cancer, and it identified that this was a genetic variant that can cause some sort of pathogenic outcome in the organism.” “That's a great example where there's a lack of understanding at the human level on what really drives some of the patterns in nature, the patterns in society, the patterns in behavior that are kind of emergent phenomena perhaps, that these AI models are starting to identify.”

The All-In Podcast

79,717 Aufrufe • vor 11 Monaten