Radical Numerics's banner

Radical Numerics

@RadicalNumerics • 4,434 subscribers

Systems, scaling and architecture for general biological intelligence

Shorts

1/8 Does text-to-image generation need language pretraining? Today, we share Halcyon, a family of early-fusion, base models trained from scratch. Halcyon outperforms strong late-fusion baselines with up to 275× less pretraining compute. Models and recipes are open. Halcyon is part of a research program at Radical Numerics on the science of multimodal pretraining and scaling.

1/8 Does text-to-image generation need language pretraining? Today, we share Halcyon, a family of early-fusion, base models trained from scratch. Halcyon outperforms strong late-fusion baselines with up to 275× less pretraining compute. Models and recipes are open. Halcyon is part of a research program at Radical Numerics on the science of multimodal pretraining and scaling.

76,603 Aufrufe

1/ With Omnii Diagnostics, we asked whether a multimodal genome language model could help find cancers whose signals in blood are too faint for current classifiers. We adapted Omnii-1 to a biomarker never seen in pretraining. In a test cohort, Omnii's features improved early-stage cancer detection

1/ With Omnii Diagnostics, we asked whether a multimodal genome language model could help find cancers whose signals in blood are too faint for current classifiers. We adapted Omnii-1 to a biomarker never seen in pretraining. In a test cohort, Omnii's features improved early-stage cancer detection

17,686 Aufrufe

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

1/5 What does it take to scale pretraining to 20+ data modalities at once? Improved data mixing methods are one important ingredient. Today, we share how we scale data mixing to thousands of sources for DNA and natural language pretraining of Omnii, our multimodal genome model.

1/5 What does it take to scale pretraining to 20+ data modalities at once? Improved data mixing methods are one important ingredient. Today, we share how we scale data mixing to thousands of sources for DNA and natural language pretraining of Omnii, our multimodal genome model.

Radical Numerics

367,277 Aufrufe • vor 21 Tagen

1/10 Introducing Omnii Genome, one of eight Advances built on Omnii-1. A single generalist model now outperforms leading specialized models (AlphaGenome) in linking genetic changes to gene activity and mapping regulatory interactions. These capabilities help make sense of the 98% of the human genome that doesn’t code for proteins How Omnii-1 works:

1/10 Introducing Omnii Genome, one of eight Advances built on Omnii-1. A single generalist model now outperforms leading specialized models (AlphaGenome) in linking genetic changes to gene activity and mapping regulatory interactions. These capabilities help make sense of the 98% of the human genome that doesn’t code for proteins How Omnii-1 works:

Radical Numerics

56,605 Aufrufe • vor 11 Tagen

Keine weiteren Inhalte verfügbar