Radical Numerics's banner

Radical Numerics

@RadicalNumerics • 4,337 subscribers

Systems, scaling and architecture for general biological intelligence

Shorts

1/8 Does text-to-image generation need language pretraining? Today, we share Halcyon, a family of early-fusion, base models trained from scratch. Halcyon outperforms strong late-fusion baselines with up to 275× less pretraining compute. Models and recipes are open. Halcyon is part of a research program at Radical Numerics on the science of multimodal pretraining and scaling.

1/8 Does text-to-image generation need language pretraining? Today, we share Halcyon, a family of early-fusion, base models trained from scratch. Halcyon outperforms strong late-fusion baselines with up to 275× less pretraining compute. Models and recipes are open. Halcyon is part of a research program at Radical Numerics on the science of multimodal pretraining and scaling.

75,659 Aufrufe

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

1/5 What does it take to scale pretraining to 20+ data modalities at once? Improved data mixing methods are one important ingredient. Today, we share how we scale data mixing to thousands of sources for DNA and natural language pretraining of Omnii, our multimodal genome model.

1/5 What does it take to scale pretraining to 20+ data modalities at once? Improved data mixing methods are one important ingredient. Today, we share how we scale data mixing to thousands of sources for DNA and natural language pretraining of Omnii, our multimodal genome model.

Radical Numerics

367,073 Aufrufe • vor 13 Tagen

1/10 Introducing Omnii Genome, one of eight Advances built on Omnii-1. A single generalist model now outperforms leading specialized models (AlphaGenome) in linking genetic changes to gene activity and mapping regulatory interactions. These capabilities help make sense of the 98% of the human genome that doesn’t code for proteins How Omnii-1 works:

1/10 Introducing Omnii Genome, one of eight Advances built on Omnii-1. A single generalist model now outperforms leading specialized models (AlphaGenome) in linking genetic changes to gene activity and mapping regulatory interactions. These capabilities help make sense of the 98% of the human genome that doesn’t code for proteins How Omnii-1 works:

Radical Numerics

55,799 Aufrufe • vor 3 Tagen

Keine weiteren Inhalte verfügbar