Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Introducing FlexOlmo, a new paradigm for language model training that enables the co-development of AI through data collaboration. 🧵

Ai2

86,025 subscribers

377,039 views • 1 year ago •via X (Twitter)

Science & Technology Education

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Introducing The Largest Organized and Incentivized Human-Data Fleet for General-Purpose Humanoid-Robotics and large language model training Our users are creators that complete daily data quests with crypto incentives through our Mobile App 🧵

Introducing The Largest Organized and Incentivized Human-Data Fleet for General-Purpose Humanoid-Robotics and large language model training Our users are creators that complete daily data quests with crypto incentives through our Mobile App 🧵

Mecka

385,784 views • 2 years ago

Can data owners & LM developers collaborate to build a strong shared model while each retaining data control? Introducing FlexOlmo💪, a mixture-of-experts LM enabling: • Flexible training on your local data without sharing it • Flexible inference to opt in/out your data anytime At 37B parameters, FlexOlmo is competitive across 31 tasks.

Can data owners & LM developers collaborate to build a strong shared model while each retaining data control? Introducing FlexOlmo💪, a mixture-of-experts LM enabling: • Flexible training on your local data without sharing it • Flexible inference to opt in/out your data anytime At 37B parameters, FlexOlmo is competitive across 31 tasks.

Weijia Shi

100,038 views • 1 year ago

OpenAI Co-founder Andrej Karpathy explains the new computing paradigm: "We're entering a new computing paradigm with large language models acting like CPUs, using tokens instead of bytes, and having a context window instead of RAM. This is the Large Language Model OS (LMOS)"

OpenAI Co-founder Andrej Karpathy explains the new computing paradigm: "We're entering a new computing paradigm with large language models acting like CPUs, using tokens instead of bytes, and having a context window instead of RAM. This is the Large Language Model OS (LMOS)"

Haider.

552,430 views • 2 years ago

Introducing LDA, a latent world action foundation model that, for the first time, unifies the utilization of heterogeneous embodied data across simulation and reality, humans and robots, and varying levels of action quality and annotation. By breaking long-standing data silos in embodied intelligence, LDA enables the field, much like GPT did for language, to benefit continuously from scaling data, marking the transition into a new era of scalable learning. #Galbot #Robotics #Innovation #AI #Technology #Humanoid #WorldModel

Introducing LDA, a latent world action foundation model that, for the first time, unifies the utilization of heterogeneous embodied data across simulation and reality, humans and robots, and varying levels of action quality and annotation. By breaking long-standing data silos in embodied intelligence, LDA enables the field, much like GPT did for language, to benefit continuously from scaling data, marking the transition into a new era of scalable learning. #Galbot #Robotics #Innovation #AI #Technology #Humanoid #WorldModel

Galbot

39,768 views • 4 months ago

Introducing 𝐃𝐫𝐞𝐚𝐦𝐆𝐞𝐧! We got humanoid robots to perform totally new 𝑣𝑒𝑟𝑏𝑠 in new environments through video world models. We believe video world models will solve the data problem in robotics. Bringing the paradigm of scaling human hours to GPU hours. Quick 🧵

Introducing 𝐃𝐫𝐞𝐚𝐦𝐆𝐞𝐧! We got humanoid robots to perform totally new 𝑣𝑒𝑟𝑏𝑠 in new environments through video world models. We believe video world models will solve the data problem in robotics. Bringing the paradigm of scaling human hours to GPU hours. Quick 🧵

Joel Jang

117,574 views • 1 year ago

KULR has entered a joint development collaboration co-develop a next generation $KULR ONE MAX Battery Backup Unit for AI scale data centers Learn more here:

KULR has entered a joint development collaboration co-develop a next generation $KULR ONE MAX Battery Backup Unit for AI scale data centers Learn more here:

KULR Technology

19,267 views • 8 months ago

Today, Generative AI takes its next big step forward. Introducing Gen-1: a new AI model that uses language and images to generate new videos out of existing ones. Sign up for early research access:

Today, Generative AI takes its next big step forward. Introducing Gen-1: a new AI model that uses language and images to generate new videos out of existing ones. Sign up for early research access:

Runway

2,480,715 views • 3 years ago

Satya Nadella says the convergence of quantum computing and AI will unlock the language of nature Because nature is inherently quantum, quantum computers are the ultimate tool to generate training data for AI models "this enables predictive simulations, like testing cancer immunotherapies"

Satya Nadella says the convergence of quantum computing and AI will unlock the language of nature Because nature is inherently quantum, quantum computers are the ultimate tool to generate training data for AI models "this enables predictive simulations, like testing cancer immunotherapies"

Haider.

17,148 views • 5 months ago

$Introducing HRM-Text. An ultra-lean 1B-parameter reasoning language model designed to deliver strong general performance with a fraction of the data, compute, and infrastructure. Trained on just 40B structured tokens, HRM-Text achieves competitive performance while using ~1/1000 of the training data of comparable models. The kicker? The full model trains in roughly one day on a $1,000 budget. This opens the door to a new generation of AI that is powerful, accessible, and radically easier to adapt. Theories and research concepts once deemed too expensive to test are officially back in the game. Sapient Intelligence invites you to help us shape a new paradigm for general intelligence.$

Introducing HRM-Text. An ultra-lean 1B-parameter reasoning language model designed to deliver strong general performance with a fraction of the data, compute, and infrastructure. Trained on just 40B structured tokens, HRM-Text achieves competitive performance while using ~1/1000 of the training data of comparable models. The kicker? The full model trains in roughly one day on a $1,000 budget. This opens the door to a new generation of AI that is powerful, accessible, and radically easier to adapt. Theories and research concepts once deemed too expensive to test are officially back in the game. Sapient Intelligence invites you to help us shape a new paradigm for general intelligence.

Sapient Intelligence

516,755 views • 3 months ago

Sam Altman says AI reasoning is still at the GPT-2 stage but the improvement curve is steep and the new o1 model represents a new paradigm of AI development which will enable rapid progress in capabilities

Sam Altman says AI reasoning is still at the GPT-2 stage but the improvement curve is steep and the new o1 model represents a new paradigm of AI development which will enable rapid progress in capabilities

Tsarathustra

419,003 views • 1 year ago

A reward model that works, zero-shot, across robots, tasks, and scenes? Introducing Robometer: Scaling general-purpose robotic reward models with 1M+ trajectories. Enables zero-shot: online/offline/model-based RL, data retrieval + IL, automatic failure detection, and more! 🧵 (1/12)

A reward model that works, zero-shot, across robots, tasks, and scenes? Introducing Robometer: Scaling general-purpose robotic reward models with 1M+ trajectories. Enables zero-shot: online/offline/model-based RL, data retrieval + IL, automatic failure detection, and more! 🧵 (1/12)

Jesse Zhang

102,369 views • 6 months ago

Introducing a small portion of proprietary phenomics data from Recursion into the training of MolGPS, our foundation model for molecular property prediction, led to massive performance increases on new & existing benchmarks. Learn more about the impact of data & scale.

Introducing a small portion of proprietary phenomics data from Recursion into the training of MolGPS, our foundation model for molecular property prediction, led to massive performance increases on new & existing benchmarks. Learn more about the impact of data & scale.

Valence Labs

10,091 views • 1 year ago

Goal-conditioned RL (GCRL) is great - unsupervised, can use data (in offline mode), flexibility to define tasks at test time. But can we run GCRL on *language data*?? In our new work we show that language GCRL enables sophisticated test-time reasoning for interactive tasks! 🧵👇

Goal-conditioned RL (GCRL) is great - unsupervised, can use data (in offline mode), flexibility to define tasks at test time. But can we run GCRL on language data?? In our new work we show that language GCRL enables sophisticated test-time reasoning for interactive tasks! 🧵👇

Sergey Levine

18,782 views • 1 year ago

Edge Computing 🤝 Federated Learning The next AI breakthrough lies in unlocking private data. By expanding training from public to private data, FLock enables AI models to specialise, delivering deeper insights and continuous innovation. Introducing the FLock FL Alliance.

Edge Computing 🤝 Federated Learning The next AI breakthrough lies in unlocking private data. By expanding training from public to private data, FLock enables AI models to specialise, delivering deeper insights and continuous innovation. Introducing the FLock FL Alliance.

FLock.io

102,558 views • 1 year ago

Introducing Paradigm – a reimagined workspace with AI at its core. Centered around the primitive of a spreadsheet, Paradigm puts swarms of intelligent agents at your fingertips. The real power of Paradigm comes with scale: imagine having tens of thousands of interns working for you in parallel. Paradigm is 1000x faster than manual data collection, completing an average of 500 cells per minute. Check out Paradigm in action below.

Introducing Paradigm – a reimagined workspace with AI at its core. Centered around the primitive of a spreadsheet, Paradigm puts swarms of intelligent agents at your fingertips. The real power of Paradigm comes with scale: imagine having tens of thousands of interns working for you in parallel. Paradigm is 1000x faster than manual data collection, completing an average of 500 cells per minute. Check out Paradigm in action below.

Anna Monaco

589,963 views • 2 years ago