Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Introducing FlexOlmo, a new paradigm for language model training that enables the co-development of AI through data collaboration. 🧵

Ai2

84,820 subscribers

370,042 views • 11 months ago •via X (Twitter)

Science & Technology Education

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Introducing The Largest Organized and Incentivized Human-Data Fleet for General-Purpose Humanoid-Robotics and large language model training Our users are creators that complete daily data quests with crypto incentives through our Mobile App 🧵

Introducing The Largest Organized and Incentivized Human-Data Fleet for General-Purpose Humanoid-Robotics and large language model training Our users are creators that complete daily data quests with crypto incentives through our Mobile App 🧵

Mecka

385,569 views • 2 years ago

Can data owners & LM developers collaborate to build a strong shared model while each retaining data control? Introducing FlexOlmo💪, a mixture-of-experts LM enabling: • Flexible training on your local data without sharing it • Flexible inference to opt in/out your data anytime At 37B parameters, FlexOlmo is competitive across 31 tasks.

Can data owners & LM developers collaborate to build a strong shared model while each retaining data control? Introducing FlexOlmo💪, a mixture-of-experts LM enabling: • Flexible training on your local data without sharing it • Flexible inference to opt in/out your data anytime At 37B parameters, FlexOlmo is competitive across 31 tasks.

Weijia Shi

95,514 views • 11 months ago

OpenAI Co-founder Andrej Karpathy explains the new computing paradigm: "We're entering a new computing paradigm with large language models acting like CPUs, using tokens instead of bytes, and having a context window instead of RAM. This is the Large Language Model OS (LMOS)"

OpenAI Co-founder Andrej Karpathy explains the new computing paradigm: "We're entering a new computing paradigm with large language models acting like CPUs, using tokens instead of bytes, and having a context window instead of RAM. This is the Large Language Model OS (LMOS)"

Haider.

552,316 views • 2 years ago

Introducing LDA, a latent world action foundation model that, for the first time, unifies the utilization of heterogeneous embodied data across simulation and reality, humans and robots, and varying levels of action quality and annotation. By breaking long-standing data silos in embodied intelligence, LDA enables the field, much like GPT did for language, to benefit continuously from scaling data, marking the transition into a new era of scalable learning. #Galbot #Robotics #Innovation #AI #Technology #Humanoid #WorldModel

Introducing LDA, a latent world action foundation model that, for the first time, unifies the utilization of heterogeneous embodied data across simulation and reality, humans and robots, and varying levels of action quality and annotation. By breaking long-standing data silos in embodied intelligence, LDA enables the field, much like GPT did for language, to benefit continuously from scaling data, marking the transition into a new era of scalable learning. #Galbot #Robotics #Innovation #AI #Technology #Humanoid #WorldModel

Galbot

37,804 views • 2 months ago

Introducing 𝐃𝐫𝐞𝐚𝐦𝐆𝐞𝐧! We got humanoid robots to perform totally new 𝑣𝑒𝑟𝑏𝑠 in new environments through video world models. We believe video world models will solve the data problem in robotics. Bringing the paradigm of scaling human hours to GPU hours. Quick 🧵

Introducing 𝐃𝐫𝐞𝐚𝐦𝐆𝐞𝐧! We got humanoid robots to perform totally new 𝑣𝑒𝑟𝑏𝑠 in new environments through video world models. We believe video world models will solve the data problem in robotics. Bringing the paradigm of scaling human hours to GPU hours. Quick 🧵

Joel Jang

117,493 views • 1 year ago

KULR has entered a joint development collaboration co-develop a next generation $KULR ONE MAX Battery Backup Unit for AI scale data centers Learn more here:

KULR has entered a joint development collaboration co-develop a next generation $KULR ONE MAX Battery Backup Unit for AI scale data centers Learn more here:

KULR Technology

19,157 views • 6 months ago

Today, Generative AI takes its next big step forward. Introducing Gen-1: a new AI model that uses language and images to generate new videos out of existing ones. Sign up for early research access:

Today, Generative AI takes its next big step forward. Introducing Gen-1: a new AI model that uses language and images to generate new videos out of existing ones. Sign up for early research access:

Runway

2,480,387 views • 3 years ago

Introducing the new Where everyone can contribute to model development And benefit from it Enter FLock, the private AI training platform, where AI is created, trained, and governed by all. Collaborative, Onchain, And Private Not your model, not your AI YOUR model, YOUR AI

Introducing the new Where everyone can contribute to model development And benefit from it Enter FLock, the private AI training platform, where AI is created, trained, and governed by all. Collaborative, Onchain, And Private Not your model, not your AI YOUR model, YOUR AI

FLock.io

69,464 views • 1 year ago

Satya Nadella says the convergence of quantum computing and AI will unlock the language of nature Because nature is inherently quantum, quantum computers are the ultimate tool to generate training data for AI models "this enables predictive simulations, like testing cancer immunotherapies"

Satya Nadella says the convergence of quantum computing and AI will unlock the language of nature Because nature is inherently quantum, quantum computers are the ultimate tool to generate training data for AI models "this enables predictive simulations, like testing cancer immunotherapies"

Haider.

17,148 views • 3 months ago

$Introducing HRM-Text. An ultra-lean 1B-parameter reasoning language model designed to deliver strong general performance with a fraction of the data, compute, and infrastructure. Trained on just 40B structured tokens, HRM-Text achieves competitive performance while using ~1/1000 of the training data of comparable models. The kicker? The full model trains in roughly one day on a $1,000 budget. This opens the door to a new generation of AI that is powerful, accessible, and radically easier to adapt. Theories and research concepts once deemed too expensive to test are officially back in the game. Sapient Intelligence invites you to help us shape a new paradigm for general intelligence.$

Introducing HRM-Text. An ultra-lean 1B-parameter reasoning language model designed to deliver strong general performance with a fraction of the data, compute, and infrastructure. Trained on just 40B structured tokens, HRM-Text achieves competitive performance while using ~1/1000 of the training data of comparable models. The kicker? The full model trains in roughly one day on a $1,000 budget. This opens the door to a new generation of AI that is powerful, accessible, and radically easier to adapt. Theories and research concepts once deemed too expensive to test are officially back in the game. Sapient Intelligence invites you to help us shape a new paradigm for general intelligence.

Sapient Intelligence

510,542 views • 1 month ago

Sam Altman says AI reasoning is still at the GPT-2 stage but the improvement curve is steep and the new o1 model represents a new paradigm of AI development which will enable rapid progress in capabilities

Sam Altman says AI reasoning is still at the GPT-2 stage but the improvement curve is steep and the new o1 model represents a new paradigm of AI development which will enable rapid progress in capabilities

Tsarathustra

419,003 views • 1 year ago

A reward model that works, zero-shot, across robots, tasks, and scenes? Introducing Robometer: Scaling general-purpose robotic reward models with 1M+ trajectories. Enables zero-shot: online/offline/model-based RL, data retrieval + IL, automatic failure detection, and more! 🧵 (1/12)

A reward model that works, zero-shot, across robots, tasks, and scenes? Introducing Robometer: Scaling general-purpose robotic reward models with 1M+ trajectories. Enables zero-shot: online/offline/model-based RL, data retrieval + IL, automatic failure detection, and more! 🧵 (1/12)

Jesse Zhang

100,274 views • 3 months ago

Introducing a small portion of proprietary phenomics data from Recursion into the training of MolGPS, our foundation model for molecular property prediction, led to massive performance increases on new & existing benchmarks. Learn more about the impact of data & scale.

Introducing a small portion of proprietary phenomics data from Recursion into the training of MolGPS, our foundation model for molecular property prediction, led to massive performance increases on new & existing benchmarks. Learn more about the impact of data & scale.

Valence Labs

10,091 views • 1 year ago

Goal-conditioned RL (GCRL) is great - unsupervised, can use data (in offline mode), flexibility to define tasks at test time. But can we run GCRL on *language data*?? In our new work we show that language GCRL enables sophisticated test-time reasoning for interactive tasks! 🧵👇

Goal-conditioned RL (GCRL) is great - unsupervised, can use data (in offline mode), flexibility to define tasks at test time. But can we run GCRL on language data?? In our new work we show that language GCRL enables sophisticated test-time reasoning for interactive tasks! 🧵👇

Sergey Levine

18,782 views • 1 year ago

Edge Computing 🤝 Federated Learning The next AI breakthrough lies in unlocking private data. By expanding training from public to private data, FLock enables AI models to specialise, delivering deeper insights and continuous innovation. Introducing the FLock FL Alliance.

Edge Computing 🤝 Federated Learning The next AI breakthrough lies in unlocking private data. By expanding training from public to private data, FLock enables AI models to specialise, delivering deeper insights and continuous innovation. Introducing the FLock FL Alliance.

FLock.io

102,531 views • 1 year ago

Introducing Paradigm – a reimagined workspace with AI at its core. Centered around the primitive of a spreadsheet, Paradigm puts swarms of intelligent agents at your fingertips. The real power of Paradigm comes with scale: imagine having tens of thousands of interns working for you in parallel. Paradigm is 1000x faster than manual data collection, completing an average of 500 cells per minute. Check out Paradigm in action below.

Introducing Paradigm – a reimagined workspace with AI at its core. Centered around the primitive of a spreadsheet, Paradigm puts swarms of intelligent agents at your fingertips. The real power of Paradigm comes with scale: imagine having tens of thousands of interns working for you in parallel. Paradigm is 1000x faster than manual data collection, completing an average of 500 cells per minute. Check out Paradigm in action below.

Anna Monaco

588,895 views • 1 year ago