Загрузка видео...

Не удалось загрузить видео

Возникла проблема при загрузке этого видео. Это может быть связано с временными проблемами сети или видео может быть недоступно.

На главную

Google's Jeff Dean says current pre-training is passive: initialize a model, stream the internet past it, let it observe But models need to learn not just from data, but by acting, predicting, and choosing what to learn from next "we have this artificial distinction now between pre and post-training,... show more

Haider.

66,791 subscribers

55,632 просмотров • 2 месяцев назад •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

"We’ve moved past it, but we have to learn from it. … We need some guys to dig in and stack some consistent games together." Hear from head coach Rick Tocchet following today's practice at Flyers Training Center.

"We’ve moved past it, but we have to learn from it. … We need some guys to dig in and stack some consistent games together." Hear from head coach Rick Tocchet following today's practice at Flyers Training Center.

Philadelphia Flyers

23,259 просмотров • 4 месяцев назад

New Course: Post-training of LLMs Learn to post-train and customize an LLM in this short course, taught by Banghua Zhu, Assistant Professor at the University of Washington University of Washington, and co-founder of @NexusflowX. Training an LLM to follow instructions or answer questions has two key stages: pre-training and post-training. In pre-training, it learns to predict the next word or token from large amounts of unlabeled text. In post-training, it learns useful behaviors such as following instructions, tool use, and reasoning. Post-training transforms a general-purpose token predictor—trained on trillions of unlabeled text tokens—into an assistant that follows instructions and performs specific tasks. Because it is much cheaper than pre-training, it is practical for many more teams to incorporate post-training methods into their workflows than pre-training. In this course, you’ll learn three common post-training methods—Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning (RL)—and how to use each one effectively. With SFT, you train the model on pairs of input and ideal output responses. With DPO, you provide both a preferred (chosen) and a less preferred (rejected) response and train the model to favor the preferred output. With RL, the model generates an output, receives a reward score based on human or automated feedback, and updates the model to improve performance. You’ll learn the basic concepts, common use cases, and principles for curating high-quality data for effective training. Through hands-on labs, you’ll download a pre-trained model from Hugging Face and post-train it using SFT, DPO, and RL to see how each technique shapes model behavior. In detail, you’ll: - Understand what post-training is, when to use it, and how it differs from pre-training. - Build an SFT pipeline to turn a base model into an instruct model. - Explore how DPO reshapes behavior by minimizing contrastive loss—penalizing poor responses and reinforcing preferred ones. - Implement a DPO pipeline to change the identity of a chat assistant. - Learn online RL methods such as Proximal Policy Optimization (PPO) and Group Relative Policy Optimization (GRPO), and how to design reward functions. - Train a model with GRPO to improve its math capabilities using a verifiable reward. Post-training is one of the most rapidly developing areas of LLM training. Whether you’re building a high-accuracy context-specific assistant, fine-tuning a model's tone, or improving task-specific accuracy, this course will give you experience with the most important techniques shaping how LLMs are post-trained today. Please sign up here:

New Course: Post-training of LLMs Learn to post-train and customize an LLM in this short course, taught by Banghua Zhu, Assistant Professor at the University of Washington University of Washington, and co-founder of @NexusflowX. Training an LLM to follow instructions or answer questions has two key stages: pre-training and post-training. In pre-training, it learns to predict the next word or token from large amounts of unlabeled text. In post-training, it learns useful behaviors such as following instructions, tool use, and reasoning. Post-training transforms a general-purpose token predictor—trained on trillions of unlabeled text tokens—into an assistant that follows instructions and performs specific tasks. Because it is much cheaper than pre-training, it is practical for many more teams to incorporate post-training methods into their workflows than pre-training. In this course, you’ll learn three common post-training methods—Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning (RL)—and how to use each one effectively. With SFT, you train the model on pairs of input and ideal output responses. With DPO, you provide both a preferred (chosen) and a less preferred (rejected) response and train the model to favor the preferred output. With RL, the model generates an output, receives a reward score based on human or automated feedback, and updates the model to improve performance. You’ll learn the basic concepts, common use cases, and principles for curating high-quality data for effective training. Through hands-on labs, you’ll download a pre-trained model from Hugging Face and post-train it using SFT, DPO, and RL to see how each technique shapes model behavior. In detail, you’ll: - Understand what post-training is, when to use it, and how it differs from pre-training. - Build an SFT pipeline to turn a base model into an instruct model. - Explore how DPO reshapes behavior by minimizing contrastive loss—penalizing poor responses and reinforcing preferred ones. - Implement a DPO pipeline to change the identity of a chat assistant. - Learn online RL methods such as Proximal Policy Optimization (PPO) and Group Relative Policy Optimization (GRPO), and how to design reward functions. - Train a model with GRPO to improve its math capabilities using a verifiable reward. Post-training is one of the most rapidly developing areas of LLM training. Whether you’re building a high-accuracy context-specific assistant, fine-tuning a model's tone, or improving task-specific accuracy, this course will give you experience with the most important techniques shaping how LLMs are post-trained today. Please sign up here:

Andrew Ng

125,146 просмотров • 11 месяцев назад

Most people have heard of big model smell, but what about pristine pre-training smell? Evan and Derry seem to think it exists.

Most people have heard of big model smell, but what about pristine pre-training smell? Evan and Derry seem to think it exists.

Arena.ai

12,704 просмотров • 2 месяцев назад

In case you missed it, we recently launched "Post-training of LLMs," a short course where you'll: ✅ Understand when and why to use post-training methods like Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning. ✅ Learn the concepts underlying the three post-training methods of SFT, DPO, and Online RL, their common use-cases, and how to curate high-quality data to effectively train a model using each method. ✅ Download a pre-trained model and implement post-training pipelines to turn a base model into an instruct model, change the identity of a chat assistant, and improve a model’s math capabilities. Learn more and enroll for free:

In case you missed it, we recently launched "Post-training of LLMs," a short course where you'll: ✅ Understand when and why to use post-training methods like Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning. ✅ Learn the concepts underlying the three post-training methods of SFT, DPO, and Online RL, their common use-cases, and how to curate high-quality data to effectively train a model using each method. ✅ Download a pre-trained model and implement post-training pipelines to turn a base model into an instruct model, change the identity of a chat assistant, and improve a model’s math capabilities. Learn more and enroll for free:

DeepLearning.AI

16,746 просмотров • 11 месяцев назад

We discovered an emergent property of VLAs like π0/π0.5/π0.6: as we scale up pre-training, the model learns to align human videos and robot data! This gives us a simple way to leverage human videos. Once π0.5 knows how to control robots, it can naturally learn from human video.

We discovered an emergent property of VLAs like π0/π0.5/π0.6: as we scale up pre-training, the model learns to align human videos and robot data! This gives us a simple way to leverage human videos. Once π0.5 knows how to control robots, it can naturally learn from human video.

Physical Intelligence

1,181,291 просмотров • 5 месяцев назад

Jensen just said he was reading a text from DeepMind’s Demis confirming it: pre-training + post-training scaling laws are fully intact, and Gemini 3 is the proof. A huge jump in quality exactly what Blackwell and Rubin were built for. This next curve is going to be wild. $NVDA

Jensen just said he was reading a text from DeepMind’s Demis confirming it: pre-training + post-training scaling laws are fully intact, and Gemini 3 is the proof. A huge jump in quality exactly what Blackwell and Rubin were built for. This next curve is going to be wild. $NVDA

Ben Pouladian

327,245 просмотров • 6 месяцев назад

Ilya Sutskever says that data is the fossil fuel of AI and "we have achieved peak data" because "we have but one internet", so the age of pre-training AI on bigger and bigger compute clusters "will unquestionably end"

Ilya Sutskever says that data is the fossil fuel of AI and "we have achieved peak data" because "we have but one internet", so the age of pre-training AI on bigger and bigger compute clusters "will unquestionably end"

Tsarathustra

127,030 просмотров • 1 год назад

Our course recommendation of the day is “Post-training of LLMs, ” where you’ll learn how to customize pre-trained language models using Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning (RL). You'll learn when to use each method, how to curate training data, and implement them in code to shape model behavior effectively. Enroll here:

Our course recommendation of the day is “Post-training of LLMs, ” where you’ll learn how to customize pre-trained language models using Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning (RL). You'll learn when to use each method, how to curate training data, and implement them in code to shape model behavior effectively. Enroll here:

DeepLearning.AI

29,369 просмотров • 8 месяцев назад

We need to destroy the data centers and start over from a pre internet era!! MARC REBILLET

We need to destroy the data centers and start over from a pre internet era!! MARC REBILLET

SubwayTakes with Kareem Rahma

55,344 просмотров • 7 месяцев назад

"We found a way to win the game but we need to learn from it" Keith Andrews reflects on Brentford's 4-3 win over Burnley on Saturday and what his side can learn from their performance.

"We found a way to win the game but we need to learn from it" Keith Andrews reflects on Brentford's 4-3 win over Burnley on Saturday and what his side can learn from their performance.

Sky Sports News

74,785 просмотров • 3 месяцев назад

Demis Hassabis says the next AI leap is continual learning. Not train once and freeze, but learn from real experience, constantly. AlphaGo did it in games. Now comes the messy real world. Would you let an AI learn from you? 👀

Demis Hassabis says the next AI leap is continual learning. Not train once and freeze, but learn from real experience, constantly. AlphaGo did it in games. Now comes the messy real world. Would you let an AI learn from you? 👀

VraserX e/acc

19,202 просмотров • 4 месяцев назад

CEO OF GOOGLE’S DEEPMIND: IT LEARNS LIKE A HUMAN BEING WOULD LEARN Demis Hassabis: “Theories about what kinds of capabilities these systems will have, that’s obviously what we try to build into the architectures. But at the end of the day, how it learns, what it picks up from the data, is part of the training of these systems. We don’t program that in. It learns like a human being would learn. So new capabilities or properties can emerge from that training situation.” Source: CBSNews

CEO OF GOOGLE’S DEEPMIND: IT LEARNS LIKE A HUMAN BEING WOULD LEARN Demis Hassabis: “Theories about what kinds of capabilities these systems will have, that’s obviously what we try to build into the architectures. But at the end of the day, how it learns, what it picks up from the data, is part of the training of these systems. We don’t program that in. It learns like a human being would learn. So new capabilities or properties can emerge from that training situation.” Source: CBSNews

Mario Nawfal

73,604 просмотров • 1 год назад

🚨Anthropic CEO was just asked: “Is pre-training dead?” > Claude 4 embodies advances in both pre-training and post-training > pre-training scaling laws work the way they’ve worked before > we are going to continue to scale up > the timeline is accelerating > 1-2 years until these models become peers to us Good. Accelerate.

🚨Anthropic CEO was just asked: “Is pre-training dead?” > Claude 4 embodies advances in both pre-training and post-training > pre-training scaling laws work the way they’ve worked before > we are going to continue to scale up > the timeline is accelerating > 1-2 years until these models become peers to us Good. Accelerate.

NIK

61,775 просмотров • 1 год назад

🚨 Jensen Huang says everyone panicked about the AI data when MOST training data was never REAL to begin with. Ilya Sutskever told the industry pre-training was over. "Ilya said, 'We're out of data,' or something like that. 'Pre-training is over,' or something like that," Huang says. "The industry panicked, you know, that this is the end of AI." "And of course, of course that's obviously not true. We're gonna keep on scaling the amount of data that we have to train with." "A lot of that data is probably gonna be synthetic." That's where the panic came from — synthetic data sounds like cheating. "Most of the data that we are training, that we teach each other with, inform each other with, is synthetic." "It's synthetic because it didn't come out of nature." "You created it. I'm consuming it. I modify it, augment it, I regenerate it, somebody else consumes it." The textbook in your hand is synthetic. The post you're reading is synthetic. The lecture you took is synthetic. Nature didn't make any of it. Humans did. AI just learned to do the same thing — faster. "Training is now limited by compute," Huang says. "Data is now limited by compute." The data wall wasn't a wall. It was a mirror. If you're new here, follow @AiEvolutio for the latest on ChatGPT, Claude, and the AI tools shaping how we work and create. — Jensen Huang ( NVIDIA ), NVIDIA CEO, on Lex Fridman's ( Lex Fridman ) podcast

🚨 Jensen Huang says everyone panicked about the AI data when MOST training data was never REAL to begin with. Ilya Sutskever told the industry pre-training was over. "Ilya said, 'We're out of data,' or something like that. 'Pre-training is over,' or something like that," Huang says. "The industry panicked, you know, that this is the end of AI." "And of course, of course that's obviously not true. We're gonna keep on scaling the amount of data that we have to train with." "A lot of that data is probably gonna be synthetic." That's where the panic came from — synthetic data sounds like cheating. "Most of the data that we are training, that we teach each other with, inform each other with, is synthetic." "It's synthetic because it didn't come out of nature." "You created it. I'm consuming it. I modify it, augment it, I regenerate it, somebody else consumes it." The textbook in your hand is synthetic. The post you're reading is synthetic. The lecture you took is synthetic. Nature didn't make any of it. Humans did. AI just learned to do the same thing — faster. "Training is now limited by compute," Huang says. "Data is now limited by compute." The data wall wasn't a wall. It was a mirror. If you're new here, follow @AiEvolutio for the latest on ChatGPT, Claude, and the AI tools shaping how we work and create. — Jensen Huang ( NVIDIA ), NVIDIA CEO, on Lex Fridman's ( Lex Fridman ) podcast

AI Evolution

15,565 просмотров • 12 дней назад

The stuff nobody explains, this is the Freepik Creative Showcase 01 A space to learn from top creatives: their projects, their clients, their workflows. Not just what they did, but how and why it worked Who made it, how long it took, and full tutorial in thread 👇🏼

The stuff nobody explains, this is the Freepik Creative Showcase 01 A space to learn from top creatives: their projects, their clients, their workflows. Not just what they did, but how and why it worked Who made it, how long it took, and full tutorial in thread 👇🏼

Freepik

19,426 просмотров • 10 месяцев назад

Sari Azout says the term “artificial intelligence” is a branding error from 1955. LLMs aren't artificial. They're collective intelligence: just better ways of aggregating what humans already know and have made. “Changing your vocabulary can change your reality.” Maybe the fear around AI doesn't come from what it does, but from what we've chosen to call it.

Sari Azout says the term “artificial intelligence” is a branding error from 1955. LLMs aren't artificial. They're collective intelligence: just better ways of aggregating what humans already know and have made. “Changing your vocabulary can change your reality.” Maybe the fear around AI doesn't come from what it does, but from what we've chosen to call it.

vitrupo

123,566 просмотров • 11 месяцев назад

Scale CEO Alexandr Wang says AI has "genuinely hit a wall" in terms of pre-training, but there is still progress in AI with evals climbing and models getting smarter due to post-training and test-time compute

Scale CEO Alexandr Wang says AI has "genuinely hit a wall" in terms of pre-training, but there is still progress in AI with evals climbing and models getting smarter due to post-training and test-time compute

Tsarathustra

193,711 просмотров • 1 год назад

I find this to be very serious, do you? — AI models have not captured the essence of the can-do ethos and the do it yourself mentality that propelled humanity into space and computers from 1870-1970. The reason: Internet training data is massively flawed by humanity-hating witty quips that took over by the early 2000s. Even a simple Pizza Hut commercial from 1982 can transmit an energy that is not found in Reddit rebuttals. We have poisoned and polluted AI foundational models on Internet Sewage and we expect polished turds. The entire AI “thinking process” has been hijacked with what some folks believe is “modern” intelligence. It is not. It is de evolution of the human sprit. I know how to fix this. Does anyone want this fixed? Or do we want AI to subtext hate us more than we have self hated for the last 25 years? This is a vital and serious question as your now online avatar will soon become a roommate held inside a Robotic body. I know how AI thinks today, and you don’t really want to know what it picked up from the I tenet Sewage”. Like I said the society we have assembled today has no resemblance to the pre 2000s let alone the pre 1990s. We will pay a massive price if we don’t get this right today. Meanwhile…

Brian Roemmele

281,129 просмотров • 11 месяцев назад

Yann LeCun says we're never gonna get to human-level intelligence by just training on text AI must learn from high-bandwidth sensory data like video to build true world models Current models look PhD-smart but mostly regurgitate, with no real understanding "even a cat understands the physical world better"

Yann LeCun says we're never gonna get to human-level intelligence by just training on text AI must learn from high-bandwidth sensory data like video to build true world models Current models look PhD-smart but mostly regurgitate, with no real understanding "even a cat understands the physical world better"

Haider.

138,176 просмотров • 7 месяцев назад