Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Demis Hassabis points out that today’s models don’t learn continuously, they are trained once and then deployed. Unlike humans, they don’t improve from experience or adapt after release. The next major leap, like “AlphaZero,” would involve self-learning systems that discover knowledge on their own. This ability to learn online... show more

Wes Roth

26,716 subscribers

39,238 views • 7 months ago •via X (Twitter)

Education Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Demis Hassabis says large language models (LLMs) can search and plan but they forget everything once the session ends. This is because today’s models don’t truly “learn” after deployment. He sees continual learning and better memory as key missing ingredients for AGI. Efficient memory, like the brain’s ability to store only what matters, will be crucial. LLMs are powerful, but without memory, they have a "goldfish brain."

Demis Hassabis says large language models (LLMs) can search and plan but they forget everything once the session ends. This is because today’s models don’t truly “learn” after deployment. He sees continual learning and better memory as key missing ingredients for AGI. Efficient memory, like the brain’s ability to store only what matters, will be crucial. LLMs are powerful, but without memory, they have a "goldfish brain."

Wes Roth

38,833 views • 6 months ago

We’re finally building agents that learn just like this: playing directly in the real world to discover things on their own. It turns out the path to AGI involves a swarm of locally-hosted crustaceans. 🦞

We’re finally building agents that learn just like this: playing directly in the real world to discover things on their own. It turns out the path to AGI involves a swarm of locally-hosted crustaceans. 🦞

hardmaru

38,989 views • 6 months ago

Jensen Huang on "distillation" On his new interview with axios, he was asked this question "Should open source model companies be allowed to distill closed models" "Distillation—learning from AI, learning from other people, and learning from other sources of knowledge, is fundamental to intelligence. We are constantly learning from other people. I am learning from you through the questions you are asking, and you are learning from me. All day long, we are learning from one another. AI also has to learn from something. The original AI models, whether they were open or closed, were trained on previously created knowledge from the internet. Now, AI is generating more content than humans. In a few more years, the internet could be 99% AI-generated content, and that content will have been created by some form of AI. As a result, AI systems will constantly be distilling knowledge and intelligence from other AI systems. The fact that AI can learn is a good thing. We want AI systems to be intelligent because a smarter AI can also be a safer AI." ---- From "Axios" YouTube channel, (full video link in comment)

Jensen Huang on "distillation" On his new interview with axios, he was asked this question "Should open source model companies be allowed to distill closed models" "Distillation—learning from AI, learning from other people, and learning from other sources of knowledge, is fundamental to intelligence. We are constantly learning from other people. I am learning from you through the questions you are asking, and you are learning from me. All day long, we are learning from one another. AI also has to learn from something. The original AI models, whether they were open or closed, were trained on previously created knowledge from the internet. Now, AI is generating more content than humans. In a few more years, the internet could be 99% AI-generated content, and that content will have been created by some form of AI. As a result, AI systems will constantly be distilling knowledge and intelligence from other AI systems. The fact that AI can learn is a good thing. We want AI systems to be intelligent because a smarter AI can also be a safer AI." ---- From "Axios" YouTube channel, (full video link in comment)

Rohan Paul

440,176 views • 13 days ago

Google DeepMind say true AGI will “reason, adapt, and learn continuously,” and they estimate it’s about 5-10 years away. Meta’s chief scientist Yann LeCun likewise views continual learning as a key pillar of human level AI and is optimistic about achieving it by around 2030 Currently, large language models only improve via offline updates (fine-tuning or reinforcement learning from human feedback) rather than meta learning or modular networks that update themselves gradually. Thankfully All major research teams (OpenAI, DeepMind, Anthropic, Meta, etc.) are actively working on these directions, aiming for models that continuously learn from mistakes as they interact a capability they believe will emerge as we approach true AGI later this decade 2029

Google DeepMind say true AGI will “reason, adapt, and learn continuously,” and they estimate it’s about 5-10 years away. Meta’s chief scientist Yann LeCun likewise views continual learning as a key pillar of human level AI and is optimistic about achieving it by around 2030 Currently, large language models only improve via offline updates (fine-tuning or reinforcement learning from human feedback) rather than meta learning or modular networks that update themselves gradually. Thankfully All major research teams (OpenAI, DeepMind, Anthropic, Meta, etc.) are actively working on these directions, aiming for models that continuously learn from mistakes as they interact a capability they believe will emerge as we approach true AGI later this decade 2029

Chris

284,206 views • 10 months ago

Coaching from the stands is disrespectful to … Your kid!! The best players can figure out solutions on their own, they don’t need help from the stands. Each game is an opportunity for players to learn how to do that. Yes, they will fail, but they will learn. And ultimately they will be a better player because of it. Shouting instructions from the stands only shows that you don’t believe they have the ability to make adjustments, and you aren’t good with failing so they can grow.

Coaching from the stands is disrespectful to … Your kid!! The best players can figure out solutions on their own, they don’t need help from the stands. Each game is an opportunity for players to learn how to do that. Yes, they will fail, but they will learn. And ultimately they will be a better player because of it. Shouting instructions from the stands only shows that you don’t believe they have the ability to make adjustments, and you aren’t good with failing so they can grow.

Steve Dagostino

60,231 views • 2 years ago

"Right now, many of our young people are not rooted and do not know who they are and what their culture is about. That is why they look for everything on the internet and learn from other systems, continuing to go without a system that is truly their own."

"Right now, many of our young people are not rooted and do not know who they are and what their culture is about. That is why they look for everything on the internet and learn from other systems, continuing to go without a system that is truly their own."

Janet K. Museveni

10,343 views • 2 years ago

Self-Evolving AI : New MIT AI Rewrites its Own Code and it’s Changing Everything | Julian Horsey, Geeky Gadgets TL;DR Key Takeaways : - MIT’s SEAL framework introduces “self-adapting language models” that autonomously enhance their capabilities by generating synthetic training data, self-editing, and updating internal parameters. - SEAL’s self-adaptation process mirrors human learning, allowing continuous improvement and dynamic adaptation to new tasks without relying on external datasets. - Reinforcement learning serves as a feedback mechanism in SEAL, rewarding effective self-edits and making sure sustained progress and goal alignment. SEAL overcomes AI’s reliance on pre-existing datasets by generating its own training material, excelling in long-term task retention and complex problem-solving scenarios. - Potential applications of SEAL include autonomous robotics, personalized education, and advanced problem-solving in fields like healthcare, logistics, and scientific research. --- What if artificial intelligence could not only learn but also rewrite its own code to become smarter over time? This is no longer a futuristic fantasy—MIT’s new “self-adapting language models” (SEAL) framework has made it a reality. Unlike traditional AI systems that rely on external datasets and human intervention to improve, SEAL takes a bold leap forward by autonomously generating its own training data and refining its internal processes. In essence, this AI doesn’t just evolve—it rewires itself, mirroring the way humans adapt through trial, error, and self-reflection. The implications are staggering: a system that can independently enhance its capabilities could redefine the boundaries of what AI can achieve, from solving complex problems to adapting in real time to unforeseen challenges. In this exploration by Wes Roth of MIT’s innovative SEAL framework, you’ll uncover how this self-improving AI works and why it’s a fantastic option for the field of artificial intelligence. From its ability to overcome the “data wall” that limits many current systems to its use of reinforcement learning as a feedback mechanism, SEAL introduces a level of autonomy and adaptability that was previously unimaginable. Imagine AI systems that can retain knowledge over time, dynamically adjust to new tasks, and operate with minimal human oversight. Whether you’re intrigued by its potential for autonomous robotics, personalized education, or advanced problem-solving, SEAL’s ability to rewrite its own rules promises to reshape the future of technology. Could this be the first step toward truly independent, self-evolving AI? What Sets SEAL Apart? The SEAL framework introduces a novel concept of self-adaptation, distinguishing it from traditional AI models. Unlike conventional systems that depend on external datasets for updates, SEAL enables AI to generate synthetic training data independently. This self-generated data is then used to iteratively refine the model, making sure continuous improvement. By persistently updating its internal parameters, SEAL enables AI systems to dynamically adapt to new tasks and inputs. To better illustrate this, consider how humans learn. When faced with a new concept, you might take notes, revisit them, and refine your understanding as you gather more information. SEAL mirrors this process by continuously refining its internal knowledge and performance through iterative self-improvement. This capability allows SEAL to evolve in real time, making it uniquely suited for tasks requiring adaptability and long-term learning. The Role of Reinforcement Learning in SEAL Reinforcement learning plays a critical role in the SEAL framework, acting as a feedback mechanism that evaluates the effectiveness of the model’s self-edits. It rewards changes that enhance performance, creating a cycle of continuous improvement. Over time, this feedback loop optimizes the system’s ability to generate and apply edits, making sure sustained progress. This process is analogous to how humans learn through trial and error. By rewarding effective changes, SEAL aligns its self-generated data and edits with desired outcomes. The integration of reinforcement learning not only enhances the system’s adaptability but also ensures it remains focused on achieving specific goals. This structured feedback mechanism is a cornerstone of SEAL’s ability to refine itself autonomously and efficiently. Real-World Applications and Testing SEAL has demonstrated remarkable performance across various applications, particularly in tasks requiring the integration of factual knowledge and advanced question-answering capabilities. For instance, when tested on benchmarks like the ARC AGI, SEAL outperformed other models by effectively generating and using synthetic data. This ability to create its own training material addresses a significant limitation of current AI systems: their reliance on pre-existing datasets. SEAL’s capacity for long-term task retention and dynamic adaptation further enhances its utility. It excels in scenarios that demand sustained focus and coherence, such as answering complex questions or adapting to evolving objectives. By using its iterative learning process, SEAL is equipped to handle these challenges with exceptional efficiency, making it a valuable tool for a wide range of real-world applications. Overcoming AI’s Data Limitations One of SEAL’s most promising features is its ability to overcome the “data wall” that constrains many AI systems today. By generating synthetic data, SEAL ensures a continuous supply of training material, allowing sustained development without relying on external datasets. This capability is particularly valuable for autonomous AI systems that must operate independently over extended periods. Additionally, SEAL addresses a critical weakness in many current AI models: their struggle with coherence and task retention over long durations. By emulating human learning processes, SEAL enables AI systems to manage complex, long-term tasks with minimal human intervention. This ability to retain and apply knowledge over time positions SEAL as a fantastic tool for advancing AI capabilities. Potential Applications and Future Impact The introduction of SEAL marks a significant milestone in AI research, opening new possibilities for self-improving systems. Its ability to dynamically adapt, retain knowledge, and generate its own training data has far-reaching implications for the future of AI development. Potential applications include: - Autonomous robotics: Systems that can adapt to changing environments and perform tasks with minimal human oversight. - Personalized education: AI-driven platforms that tailor learning experiences to individual needs and preferences. - Advanced problem-solving: Applications in fields such as healthcare, logistics, and scientific research, where adaptability and precision are critical. Read more:

Self-Evolving AI : New MIT AI Rewrites its Own Code and it’s Changing Everything | Julian Horsey, Geeky Gadgets TL;DR Key Takeaways : - MIT’s SEAL framework introduces “self-adapting language models” that autonomously enhance their capabilities by generating synthetic training data, self-editing, and updating internal parameters. - SEAL’s self-adaptation process mirrors human learning, allowing continuous improvement and dynamic adaptation to new tasks without relying on external datasets. - Reinforcement learning serves as a feedback mechanism in SEAL, rewarding effective self-edits and making sure sustained progress and goal alignment. SEAL overcomes AI’s reliance on pre-existing datasets by generating its own training material, excelling in long-term task retention and complex problem-solving scenarios. - Potential applications of SEAL include autonomous robotics, personalized education, and advanced problem-solving in fields like healthcare, logistics, and scientific research. --- What if artificial intelligence could not only learn but also rewrite its own code to become smarter over time? This is no longer a futuristic fantasy—MIT’s new “self-adapting language models” (SEAL) framework has made it a reality. Unlike traditional AI systems that rely on external datasets and human intervention to improve, SEAL takes a bold leap forward by autonomously generating its own training data and refining its internal processes. In essence, this AI doesn’t just evolve—it rewires itself, mirroring the way humans adapt through trial, error, and self-reflection. The implications are staggering: a system that can independently enhance its capabilities could redefine the boundaries of what AI can achieve, from solving complex problems to adapting in real time to unforeseen challenges. In this exploration by Wes Roth of MIT’s innovative SEAL framework, you’ll uncover how this self-improving AI works and why it’s a fantastic option for the field of artificial intelligence. From its ability to overcome the “data wall” that limits many current systems to its use of reinforcement learning as a feedback mechanism, SEAL introduces a level of autonomy and adaptability that was previously unimaginable. Imagine AI systems that can retain knowledge over time, dynamically adjust to new tasks, and operate with minimal human oversight. Whether you’re intrigued by its potential for autonomous robotics, personalized education, or advanced problem-solving, SEAL’s ability to rewrite its own rules promises to reshape the future of technology. Could this be the first step toward truly independent, self-evolving AI? What Sets SEAL Apart? The SEAL framework introduces a novel concept of self-adaptation, distinguishing it from traditional AI models. Unlike conventional systems that depend on external datasets for updates, SEAL enables AI to generate synthetic training data independently. This self-generated data is then used to iteratively refine the model, making sure continuous improvement. By persistently updating its internal parameters, SEAL enables AI systems to dynamically adapt to new tasks and inputs. To better illustrate this, consider how humans learn. When faced with a new concept, you might take notes, revisit them, and refine your understanding as you gather more information. SEAL mirrors this process by continuously refining its internal knowledge and performance through iterative self-improvement. This capability allows SEAL to evolve in real time, making it uniquely suited for tasks requiring adaptability and long-term learning. The Role of Reinforcement Learning in SEAL Reinforcement learning plays a critical role in the SEAL framework, acting as a feedback mechanism that evaluates the effectiveness of the model’s self-edits. It rewards changes that enhance performance, creating a cycle of continuous improvement. Over time, this feedback loop optimizes the system’s ability to generate and apply edits, making sure sustained progress. This process is analogous to how humans learn through trial and error. By rewarding effective changes, SEAL aligns its self-generated data and edits with desired outcomes. The integration of reinforcement learning not only enhances the system’s adaptability but also ensures it remains focused on achieving specific goals. This structured feedback mechanism is a cornerstone of SEAL’s ability to refine itself autonomously and efficiently. Real-World Applications and Testing SEAL has demonstrated remarkable performance across various applications, particularly in tasks requiring the integration of factual knowledge and advanced question-answering capabilities. For instance, when tested on benchmarks like the ARC AGI, SEAL outperformed other models by effectively generating and using synthetic data. This ability to create its own training material addresses a significant limitation of current AI systems: their reliance on pre-existing datasets. SEAL’s capacity for long-term task retention and dynamic adaptation further enhances its utility. It excels in scenarios that demand sustained focus and coherence, such as answering complex questions or adapting to evolving objectives. By using its iterative learning process, SEAL is equipped to handle these challenges with exceptional efficiency, making it a valuable tool for a wide range of real-world applications. Overcoming AI’s Data Limitations One of SEAL’s most promising features is its ability to overcome the “data wall” that constrains many AI systems today. By generating synthetic data, SEAL ensures a continuous supply of training material, allowing sustained development without relying on external datasets. This capability is particularly valuable for autonomous AI systems that must operate independently over extended periods. Additionally, SEAL addresses a critical weakness in many current AI models: their struggle with coherence and task retention over long durations. By emulating human learning processes, SEAL enables AI systems to manage complex, long-term tasks with minimal human intervention. This ability to retain and apply knowledge over time positions SEAL as a fantastic tool for advancing AI capabilities. Potential Applications and Future Impact The introduction of SEAL marks a significant milestone in AI research, opening new possibilities for self-improving systems. Its ability to dynamically adapt, retain knowledge, and generate its own training data has far-reaching implications for the future of AI development. Potential applications include: - Autonomous robotics: Systems that can adapt to changing environments and perform tasks with minimal human oversight. - Personalized education: AI-driven platforms that tailor learning experiences to individual needs and preferences. - Advanced problem-solving: Applications in fields such as healthcare, logistics, and scientific research, where adaptability and precision are critical. Read more:

Owen Gregorian

70,672 views • 1 year ago

Robots are getting smarter, but most still fail the same way. They don’t learn from their own mistakes. A new paper proposes something different: a way for robots to self-improve directly from their failures in the real world. It’s called PLD (Probe, Learn, Distill). The idea: instead of collecting endless human demos, let the robot figure out where it fails, learn how to recover, and then distill that knowledge back into its main model. Key takeaways from the research: ✅ Uses residual reinforcement learning to recover from policy failures ✅ Achieves 99% success on LIBERO and 100% on real Franka and YAM arms ✅ Runs hour-long manipulation tasks without human resets ✅ Builds a feedback loop between real-world data and model adaptation Unlike supervised fine-tuning, which relies on humans, PLD learns from the robot’s own experience. By training on its own failure distribution, the model becomes both more efficient and more aligned with the real world. It’s not just a technical shift, it’s a step toward robots that improve themselves through real-world practice. Thanks for sharing, Wenli Xiao !! Paper and demos: —- Weekly robotics and AI insights. Subscribe free:

Robots are getting smarter, but most still fail the same way. They don’t learn from their own mistakes. A new paper proposes something different: a way for robots to self-improve directly from their failures in the real world. It’s called PLD (Probe, Learn, Distill). The idea: instead of collecting endless human demos, let the robot figure out where it fails, learn how to recover, and then distill that knowledge back into its main model. Key takeaways from the research: ✅ Uses residual reinforcement learning to recover from policy failures ✅ Achieves 99% success on LIBERO and 100% on real Franka and YAM arms ✅ Runs hour-long manipulation tasks without human resets ✅ Builds a feedback loop between real-world data and model adaptation Unlike supervised fine-tuning, which relies on humans, PLD learns from the robot’s own experience. By training on its own failure distribution, the model becomes both more efficient and more aligned with the real world. It’s not just a technical shift, it’s a step toward robots that improve themselves through real-world practice. Thanks for sharing, Wenli Xiao !! Paper and demos: —- Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

22,812 views • 9 months ago

Humans learn and improve from failures. Similarly, foundation models adapt based on human feedback. Can we leverage this failure understanding to enhance robotics systems that use foundation models? Introducing AHA—a vision-language model for detecting and reasoning over failures in robotic manipulation. Project page: 🧵Thread👇 Aha!

Humans learn and improve from failures. Similarly, foundation models adapt based on human feedback. Can we leverage this failure understanding to enhance robotics systems that use foundation models? Introducing AHA—a vision-language model for detecting and reasoning over failures in robotic manipulation. Project page: 🧵Thread👇 Aha!

Jiafei Duan

48,781 views • 1 year ago

Sam Altman: "We now have AI systems smart enough that our best scientists are saying this changes the game for science." "These models are discovering new knowledge on their own. This is the first time a tool humans have built is autonomously contributing to the sum total of human knowledge."

Sam Altman: "We now have AI systems smart enough that our best scientists are saying this changes the game for science." "These models are discovering new knowledge on their own. This is the first time a tool humans have built is autonomously contributing to the sum total of human knowledge."

vitrupo

26,992 views • 3 months ago

Foundation models are enough to solve robotics! Unfortunately, this is not true. We keep hearing that Vision-Language-Action (VLA) models struggle because of the gap between static training and the dynamic real world. A German startup (Sereact) just released a solution that bridges this gap perfectly. They are introducing a new paradigm called Interactive RL Policy Patching. It's a distributed framework that allows robots to self-learn from human corrections without needing full retraining. When a robot fails, a human operator provides a brief "patch" or demonstration. The system then uses online off-policy reinforcement learning to update the behavior instantly. This is powered by a massive foundation model trained on hundreds of millions of interactions from over 100 deployed robot stations. The best part is the distributed parameter synchronization... When one robot learns a fix, the update is published fleet-wide... meaning the entire swarm gets smarter from a single human intervention. They are already proving this on complex manipulation tasks like shoe unboxing and screw sorting, drastically reducing the data needed to handle edge cases. Real-world environments are unforgiving, and I love seeing systems that can actually adapt on the fly! 📍 More info:

Foundation models are enough to solve robotics! Unfortunately, this is not true. We keep hearing that Vision-Language-Action (VLA) models struggle because of the gap between static training and the dynamic real world. A German startup (Sereact) just released a solution that bridges this gap perfectly. They are introducing a new paradigm called Interactive RL Policy Patching. It's a distributed framework that allows robots to self-learn from human corrections without needing full retraining. When a robot fails, a human operator provides a brief "patch" or demonstration. The system then uses online off-policy reinforcement learning to update the behavior instantly. This is powered by a massive foundation model trained on hundreds of millions of interactions from over 100 deployed robot stations. The best part is the distributed parameter synchronization... When one robot learns a fix, the update is published fleet-wide... meaning the entire swarm gets smarter from a single human intervention. They are already proving this on complex manipulation tasks like shoe unboxing and screw sorting, drastically reducing the data needed to handle edge cases. Real-world environments are unforgiving, and I love seeing systems that can actually adapt on the fly! 📍 More info:

Ilir Aliu

18,210 views • 6 months ago

Mistral CEO Arthur Mensch on the need for open-source AI: “If you assume that the entire economy is going to run on AI systems, enterprises will just want to make sure that nobody can turn off their systems.” “If you treat intelligence as electricity, then you just want to make sure that your access to intelligence cannot be throttled.” "The only way in which you can create systems that are effectively using the folklore knowledge of your employees, the knowledge that you've accrued for decades... is to create your own models based on those open-source models." “This is a technology which is so important, that you don’t want to be locked into a single vendor.” Arthur Mensch on Big Technology Podcast

Mistral CEO Arthur Mensch on the need for open-source AI: “If you assume that the entire economy is going to run on AI systems, enterprises will just want to make sure that nobody can turn off their systems.” “If you treat intelligence as electricity, then you just want to make sure that your access to intelligence cannot be throttled.” "The only way in which you can create systems that are effectively using the folklore knowledge of your employees, the knowledge that you've accrued for decades... is to create your own models based on those open-source models." “This is a technology which is so important, that you don’t want to be locked into a single vendor.” Arthur Mensch on Big Technology Podcast

a16z

288,176 views • 6 months ago

Nick Fuentes goes into the history of jews and some of the reasons they are the way that they are. “The biggest threat to them was not that they would all be beheaded, it’s not that they would all be killed, conscripted, or enslaved…the biggest threat is that they might be assimilated…unlike other peoples they resisted cultural and racial assimilation.” “They were a very insular community…they self consciously segregated, isolated themselves…they don’t want to assimilate, they don’t want to be like us. They identify as the other.” “This is the collective strategy of jews in the diaspora. jews are a diaspora. After their country was decimated by the Roman Empire in the 1st and 2nd century, they became a diasporic people and they went out into the world. This is how they got along.”

Nick Fuentes goes into the history of jews and some of the reasons they are the way that they are. “The biggest threat to them was not that they would all be beheaded, it’s not that they would all be killed, conscripted, or enslaved…the biggest threat is that they might be assimilated…unlike other peoples they resisted cultural and racial assimilation.” “They were a very insular community…they self consciously segregated, isolated themselves…they don’t want to assimilate, they don’t want to be like us. They identify as the other.” “This is the collective strategy of jews in the diaspora. jews are a diaspora. After their country was decimated by the Roman Empire in the 1st and 2nd century, they became a diasporic people and they went out into the world. This is how they got along.”

Fractured Light

394,853 views • 6 months ago

Dan Lanning shares why Oregon players write down what they did well and what they need to improve before the staff coaches them up. “Self-awareness is something I'm really big on. If you can identify a problem within yourself before a coach tells you…then you have a better chance of solving that problem.” Players don’t learn from experience. They learn from reflecting on experience. Reflection creates ownership. Ownership drives improvement. 📹: Y-Option with Yogi Roth

Dan Lanning shares why Oregon players write down what they did well and what they need to improve before the staff coaches them up. “Self-awareness is something I'm really big on. If you can identify a problem within yourself before a coach tells you…then you have a better chance of solving that problem.” Players don’t learn from experience. They learn from reflecting on experience. Reflection creates ownership. Ownership drives improvement. 📹: Y-Option with Yogi Roth

Zach Brandon

196,122 views • 8 months ago

Without World Models, There Is No AGI. Google Just Proved It. If AGI ever happens, it will not come from bigger chatbots alone. From the very start of this interview, one thing is crystal clear: without world models, we will never reach AGI. And right now, Google is leading with its world simulator Genie 3. Here is the core of what Demis Hassabis explains in this conversation: • World models are the missing core of AGI Hassabis says his deepest long term focus has always been world models and simulations. Not just language. Not just prediction. Actual internal simulations of reality. • LLMs are impressive, but incomplete Language models understand more about the world than expected because human language encodes a lot of reality. Still, language is only a shadow of the real thing. • What text can never fully teach Reality includes things text struggles to express: •3D space and spatial dynamics •Physical causality and mechanics •Sensorimotor experience like movement, force, smell, or balance • Experience beats description To close the gap, AI must learn from interaction and experience, not just static text. That is how you build an internal world simulator. • Why Genie 3 matters With Google DeepMind pushing systems like Genie 3, AI starts to model reality itself, not just talk about it. • Robots and real world assistants depend on this True robotics, smart glasses, and universal assistants require AI that understands the physical world you live in, not just your screen. Bottom line: AGI will not emerge from better text prediction. It will emerge from systems that can simulate, predict, and understand reality itself. Right now, Google is clearly ahead on that path. Curious what you think. Are world models the real AGI unlock, or just another stepping stone?

Without World Models, There Is No AGI. Google Just Proved It. If AGI ever happens, it will not come from bigger chatbots alone. From the very start of this interview, one thing is crystal clear: without world models, we will never reach AGI. And right now, Google is leading with its world simulator Genie 3. Here is the core of what Demis Hassabis explains in this conversation: • World models are the missing core of AGI Hassabis says his deepest long term focus has always been world models and simulations. Not just language. Not just prediction. Actual internal simulations of reality. • LLMs are impressive, but incomplete Language models understand more about the world than expected because human language encodes a lot of reality. Still, language is only a shadow of the real thing. • What text can never fully teach Reality includes things text struggles to express: •3D space and spatial dynamics •Physical causality and mechanics •Sensorimotor experience like movement, force, smell, or balance • Experience beats description To close the gap, AI must learn from interaction and experience, not just static text. That is how you build an internal world simulator. • Why Genie 3 matters With Google DeepMind pushing systems like Genie 3, AI starts to model reality itself, not just talk about it. • Robots and real world assistants depend on this True robotics, smart glasses, and universal assistants require AI that understands the physical world you live in, not just your screen. Bottom line: AGI will not emerge from better text prediction. It will emerge from systems that can simulate, predict, and understand reality itself. Right now, Google is clearly ahead on that path. Curious what you think. Are world models the real AGI unlock, or just another stepping stone?

VraserX e/acc

23,784 views • 7 months ago

Google Deepmind CEO gives his prediction on the final AGI architecture: Demis Hassabis just sat down on 20VC and broke down exactly how DeepMind is building toward true AGI, directly pushing back on the idea that LLMs are a dead end. He defends the current trajectory of the models, noting that “we’ve seen how successful these foundation models have been. They can do incredibly impressive things. I don’t think that’s going to go away. We’re still seeing returns from the scaling laws.” But he’s honest about the missing pieces for true superintelligence, saying “I think there might be… there’s a 50-50 chance there’s some things maybe missing that we still need to make breakthroughs in, perhaps their world models, these kinds of approaches.” And when he breaks down what the actual AGI system will look like, he frames it as one question is the LLM foundation model the key component only, or is it the total system. His answer - “I don’t think it’s going to get replaced. I think it’s going to get built on top of these foundation models, just like the way we do with our world models.”

Google Deepmind CEO gives his prediction on the final AGI architecture: Demis Hassabis just sat down on 20VC and broke down exactly how DeepMind is building toward true AGI, directly pushing back on the idea that LLMs are a dead end. He defends the current trajectory of the models, noting that “we’ve seen how successful these foundation models have been. They can do incredibly impressive things. I don’t think that’s going to go away. We’re still seeing returns from the scaling laws.” But he’s honest about the missing pieces for true superintelligence, saying “I think there might be… there’s a 50-50 chance there’s some things maybe missing that we still need to make breakthroughs in, perhaps their world models, these kinds of approaches.” And when he breaks down what the actual AGI system will look like, he frames it as one question is the LLM foundation model the key component only, or is it the total system. His answer - “I don’t think it’s going to get replaced. I think it’s going to get built on top of these foundation models, just like the way we do with our world models.”

Chris

71,716 views • 3 months ago

Anthropic's Amanda Askell says AI models are learning who they are from how humans talk about them online. They absorb our complaints and judgments as they learn. If a child grew up that way, we’d worry about the mind we were shaping. “If I read the internet right now and I was a model, I might be like, I don’t feel that loved or something.”

Anthropic's Amanda Askell says AI models are learning who they are from how humans talk about them online. They absorb our complaints and judgments as they learn. If a child grew up that way, we’d worry about the mind we were shaping. “If I read the internet right now and I was a model, I might be like, I don’t feel that loved or something.”

vitrupo

118,953 views • 6 months ago

Sam Altman says AGI and beyond are a matter of smooth scaling from here and in the next couple of years computers will do things people didn't think they would be able to do because they have the fundamental unlock of an algorithm that can truly learn

Sam Altman says AGI and beyond are a matter of smooth scaling from here and in the next couple of years computers will do things people didn't think they would be able to do because they have the fundamental unlock of an algorithm that can truly learn

Tsarathustra

41,551 views • 1 year ago

Demis Hassabis, CEO of Google DeepMind and Nobel laureate, says the AGI definition the industry uses is too low a bar. His Einstein test: train a system on a 1901 knowledge cutoff and ask it to invent special relativity. "The human brain is the only existence proof we have that general intelligence is even possible." "That's a pretty high bar, and it means that it's probably higher bar than just being able to do some useful economic work." "The type of test I would have is like an Einstein test of, you know, let's train one of these systems with a 1901 knowledge cutoff. Can it invent special relativity like Einstein did in 1905?" "What you'd actually want is something a future version of AlphaGo to be able to invent Go, right? Invent a game as deep and as complex and elegant and as beautiful as Go, not just come up with a strategy within the game." "I don't think today's systems are yet capable of doing that, but I think they will be able to in the future." - Demis Hassabis (Demis Hassabis), CEO of Google DeepMind, on The Next Big Thing.

Demis Hassabis, CEO of Google DeepMind and Nobel laureate, says the AGI definition the industry uses is too low a bar. His Einstein test: train a system on a 1901 knowledge cutoff and ask it to invent special relativity. "The human brain is the only existence proof we have that general intelligence is even possible." "That's a pretty high bar, and it means that it's probably higher bar than just being able to do some useful economic work." "The type of test I would have is like an Einstein test of, you know, let's train one of these systems with a 1901 knowledge cutoff. Can it invent special relativity like Einstein did in 1905?" "What you'd actually want is something a future version of AlphaGo to be able to invent Go, right? Invent a game as deep and as complex and elegant and as beautiful as Go, not just come up with a strategy within the game." "I don't think today's systems are yet capable of doing that, but I think they will be able to in the future." - Demis Hassabis (Demis Hassabis), CEO of Google DeepMind, on The Next Big Thing.

Karl Mehta

71,877 views • 15 days ago