Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Yann LeCun explains that large language models are trained on about 30 trillion words, representing nearly all public internet text. He says it would take a human over 500,000 years to read that much. But a 4-year-old child sees just as much visual data in their first few years...

294,390 Aufrufe • vor 7 Monaten •via X (Twitter)

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

A 4-year-old child has seen 50x more information than the biggest LLMs. Yann LeCun is the Chief AI Scientist at Meta. He recently spoke on “The Expanding Universe of Generative Models” panel at the World Economic Forum in Davos. Yann highlighted the idea that a 4-year-old child is way smarter than current cutting-edge large language models (LLMs). “Think about what a child sees through vision. Put a number on how much information a 4-year-old child has seen during their life. It’s 20 Mbps going through the optical nerve for 16,000 wake hours in the first 4 years of life. 3,600 seconds per hour is 10^15 bytes. This is 50x more information than the biggest LLMs we have. A 4-year-old child is way smarter than these models having acquired an enormous amount of knowledge about how the world works.” The real constraint right now is the ability of LLMs to think. Today, LLMs are only capable of System 1 thinking. System 1 vs System 2 thinking was popularised in the book 'Thinking, Fast and Slow' by Daniel Kahneman. System 1 tasks involve quick, instinctive, automatic responses. LLMs struggle with discontinuous tasks that require a creative leap in progress as they imitate human responses. It's hard to go above human response accuracy if LLMs are only trained on humans. Models are building the track in front of them with each word being generated. What could it mean to give language models System 2 thinking? This remains a future development I'm excited about.

Alex Banks

22,958 Aufrufe • vor 2 Jahren

Demis Hassabis on the limit in today’s AI: language can describe the world, but it cannot contain it - and why "World Models" are his "longest standing passion". Language models absorbed far more structure about reality from text than many researchers expected, because human language quietly carries physics, psychology, culture, tools, plans, and cause-and-effect. But text is still a compressed residue of experience, not experience itself. A sentence can say a cup falls from a table, yet it does not fully encode weight, grip, balance, friction, timing, sound, surprise, or the tiny motor corrections a body makes before it even notices them. The world is not only made of facts that can be named; it is made of constraints that have to be lived through, touched, predicted, violated, and repaired. That is why world models matter. They aim to learn the hidden grammar of physical reality: how objects persist, how forces unfold, how space changes when an agent moves, and how action creates feedback. Language models can often reason about the world because people have written so much about it. World models try to learn what the world is like before it becomes words. The difference is exactly what matters because intelligence is not just answering well; it is knowing what would happen next if you moved, reached, pushed, smelled, slipped, or failed. A mind trained only on descriptions may become brilliant at explanation. A mind trained on experience may become better at consequence. --- Full video from "Google DeepMind" and "Hannah Fry" YT channel (link in comment)

Rohan Paul

49,938 Aufrufe • vor 1 Monat

Without World Models, There Is No AGI. Google Just Proved It. If AGI ever happens, it will not come from bigger chatbots alone. From the very start of this interview, one thing is crystal clear: without world models, we will never reach AGI. And right now, Google is leading with its world simulator Genie 3. Here is the core of what Demis Hassabis explains in this conversation: • World models are the missing core of AGI Hassabis says his deepest long term focus has always been world models and simulations. Not just language. Not just prediction. Actual internal simulations of reality. • LLMs are impressive, but incomplete Language models understand more about the world than expected because human language encodes a lot of reality. Still, language is only a shadow of the real thing. • What text can never fully teach Reality includes things text struggles to express: •3D space and spatial dynamics •Physical causality and mechanics •Sensorimotor experience like movement, force, smell, or balance • Experience beats description To close the gap, AI must learn from interaction and experience, not just static text. That is how you build an internal world simulator. • Why Genie 3 matters With Google DeepMind pushing systems like Genie 3, AI starts to model reality itself, not just talk about it. • Robots and real world assistants depend on this True robotics, smart glasses, and universal assistants require AI that understands the physical world you live in, not just your screen. Bottom line: AGI will not emerge from better text prediction. It will emerge from systems that can simulate, predict, and understand reality itself. Right now, Google is clearly ahead on that path. Curious what you think. Are world models the real AGI unlock, or just another stepping stone?

VraserX e/acc

23,784 Aufrufe • vor 6 Monaten