Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

A large portion of animal intelligence doesn't require any learning, claims Andrej Karpathy: it's baked into DNA. AI models, by contrast, start from random weights. They have to learn their intelligence, mostly by imitating the internet. This is so different that Andrej thinks it's a fundamentally different kind of... show more

Dwarkesh Patel

252,732 subscribers

82,232 Aufrufe • vor 4 Monaten •via X (Twitter)

Wissenschaft & Technologie Tiere

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Andrej Karpathy beautifully explains the fundamental difference of learning between a human and an LLM. > “The book I’m reading is a set of prompts for me to do synthetic data generation. It's by manipulating that information that you actually gain that knowledge. We have no equivalent of that with LLMs; they don't really do that.” many of the best minds in this field think LLMs are not really learning anything, and therefore are incapable of surpassing human-level intelligence.

Andrej Karpathy beautifully explains the fundamental difference of learning between a human and an LLM. > “The book I’m reading is a set of prompts for me to do synthetic data generation. It's by manipulating that information that you actually gain that knowledge. We have no equivalent of that with LLMs; they don't really do that.” many of the best minds in this field think LLMs are not really learning anything, and therefore are incapable of surpassing human-level intelligence.

ℏεsam

895,349 Aufrufe • vor 11 Monaten

Andrej Karpathy in Stanford classroom said: "GPT is not a language model - It's a general-purpose computer" 90% of AI Twitter still thinks it's just autocomplete. It's not. >90% of the tools built on top of LLMs treat them like a smarter search engine. In this 40-minute lecture, Karpathy builds nanoGPT live 300 lines, reproduces GPT-2, explains every single decision. Worth more than any $500 deep learning bootcamp.

Andrej Karpathy in Stanford classroom said: "GPT is not a language model - It's a general-purpose computer" 90% of AI Twitter still thinks it's just autocomplete. It's not. >90% of the tools built on top of LLMs treat them like a smarter search engine. In this 40-minute lecture, Karpathy builds nanoGPT live 300 lines, reproduces GPT-2, explains every single decision. Worth more than any $500 deep learning bootcamp.

Ricker

117,471 Aufrufe • vor 2 Monaten

Lots of people think it's obvious that humans learn by imitation, starting with babies imitating their parents. Richard Sutton thinks this is completely wrong. Sutton basically thinks direct imitation plays almost no role in animal learning, and at most a small role in human intelligence. When one animal ends up doing the same thing as another, he thinks this is the result of RL-style trial-and-error, not direct imitation. And if imitation isn't really a kind of learning, then training LLMs to imitate humans isn't really Bitter Lesson–pilled.

Lots of people think it's obvious that humans learn by imitation, starting with babies imitating their parents. Richard Sutton thinks this is completely wrong. Sutton basically thinks direct imitation plays almost no role in animal learning, and at most a small role in human intelligence. When one animal ends up doing the same thing as another, he thinks this is the result of RL-style trial-and-error, not direct imitation. And if imitation isn't really a kind of learning, then training LLMs to imitate humans isn't really Bitter Lesson–pilled.

Dwarkesh Patel

55,137 Aufrufe • vor 3 Monaten

this was the most important bit of the ilya interview imo. humans are not AGI, and LLMs won’t become like humans with more scaling. humans lack a huge amount of knowledge and have insanely good “continual learning” powered by extremely good reward functions (except for addiction) that guide them. and so it’s more about the learning rather than knowledge. the term AGI was coined as a response to the narrow AI which was only capable of intelligence in a specific domain (chess, game, code, etc) but General intelligence is able to learn different topics because that’s what “learning” is about. pre-training was thought to be the solution to reaching AGI because you train AI on so many different topics. but they have “overshot” that target. amazing perspective.

this was the most important bit of the ilya interview imo. humans are not AGI, and LLMs won’t become like humans with more scaling. humans lack a huge amount of knowledge and have insanely good “continual learning” powered by extremely good reward functions (except for addiction) that guide them. and so it’s more about the learning rather than knowledge. the term AGI was coined as a response to the narrow AI which was only capable of intelligence in a specific domain (chess, game, code, etc) but General intelligence is able to learn different topics because that’s what “learning” is about. pre-training was thought to be the solution to reaching AGI because you train AI on so many different topics. but they have “overshot” that target. amazing perspective.

ℏεsam

53,444 Aufrufe • vor 10 Monaten

Ken Liu Ken Liu on the question we can't avoid anymore: what is consciousness? why certain plants evolved to change our minds, why intelligence ≠ consciousness (AI made this impossible to ignore), and the ethical moment we're racing toward. _-_-_-_-_-_-_-_-_-_-_-_-_-_- "historically in sci-fi, we've imagined that intelligence and consciousness are almost equivalent in the sense that if you have intelligence, you automatically have consciousness. But AI is making us more and more aware of this distinction, right?"So here's an example where consciousness intelligence are decoupled, and it's a very strange feeling to realize that they are fundamentally different things. "In the moment when we have created artificial consciousness, how will we know when that has happened? Because to me, that is an important ethical moment where we have to decide what we can and can't do. Shutting down a model that merely has intelligence is one thing. Shutting down a model that has consciousness is something quite different. "

Ken Liu Ken Liu on the question we can't avoid anymore: what is consciousness? why certain plants evolved to change our minds, why intelligence ≠ consciousness (AI made this impossible to ignore), and the ethical moment we're racing toward. _-_-_-_-_-_-_-_-_-_-_-_-_-_- "historically in sci-fi, we've imagined that intelligence and consciousness are almost equivalent in the sense that if you have intelligence, you automatically have consciousness. But AI is making us more and more aware of this distinction, right?"So here's an example where consciousness intelligence are decoupled, and it's a very strange feeling to realize that they are fundamentally different things. "In the moment when we have created artificial consciousness, how will we know when that has happened? Because to me, that is an important ethical moment where we have to decide what we can and can't do. Shutting down a model that merely has intelligence is one thing. Shutting down a model that has consciousness is something quite different. "

Sabrina Halper

14,841 Aufrufe • vor 8 Monaten

Jensen Huang on "distillation" On his new interview with axios, he was asked this question "Should open source model companies be allowed to distill closed models" "Distillation—learning from AI, learning from other people, and learning from other sources of knowledge, is fundamental to intelligence. We are constantly learning from other people. I am learning from you through the questions you are asking, and you are learning from me. All day long, we are learning from one another. AI also has to learn from something. The original AI models, whether they were open or closed, were trained on previously created knowledge from the internet. Now, AI is generating more content than humans. In a few more years, the internet could be 99% AI-generated content, and that content will have been created by some form of AI. As a result, AI systems will constantly be distilling knowledge and intelligence from other AI systems. The fact that AI can learn is a good thing. We want AI systems to be intelligent because a smarter AI can also be a safer AI." ---- From "Axios" YouTube channel, (full video link in comment)

Jensen Huang on "distillation" On his new interview with axios, he was asked this question "Should open source model companies be allowed to distill closed models" "Distillation—learning from AI, learning from other people, and learning from other sources of knowledge, is fundamental to intelligence. We are constantly learning from other people. I am learning from you through the questions you are asking, and you are learning from me. All day long, we are learning from one another. AI also has to learn from something. The original AI models, whether they were open or closed, were trained on previously created knowledge from the internet. Now, AI is generating more content than humans. In a few more years, the internet could be 99% AI-generated content, and that content will have been created by some form of AI. As a result, AI systems will constantly be distilling knowledge and intelligence from other AI systems. The fact that AI can learn is a good thing. We want AI systems to be intelligent because a smarter AI can also be a safer AI." ---- From "Axios" YouTube channel, (full video link in comment)

Rohan Paul

443,912 Aufrufe • vor 2 Monaten

TESLA ISN'T JUST AHEAD IN AI, IT'S AN ORDER OF MAGNITUDE MORE EFFICIENT THAN THE REST OF THE WORLD "I actually think Tesla is ahead of the rest of the world in intelligence density of AI by an order of magnitude or more This is going to sound like a pretty bold statement, but I know what the intelligence efficiency of the big models are like, Grok and a bunch of the other models Tesla’s AI is, in terms of its memory efficiency, I think more than an order of magnitude better. The Tesla AI is very compute-efficient and very memory-efficient One of the metrics one should consider for any given AI model is the intelligence per gigabyte. Especially when you’re constrained on RAM, having an AI that has very high intelligence density per gigabyte for a given number of gigabytes, how much functionality can you get out of it" - Elon Musk

TESLA ISN'T JUST AHEAD IN AI, IT'S AN ORDER OF MAGNITUDE MORE EFFICIENT THAN THE REST OF THE WORLD "I actually think Tesla is ahead of the rest of the world in intelligence density of AI by an order of magnitude or more This is going to sound like a pretty bold statement, but I know what the intelligence efficiency of the big models are like, Grok and a bunch of the other models Tesla’s AI is, in terms of its memory efficiency, I think more than an order of magnitude better. The Tesla AI is very compute-efficient and very memory-efficient One of the metrics one should consider for any given AI model is the intelligence per gigabyte. Especially when you’re constrained on RAM, having an AI that has very high intelligence density per gigabyte for a given number of gigabytes, how much functionality can you get out of it" - Elon Musk

X Freeze

62,736 Aufrufe • vor 8 Monaten

Okay, this is actually insane Recent UnitedHealthcare lawsuit reveals that the company KNOWINGLY has been using faulty artificial intelligence to deny claims to increase profitability. The AI they’ve been using HAS A 90% INACCURACY RATE “The company knowingly used artificial intelligence. That that was faulty. That's where this comes out of. It comes out of litigation” “Separate litigation that they knowingly used faulty artificial intelligence to deny claims that were legitimate to increase profitability. That is a big deal. — This is very, very overt artificial intelligence tool with 90% inaccuracy” “It's a sinister thing.”

Okay, this is actually insane Recent UnitedHealthcare lawsuit reveals that the company KNOWINGLY has been using faulty artificial intelligence to deny claims to increase profitability. The AI they’ve been using HAS A 90% INACCURACY RATE “The company knowingly used artificial intelligence. That that was faulty. That's where this comes out of. It comes out of litigation” “Separate litigation that they knowingly used faulty artificial intelligence to deny claims that were legitimate to increase profitability. That is a big deal. — This is very, very overt artificial intelligence tool with 90% inaccuracy” “It's a sinister thing.”

Wall Street Apes

461,416 Aufrufe • vor 1 Jahr

ANDREJ KARPATHY: "the internet is terrible. A huge amount of slop and garbage from all the corners of the internet." Type 1: you ask generic Claude generic questions, you get back generic internet-trained answers. Type 2: you brief Claude with your business, your voice, your audience. Same model. Different fluency. The gap between the two types isn't intelligence. It's setup. Bookmark this for the next time someone says Claude is generic and can't replace a real specialist. The article below has the 7 specific setups that turn the internet-slop model into a specialist for your work.

ANDREJ KARPATHY: "the internet is terrible. A huge amount of slop and garbage from all the corners of the internet." Type 1: you ask generic Claude generic questions, you get back generic internet-trained answers. Type 2: you brief Claude with your business, your voice, your audience. Same model. Different fluency. The gap between the two types isn't intelligence. It's setup. Bookmark this for the next time someone says Claude is generic and can't replace a real specialist. The article below has the 7 specific setups that turn the internet-slop model into a specialist for your work.

Zephyr

147,644 Aufrufe • vor 4 Monaten

.𝔊𝔴𝔢𝔯𝔫 almost thinks there's no such thing as general intelligence. Humans and AIs just learn a large number of individual specialized tricks. In any given situation we're doing search over special cases, nothing more. What matters is just the number of individual tricks that we can search over - which is mostly determined by compute.

.𝔊𝔴𝔢𝔯𝔫 almost thinks there's no such thing as general intelligence. Humans and AIs just learn a large number of individual specialized tricks. In any given situation we're doing search over special cases, nothing more. What matters is just the number of individual tricks that we can search over - which is mostly determined by compute.

Dwarkesh Patel

54,208 Aufrufe • vor 4 Monaten

Barack Obama made using propaganda against Americans legal in the United States. Restore The Smith-Mundt Act “So a hundred different journalists are being paid directly by the CIA. They had CIA intelligence officers, assets, CIA agents just working hand in glove inside of newsrooms, writing articles, producing the news. Operation Mockingbird. Nobody's ever asked CIA about this in modern times” “Tulsi Gabbard confirming that Operation Mockingbird is still ongoing, which what she told me was that, yes, this is still happening and that we are fighting to this day. Intel operatives that are running disinformation campaigns through the corporate press.” “Within this administration, where there are people within the intelligence community who believe that their will is more important than the will of the American people and will weaponize intelligence by leaking it to their friends within the mainstream media with the intent of undermining President Trump's agenda” “The intelligence world was allying itself with journalists. Yeah, this is still ongoing. It's a massive, massive problem and it's something that the administration is currently dealing with”

Barack Obama made using propaganda against Americans legal in the United States. Restore The Smith-Mundt Act “So a hundred different journalists are being paid directly by the CIA. They had CIA intelligence officers, assets, CIA agents just working hand in glove inside of newsrooms, writing articles, producing the news. Operation Mockingbird. Nobody's ever asked CIA about this in modern times” “Tulsi Gabbard confirming that Operation Mockingbird is still ongoing, which what she told me was that, yes, this is still happening and that we are fighting to this day. Intel operatives that are running disinformation campaigns through the corporate press.” “Within this administration, where there are people within the intelligence community who believe that their will is more important than the will of the American people and will weaponize intelligence by leaking it to their friends within the mainstream media with the intent of undermining President Trump's agenda” “The intelligence world was allying itself with journalists. Yeah, this is still ongoing. It's a massive, massive problem and it's something that the administration is currently dealing with”

Wall Street Apes

159,355 Aufrufe • vor 1 Jahr

Yann LeCun says you cannot build a reliable agentic system without a world model LLMs don't have world models. They can't predict the consequences of their actions before taking them "they just act, and whatever happens next is someone else's problem" Without that, it's not intelligence

Yann LeCun says you cannot build a reliable agentic system without a world model LLMs don't have world models. They can't predict the consequences of their actions before taking them "they just act, and whatever happens next is someone else's problem" Without that, it's not intelligence

Haider.

333,367 Aufrufe • vor 4 Monaten

BREAKING: Andrej Karpathy calls out Sam Altman Altman: >"We are now confident we know how to build AGI" >"2025 is the year of AI agents" Karpathy: >"I was triggered by that over-prediction" >"More accurately, it's the decade of agents" >"There's SO much work to be done" Hmm looks like Sam Altman has been lying to investors all year to raise trillions… The bubble is popping.

BREAKING: Andrej Karpathy calls out Sam Altman Altman: >"We are now confident we know how to build AGI" >"2025 is the year of AI agents" Karpathy: >"I was triggered by that over-prediction" >"More accurately, it's the decade of agents" >"There's SO much work to be done" Hmm looks like Sam Altman has been lying to investors all year to raise trillions… The bubble is popping.

NIK

579,449 Aufrufe • vor 11 Monaten

$Enterprise AI is in a wildly paradoxical state 🤔, and we’re reaching the inflection point that will resolve it. 💥 Enterprises want to differentiate with AI, yet rent the same intelligence as their competitors. Their workflows and expertise are highly specialized, yet they rely on generic models built to be good at everything. They worry about AI costs, yet pay premium prices for massive models where only a fraction (1%) of the intelligence is relevant to their task. 💸 And they demand control and sovereignty, yet rent the intelligence becoming core to their business. This is not a sustainable equilibrium. The next era of enterprise AI is specialized intelligence companies build, own, and compound. And we are at the inflection point of this transition. That’s the bet we made when we started Oumi two years ago. Today we’re closing the loop: Oumi can now not only automatically build your specialized AI models, but also deploy them into production, learn from their production experience, and continuously improve them. The intelligence that your business runs on, becomes your differentiator. Your compounding advantage. The winners of the next AI era will turn their own data, expertise, and experience into specialized intelligence that nobody else can rent. Don’t rent your AI. Build it. Own it. Compound it.$

Enterprise AI is in a wildly paradoxical state 🤔, and we’re reaching the inflection point that will resolve it. 💥 Enterprises want to differentiate with AI, yet rent the same intelligence as their competitors. Their workflows and expertise are highly specialized, yet they rely on generic models built to be good at everything. They worry about AI costs, yet pay premium prices for massive models where only a fraction (1%) of the intelligence is relevant to their task. 💸 And they demand control and sovereignty, yet rent the intelligence becoming core to their business. This is not a sustainable equilibrium. The next era of enterprise AI is specialized intelligence companies build, own, and compound. And we are at the inflection point of this transition. That’s the bet we made when we started Oumi two years ago. Today we’re closing the loop: Oumi can now not only automatically build your specialized AI models, but also deploy them into production, learn from their production experience, and continuously improve them. The intelligence that your business runs on, becomes your differentiator. Your compounding advantage. The winners of the next AI era will turn their own data, expertise, and experience into specialized intelligence that nobody else can rent. Don’t rent your AI. Build it. Own it. Compound it.

Manos Koukoumidis

1,006,156 Aufrufe • vor 1 Monat

Here’s How 1 McDonald’s Hamburger Contains 1300 Strands Of Different DNA. This Is The Result Of Going From Small Farms To Mega Corporations “We're pooling the bacteria from a thousand different animals” “Thousands of animals” contribute “to a single hamburger.” “This is a combo bin of meat. The meat in these boxes comes from many different animals and many different places. Some is even from overseas. All of it is ground together to make the juicy hamburger Americans love. Hamburger used to be the scraps left over from butchering just one cow.” But a significant change has occurred. Now parts of many cows are blended together by the ton. ‌ If we take the meat from one animal, grind it up and make ground beef from just one animal, we're including only the bacteria from one animal. But if we take the meat from a thousand different animals and grind that together, we're pooling the bacteria from a thousand different animals as well. So explain this to me, how many different cows would be in one burger? Well, I suspect that there are hundreds or even thousands of animals that have contributed to a single hamburger.”

Here’s How 1 McDonald’s Hamburger Contains 1300 Strands Of Different DNA. This Is The Result Of Going From Small Farms To Mega Corporations “We're pooling the bacteria from a thousand different animals” “Thousands of animals” contribute “to a single hamburger.” “This is a combo bin of meat. The meat in these boxes comes from many different animals and many different places. Some is even from overseas. All of it is ground together to make the juicy hamburger Americans love. Hamburger used to be the scraps left over from butchering just one cow.” But a significant change has occurred. Now parts of many cows are blended together by the ton. ‌ If we take the meat from one animal, grind it up and make ground beef from just one animal, we're including only the bacteria from one animal. But if we take the meat from a thousand different animals and grind that together, we're pooling the bacteria from a thousand different animals as well. So explain this to me, how many different cows would be in one burger? Well, I suspect that there are hundreds or even thousands of animals that have contributed to a single hamburger.”

Wall Street Apes

3,114,375 Aufrufe • vor 2 Jahren

Stanley Druckenmiller: My advantage is not IQ. It's trigger pulling. I admit it's some kind of intelligence. I wasn't in the top 10% of my class. A lot people think i'm smarter than I am because i'm good at our business. But I have a very narrow form of intelligence that allows me to love and play this game

Stanley Druckenmiller: My advantage is not IQ. It's trigger pulling. I admit it's some kind of intelligence. I wasn't in the top 10% of my class. A lot people think i'm smarter than I am because i'm good at our business. But I have a very narrow form of intelligence that allows me to love and play this game

Bourbon Capital

219,741 Aufrufe • vor 7 Monaten

Continual learning sometimes gets discussed as if the goal is to dissolve the context/weights distinction. Let the model just keep accumulating, fine-tuning itself on the fly. Andrej Karpathy points out, though, that this isn't how humans do it. Our working memory gets wiped regularly. What we actually have is a consolidation process (sleep) that distills stuff into the brain, in a weird and lossy way. This is very different from how people sometimes talk about continual learning. It's not obvious it's something you can get for free from doing long enough RL loops.

Continual learning sometimes gets discussed as if the goal is to dissolve the context/weights distinction. Let the model just keep accumulating, fine-tuning itself on the fly. Andrej Karpathy points out, though, that this isn't how humans do it. Our working memory gets wiped regularly. What we actually have is a consolidation process (sleep) that distills stuff into the brain, in a weird and lossy way. This is very different from how people sometimes talk about continual learning. It's not obvious it's something you can get for free from doing long enough RL loops.

Dwarkesh Patel

60,457 Aufrufe • vor 4 Monaten

Don't waste 2 years learning to use LLMs like Claude & ChatGPT. Andrej Karpathy, the godfather of AI, dropped a 2 hour course on how he personally uses LLMs daily. • 00:00 - LLMs simplified • 22:49 - which LLM to actually use • 42:00 - one prompt for full research • 1:13:57 - how to code with LLMs • 1:37:04 - NotebookLM podcast generation This course will teach you more about using LLMs than most AI engineers learn in their entire career. Bookmark this & give 2 hours today, no matter what. Then read the article below.

Don't waste 2 years learning to use LLMs like Claude & ChatGPT. Andrej Karpathy, the godfather of AI, dropped a 2 hour course on how he personally uses LLMs daily. • 00:00 - LLMs simplified • 22:49 - which LLM to actually use • 42:00 - one prompt for full research • 1:13:57 - how to code with LLMs • 1:37:04 - NotebookLM podcast generation This course will teach you more about using LLMs than most AI engineers learn in their entire career. Bookmark this & give 2 hours today, no matter what. Then read the article below.

Roan

56,500 Aufrufe • vor 1 Monat

🚨The United States is Led by a GANGSTER GROUP Jeffrey Sachs: The Washington Post, which is the mouthpiece of the intelligence agencies, twists it so that it's Putin that's the villain because he doesn't respond to Trump's thuggery. So Putin's a liar because he doesn't stand up to Trump's thuggery, rather than an article that Trump is a thug and maybe it's a, it's a dangerous thing for the world that United States is led by a gangster, group.

🚨The United States is Led by a GANGSTER GROUP Jeffrey Sachs: The Washington Post, which is the mouthpiece of the intelligence agencies, twists it so that it's Putin that's the villain because he doesn't respond to Trump's thuggery. So Putin's a liar because he doesn't stand up to Trump's thuggery, rather than an article that Trump is a thug and maybe it's a, it's a dangerous thing for the world that United States is led by a gangster, group.

Ignorance, the root and stem of all evil

46,230 Aufrufe • vor 6 Monaten