PJ
@Prithvir12 • 11,075 subscribers
Founder and investor | @alliance, @zfellows, @DukeU
Videos
If this Karpathy interview doesn't pop the ai bubble, nothing will. 10 brutal quotes: 1. LLMs don’t work yet They don’t have enough intelligence, they’re not multimodal enough, they can’t use computers, and they don’t remember what you tell them. They’re cognitively lacking. It’ll take about a decade to work through all of that. 2. When you boot them up, they always start from zero They have no distillation phase, no process like sleep where what happened gets analyzed and written back into the weights. 3. What’s stored in their weights is only a hazy recollection of the internet It's just a compressed blur of 15 trillion tokens squeezed into a few billion parameters. Their context window is just short-term working memory. 4. They’re good at imitation, terrible at going off the data manifold Too much memory, not enough reasoning. We need to strip away the memorized knowledge and keep the cognitive core: the algorithms, the magic of intelligence, problem-solving, strategy. 5. We’ve probably recreated a cortical tissue, pattern-learning and general, but we’re still missing the rest of the brain No hippocampus for memory. No amygdala for instincts. No emotions or motivations. 6. They memorize perfectly but generalize poorly If you give them random numbers, they can recite them back. No human can do that. That’s the problem: humans forget just enough to be forced to find patterns. 7. Anything truly new, code that’s never been written before, ideas that have no template; they stumble They’re still autocomplete engines with perfect recall and no understanding. Until we find that cognitive core, intelligence stripped of memory but full of reasoning, they’ll stay brilliant mimics, not minds.
PJ1,403,860 Aufrufe • vor 8 Monaten
Interesting idea from Arthur Hayes on how to think about selling bitcoin. Don't look at BTC in fiat terms. Look at BTC's price in energy terms. Today 1 BTC is worth ~500 barrels of oil. If 1 BTC = 10k barrels of oil, maybe sell BTC to buy energy producing assets.. but not to hold fiat.
PJ259,826 Aufrufe • vor 2 Jahren
Keine weiteren Inhalte verfügbar