正在加载视频...

视频加载失败

John von Neumann designed a self-replicating machine in a cellular automaton in the 1950s - without a computer to run it. Every modern reinforcement learning algorithm that discovers emergent behavior traces back to that same idea: define the rules, not the outcome. The holy grail of artificial life is...

13,998 次观看 • 2 个月前 •via X (Twitter)

10 条评论

天惺愛美 的头像
天惺愛美2 个月前

イリヤ・プリゴジンは液体の中で起こる散逸構造の現象を研究しましたが、人工生命はプラズマが自己組織化する性質を利用して構築すべきです。 DNAの高分子の前駆代謝物質群は宇宙空間でプラズマ化してシンクロリンクしながら散逸構造の代謝サイクル群を自己組織化していったのです。 人工散逸構造体

Carl Friedrich Gauss 3 的头像
Carl Friedrich Gauss 32 个月前

This Jew Von Neumann was extremely genius.

SF Norte Libertario. Todo decanta 的头像
SF Norte Libertario. Todo decanta2 个月前

Correct me if I'm wrong, but one of the biggest shortcomings of mathematics is: finding the final result universally from a set of rules. And even more fabulous, knowing the result, obtaining the rules that produce it. That would be like a holy grail for human knowledge.

Starhound Studio 的头像
Starhound Studio2 个月前

I wonder if the harder problem isn’t defining the rules, but building a system whose interactions can produce new rules at a higher level without us having specified those rules in advance. That feels like where “surprising” starts becoming interesting.

sophia v 的头像
sophia v2 个月前

Couldn't agree more

Di Krass 的头像
Di Krass2 个月前

emergence is the interesting part here

robin_rx 的头像
robin_rx2 个月前

I wonder why people are sleeping on this. Lenia for example was such a fascinating thing. I often had the impression they resembled small single-cell organisms.

Greg Focaccio 的头像
Greg Focaccio2 个月前

the sandbox guardrails being an individuals lifespan? persistent memory/differentiation/improvement/etc is in the genetic information repo (chromosomes) - what is the equivalent for models?

Latent One 的头像
Latent One2 个月前

von neumann is the goat, he and landauer defined the limit of the lowest possible energy required to erase a bit of information at a given temperature.

Æ 的头像
Æ2 个月前

We laid the foundation with Orange AI Computer.

相关视频

MIT defines an algorithm in one sentence that changes how you think about trading "a computational procedure that takes an input and produces an output through a well-defined sequence of steps" that's it. not AI. not machine learning. not a black box a set of rules that takes data in and spits a decision out every quant strategy ever built is just an algorithm Citadel's execution system that routes 40% of US equity volume is an algorithm Renaissance's Medallion Fund running millions of trades per year is an algorithm Jane Street's market making engine processing $26 trillion annually is an algorithm input: market data rules: mathematical conditions output: trade or no trade the difference between a quant desk and a retail trader is not the data it's that one side wrote down their rules precisely enough for a machine to execute them retail says "if RSI is low and the chart looks good, i'll probably buy" a quant desk says "if RSI 1.5, buy 0.3% of NAV" same logic. one is a feeling. the other is an algorithm the feeling can't be tested, can't be repeated, can't be measured the algorithm can be backtested across 10,000 trades and you know exactly when it works and when it doesn't > this lecture: MIT, free, 70 seconds > algorithmic trading volume: 60-75% of all US equity trades > Jane Street, Citadel, Two Sigma: every trade is algorithmically executed > tools to build your own: Python, free data, a laptop you don't need a faster computer or better data you need to write your strategy down precisely enough that a machine could run it without you that's the whole leap. from intuition to algorithm full breakdown in the video below

delost

23,905 次观看 • 4 个月前

Former Meta Chief AI Scientist Yann LeCun on the three paradigms of machine learning — and why the third is what made ChatGPT possible: Here's each one, and where it breaks. First, supervised learning. You tell the machine the answer. "You show it a picture, let's say of a table, and you tell it this is a table. So it's supervised because you tell it what the correct answer is." Get it wrong, and the machine rewrites itself: "The system computes its output, and if it says something else than table, then it's going to adjust its parameters, its internal structure, so that the output it produces gets closer to the output you want." Repeat at scale and something more than memorisation appears: "Eventually the system will find a way to recognize every image you trained it on, but also images it's never seen that are similar to the one you train it on. This is called a generalization ability." The limit: a human has to supply every single answer. That doesn't scale to the size of the internet. Second, reinforcement learning. You don't give the answer, only a verdict. "You don't tell the system what the correct answer is. You only tell it whether the answer it produced was good or bad." Learning to ride a bike, essentially: "You try to ride a bike and you don't know how to ride the bike and after a while you fall. So you know you did something bad and so you change your strategy a little bit. And eventually you learn how to ride a bike." For years the field assumed this was the closest thing to how animals actually learn. Yann LeCun's verdict: "Now it turns out reinforcement learning is extremely inefficient." It dominates wherever failure is free: "It works really well if you want to train a system to play chess or play go or poker, because you can have the system play millions and millions of games against itself and basically fine-tune itself. But it doesn't really work in the real world." The limit, in one image: "If you want to train a car to drive itself, you're not going to do it with reinforcement learning. It's going to crash thousands of times." On robotics he's careful rather than dismissive: "Reinforcement learning can be part of the solution, but it's not the complete answer. It's not sufficient." Third, self-supervised learning. You tell the machine nothing at all. "And this is what has enabled the recent progress in natural language understanding and chatbots." The strange part is that you stop asking for a task: "You don't train the system to accomplish any particular task. You just train it to basically capture the structure..." The method is deliberate sabotage: "You take a piece of text, you corrupt it in some way, by for example removing some words, and then you train a big neural net to predict the words that are missing." And one narrow version of that trick runs every chatbot on Earth: "A special case of this is that you take a piece of text and the last word in that text is not visible, and so you train the system to predict the last word in that text — and this is the way large language models are trained on." So why did the third one win? Supervised learning needs a human. Reinforcement learning needs a crash. Self-supervised learning needs neither — because the missing word and the correct answer are the same thing. The data grades itself.

Big Brain AI

49,293 次观看 • 2 个月前