Extropic founder Beff (e/acc) on why running probabilistic AI on deterministic hardware is quietly the biggest local optimum in computing "You have Landauer's principle. Essentially you have a minimum cost of erasing a bit." "Every time you reset a bit in a classical computer, your bit is actually random.... You don't know what state it is, and then you have to reset it to a deterministic state. So you have a Maxwell's demon for every bit, for every clock cycle. I'm tired of paying the demon tax." "If you go with fractional bits, you don't need to do full bit operations. Running hardware probabilistically is just much more power efficient." "All the algorithms we want to run these days, whether it's PageRank, whether it's recommender systems, whether it's diffusion models, whether it's transformers, they're all probabilistic algorithms." "Why are we paying the Maxwell's demon tax to run probabilistic algorithms on deterministic hardware? It just makes zero sense, and we've just been caught in a local optima." "It takes a true set of autists that are like, screw the whole stack, we're going to start from scratch. This has the bones to eat the world." Extropicshow more

MTS

386,359 subscribers

Поделиться Скачать