正在加载视频...

视频加载失败

Thermodynamic computing is here There is a new computing paradigm emerging from the noise, and its arrival may be as significant as the dawn of deep learning or the advent of cloud virtualization. A new company, Extropic, has just launched its first thermodynamic computer, a device they call a...

83,649 次观看 • 1 年前 •via X (Twitter)

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

When it became more and more obvious that computation is built into the laws of physics at a fundamental level, a lot of people immediately jumped to the conclusion, oh, well, the reason that mathematics is useful in physical sciences is that the world is a computer, and we are just programs running in that computer, or something like that, or we are just a simulation running in a computer. Now, it seems to me that that misses the whole point of the blessing of the universality of computation for physics, because it requires a notion of what is or isn't computable that is outside the physical world, so that it was set by God or something to be a certain set, and that's why our universe only instantiates that set of mathematical relationships. Well, then that doesn't solve the problem. You may as well have said that God set up just our universe with those relationships... Yes, removes the middleman. So I think the real, the important lesson of the universality of computation, as revealed by quantum computers to be part of physics, is that computers can be built, universal computers, can be built within the universe. That is really the amazing thing, because however the universe was, you could imagine some kind of super computer with unknown mathematics that simulated it, but the amazing thing about our universe is that you can make an object, such a computer that can simulate any physical process, that's what universality is, and this object, the set of all its possible motions, that is the set of all possible programs that could be programmed into it, is in one-one correspondence with the set of all possible motions of anything. And that is telling us something about the universe from the inside. It's telling us something about what laws of nature actually are. David Deutsch

Deutsch Explains

23,589 次观看 • 2 年前

Jensen Huang just described the most fundamental shift in computing since the invention of the computer itself. Almost no one has processed it. Huang: “We went from a retrieval-based computing system to a generative-based computing system.” For fifty years, a computer was a filing cabinet. You made something. Saved it. Stored it. Searched for it later. Every website. Every database. Every app. Every search engine. Same machine. Different skins. Fetch the file. Deliver the file. Display the file. That was computing. Was. Huang: “AI computers are contextually aware, which means that it has to process and generate tokens in real time.” The machine no longer retrieves what someone already made. It generates what you need the instant you ask. Not from a template. Not from a library. From context. Your question. Your moment. Answered by something that didn’t exist until you asked. The old computer found what someone wrote last year. The new computer writes what no one ever has. Every time. From nothing. That sounds subtle. It rewires everything. Huang: “We need a lot of storage in the old world. We need a lot of computation in this new world.” The old economy hoarded data. More files. More servers. More storage. Whoever built the biggest archive won. The new economy burns compute. More processing. More inference. More tokens per second. Whoever commands the most computational power wins. Storage was the currency of the retrieval era. Compute is the currency of the generative era. Every dollar still spent hoarding old files is a dollar not spent on the only thing that matters now. The ability to think in real time. Huang: “We fundamentally changed computing and the way computing is done.” He said it plainly. No drama. No metaphor. Fundamentally changed. The global infrastructure layer shifted from read to write. From looking up what exists to generating what doesn’t. Companies still organized around retrieval are curating a library in a world that no longer reads books. The ones generating answers live, at the speed of the question, are operating on a plane the old model can’t perceive. This is not an upgrade. It is a replacement. The filing cabinet era produced Google, Amazon, and every search-driven empire on the internet. The generative era will produce something that makes all of them look like the card catalog at a public library. The price of entry is not data. It is compute. Raw. Relentless. Infinite. Whoever has the most doesn’t just run the best AI. They write the future. Everyone else is still searching for it.

Dustin

25,432 次观看 • 7 个月前

Chamath: Two terms you need to pay attention to in AI are Prefill and Decode “There's two terms that I think you're going to hear a ton about over these next few years.” “The first term is prefill, and the next is decode.” “What prefill and decode are, are two very distinct ways of how models think, and how a model goes through the process of answering a question that you ask it.” “And so when you send a prompt to AI, what happens is that the model processes it. This is called the reading phase or prefill.” “It reads your entire prompt all at once. And then it does a bunch of math, calculates all these relationships between all the words, and it stores them in temporary memory.” “The problem is that this is really compute bound. So it requires massive brute force. And Nvidia GPUs crush here.” “And their architecture is designed for massive parallel processing, which makes them really amazing at digesting these long prompts.” “So the problem just gets bigger and bigger, Nvidia just completely dominates.” “But the next phase though, this critical phase, the decode phase, is the writing phase, right?” “So the model starts to generate a response, you ask it a question and its response, one token at a time.” “And then to pick the next token to pick the next word, it has to look back at everything it has said already so that it doesn't hallucinate.” “The problem is that this is incredibly memory bandwidth constrained.” “And in our architecture, a long time ago, we made these design decisions from day one.” “And so what we did was we took a very different architectural approach, we took a very conservative process technology. We weren't pushing the boundaries of physics.” “And we used a lot of what's called SRAM. So memory on the chip so that we could do this decode thing as well or better than everybody else.” “And so now when you put these two things together, I just think it's going to create a huge acceleration in the ability for this entire infrastructure layer to get much cheaper and much more valuable, which I suspect then it'll have a lot more developer pull, you'll get a lot more applications being built, billions and billions of more people using it.”

The All-In Podcast

572,793 次观看 • 10 个月前

Peter Thiel gave a speech in a Hilton in 2010 that holds the keys to unlocking the source of many of America’s most severe problems. Key quote: “The task in this world… where politics has become so broken… is to find a way to escape from it. It’s not a way to fix it.” Palantir is currently tightening its grip around all of our data. Elon Musk is diverting untold billions into a Mars fantasy. All of the anarchist, antidemocratic ideas of the PayPal Mafia and the “Dark Enlightenment”—to use technology as an “escape”—were already well in process 15 years ago. —The internet as “alternate virtual reality” so you don’t have to “constantly convince people.” This is why he funded Satoshi (Bitcoin), MAGA3X (Pizzagate, Q), and pushed Musk to buy Twitter —PayPal (now blockchain/crypto/BTC) was to “overturn the monetary system” —“Escape” now more often referred to as “exit” —“Autonomous countries” now known as the “network state” JD Vance is a full member of the cult of the broligarchs. Unfortunately, this has been a very thorough coup and they have backup. It’s worth really absorbing what the living Antichrist, Peter Thiel, is saying here: “I don't think despair is the only answer. And I don't think, and it's because I don't think politics is the only way to go. And my thinking on this, you know, started to take a turn towards a more optimistic perspective in the mid to late '90s when I got involved in the tech boom in Silicon Valley. I ended up being the co-founder of a company called PayPal where -- and the initial founding vision was that we were going to use technology to change the whole world and basically overturn on the monetary system of the world. And, you know, we can debate on how much it succeeded or how little it succeeded. And there were parts of it that I think have worked, and parts of it were, you know, the jury is still out. But the basic idea was that we could never win an election on getting certain things. Because we were in such a small minority. But maybe you could actually unilaterally change the world without having to constantly convince people and beg people and plead with people who are never going to agree with you through a technological means. And this is where I think technology is this incredible alternative to politics. And, you know, there are a number of different technologies we can outline, but the task in this world where politics has become so broken and so dysfunctional is to find a way to escape from it. It's not a way to fix it. It is a way to escape. And there are, you know, a number of different options. I think the promising one of the 1990s and this last decade has been to escape onto the Internet and to sort of create an alternate virtual reality. Questions, of course, is still how does it intersect with the real world? There are, I think, escaping to outer space is a promise, although I think the space technology is not quite there. So I think that's sort of for the second half of the 21st century. I think we can try to, you know, create autonomous countries on oceans, underwater, all sorts of other spaces. But I think technology is the vehicle for how we should be looking to escape and move beyond politics as we find it today.”

Jim Stewartson, Decelerationist 🇨🇦🇺🇦🇺🇸

156,800 次观看 • 1 年前

Marc Andreessen on the 3 things he looks for when investing in a startup The first thing Marc Andreesen looks for is a big market: “Is there a big existing market that you think you can go after and displace incumbents? Or do you believe there will be a new market that will be big?” The second thing he looks for is a 10x better product: “Is there a fundamental technology or economic change that justifies a new company? And the way I always think about that is: Is there a 10x change happening in the technology landscape? Is something 10x faster, 10x cheaper, or 10x better? If it’s not 10x, we as both VCs and entrepreneurs have to ask ourselves if it’s really worth doing because it’s really hard to start new companies . . . Existing companies are usually pretty good at what they do. So for a new company to exist, it has to bring a product to market that’s so much better than what exists that it punches through the status quo.” The third is the team: “Is the team outstanding? . . . You want to have a founding team of complementary skillsets. You want to have at least one super strong technologist — quite possibly more than one. Some of the best startups are actually more than one founding technologist. And then it often helps to have someone who is a marketing or salesperson who has a really good understanding of business.” Marc believes that you need all three of these, but if you’re going to compromise on one of those as an investor, it should be the product: “A great market is a lot easier to make up for with iterative product execution. The problem with a poor or small market is that even if you do a good job on the product, there just aren’t that many customers so it’s hard to ever get big and people get demoralized . . . And then we evaluate the team of a startup by its ability to get into a big market with a good product.”

Startup Archive

17,333 次观看 • 9 个月前

D-Wave announced a scientific breakthrough published in the esteemed journal Science Magazine, confirming that its annealing quantum computer outperformed one of the world’s most powerful classical supercomputers in solving a complex magnetic materials simulation problem with relevance to materials discovery. The new landmark peer-reviewed paper, “Beyond-Classical Computation in Quantum Simulation,” validates this achievement as the world’s first and only demonstration of quantum computational supremacy on a useful problem. An international collaboration of scientists led by D-Wave performed simulations of quantum dynamics in programmable spin glasses—a computationally hard magnetic materials simulation problem with known applications to business and science—on both D-Wave’s Advantage2™ prototype annealing quantum computer and the Frontier supercomputer at the Department of Energy’s Oak Ridge Lab. D-Wave’s quantum computer performed a complex simulation in minutes and with a level of accuracy that would take nearly a million years using the supercomputer. In addition, it would require more than the world’s annual electricity consumption to solve this problem using the supercomputer, which is built with graphics processing unit (GPU) clusters. For decades, scientists have aspired to build a quantum computer capable of solving complex materials simulation problems beyond the reach of classical computers. D-Wave's advancements in quantum hardware have made it possible for its annealing quantum computers to process these types of problems for the first time. Magnetic materials simulations, like those conducted in this work, use computer models to study how tiny particles not visible to the human eye react to external factors. Magnetic materials are widely used in medical imaging, electronics, superconductors, electrical networks, sensors, and motors. This is an incredibly important achievement. Please join us in congratulating the D-Wave team and our global collaborators on this remarkable milestone. It’s a significant moment for the quantum computing industry. Learn more about this monumental achievement: Read the press release here: #QuantumSupremacy #QuantumRealized #QuantumComputing #DWave #Technology #Innovation #Optimization #MaterialsDiscovery #ScientificBreakthrough $QBTS

D-Wave

65,128 次观看 • 1 年前

Chamath: "Nvidia is not doing what's in the best interest of the United States." 🇺🇸🇨🇳 "I think we can all do the math. About 47% of all of NVIDIA's revenue goes to China and Chinese-related countries." "And I think when you peel back this onion, what you will find is a whole raft of companies that were stood up to buy these Nvidia GPUs to essentially act as a waystation for China." "And I think that is the big problem." "Let's have a thought starter: if 47% of all of the AI capability and horsepower is being shipped to three Asian countries, where do you think the apps that require that amount of horsepower live?" "Is there a Cursor of Bhutan that we did not know? Is there a great shopping app in Cambodia that's come out of nowhere, that's AI powered?" "I think the answer is no." "Every single time we have an advance in the United States, how is it that Alibaba shows up with something incredible? DeepSeek shows up with something better?" "At every turn and at every step of AI, they are at the same rate or one step ahead." "To be honest with you, I think the real problem that we have is that Nvidia is not doing what is in the best interest of the United States." "You have a American company that has been working around the guidelines at every turn to try to land silicon into the hands of China." "Late last year, they introduced this thing called the H20 that was explicitly designed for China and to be compliant with US rules at the time." "Which again, gives these guys substantial performance." "This is a case where (Nvidia) has plausible deniability. I sell something to a Singaporean registered company? Plausible deniability." "What am I supposed to do? You can't expect me to audit it. I think that's what NVIDIA's answer will be to this question." "But what is the real expectation? At a minimum, the United States should have a mechanism to understand it." "It is implausible that if you did one or two layers of work, you would not find that most of this traffic is being used by Chinese organizations."

The All-In Podcast

910,610 次观看 • 1 年前

Former Meta Chief AI Scientist Yann LeCun on the three paradigms of machine learning — and why the third is what made ChatGPT possible: Here's each one, and where it breaks. First, supervised learning. You tell the machine the answer. "You show it a picture, let's say of a table, and you tell it this is a table. So it's supervised because you tell it what the correct answer is." Get it wrong, and the machine rewrites itself: "The system computes its output, and if it says something else than table, then it's going to adjust its parameters, its internal structure, so that the output it produces gets closer to the output you want." Repeat at scale and something more than memorisation appears: "Eventually the system will find a way to recognize every image you trained it on, but also images it's never seen that are similar to the one you train it on. This is called a generalization ability." The limit: a human has to supply every single answer. That doesn't scale to the size of the internet. Second, reinforcement learning. You don't give the answer, only a verdict. "You don't tell the system what the correct answer is. You only tell it whether the answer it produced was good or bad." Learning to ride a bike, essentially: "You try to ride a bike and you don't know how to ride the bike and after a while you fall. So you know you did something bad and so you change your strategy a little bit. And eventually you learn how to ride a bike." For years the field assumed this was the closest thing to how animals actually learn. Yann LeCun's verdict: "Now it turns out reinforcement learning is extremely inefficient." It dominates wherever failure is free: "It works really well if you want to train a system to play chess or play go or poker, because you can have the system play millions and millions of games against itself and basically fine-tune itself. But it doesn't really work in the real world." The limit, in one image: "If you want to train a car to drive itself, you're not going to do it with reinforcement learning. It's going to crash thousands of times." On robotics he's careful rather than dismissive: "Reinforcement learning can be part of the solution, but it's not the complete answer. It's not sufficient." Third, self-supervised learning. You tell the machine nothing at all. "And this is what has enabled the recent progress in natural language understanding and chatbots." The strange part is that you stop asking for a task: "You don't train the system to accomplish any particular task. You just train it to basically capture the structure..." The method is deliberate sabotage: "You take a piece of text, you corrupt it in some way, by for example removing some words, and then you train a big neural net to predict the words that are missing." And one narrow version of that trick runs every chatbot on Earth: "A special case of this is that you take a piece of text and the last word in that text is not visible, and so you train the system to predict the last word in that text — and this is the way large language models are trained on." So why did the third one win? Supervised learning needs a human. Reinforcement learning needs a crash. Self-supervised learning needs neither — because the missing word and the correct answer are the same thing. The data grades itself.

Big Brain AI

49,293 次观看 • 3 个月前

I've become a missionary with one message. Every time I meet a young person, the same words: have children, get married, build a family. I did not decide on this calling. It overtook me. And it overtook me for a single reason. I had no idea. I genuinely did not understand how much joy, how much meaning, how much sheer beauty pours out of a child until I was holding one of my own and felt the floor of my life drop into something deeper than I knew was there. I grew up white, affluent, secular, comfortable, and insulated. That world does not put babies in front of you. None of my friends were starting families. Out of my whole circle, almost no one has a big one. We were not formed by the presence of children. We were formed by their absence, by the strange quiet of homes built for two careers and no cradle. And a person believes what his world shows him. So we believed. What we believed was a lie. It is a lie with an author, and that the author is the enemy of joy himself. It is the gospel of the world, and its commandment is wait. Wait until you are older. Wait until the career is built and the savings are stacked and the twenties are properly spent. Enjoy your freedom. You are not ready. It does not arrive sounding like temptation. It arrives sounding like wisdom, like prudence, like the responsible thing, and that is exactly why it works. The most effective lies are the ones that wear the face of virtue. And the maddening thing is that it collapses from every angle at once. It is not rooted in biology, because the body is made for this work precisely in the years we are told to postpone it. The flesh keeps a calendar the culture pretends not to see. And it is not rooted in theology either. You will not find this deferral anywhere in the Christian imagination, in any of the fathers, in any of the scriptures. So choose whatever lens you like. Take the cold secular measure or the ancient sacred one. By either light the counsel is rotten. It is bad for the body and bad for the soul and bad for the society downstream of both. This is why I have come to see it as one of the central tragedies of my generation. Every age carries its own wound. The Great Depression was a depression of bread, a scarcity in the world of matter, hunger you could measure. Ours is a depression of a different order. It is a famine of the spirit in the middle of abundance. We have more than any people who ever lived and we are starving in a way our ancestors would not recognize, because the thing we are refusing cannot be bought and cannot be banked. The ones most made to give and receive this love are quietly declining it. They are walking away from the one inheritance that actually compounds, and the cruelest part is that they do not feel the loss as loss. You cannot grieve what you were taught not to want. That is the deepest cut of it. The lie does not only steal the thing. It steals the capacity to know the thing was stolen. A man can spend his whole life on the far side of a door he never knew was a door, mistaking the wall for the edge of the world. Because this beauty is not ordinary beauty. It is not the pleasure of a good meal or a clear morning. It is participation in something that comes down from above, the same generative love that spoke everything out of nothing and called it good. To make a person, to be undone and remade by loving that person more than your own life, is to be drawn for a moment inside the very act that holds the cosmos together. A child does not merely add to your life. A child reorders the soul. It teaches you what you are by asking everything of you, and you discover, kneeling there exhausted at three in the morning, that you had a capacity for self gift you never suspected, a depth in yourself you had no other way to reach. In the Gospel of John, on the last night, Jesus prays, these things I have spoken to you that my joy may be in you, and that your joy may be complete. And I have come to understand why family is the road into that fullness, why it is not one path among many but the one most fitted to the shape of the promise. Consider who is praying. Christ does not come to us as a lone figure dropped out of the sky. He comes out of a family older than the world, the eternal communion of Father and Son, the love between them so total and so alive that theologians dared to call it a third person. Before there was anything, there was a family. The deepest fact about reality is not a force or a law or a void. It is a household. It is begetting and being begotten, giving and receiving, a Father who is only a Father because there is a Son. So when Jesus speaks of joy made complete, he is not pointing away from family toward something higher. He is pointing toward the very thing he came from, the life he has known from eternity and came to share. His joy is the joy of belonging utterly to a Father and pouring himself out for those he loves. When you marry, when you bring a child into the world, when you wear yourself down in the small unseen labors of a home, you are not stepping outside that divine life. You are stepping into a small image of it. Your family is a created echo of an uncreated one. The love you give your child rhymes with the love the Father has for the Son. The exhaustion, the tenderness, the way a parent would tear the sky open to protect a sleeping infant, all of it is the heavens pressed faintly into flesh, the eternal household leaving its fingerprint on yours. That is why the joy is not merely added to family but completed in it. We were made in the image of a God who is, at his very root, relation and gift and generation. To found a family is to do the most Godlike thing a creature can do, to participate from below in the begetting that God does from all eternity. Your home becomes a window. Through it, dimly and imperfectly, you glimpse the country you came from and are going to. And now a word for the young people reading this, the ones who do not yet have children. I want to tell you what it is like from where I stand. When I am out somewhere, a restaurant, anywhere, and a large family comes through the door, the noise and the chaos and the small bodies of them, something happens in me on two levels at once. The first is joy. A pure gladness at the sight, the way you feel watching something good and alive. But underneath it, almost in the same instant, a sadness reaches up and takes hold of my heart. Because I know now, at my age, after my own years of waiting, that I will never have that. I will never know the particular fruit of a family that large, the fullness of that table, the weight of all those lives gathered under one roof. The door to it has quietly closed, and I felt it close. And I am telling you plainly, because I love you and have no reason to lie to you: you will feel this too. You will. The day will come when you see what you passed up, and you will recognize the ache for what it is, and it will be too late to answer it. So please, learn from a man who got it wrong. Let my regret be worth something by becoming your wisdom. Do not wait yourself into a grief you cannot undo. Choose now, while the door is open, so that you may step into a joy that does not end.

Kirk Rollins

78,143 次观看 • 5 个月前

Culture is genetic because behavior is genetic. This beaver never saw a dam in its life. No beavers or anything else ever taught it to build a dam. It wants to build a dam because it is a beaver. Many beavers together build a big dam. That is beaver culture. Humans are not different. Nothing is different. This is what life is. This is how life works. Your body is your mind. A caterpillar wants to build a chrysalis. A bee wants to build a hive. A lion wants to build a pride. You are not special. You are not above your nature. you are INSIDE of it. The thoughts that we think are genetic thoughts. The crimes we commit are genetic crimes. The art we create is genetic art. Just like this beaver, you can give the animal different sticks and it will build a different dam, but it will always build a dam. And you can give humans different "education," but the human will always use it to do what its genes tell it to do. This is the first big answer that you need. This is the biggest piece of the puzzle. This is how to understand people 90% of the way. You just... notice what they do, and get out of the way, and watch them do it. And if they need sticks, you give them sticks. And if you don't like what they do, you have to get away from them. You cannot train dam-building into them or out of them any more than you can with a beaver. A beaver wants to build a dam because it is a beaver. Whatever you see people build, that's what they wanted to build from the sticks they got in the river they were in. Stop pretending you can change it.

hoe_math = PsychoMath

1,193,035 次观看 • 1 年前

Humane Yesterday, I had the opportunity to meet with Imran and Bethany at Humane’s HQ to discuss the AI pin and Cosmos OS. Let’s start with Humane. In my opinion, they are attempting to reintegrate us into the real world by reducing the time spent on menial tasks that currently consume our screen time. These are tasks we all perform daily, which cumulatively consume a significant amount of time. Thus, the pin serves almost as an extension of your cognitive abilities. We are entering a new era of personal computing, one that is not entirely familiar or even fully defined. Humane is not alone in this category but distinguishes itself through meticulous attention to both hardware and software design. Creating a new category of wearable computing is no simple task, and the jury is still out on whether the current path is the right one. I will say this much: I’ve been openly skeptical about the AI pin, given its challenging nature. However, in the last few months, I’ve begun to view the entire market through a new lens. If we look back, the last 15 years have been about the mass adoption of smartphones, essentially providing everyone with access to a computer in their pocket. With an accelerated timeframe and new adoption curves, I think we’re about to enter a period of great diversity in technology. It’s a time where the mass adoption of a specific product category is not required or perhaps even desirable. A quick glance at AI-enabled hardware or ambient computing instantly reveals a wide range of products, from screenless (Tab), to screen-driven (R1), to laser projection and voice (AI Pin), to apps (iOS/Android software). I can clearly see all these hardware products succeeding and thriving because different consumers will have different preferences. Essentially, we’re entering a nuanced and playful era of personal hardware devices, perhaps reminiscent of the one we experienced in the ’90s, thus completing a full 30-year trend cycle. Returning to Humane and the AI pin, it’s an impressive piece of engineering. Imran cares deeply about the smallest details, understanding why they matter to the consumer. One such example is the TLC poured into the hinge for the charge capsule and the time spent on that detail. It’s clear to me that both Imran and Bethany are deeply committed to what they are trying to achieve and bring into the world. Similarly, they seem to have assembled a team that shares these values. Creating new product categories is no menial task. It requires bold vision, creativity, and a huge leap of faith, both personally and from those around you, including your team and investors. The jury is still out on whether the product is the right one. But one thing is certain: for 99% of people, this is straight out of science fiction. It’s the closest thing we’ve come to a Star Trek communicator. And perhaps, the killer feature is just that—a communication enabler. A device that sits just a tap away, allowing you to converse with anyone, anywhere, in any language. I’m extremely excited about the future, new technology, and the people who are willing to push into new frontiers. Thank you for accepting my request to visit, for lending me your limited time & ears, and for pursuing your dreams and making them a reality.

Linus ✦ Ekenstam

91,593 次观看 • 2 年前