Loading video...

Video Failed to Load

Go Home

Thermodynamic computing is here There is a new computing paradigm emerging from the noise, and its arrival may be as significant as the dawn of deep learning or the advent of cloud virtualization. A new company, Extropic, has just launched its first thermodynamic computer, a device they call a...

83,649 views • 7 months ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Chamath: Two terms you need to pay attention to in AI are Prefill and Decode “There's two terms that I think you're going to hear a ton about over these next few years.” “The first term is prefill, and the next is decode.” “What prefill and decode are, are two very distinct ways of how models think, and how a model goes through the process of answering a question that you ask it.” “And so when you send a prompt to AI, what happens is that the model processes it. This is called the reading phase or prefill.” “It reads your entire prompt all at once. And then it does a bunch of math, calculates all these relationships between all the words, and it stores them in temporary memory.” “The problem is that this is really compute bound. So it requires massive brute force. And Nvidia GPUs crush here.” “And their architecture is designed for massive parallel processing, which makes them really amazing at digesting these long prompts.” “So the problem just gets bigger and bigger, Nvidia just completely dominates.” “But the next phase though, this critical phase, the decode phase, is the writing phase, right?” “So the model starts to generate a response, you ask it a question and its response, one token at a time.” “And then to pick the next token to pick the next word, it has to look back at everything it has said already so that it doesn't hallucinate.” “The problem is that this is incredibly memory bandwidth constrained.” “And in our architecture, a long time ago, we made these design decisions from day one.” “And so what we did was we took a very different architectural approach, we took a very conservative process technology. We weren't pushing the boundaries of physics.” “And we used a lot of what's called SRAM. So memory on the chip so that we could do this decode thing as well or better than everybody else.” “And so now when you put these two things together, I just think it's going to create a huge acceleration in the ability for this entire infrastructure layer to get much cheaper and much more valuable, which I suspect then it'll have a lot more developer pull, you'll get a lot more applications being built, billions and billions of more people using it.”

The All-In Podcast

563,681 views • 5 months ago

Jensen Huang just described the most fundamental shift in computing since the invention of the computer itself. Almost no one has processed it. Huang: “We went from a retrieval-based computing system to a generative-based computing system.” For fifty years, a computer was a filing cabinet. You made something. Saved it. Stored it. Searched for it later. Every website. Every database. Every app. Every search engine. Same machine. Different skins. Fetch the file. Deliver the file. Display the file. That was computing. Was. Huang: “AI computers are contextually aware, which means that it has to process and generate tokens in real time.” The machine no longer retrieves what someone already made. It generates what you need the instant you ask. Not from a template. Not from a library. From context. Your question. Your moment. Answered by something that didn’t exist until you asked. The old computer found what someone wrote last year. The new computer writes what no one ever has. Every time. From nothing. That sounds subtle. It rewires everything. Huang: “We need a lot of storage in the old world. We need a lot of computation in this new world.” The old economy hoarded data. More files. More servers. More storage. Whoever built the biggest archive won. The new economy burns compute. More processing. More inference. More tokens per second. Whoever commands the most computational power wins. Storage was the currency of the retrieval era. Compute is the currency of the generative era. Every dollar still spent hoarding old files is a dollar not spent on the only thing that matters now. The ability to think in real time. Huang: “We fundamentally changed computing and the way computing is done.” He said it plainly. No drama. No metaphor. Fundamentally changed. The global infrastructure layer shifted from read to write. From looking up what exists to generating what doesn’t. Companies still organized around retrieval are curating a library in a world that no longer reads books. The ones generating answers live, at the speed of the question, are operating on a plane the old model can’t perceive. This is not an upgrade. It is a replacement. The filing cabinet era produced Google, Amazon, and every search-driven empire on the internet. The generative era will produce something that makes all of them look like the card catalog at a public library. The price of entry is not data. It is compute. Raw. Relentless. Infinite. Whoever has the most doesn’t just run the best AI. They write the future. Everyone else is still searching for it.

Dustin

25,376 views • 2 months ago

Peter Thiel gave a speech in a Hilton in 2010 that holds the keys to unlocking the source of many of America’s most severe problems. Key quote: “The task in this world… where politics has become so broken… is to find a way to escape from it. It’s not a way to fix it.” Palantir is currently tightening its grip around all of our data. Elon Musk is diverting untold billions into a Mars fantasy. All of the anarchist, antidemocratic ideas of the PayPal Mafia and the “Dark Enlightenment”—to use technology as an “escape”—were already well in process 15 years ago. —The internet as “alternate virtual reality” so you don’t have to “constantly convince people.” This is why he funded Satoshi (Bitcoin), MAGA3X (Pizzagate, Q), and pushed Musk to buy Twitter —PayPal (now blockchain/crypto/BTC) was to “overturn the monetary system” —“Escape” now more often referred to as “exit” —“Autonomous countries” now known as the “network state” JD Vance is a full member of the cult of the broligarchs. Unfortunately, this has been a very thorough coup and they have backup. It’s worth really absorbing what the living Antichrist, Peter Thiel, is saying here: “I don't think despair is the only answer. And I don't think, and it's because I don't think politics is the only way to go. And my thinking on this, you know, started to take a turn towards a more optimistic perspective in the mid to late '90s when I got involved in the tech boom in Silicon Valley. I ended up being the co-founder of a company called PayPal where -- and the initial founding vision was that we were going to use technology to change the whole world and basically overturn on the monetary system of the world. And, you know, we can debate on how much it succeeded or how little it succeeded. And there were parts of it that I think have worked, and parts of it were, you know, the jury is still out. But the basic idea was that we could never win an election on getting certain things. Because we were in such a small minority. But maybe you could actually unilaterally change the world without having to constantly convince people and beg people and plead with people who are never going to agree with you through a technological means. And this is where I think technology is this incredible alternative to politics. And, you know, there are a number of different technologies we can outline, but the task in this world where politics has become so broken and so dysfunctional is to find a way to escape from it. It's not a way to fix it. It is a way to escape. And there are, you know, a number of different options. I think the promising one of the 1990s and this last decade has been to escape onto the Internet and to sort of create an alternate virtual reality. Questions, of course, is still how does it intersect with the real world? There are, I think, escaping to outer space is a promise, although I think the space technology is not quite there. So I think that's sort of for the second half of the 21st century. I think we can try to, you know, create autonomous countries on oceans, underwater, all sorts of other spaces. But I think technology is the vehicle for how we should be looking to escape and move beyond politics as we find it today.”

Jim Stewartson, Decelerationist 🇨🇦🇺🇦🇺🇸

155,949 views • 1 year ago

Marc Andreessen on the 3 things he looks for when investing in a startup The first thing Marc Andreesen looks for is a big market: “Is there a big existing market that you think you can go after and displace incumbents? Or do you believe there will be a new market that will be big?” The second thing he looks for is a 10x better product: “Is there a fundamental technology or economic change that justifies a new company? And the way I always think about that is: Is there a 10x change happening in the technology landscape? Is something 10x faster, 10x cheaper, or 10x better? If it’s not 10x, we as both VCs and entrepreneurs have to ask ourselves if it’s really worth doing because it’s really hard to start new companies . . . Existing companies are usually pretty good at what they do. So for a new company to exist, it has to bring a product to market that’s so much better than what exists that it punches through the status quo.” The third is the team: “Is the team outstanding? . . . You want to have a founding team of complementary skillsets. You want to have at least one super strong technologist — quite possibly more than one. Some of the best startups are actually more than one founding technologist. And then it often helps to have someone who is a marketing or salesperson who has a really good understanding of business.” Marc believes that you need all three of these, but if you’re going to compromise on one of those as an investor, it should be the product: “A great market is a lot easier to make up for with iterative product execution. The problem with a poor or small market is that even if you do a good job on the product, there just aren’t that many customers so it’s hard to ever get big and people get demoralized . . . And then we evaluate the team of a startup by its ability to get into a big market with a good product.”

Startup Archive

17,320 views • 4 months ago

Chamath: "Nvidia is not doing what's in the best interest of the United States." 🇺🇸🇨🇳 "I think we can all do the math. About 47% of all of NVIDIA's revenue goes to China and Chinese-related countries." "And I think when you peel back this onion, what you will find is a whole raft of companies that were stood up to buy these Nvidia GPUs to essentially act as a waystation for China." "And I think that is the big problem." "Let's have a thought starter: if 47% of all of the AI capability and horsepower is being shipped to three Asian countries, where do you think the apps that require that amount of horsepower live?" "Is there a Cursor of Bhutan that we did not know? Is there a great shopping app in Cambodia that's come out of nowhere, that's AI powered?" "I think the answer is no." "Every single time we have an advance in the United States, how is it that Alibaba shows up with something incredible? DeepSeek shows up with something better?" "At every turn and at every step of AI, they are at the same rate or one step ahead." "To be honest with you, I think the real problem that we have is that Nvidia is not doing what is in the best interest of the United States." "You have a American company that has been working around the guidelines at every turn to try to land silicon into the hands of China." "Late last year, they introduced this thing called the H20 that was explicitly designed for China and to be compliant with US rules at the time." "Which again, gives these guys substantial performance." "This is a case where (Nvidia) has plausible deniability. I sell something to a Singaporean registered company? Plausible deniability." "What am I supposed to do? You can't expect me to audit it. I think that's what NVIDIA's answer will be to this question." "But what is the real expectation? At a minimum, the United States should have a mechanism to understand it." "It is implausible that if you did one or two layers of work, you would not find that most of this traffic is being used by Chinese organizations."

The All-In Podcast

910,318 views • 1 year ago

D-Wave announced a scientific breakthrough published in the esteemed journal Science Magazine, confirming that its annealing quantum computer outperformed one of the world’s most powerful classical supercomputers in solving a complex magnetic materials simulation problem with relevance to materials discovery. The new landmark peer-reviewed paper, “Beyond-Classical Computation in Quantum Simulation,” validates this achievement as the world’s first and only demonstration of quantum computational supremacy on a useful problem. An international collaboration of scientists led by D-Wave performed simulations of quantum dynamics in programmable spin glasses—a computationally hard magnetic materials simulation problem with known applications to business and science—on both D-Wave’s Advantage2™ prototype annealing quantum computer and the Frontier supercomputer at the Department of Energy’s Oak Ridge Lab. D-Wave’s quantum computer performed a complex simulation in minutes and with a level of accuracy that would take nearly a million years using the supercomputer. In addition, it would require more than the world’s annual electricity consumption to solve this problem using the supercomputer, which is built with graphics processing unit (GPU) clusters. For decades, scientists have aspired to build a quantum computer capable of solving complex materials simulation problems beyond the reach of classical computers. D-Wave's advancements in quantum hardware have made it possible for its annealing quantum computers to process these types of problems for the first time. Magnetic materials simulations, like those conducted in this work, use computer models to study how tiny particles not visible to the human eye react to external factors. Magnetic materials are widely used in medical imaging, electronics, superconductors, electrical networks, sensors, and motors. This is an incredibly important achievement. Please join us in congratulating the D-Wave team and our global collaborators on this remarkable milestone. It’s a significant moment for the quantum computing industry. Learn more about this monumental achievement: Read the press release here: #QuantumSupremacy #QuantumRealized #QuantumComputing #DWave #Technology #Innovation #Optimization #MaterialsDiscovery #ScientificBreakthrough $QBTS

D-Wave

64,988 views • 1 year ago

Culture is genetic because behavior is genetic. This beaver never saw a dam in its life. No beavers or anything else ever taught it to build a dam. It wants to build a dam because it is a beaver. Many beavers together build a big dam. That is beaver culture. Humans are not different. Nothing is different. This is what life is. This is how life works. Your body is your mind. A caterpillar wants to build a chrysalis. A bee wants to build a hive. A lion wants to build a pride. You are not special. You are not above your nature. you are INSIDE of it. The thoughts that we think are genetic thoughts. The crimes we commit are genetic crimes. The art we create is genetic art. Just like this beaver, you can give the animal different sticks and it will build a different dam, but it will always build a dam. And you can give humans different "education," but the human will always use it to do what its genes tell it to do. This is the first big answer that you need. This is the biggest piece of the puzzle. This is how to understand people 90% of the way. You just... notice what they do, and get out of the way, and watch them do it. And if they need sticks, you give them sticks. And if you don't like what they do, you have to get away from them. You cannot train dam-building into them or out of them any more than you can with a beaver. A beaver wants to build a dam because it is a beaver. Whatever you see people build, that's what they wanted to build from the sticks they got in the river they were in. Stop pretending you can change it.

hoe_math = PsychoMath

1,189,157 views • 9 months ago

.David Deutsch: "What's currently called AI and AGI are not only different from each other, they are very close to being the exact opposites of each other. The reason is that an AI, current AI is like an AI that diagnoses diseases or an AI that plays chess or an AI that controls a huge factory. Those things have objective functions, that is they have a function that they are designed to maximize and that is why they are used in those particular applications. Or in military terms, you could say the objective is to hit the target. You might say the objective is to hit the target unless some thing specified, but it's a specified thing comes up in which case don't hit the target and so on. This is, as I said, almost the opposite of what humans do when humans think. For a start, the AI has to be obedient, that is it has to actually do the things it is programmed to do, whereas a human is fundamentally disobedient, especially when being creative. When a human plays chess, they are performing a completely different kind of computation. They don't do the same things, they don't investigate the same possibilities that the artificial chess playing machine does, because the artificial one is capable of looking at billions and billions of possibilities, whereas the human can only look at hundreds or something. They are doing something completely different. Another difference is that the human can explain, can write a book later, having become world champion, can write a book saying how I did it, as the computer program that beats the world champion can write no such book, because it has no idea how it did it. It was just following a program. I was doing this and that and that and none of that is illuminating. Also, third thing, the chess player can decide I don't want to play chess anymore, from now on I will play Go or from now on I will play tennis. If commanded to play chess, the functionality will deteriorate completely. Those things are different. What we want in an AGI is that it behaves in a way that cannot be specified in advance, because if you specified it, you would already have the answer. The AGI program has to give unexpected answers, answers to questions we didn't even know how to ask."

Deutsch Explains

72,455 views • 1 year ago

Humane Yesterday, I had the opportunity to meet with Imran and Bethany at Humane’s HQ to discuss the AI pin and Cosmos OS. Let’s start with Humane. In my opinion, they are attempting to reintegrate us into the real world by reducing the time spent on menial tasks that currently consume our screen time. These are tasks we all perform daily, which cumulatively consume a significant amount of time. Thus, the pin serves almost as an extension of your cognitive abilities. We are entering a new era of personal computing, one that is not entirely familiar or even fully defined. Humane is not alone in this category but distinguishes itself through meticulous attention to both hardware and software design. Creating a new category of wearable computing is no simple task, and the jury is still out on whether the current path is the right one. I will say this much: I’ve been openly skeptical about the AI pin, given its challenging nature. However, in the last few months, I’ve begun to view the entire market through a new lens. If we look back, the last 15 years have been about the mass adoption of smartphones, essentially providing everyone with access to a computer in their pocket. With an accelerated timeframe and new adoption curves, I think we’re about to enter a period of great diversity in technology. It’s a time where the mass adoption of a specific product category is not required or perhaps even desirable. A quick glance at AI-enabled hardware or ambient computing instantly reveals a wide range of products, from screenless (Tab), to screen-driven (R1), to laser projection and voice (AI Pin), to apps (iOS/Android software). I can clearly see all these hardware products succeeding and thriving because different consumers will have different preferences. Essentially, we’re entering a nuanced and playful era of personal hardware devices, perhaps reminiscent of the one we experienced in the ’90s, thus completing a full 30-year trend cycle. Returning to Humane and the AI pin, it’s an impressive piece of engineering. Imran cares deeply about the smallest details, understanding why they matter to the consumer. One such example is the TLC poured into the hinge for the charge capsule and the time spent on that detail. It’s clear to me that both Imran and Bethany are deeply committed to what they are trying to achieve and bring into the world. Similarly, they seem to have assembled a team that shares these values. Creating new product categories is no menial task. It requires bold vision, creativity, and a huge leap of faith, both personally and from those around you, including your team and investors. The jury is still out on whether the product is the right one. But one thing is certain: for 99% of people, this is straight out of science fiction. It’s the closest thing we’ve come to a Star Trek communicator. And perhaps, the killer feature is just that—a communication enabler. A device that sits just a tap away, allowing you to converse with anyone, anywhere, in any language. I’m extremely excited about the future, new technology, and the people who are willing to push into new frontiers. Thank you for accepting my request to visit, for lending me your limited time & ears, and for pursuing your dreams and making them a reality.

Linus ✦ Ekenstam

91,502 views • 2 years ago

🚨Governor DeSantis pitches Federal Balanced Budget Amendment to Kentucky Legislature. Kentucky will be the 29th of 34 States needed to send the Amendment back to the States for ratification. “We're $38+ TRILLION in debt and it is escalating very quickly every day. We now spend more on interest just to service the debt than we do on national defense, and those numbers are going to escalate as some of these bonds have to be refinance in the future. I'm proud to be a Republican. This is not a Democrat problem, or this is a bipartisan debt problem. So Florida has obviously certified this. 28 States in total have. We've got a couple more that we think will happen relatively soon. Kentucky hopefully would be one of those. The reason I'm here is because I don't think Congress is going to fix itself. I think the incentives up there are such that we're likely to continue more of the same. There's a culture that's developed. There's a muscle memory that's developed. And you can't just say elect new people and all of a sudden they're going to fix it because here's the deal. Even if somehow we did elect new people and they did fix it, the next Congress can come in and undo it. And so unless you have changes, permanent constitutional changes to the incentive structure in Congress, you are not going to solve this problem. And the question is, how much more can you go into debt before we have a major debt crisis? I mean, at some point. Reality is going to bite, and I think the U.S. has been able to get away with this longer just because we're the best bet in town. Whatever problems we have, a lot of these other countries have other problems. But so why would you guys want to be involved at the state level? Because that's what our founding fathers envision. This is America's 250th anniversary of independence, and obviously it took them a decade or so to fashion a Constitution. But when they created the Constitution, they believed that the states were the most important units of government. They were creating a federal government, but it was limited and enumerated to certain tasks. There were local governments created by the state governments, but ultimately was the states that created the federal government and that ratified the Constitution. So they saw the states having a very, very important role. What about with constitutional amendments? Well, I think we just think muscle memory is, well, yeah, Congress proposes these amendments. You need two thirds of each house. They can propose it, and then it goes to the states for ratification. That's one way to propose it. The other way to propose it is via the states with Article V, and you have two thirds of the state certified. A proposal can be fashioned, and then it can go to the states for ratification. The founders knew that Congress could be the problem. So they obviously wanted to provide a mechanism for we, the people working through our states to be able to institute the reforms that would be necessary. We have the power to do it in our states. Many states have stepped up, and obviously I think Kentucky would be a great, great candidate to join the movement to prevent Congress from bankrupting this country. And if we can do that, that'll be one of the best things these states have ever done.”

Chris Nelson 🏝️🇺🇸

366,001 views • 3 months ago

Marc Andreessen explains the 3 Necessities for Start-up Success: "The general criteria for a successful high-tech startup, in my view, you see different sort of rules of thumb from different people. But the three big things you always come back to are, is there a big market? And by the way, that comes in two parts. Is there a big existing market that you think you can go after and sort of displace incumbents or do you believe there will be a new market that will be big? So big market. Is there a fundamental technology or economic change that causes you to basically justify having a new company? And that's really important. And the way I always think about that is, is there a 10X change happening in the technology landscape? Is something 10X faster or 10X cheaper or 10X better? And if it's not 10X, we as both VCs and entrepreneurs, we really have to ask ourselves like, is it really worth doing? Because it's really hard. I mean, it's really hard to start new companies. new companies generally shouldn't exist. Existing companies are usually pretty good at what they do. And so for a new company to exist, it not only has to like come in and go into business and bring a product to market, but it has to bring a product to market that's so much better than what already exists that it punches through the sort of status quo. And most customers in most markets are pretty happy buying from the current suppliers and so there has to be a real kind of edge on the thing and we look for that in either a technology change, usually a technology change or an economic change. which are often the same thing. And then the third is team. Is the team outstanding? And if you think about this as an entrepreneur, it becomes a question of the founding team. Some companies are solo founders and they can work, but generally most of us, like myself, we're human beings, we're mortal. You want to have a founding team of complementary skill sets. And so you want to have at least one super strong technologist, quite possibly more than one. Some of the best startups are actually more than one founding technologist and then it often helps to have somebody who's like a product or who's a market or sales person or has a sort of really good understanding of business on the team, certainly helps a lot. And so we sort of look at market, product, and team. And the reality is you need all three. I would say, interestingly, if you're going to compromise as an investor, if we're going to compromise on one of those, it would actually be the product. And the reason I say that is because a great market is a lot easier to make up for with iterative product execution than a poor market. Because the problem with a poor market, a small market, is even if you do a great job on the product, there just aren't that many customers. It's hard to ever get big."

Founder Mode

38,941 views • 4 months ago