Loading video...

Video Failed to Load

Go Home

Extropic founder Beff (e/acc) predicts 1000X more efficient AI inference could have a multi-trillion-dollar impact on the economy: "It shows it's possible to create arbitrarily scalable models on a new hardware substrate. We released our first results about a year ago, and it was MNIST, which is the very...

76,337 views • 2 months ago •via X (Twitter)

14 Comments

Danny Nemer's profile picture
Danny Nemer2 months ago

@beffjezos He looks nothing like his profile photo.

Ilyas's profile picture
Ilyas2 months ago

@beffjezos u going from mnist to gpt2 is not algorithmic progress, the algorithms were already developed 😂 you took all that time to implement them, so why are you comparing to the time it took to develop them ?

Dave Try's profile picture
Dave Try2 months ago

@beffjezos ahem

Silk b's profile picture
Silk b2 months ago

@beffjezos this guy looks like family guy––uncanny.

Alps's profile picture
Alps2 months ago

@beffjezos goat

science.minister.0's profile picture
science.minister.02 months ago

@beffjezos LOL, somebody ate the extropic's runway.

Trying to finally complete suicide's profile picture
Trying to finally complete suicide2 months ago

@beffjezos * "You can vibe code thermodynamic computing research, too -- there's space to stretch out." * Is a Waterloo-trained PhD @beffjezos

Jael {e/acc}'s profile picture
Jael {e/acc}2 months ago

@beffjezos yesssssssssssssssssssssssssssss

z3ratul's profile picture
z3ratul2 months ago

@beffjezos sublime grifting

Neha Singh's profile picture
Neha Singh2 months ago

@beffjezos 1000x inference efficiency is the only AI claim that changes unit economics instead of the demo. Everything else is still “smarter answers, same power bill.”

Ray Velez's profile picture
Ray Velez2 months ago

@beffjezos yung obi wan

TheDigitalRetailHivemindNetwork💹🧲's profile picture
TheDigitalRetailHivemindNetwork💹🧲2 months ago

@beffjezos The man is literally a legend

Riley Paul's profile picture
Riley Paul1 month ago

@beffjezos A critical discussion of data science should include both technological opportunities and systemic risks under resource constraints.

安叫兽|Bird🕊️ 🔶 BNB's profile picture
安叫兽|Bird🕊️ 🔶 BNB2 months ago

@beffjezos 从 MNIST 到 GPT-2,这个跨度也太夸张了

Related Videos

Friedberg: “We're watching the birth of a new religion.” “The idea that you can prescribe or describe AI as being conscious is effectively the creation of a new belief system, a system that doesn't actually spread via proof, it spreads via narrative. ‘Please believe it with me. Here's why I think we should believe this thing together.’ It's not based on evidence, it’s not based on data, it's not provable. Over time, what happens is some set of people believe this thing, and they form a group. And in some cases, that group is known as a religion. And that new belief system creates new power structures, which is now, ‘Our view is different than your view, and we want to have more people on our side with our view. And therefore we have to try and create leverage and create power with our system.’ I think that if we fast-forward a couple of years, there's going to be large groups of people on Earth that are gonna believe that AI is conscious, and there are going to be large groups of people that believe that AI is not conscious. And those groups will come into conflict, fighting over control of the AI, or allowing the AI to do things or not do things, or who gets to use the AI, or who gets to be in charge of the AI. And it will very likely lead to human to human conflict. I know that that's a very far and deep extrapolation of where we are, but I think that the fact that we are seeing (Anthropic) go and meet with religious leaders today to try and get them to believe in this new belief system plants the seed. And it's not just anyone doing this, it is the most powerful AI lab on Earth. And you can see in the Claude usage policy that was just published, it says, ‘You are not allowed to engage in sustained and needless abusive or cruel behavior toward our models.’ There is an anthropomorphizing conditioning going on with all of us where we talk about models as if they are a thing. One way to describe this is a software program is writing text on a screen that tells the user, ‘I am a thing.’”

The All-In Podcast

48,299 views • 28 days ago

Etched is deploying two new technologies in chip design: low-voltage inference and cluster-scale memory. CEO Gavin Uberti says they'll make their chips much more power-efficient and way, way faster than today's leading GPUs. He breaks it down: "We looked at a lot of early research directions, and we realized the key things that models need are way more compute and way faster memory." "If you think about inference, there are two key parts: prefill and decode. For prefill, it's a compute-bound problem. You need to have more FLOPS, more operations per second on each of your chips." "On our GPU, the bottleneck's actually thermals. You can't really run a GPU at more than around 50% of what it could theoretically do, or it'll melt." "So we're using a new technology today called low-voltage inference to try to solve this problem. You bring the voltage of the chip down dramatically, which allows us to have way, way better efficiency in terms of how much power is drawn per unit of math, and thus fit way way more flops onto the chip..." "For decode, it's all about bandwidth. Not just bandwidth on a chip, but bandwidth across your cluster. That's why we have this technology we call cluster-scale memory. It reduces the amount of time it takes to communicate from one chip to another dramatically." "As a result we can go use all of our HBM, HBM bandwidth, SRAM, SRAM bandwidth, and our scale-up domain as a single coherent pool. And that means if you're a user, you can go get much faster tokens per second, while still keeping your costs low."

TBPN

20,404 views • 4 months ago