Microsoft CEO Satya Nadella says computing power is now doubling every 6 months, as the Scaling Laws paradigm has taken over from Moore's Law, and the new currency is tokens per dollar per watt

Source:

So why does it still take 30 seconds for Word to open.

The end of Moore's law.. Moore's law squared is here

The metric “Tokens per dollar per watt” is a flawed metric that essentially refers to the efficiency of computing in terms of AI processing. Here’s my take: the most balanced metric would be tokens / second / watt-hour. It covers everything: computational throughput, energy efficiency, and hardware capability—all in one. As AI scales, this kind of precision is key for both tech and sustainability goals.

Kurzweil was right since forty years ago

I didn’t get it. — he plots compute over time, which is not scaling law. — he says performance gets cheaper (which I understood to mean loss), but I don’t understand how performance is related to tokens per dollar per watt.

Jensen tried to tell us what was coming 8 years ago…

tokens per dollar per watt?? but....wtf. na. no words

What exactly does it mean to get an x amount of tokens per dollar, and then also per watt?

It's over this time 👀