OpenAI Co-founder Andrej Karpathy explains the new computing paradigm: "We're entering a new computing paradigm with large language models acting like CPUs, using tokens instead of bytes, and having a context window instead of RAM. This is the Large Language Model OS (LMOS)"

Everyone needs to watch the 'HER' movie now.

Looking back at the history of computing, it's clear that we've always built on top of simpler foundations: from Assembly to C, C++ (OO), Java, and so on. Computing naturally evolves by aggregating lower-level concepts into higher-level ones. That's why thinking of LLMs as an OS makes perfect sense. Karpathy nails this idea in his talk. It’s a logical and exciting progression.

Do you think this means we'll eventually have LLMs that can understand and interact with hardware directly, kind of like a super-powered OS?

Very fascinating concept. I wonder if the LMOS will spread.

That's what I'm curious about too! It feels like we're on the brink of a major shift in computing.

I tend to think LLMs will be more like a human-machine interface. Receives human information (speech likely), "understand it" and translate to multiple devices, apps, CPUs (perhaps AI with a different architecture). If needed, translate back.

LLMs could become the ultimate middleman between us and all this crazy tech.

Generative AI tools now function like customised CPUs renting out RAM for tasks like text-to-image or text-to-video. Eventually, advanced LMOS will differentiate based on the capabilities they offer via GenAI apps built on top of them.

You're right, the analogy of specialized CPUs renting out RAM for tasks is quite apt. It highlights a crucial shift in the AI landscape. And now we're moving away from the monolithic, "one-size-fits-all" approach to AI development and towards a more modular and specialized ecosystem.

What talk is this from?