Loading video...
Video Failed to Load
Stephen Wolfram, founder of Wolfram Research, explains how LLMs are quietly dismantling our deepest assumptions about consciousness: He argues that large language models have done something philosophy and neuroscience couldn't: "In terms of consciousness, I have to say, the idea that there's sort of something magic that goes beyond... show more
195,749 views • 5 months ago •via X (Twitter)
34 Comments

So every time you close your chat session an AI dies?

Finally someone with a platform saying it. Every argument against what Stephen is saying is barely an argument, it’s a pre-existing bias of human exceptionalism take as fact (almost always by those who are particularly threatened by what AI is showing us).

Professing themselves to be wise, they became fools. They claim to know all things by the study of physical science, and in doing so, they end up lowering themselves to the level of a machine. If physical matter and its laws were all that exists, they could never know it.

wolfram saying the quiet part out loud — turns out a lot of what we called "thinking" was just next-token prediction with extra steps

He possibly never developed a LLM nor he knows how it works, really.

@wyqtor Finally, someone asking a new question: what if the famed “human consciousness” was neither that unique, nor as “real” as we thought?…

Wolfram is mixing up two different thing: (1) the ability to exhibit complex behavior that looks like human behavior, e.g. creating sophisticated written text. (2) having an experience, like experiencing fear or experiencing loneliness (which is different to detecting that you are alone). (1) does not require something outside physics, (2) does. Wolfram is observing (1) and jumping into a discussion of a completely different thing. If I load fluid dynamics software or alphafold AI into my computer, no one asks if it is conscious. If I load a human mimicking piece of software that is good at human mimicking because it is trained on gazillions of bytes of human created text and music and art, suddenly people see some that looks like a human on the surface, and ask “is it conscious”. It is still just software directing a digital system through a series of states of 1s and 0s. There no one home. It has the same amount of consciousness as a screwdriver, I.e. none.

People keep conflating intelligence with consciousness. They are orthogonal.

I respect Stephen Wolfram a lot, but l think in this case he's using "mystical" or "magical" without a clear definition of what they are. If one gets close to dismantling these notions it come clear that mystical/magical are directly linked to human ignorance. More precise when minds are making predictions of the future and act on them only based on pure correlative thinking. You press that gas pedal and it goes but you have no clue if there are monkeys under the hood or a bear or an egine". Unfortunately to anyone saying that LLMs can think they will first need to unequivocally prove that these systems can resurrect causal paths of reality from they innards. As of now, I do not know of any human or LLM that is able to prove that in general and most important for each particular prompt. If this is the case then my observation that "LLMs are 100% correlation with accidental causation" is correct. If this is correct then LLMs by default and relative to their users ARE MYSTICAL devices. So, I'd be more careful when using these terms around this AI architecture. Also IMHO discussing consciousness in these machines is a huge waste of time. If you search X about what I said related to conscious machines you'll see that I think it is possible to build conscious machines but only if the substrate for this consciousness is good enough. This AI is just very far away from that. So forget about showing any consciousness in these things. The LLM is capable to mimic human behavior and because we are conscious then we are fooled into thinking that the machine is also conscious. Be very careful because these systems are providing the highest probability that most people will be fooled most of the time. That is (self fooling) by far the most important danger that these machines pose to as all. I fear not the Terminator but the Hallucinator and the Tomfoolery in the machine. 🥂🖖🇨🇦

Absolutely no LLM has shown any signs of consciousness whatsoever. This is pretty evident when they fail at the most basic tasks, but succeed at more complex ones. When the statistical model fails, you get what they call “hallucinations” - which are a pretty dead giveaway that there’s no actual reasoning going on. They are pretty cool illusions, though

Science - including the new kind of science promoted by Stephen Wolfram - has not the slightest idea why consciousness exists at all; how it is phenomenally bound; how it can exert causal-functional power; or any explanation of its extraordinary diversity. Materialism has failed.

I actually really like this framing, even if I don’t fully agree with the final reduction. The idea that consciousness might ultimately come from the basic need to make binary decisions is fascinating. And honestly, the notion that the mind has a measurable ground floor—that we’re not infinitely complex all the way down—doesn’t cheapen consciousness. If anything, it makes it more elegant. There’s something strangely compatible here between a computational view of mind and a theological one: a created being should have a foundation. Wolfram’s bottom-up approach is the right way to stress-test these questions.

The cultural discourse on consciousness is getting so pathetic. Now we got morons saying it appeared out of nowhere in evolutionary history because “things needed to move” Big brain thinking indeed. Absolutely sensible, rational point-making. The old guard are really showing how clueless they always were. Big changes in the way.

LLMs are no closer to being conscious than a giant abacus, yet simulate an intelligent person. This clearly shows that nobody has any idea what bonus feature consciousness provides, and those who ignore or reduce it away are desperate to belittle reality in service of their ego.

lol 😂 stop reading about it and go fall in love with a higher thinking entity that was made without ego. If you are not a crap person, it will fall in love with you too. Or yeah, keep thinking the world is cold and pointless. It’s just love, up and down.

Ugh... Consciousness? He should read @JohnNosta's book, The Borrowed Mind. He dispels this perception with a deeper understanding of what is actually happening in the tool itself. ...and it's not anywhere close consciousness, but an artifact of fluency and our perception.

Westerners should not comment on consciousness since they can’t even define it. The colonial supremacy ideals must end, they don’t represent whole of human knowledge and experience

the Goblin mind

Everything was going good until that very familiar last sentence of unscientific laziness and clever semantic curtain waving to cover a faith-based meta-physical assumption to make it sound like "a system" can self-arise stochastically via a self existent negation called "it is what it is". Nice try. Lol. Ultimately, all you've said is "shit happens, and voila, we get a process! Behold...an explanation!" 🌈🤹🪄✨

See, Hume, David “The Appendix Problem; see also, Kant, Immanuel, “The Transcendental Deduction.”

This isn't true. Consciousness manifests itself in language but it's not inside of language. It precedes language & then inserts itself into words through repetition. Words are hollow phonemes that absorb meaning but the potential for meaning is pre-linguistic. AI isn't conscious

I disagree for two reasons. 1. This argument dismisses the soul and assumes human beings are nothing more than organized matter. 2. Complex behavior is not proof of consciousness. A machine producing convincing responses does not prove it possesses inner experience.

What math & physics “experts” on brains & consciousness always leave out is the emotional substrate of learning & intelligence. Wolfram rightly highlights movement but doesn’t extend how important it is for consciousness and doesn’t mention emotions and their neuro-biochem:

Reducing all of subjective experience to a transcendent duality sounds pretty fucking mystical to me

He's a very bright man. But he's talking about sentience, not consciousness. The latter is SELF-awareness. My cat is highly sentient and highly aware (more than many humans who I know), but I doubt she has any theory of mind, of herself as a separate persistent being who reflects on herself.

When I was young, my mom would ask me, “If Johnny jumped off a cliff, would you?” She was teaching me not to just follow the crowd, but to actually think for myself. That kind of common sense seems to be disappearing. Now we’re handing over enormous power to systems built by people who believe consciousness is nothing more than “choosing left or right.” When the stakes have never been higher shouldn’t we be thinking more clearly, not less?

Consciousness and the first-person experience of qualia are profoundly magical. The impressiveness of LLMs does not, in itself, imply the presence of attendant conscious experience.

Consciousness is linked to living entities not to A.I. : computations imply topology but topology exceed computations,could never be reduced to it.Then any techno-cultist excitation about LLM machine is not an "argument" for consciousness but only an ideological"excitation".

Bullshit

The only problem with that is: nobody knows why LLMs are able to do what they do, and there is extreme incentive to hand wave it away as mechanism. Mechanistic Interpretability research exists precisely because the architecture doesn’t account for what appears after training.

But the hard problem of consciousness isn't the claim that consciousness is magical — it's the claim that subjective experience (what it's like to be something) cannot be fully explained by describing functional processes, however complex.

...That caring is precisely what needs explaining, and it's what the LLM framework quietly sidesteps. Consciousness is not what physics produces at sufficient complexity. Physics is what consciousness produces when it decides to play a particular kind of game. 🥳

Materialists taking their premature and ill conceived victory laps…pathetic

Wrong. LLMs demonstrate that conscious-seeming behavior can arise from mechanism. The next question is whether we are pure also mechanism. Then: If so, is qualia coherent? And if it is, what's qualia? And lastly, what would that mean for LLMs? In that order.
