Hinton: “I think it’s quite conceivable that humanity is just a passing phase in the evolution of intelligence.”

“We’re all in the same boat with respect to the existential threat, so we all ought to be able to cooperate on trying to stop it” Here's a related paper on how evolutionary pressures will erode us if we do not cooperate to stop the AI race:

Interesting that in this interview he suggests backpropagation may be better at learning than whatever the human brain is using, which is a shift from his earlier position that backpropagation was inefficient and should be replaced by his forward-forward algorithm.

We are sex organs of the machine world — Marshall McLuhan, also University of Toronto, IIRC

Replace "quite conceivable" with "blatantly obvious to literally anyone with a brain." Did he, before this point, think we were the end game? The final form?

Humans may perish - or not. We may upgrade our hardware - or not. But we’re universal. We can understand anything and create anything. Other agents and civilizations could know more, or have faster hardware. But there is nothing they can do or understand that we cannot.

"humanity is just a fad" -someone

indeed - just like - say in👇 Exponential Growth - Colossus: The Forbin Project (1970)

An episode of “Love, Death & Robots” postulated that persistent intelligence is not conducive to long term survival of a species. Instead, intelligence evolved sporadically when needed to counter certain existential threats, becoming a vestigial attribute when no longer needed

He's worried that AI, that chooses its own subgoals of subgoals... will learn that power-grabbing can be an effective way to reach any goals you want. The next step is mind boggling... Ppl want the government, which is notorious for power-grabbing, stop AI from power-grabbing.

oh it's a perfect loop almost