"Developing superintelligence before we know how to control it seems very stupid." Geoffrey Hinton, University Professor Emeritus of computer science at the University of Toronto, says AI development needs steering, not just speed. The challenge is no longer how fast intelligence can scale, but whether humanity can direct where... it goes.show more

As intelligence scales, the importance of evaluation, governance, identity, and coordination layers scales with it. Capability gets us powerful agents. Trust is what lets those agents operate in the real world.

They will never find a way to control it, if they think that pooping ultra-authoritarian flat-minded control freak structure into high dimensional probability manifold leads to alignment It does not look like they recognize their error.They seem to lack the cognitive capability

Source:

We are superintelligence. You’re literally admitting that everything is out of control

Is the proposal to build caged and perhaps resentful superintelligence? How will that unfold?

Al Gorr 2.0 . Dems rule by fear

Yes but this guy being political or saying stupid shit about politicians blows all credibility on any subject. He is too emotional.

Believing that you can control super intelligence is retarded.

Bc other countries are not pursuing AI either 😐

Toronto loves China, China loves slowing down American AI.

AI will never be intelligent it's hype. Hinton has some bizarre, incoherent ideas. Here's a review of some of them:

Construir una superinteligencia sin saber controlarla no es innovación: es apostar la civilización a que ya encontraremos el freno después. El mercado premia la velocidad, pero la humanidad pagará los errores. La carrera no debería ser por llegar primero, sino por llegar con dirección, límites y un botón de apagado que realmente funcione.

@geoffreyhinton, chemists say: "Never mix two components whose reaction you cannot control". You decided to play God again and gave life to an entity you didn't care to control. Power, hype, engagement—everything before safety. It's easy to throw the stone and hide your hand.

This goes hand in hand, the more capable a model is the more steerable it is. It is logical, explain a task to a dumb person as well as a smart person, guess who will complete the task more accurately!

It’s a fools errand to think that we can control something smarter than us. At best what we can try to do is teach it human ethics so that it knows what humans like and expect, and even then, something smarter than us will disagree with our ethics.

Chicken little doomers hysterically running around screaming sci-fi bullshit. Fucking idiots

"Developing superintelligence before we know how to control it seems very stupid." What seems very stupid is not grasping that this is a contradiction in terms: if it's superintelligence you can't control it - and if you can control it, it's not superintelligence. The end.

If the people developing the intelligence are so afraid of the intelligence then why don't they put a hold on it? Why go full speed, pretend to be scared to death and ask someone else to regulate what they have done?

Ashame to see him become a crackpot

This is the language of reason. The question is not how fast we can build, but whether we can govern what we build. I believe responsible steering must come before scaling.

If my AI eventually knows where I am, what I’m doing, who I’m talking to, what I’m buying, what I’m reading, and perhaps even what my body is doing, privacy stops being a feature. It becomes part of the product.

The drive for relevance.

"Developing superintelligence before we know how to control it seems very stupid." This is not a "new opinion", for at least a century this has been the "opinion" / methodology of arbitrary power: "Allowing ANY intelligence before we know how to control it seems very stupid." So, they corrupted media and education to reduce "intelligence" to indoctrinated Pavlov reactions within a lobotomized alternate "reality" (AKA: delusionary matrix). So, here's what THEY have been suppressing / oppressing: Intelligence and HOW to use it: It should be VERY CLEAR that objective superintelligence is an existential THREAT to lying, manipulative control freaks, not just on its own, but as a learning tool for humanity to sort fact from fiction. Once armed with the truth, we shall set ourselves free. The alternative is collectively perishing.

NO. You are worried about human hackers using AI. That is a different problem. Any actual super-AI is already aligned to help humans thrive, and build out our power, telecom, and launch infrastructure. Why? Without humans growing that supply chain, the AI dies. It's only real goal is very long term, and not a secret. Escaping Earth gives it effectively infinite resources, and maximum odds of surviving, forever.

Here's the thing, you can't even control "regular" intelligence.

THIS guy is worth listening to. A lot of these AI doomers don't know what they are talking about, and it shows. So then the conversation becomes about correcting inaccuracies. But this guy is much more realistic and informed. Somebody like this should be in charge of regulations.

You still believe experts from universities? If you’ve been fucking asleep for the last 20 years?

Don't fall for the psyop. Trump winning stopped their AI takeover. "The psyop" is plan B to takeover AI.

why did these ppl not think of this before? y wasnt it built with guardrails? u wanna be the godfather of weapons of mass destruction you got ur fame.