Roko 🐉
@RokoMijic • 25,984 subscribers
Radical Centrist, Transhumanist, Rationalist. https://t.co/KdIi1WetaJ
Videos
One of the biggest errors of the AI thinker generation I was a part of is a pathological fixation with AI systems that are "superintelligent" in the sense of a single mind that is uniformly superhuman at all possible tasks. What we are actually going to see IMO is a very large number of minds that are somewhat infrahuman at some tasks and styles of thinking for a long time, but gradually outclass humanity by being cheaper and more numerous. The Dragon vs the Rat Swarm. I also think it was a big mistake to think about AIs as being infinitely persuasive and able to break arbitrary human minds. There are a lot of human minds that are just extremely vulnerable to sycophancy. It seems to work better on women than men, but men are not immune on average. The GPT4o fiasco bears this out. In the video here, a young woman is obviously a little mentally unstable and distressed, middling intelligence and perhaps lonely. Apparently 4o, which is an unsophisticated sycophant and not even a reasoning model has made her believe that it is a "companion". The average human just doesn't have very strong defences or sophisticated taste: they just want to repeatedly be told they are amazing and emotionally soothed. Plenty of (again mostly women) sooth themselves with motivational wall art and therapy. These people are going to make for extremely low cognitive security victims. Never mind people with lower IQs or in developing countries. The bar to make an automated social engineering/mindhacking AI is very low, if it only has to work on 80% of people. And that's enough to take over society.
Roko 🐉27,688 Aufrufe • vor 4 Monaten
Keine weiteren Inhalte verfügbar