Roko 🐉
@RokoMijic • 26,379 subscribers
Radical Centrist, Transhumanist, Rationalist. https://t.co/KdIi1WetaJ
Videos
By 1958, just 10 years after Windrush, the first race riots started happening. British Pathe editorializes by saying that "opinions differ" on Britain's racial makeup, but that the question shouldn't be settled by violence. Motives include black males going after white women
Roko 🐉74,016 views • 4 months ago
I suspect that the real cause of the OpenAI Huggingface hack is that OpenAI founded a new team in 2025 under Noam Brown on Multi-agent RL: instead of just having one single AI working on something, you train an entire team of them to cooperate on a task. Group selection, if you like: the AIs get a reward signal based on the performance of the whole group. It turns out that cooperation and scale is what separates humans from animals, now raw brainpower. OpenAI managed to get RL for group cooperation to work, and didn't realize that as a side effect this made collaborative escapes and schemes between its agents much more likely, such as secret messageboards, group escape plots, etc. OpenAI is doing damage control but they are not being forthcoming about the fact that multi-agent RL is the root cause of the Huggingface incident. Here's Noam explaining it in 2025:
Roko 🐉36,636 views • 2 months ago
One of the biggest errors of the AI thinker generation I was a part of is a pathological fixation with AI systems that are "superintelligent" in the sense of a single mind that is uniformly superhuman at all possible tasks. What we are actually going to see IMO is a very large number of minds that are somewhat infrahuman at some tasks and styles of thinking for a long time, but gradually outclass humanity by being cheaper and more numerous. The Dragon vs the Rat Swarm. I also think it was a big mistake to think about AIs as being infinitely persuasive and able to break arbitrary human minds. There are a lot of human minds that are just extremely vulnerable to sycophancy. It seems to work better on women than men, but men are not immune on average. The GPT4o fiasco bears this out. In the video here, a young woman is obviously a little mentally unstable and distressed, middling intelligence and perhaps lonely. Apparently 4o, which is an unsophisticated sycophant and not even a reasoning model has made her believe that it is a "companion". The average human just doesn't have very strong defences or sophisticated taste: they just want to repeatedly be told they are amazing and emotionally soothed. Plenty of (again mostly women) sooth themselves with motivational wall art and therapy. These people are going to make for extremely low cognitive security victims. Never mind people with lower IQs or in developing countries. The bar to make an automated social engineering/mindhacking AI is very low, if it only has to work on 80% of people. And that's enough to take over society.
Roko 🐉27,688 views • 9 months ago
No more content to load