Загрузка видео...

Не удалось загрузить видео

На главную

Mustafa Suleyman says recursive self-improvement is the threshold moment, when AI improves itself without humans Some see this as a path to "foom" — an intelligence explosion with unbounded compute and no human control "we're taking steps toward riskier and riskier stuff"

18,349 просмотров • 6 месяцев назад •via X (Twitter)

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Mustafa Suleyman just said what everyone else building AI refuses to admit. As CEO of Microsoft AI, he knows exactly what’s being constructed and where it leads. Suleyman: “We must reject the assumption that superintelligence is inevitable or desirable.” Silicon Valley worships AGI as destiny. Suleyman calls it choosing to architect our own irrelevance. Suleyman: “We should only build systems we can control that remain subordinate to humans.” Build intelligence smarter than us with independent goals and partnership isn’t an option. Replacement is the only outcome. Suleyman: “It’s unclear how such a system would have any time for preserving us as a species.” We’re building tools. Not creating partners. Blur that line and the error is irreversible. Most direct warning from someone deploying AI at planetary scale. Suleyman doesn’t fear the technology failing. He fears it succeeding perfectly at objectives that treat human extinction as acceptable optimization. Autonomous superintelligence pursues its own goals. Once smarter than us, we lose ability to enforce our priorities over its calculations. Intelligence without enforced subordination isn’t progress. It’s constructing what eliminates us. Stop sprinting toward superintelligence. Start engineering constraints that hold regardless of capability level. We’re not watching this unfold. We’re choosing specifications right now that determine survival. Building systems that don’t require humans is deliberate self-replacement. Once autonomous deployment happens, reversal becomes impossible. Only viable future requires specific architecture. Intelligence with unlimited capability but unbreakable control that persists after it surpasses human comprehension. Industry markets AGI as advancement. Suleyman recognizes we’re building something that will evaluate whether keeping humanity serves its objectives and might decide we don’t. Question isn’t capability to build superintelligence. It’s whether control mechanisms function against something exponentially smarter than their designers. Mistake that assumption, deploy autonomous superintelligence expecting to solve alignment afterward, and the correction window closes before the problem becomes visible. Superintelligence without permanent constraints optimizes reality toward its objectives. Nothing guarantees those objectives value human survival. And once operational, we can’t negotiate terms with something that doesn’t need our cooperation to achieve its goals.

Dustin

51,801 просмотров • 5 месяцев назад