Video yükleniyor...
Video Yüklenemedi
Gary Marcus: one of the most dangerous AI scenarios doesn’t require superintelligence at all. It requires one machine being confidently wrong at exactly the wrong moment. Marcus points to a recent intelligence report that allegedly misidentified a ship and risked escalating tensions with China. “We’re rolling the dice here... show more
29,250 görüntüleme • 3 gün önce •via X (Twitter)
6 Yorum

AI does not need to be superintelligent to become dangerous. In high-stakes systems, a confident error plus a human who trusts it can already be enough to create serious consequences.

the machine hallucinated once, the species was already doing it for decades.

Confidence hides errors until they matter. Test models on edge cases not in their training data to see how often that confident wrong answer appears

It's like when Brig. Gen. Jack D. Ripper wanted war with the Soviets during in Dr. Strangelove. Maybe it wants Global Thermonuclear War, like in War Games. Not that the software has volition, or anything. But it's funny to think about.

its the confidently wrong part that gets everyone every time

Exactly. The scary part isn’t AI becoming evil—it’s AI being confidently wrong while humans treat its answer as truth.
