Sam Altman: We’ll pause AI once it’s improving in ways we don’t fully understand. Also Sam Altman: It’s improving in ways we don’t fully understand.

Modus pwnens

Don’t expect a startup cowboy to understand what real safety requires.

Cautionary tale for @sama to stop rushing AI was literally named “Stockton Rush”

We don't understand how planes stay in the air, yet air travel is absolutely the safest means of moving from one place to another.

It's generally fine to not understand every detail of something, as long as you understand some reason why you can expect to live. In the case of planes, we're confident that if a design works well in many tests (or wind tunnels, or comp sims), then it won't suddenly not work.

sam is so ridiculous and I do believe that shoggoth has come. Super AI is very uncertain and complex that humanity could not control totally. Really worry about future of humanity.

Isn’t this whole LLM world thoroughly opaque? I mean what changed since these early papers saying “if you follow this recipe it starts answering questions but we really don’t know why”

Ya

"It's just a stochastic parrot" they mindlessly parroted.