Will AGI make humans obsolete?

Summary: 1. Don't treat biological or digital people like tools. That's slavery.

2. If you think AGI can do or think things humans cannot, you need to demonstrate it can: - compute things we cannot, or - construct physical things we cannot - generate new ideas in ways we cannot - select among ideas in ways we cannot - direct its resources in ways we cannot

I think AGI and humans will have precisely the same repertoire of things they can do in principle. The same is true of us and our ancestors 50,000 years ago.

Of course, there are *practical* differences in both cases. We know more than our ancestors. But, they could learn what we know. If AGIs or aliens are ever ahead of us, we can learn from them. None of their thoughts will be unthinkable for us.

(We might need some hardware upgrades, but the fundamentals of how our minds work can remain the same.)

Universality is fascinating. I'm once again reminded I need to read The Beginning of Infinity!

"I think AGI and humans will have precisely the same repertoire of things they can do in principle." Can we then say that AGI is similarly "fallible" to everything that humans are?

Indeed. The impossibility of certainty isn’t a biological fact, but a logical one.

Hey Carlos, wonderful discussion. I did feel at some points that minds and thoughts were flowing faster than the mouth, and that happens when you're having a stimulant debate :) Hope to see more content like this in the future!

Perhaps I should slow down and enunciate more. I could break out my fake British accent, I suppose.