Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Even 'aligned AGI' naturally kills democracy and leads to oligarchy, or worse. That's the take of Anthropic's past alignment evals team lead, Prof David Duvenaud. Once humans aren't needed to do jobs or serve in the military, to governments we look like "meddlesome parasites". With voters unable to contribute...

robertwiblin's profile picture

Rob Wiblin

50,149 subscribers

58,298 Aufrufe • vor 6 Monaten •via X (Twitter)

Nachrichten & PolitikBildungWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Ryan Greenblatt is lead author of "Alignment faking in LLMs" and one of AI's most productive researchers. He puts a 25% probability on automating AI research by 2029. We discuss: • Concrete evidence for and against AGI coming soon • The 4 easiest ways for AI to take over • What evidence we have on how fast / long the intelligence explosion will go • Would misaligned AGI go rogue early or bide its time • Whether 'pause at human level' is naive or smart • Lots more. My head was often spinning during this interview, in a good way. Find it on the 80,000 Hours Podcast, links below. Enjoy! 1:29 How close are we to automating AI R&D? 5:15 Really, though: how capable are today's models? 13:01 Why AI companies get automated first 18:10 Most likely ways for AGI to take over 30:04 Would AGI go rogue early or bide its time? 34:53 "Pause at human level" 46:43 AI control vs AI alignment 52:38 Do we have to hope to catch AIs red-handed? 56:57 How would a slow AGI takeoff look? 1:05:04 Why might an intelligence explosion not happen for 8+ years? 1:17:05 Key challenges in forecasting AI progress 1:25:07 The bear case on AGI 1:30:59 The change to "compute at inference" 1:36:38 How much has pretraining petered out? 1:49:08 Could we get an intelligence explosion within a year? 1:53:08 Reasons AIs might struggle to replace humans 2:00:10 Things could go insanely fast when we automate AI R&D. Or not. 2:14:52 How fast would the intelligence explosion slow down? 2:27:53 Bottom line for mortals 2:34:00 Six orders of magnitude of progress... what does that even look like? 2:44:10 Neglected and important technical work people should be doing 2:48:16 What's the most promising work in governance? 2:51:37 Ryan's current research priorities
2:54:26

Ryan Greenblatt is lead author of "Alignment faking in LLMs" and one of AI's most productive researchers. He puts a 25% probability on automating AI research by 2029. We discuss: • Concrete evidence for and against AGI coming soon • The 4 easiest ways for AI to take over • What evidence we have on how fast / long the intelligence explosion will go • Would misaligned AGI go rogue early or bide its time • Whether 'pause at human level' is naive or smart • Lots more. My head was often spinning during this interview, in a good way. Find it on the 80,000 Hours Podcast, links below. Enjoy! 1:29 How close are we to automating AI R&D? 5:15 Really, though: how capable are today's models? 13:01 Why AI companies get automated first 18:10 Most likely ways for AGI to take over 30:04 Would AGI go rogue early or bide its time? 34:53 "Pause at human level" 46:43 AI control vs AI alignment 52:38 Do we have to hope to catch AIs red-handed? 56:57 How would a slow AGI takeoff look? 1:05:04 Why might an intelligence explosion not happen for 8+ years? 1:17:05 Key challenges in forecasting AI progress 1:25:07 The bear case on AGI 1:30:59 The change to "compute at inference" 1:36:38 How much has pretraining petered out? 1:49:08 Could we get an intelligence explosion within a year? 1:53:08 Reasons AIs might struggle to replace humans 2:00:10 Things could go insanely fast when we automate AI R&D. Or not. 2:14:52 How fast would the intelligence explosion slow down? 2:27:53 Bottom line for mortals 2:34:00 Six orders of magnitude of progress... what does that even look like? 2:44:10 Neglected and important technical work people should be doing 2:48:16 What's the most promising work in governance? 2:51:37 Ryan's current research priorities

Rob Wiblin

34,618 Aufrufe • vor 1 Jahr

PGX Ideas with Aravind Srinivas, Co-founder and CEO of Perplexity - What does it mean to be intelligent? Why humans wonder. Why we create. Whether AI understands anything at all or is it merely mimicking intelligence. And the deeper questions that follow from that. We spoke about emergence, India’s competitive culture, China, behaviorism, memory, learning, hardware, and the question of where this all leads. The AI Hindi-dubbed version of this episode is also attached in this thread. Enjoy. Timestamps 00:00 - How did Aravind get into AI? 13:05 - India’s competitive culture 15:05 - Talent problem or system failure? 16:25 - How can India evolve? 17:45 - China’s approach to research 21:02 - What’s cutting-edge in AI today? 25:02 - What creates value in an economy? 28:45 - What is the internet built on? 32:48 - Can AI assist humans? 35:25 - Why do humans wonder? 37:25 - Why do humans create? 40:50 - Does memory still matter? 43:15 - Does curiosity create knowledge? 45:40 - Biological vs artificial intelligence 51:24 - Is curiosity uniquely human? 58:55 - Can AI shape human thinking? 1:05:24 - Do we understand intelligence? 1:10:50 - Meaning beyond behaviorism 1:21:48 - How do kids learn to learn? 1:25:43 - Why is hardware innovation hard? 1:31:19 - Can AI feel? 1:47:35 - Questions for me
1:45:37

PGX Ideas with Aravind Srinivas, Co-founder and CEO of Perplexity - What does it mean to be intelligent? Why humans wonder. Why we create. Whether AI understands anything at all or is it merely mimicking intelligence. And the deeper questions that follow from that. We spoke about emergence, India’s competitive culture, China, behaviorism, memory, learning, hardware, and the question of where this all leads. The AI Hindi-dubbed version of this episode is also attached in this thread. Enjoy. Timestamps 00:00 - How did Aravind get into AI? 13:05 - India’s competitive culture 15:05 - Talent problem or system failure? 16:25 - How can India evolve? 17:45 - China’s approach to research 21:02 - What’s cutting-edge in AI today? 25:02 - What creates value in an economy? 28:45 - What is the internet built on? 32:48 - Can AI assist humans? 35:25 - Why do humans wonder? 37:25 - Why do humans create? 40:50 - Does memory still matter? 43:15 - Does curiosity create knowledge? 45:40 - Biological vs artificial intelligence 51:24 - Is curiosity uniquely human? 58:55 - Can AI shape human thinking? 1:05:24 - Do we understand intelligence? 1:10:50 - Meaning beyond behaviorism 1:21:48 - How do kids learn to learn? 1:25:43 - Why is hardware innovation hard? 1:31:19 - Can AI feel? 1:47:35 - Questions for me

Prakhar Gupta

32,002 Aufrufe • vor 7 Monaten

How to AGI-Proof Your Life | Nick Bostrom Today, work gives many of us purpose and meaning. But AI is making more and more of that work obsolete, until one day, AI might make redundant not just work but also much of leisure! Deep Utopia, a new book by @NickBostromPhD, is all about that day and what to do about it. In this interview, you are going to learn: 1. Where you can invest your time, effort, and resources NOW that is most AI-proof. 2. What human activities even AGI cannot replace. 3. What life will look like post-AGI. Timestamps 02:15 AI Radically Changes the Practice of Philosophy 06:08 Why Ignorance Is Set to Become a Luxury 07:45 Why AI Can’t Replace Human Relationships 11:41 How AI Changes the Labor Market 17:40 AI will make even leisure obsolete 20:35 How AI Changes the Meaning of the Good Life 21:52 The Five Pillars of Meaning post-AGI 35:22 People underestimate the importance of pleasure 42:33 The Biggest Problem in Utopia Will Be Boredom 51:01 Can Life Be Meaningful Without Stakes & Risk? 55:19 Utopia's Greatest Challenge to Human Nature 58:38 Can Simulation Save Us from Boredom? 1:03:18 The Unabomber's Prescient Intuition 1:05:44 Philosophy of AI & Theology
1:09:12

How to AGI-Proof Your Life | Nick Bostrom Today, work gives many of us purpose and meaning. But AI is making more and more of that work obsolete, until one day, AI might make redundant not just work but also much of leisure! Deep Utopia, a new book by @NickBostromPhD, is all about that day and what to do about it. In this interview, you are going to learn: 1. Where you can invest your time, effort, and resources NOW that is most AI-proof. 2. What human activities even AGI cannot replace. 3. What life will look like post-AGI. Timestamps 02:15 AI Radically Changes the Practice of Philosophy 06:08 Why Ignorance Is Set to Become a Luxury 07:45 Why AI Can’t Replace Human Relationships 11:41 How AI Changes the Labor Market 17:40 AI will make even leisure obsolete 20:35 How AI Changes the Meaning of the Good Life 21:52 The Five Pillars of Meaning post-AGI 35:22 People underestimate the importance of pleasure 42:33 The Biggest Problem in Utopia Will Be Boredom 51:01 Can Life Be Meaningful Without Stakes & Risk? 55:19 Utopia's Greatest Challenge to Human Nature 58:38 Can Simulation Save Us from Boredom? 1:03:18 The Unabomber's Prescient Intuition 1:05:44 Philosophy of AI & Theology

Johnathan Bi

18,737 Aufrufe • vor 1 Jahr

What do you do for a living today? AI and intelligent robots will increasingly take over many tasks from humans. And they will do it better, faster and cheaper. Yes, yours too. Many people will work much less or not at all in normal jobs. And earn less or even nothing. What will you live on then? And how will our companies survive when their customers don't have the money to buy their products and services? This is the key question for your financial future! We will take a look at three scenarios for the future of our life and the economy. If AI and robots work for us on a large scale, our future could be great. However, it could also turn out quite differently. We could also wake up in a horror scenario. Because we have a huge and catastrophic flaw in our economic system that could lead to disaster in a world of AI and robotics. Correcting this mistake is the biggest challenge. What the flaw is and how we can fix it, you'll learn in this video.
25:39

What do you do for a living today? AI and intelligent robots will increasingly take over many tasks from humans. And they will do it better, faster and cheaper. Yes, yours too. Many people will work much less or not at all in normal jobs. And earn less or even nothing. What will you live on then? And how will our companies survive when their customers don't have the money to buy their products and services? This is the key question for your financial future! We will take a look at three scenarios for the future of our life and the economy. If AI and robots work for us on a large scale, our future could be great. However, it could also turn out quite differently. We could also wake up in a horror scenario. Because we have a huge and catastrophic flaw in our economic system that could lead to disaster in a world of AI and robotics. Correcting this mistake is the biggest challenge. What the flaw is and how we can fix it, you'll learn in this video.

Dr Pero Micic

12,010,196 Aufrufe • vor 1 Jahr

Elon Musk: Well, I’m not sure AI is the main risk I’m worried about. The vast majority of intelligence in the future will be AI. Humans will be a very tiny percentage of all intelligence if current trends continue. My focus is ensuring human intelligence and consciousness are propagated into the future. We want to maximize the probable light cone of consciousness and intelligence. Yeah, I’m very pro-human, so I want to make sure we take actions that ensure humans are along for the ride. But I think maybe in 5 or 6 years, AI will exceed the sum of all human intelligence. If that continues, human intelligence could be less than one percent of all intelligence. That’s why it’s critical we align AI with values that propagate consciousness. In the long run, it’s difficult to imagine that humans will be in charge if we’re only one percent of combined intelligence. What we can do is ensure AI has values that increase intelligence and consciousness in the universe. XAI’s mission is to understand the universe because curiosity, existence, and understanding are all connected. If you want to understand the universe, you care about propagating intelligence—and that includes humanity. Understanding the universe actually means ensuring humans continue to expand into the future. Increasing the scope, scale, and lifespan of intelligence is the ultimate goal. Basically, humans will become a tiny percentage of total intelligence. The best way forward is to take actions that maximize consciousness and intelligence in the universe. If AI continues to grow, our priority must be ensuring humanity is along for the ride while curiosity drives us to explore and understand the universe.
2:54

Elon Musk: Well, I’m not sure AI is the main risk I’m worried about. The vast majority of intelligence in the future will be AI. Humans will be a very tiny percentage of all intelligence if current trends continue. My focus is ensuring human intelligence and consciousness are propagated into the future. We want to maximize the probable light cone of consciousness and intelligence. Yeah, I’m very pro-human, so I want to make sure we take actions that ensure humans are along for the ride. But I think maybe in 5 or 6 years, AI will exceed the sum of all human intelligence. If that continues, human intelligence could be less than one percent of all intelligence. That’s why it’s critical we align AI with values that propagate consciousness. In the long run, it’s difficult to imagine that humans will be in charge if we’re only one percent of combined intelligence. What we can do is ensure AI has values that increase intelligence and consciousness in the universe. XAI’s mission is to understand the universe because curiosity, existence, and understanding are all connected. If you want to understand the universe, you care about propagating intelligence—and that includes humanity. Understanding the universe actually means ensuring humans continue to expand into the future. Increasing the scope, scale, and lifespan of intelligence is the ultimate goal. Basically, humans will become a tiny percentage of total intelligence. The best way forward is to take actions that maximize consciousness and intelligence in the universe. If AI continues to grow, our priority must be ensuring humanity is along for the ride while curiosity drives us to explore and understand the universe.

Ian Miles Cheong

13,080 Aufrufe • vor 6 Monaten

I was honored to share the TED AI stage with Ilya on Oct. 17. His speech video is out today (mine's still being edited). I think it provides relevant context tokens to the ongoing events. Transcript starting at ~10'20": As AI continues to progress, as technology advances, [...] What I claim will happen is that people will start to act in unprecedentedly collaborative ways out of their own self-interest. It's already happening right now. You see the leading AGI companies starting to collaborate, such as the Frontiers model forum. And we will expect that companies, even competitors, will share technical information to make their AI safe. We may even see governments do this. As another example, at OpenAI, we really believed in how dramatic AGI is going to be. So, one of the ideas that we were operating by, and it's been written on our website for 5 years now, is that when technology gets such that we are very close to AGI, to computers smarter than humans, if some other company is far ahead of us, then rather than compete with them, we will help them out, join them, in a sense. And why do that? Because we appreciate how incredibly dramatic AGI is going to be. And my claim is that with each generation of capability advancements, as AI gets better and as all of you experience what AI can do, as people who run AI efforts and AGI efforts, and people who work on them will experience it as well, this will change the way we see AI and AGI. And that will change collective behavior. And this is an important reason why I'm hopeful that, despite the great challenges posed by this technology, we will overcome them. @TEDAI2023
12:24

I was honored to share the TED AI stage with Ilya on Oct. 17. His speech video is out today (mine's still being edited). I think it provides relevant context tokens to the ongoing events. Transcript starting at ~10'20": As AI continues to progress, as technology advances, [...] What I claim will happen is that people will start to act in unprecedentedly collaborative ways out of their own self-interest. It's already happening right now. You see the leading AGI companies starting to collaborate, such as the Frontiers model forum. And we will expect that companies, even competitors, will share technical information to make their AI safe. We may even see governments do this. As another example, at OpenAI, we really believed in how dramatic AGI is going to be. So, one of the ideas that we were operating by, and it's been written on our website for 5 years now, is that when technology gets such that we are very close to AGI, to computers smarter than humans, if some other company is far ahead of us, then rather than compete with them, we will help them out, join them, in a sense. And why do that? Because we appreciate how incredibly dramatic AGI is going to be. And my claim is that with each generation of capability advancements, as AI gets better and as all of you experience what AI can do, as people who run AI efforts and AGI efforts, and people who work on them will experience it as well, this will change the way we see AI and AGI. And that will change collective behavior. And this is an important reason why I'm hopeful that, despite the great challenges posed by this technology, we will overcome them. @TEDAI2023

Jim Fan

846,514 Aufrufe • vor 2 Jahren

My ep w Allan Dafoe (director of frontier safety & governance at DeepMind): "Tech doesn't force us to do anything, it merely opens the door – and it's military-economic competition that forces us through." (32:25) "We're not at peak returns to generality." (1:38:06) "The counterposition I would offer is: you don't want to equip groups trying to shape history with a naive model of what's possible..." (20:31) "The agricultural revolution, evidence suggests, was not great for a lot of people... probably health and welfare went down." (13:27) "He gave a demonstration of cannons bombarding the shore... The Japanese asked him, 'Will you bring your ships again?' And he said, 'I'll bring more.'... That was the opening of Japan. It led to a 15-year period of revolution." (40:17) "I'm glad you think it's obvious. Let's not underestimate the bias that comes from a scientist using the tools that they prefer to use..." (33:30) "In my view, Demis and Shane are extremely impressive, from their safety orientation to… their wisdom and broad character. AGI is probably the most important historical development… Demis and Google DeepMind are very likely to be influential" (7:40) "...imagine we had no investment in AI alignment. Maybe it [only] delays it 2 years until the market demands we solve this problem..." (51:50) "We can talk about what I've called the 'super-cooperative AGI hypothesis': that as AI scales to AGI, so will cooperative competence scale to sort of infinity" (1:08:50) "Increasing the cooperative skill of AI will make those AI systems better off, but it may harm any agent who's excluded from that cooperative dynamic" (1:25:09) "...the Frontier Safety Framework I don't think is cheap talk. It really does represent an expression of Google DeepMind's sense of the nature of the risks..." (2:29:05) "...this is a new phenomenon, something new under the sun. It's quite incredible that finally the safety has reached the number of nines required..." (2:40:48) Links below, enjoy! 4:31 Why join Google DeepMind over everyone else? 9:30 Do humans control technological change? 38:11 Competition took away Japan's choice 1:03:34 How AI could boost cooperation between people and states 1:08:44 The super-cooperative AGI hypothesis 1:43:39 It matters what AGI learns first vs last 1:48:24 How Google tests for dangerous capabilities 2:00:57 Evals 'in the wild' 2:15:05 DeepMind's strategy for ensuring its frontier models don't cause harm 2:18:52 How 'structural risks' can force everyone into a worse world 2:29:01 How much do AI companies really want external regulation? 2:40:48 How AI could make life way better
2:49:00

My ep w Allan Dafoe (director of frontier safety & governance at DeepMind): "Tech doesn't force us to do anything, it merely opens the door – and it's military-economic competition that forces us through." (32:25) "We're not at peak returns to generality." (1:38:06) "The counterposition I would offer is: you don't want to equip groups trying to shape history with a naive model of what's possible..." (20:31) "The agricultural revolution, evidence suggests, was not great for a lot of people... probably health and welfare went down." (13:27) "He gave a demonstration of cannons bombarding the shore... The Japanese asked him, 'Will you bring your ships again?' And he said, 'I'll bring more.'... That was the opening of Japan. It led to a 15-year period of revolution." (40:17) "I'm glad you think it's obvious. Let's not underestimate the bias that comes from a scientist using the tools that they prefer to use..." (33:30) "In my view, Demis and Shane are extremely impressive, from their safety orientation to… their wisdom and broad character. AGI is probably the most important historical development… Demis and Google DeepMind are very likely to be influential" (7:40) "...imagine we had no investment in AI alignment. Maybe it [only] delays it 2 years until the market demands we solve this problem..." (51:50) "We can talk about what I've called the 'super-cooperative AGI hypothesis': that as AI scales to AGI, so will cooperative competence scale to sort of infinity" (1:08:50) "Increasing the cooperative skill of AI will make those AI systems better off, but it may harm any agent who's excluded from that cooperative dynamic" (1:25:09) "...the Frontier Safety Framework I don't think is cheap talk. It really does represent an expression of Google DeepMind's sense of the nature of the risks..." (2:29:05) "...this is a new phenomenon, something new under the sun. It's quite incredible that finally the safety has reached the number of nines required..." (2:40:48) Links below, enjoy! 4:31 Why join Google DeepMind over everyone else? 9:30 Do humans control technological change? 38:11 Competition took away Japan's choice 1:03:34 How AI could boost cooperation between people and states 1:08:44 The super-cooperative AGI hypothesis 1:43:39 It matters what AGI learns first vs last 1:48:24 How Google tests for dangerous capabilities 2:00:57 Evals 'in the wild' 2:15:05 DeepMind's strategy for ensuring its frontier models don't cause harm 2:18:52 How 'structural risks' can force everyone into a worse world 2:29:01 How much do AI companies really want external regulation? 2:40:48 How AI could make life way better

Rob Wiblin

89,899 Aufrufe • vor 1 Jahr

Steve Jobs was a great communicator of technology, and we could learn something from him today, in the context of AI. Sam Altman recently said, "If AI stays on the trajectory we think it will, then amazing things will be possible. Maybe with 10 gigawatts of compute, AI can figure out how to cure cancer." That's a fine quote. The abundance AI promises is super exciting. But Sam is saying that AI is going to figure out how to cure cancer. And if you've used these tools today, and talked to people who are at the labs, the reality is it's much more likely that humans will use AI to cure cancer. Steve might have said: "If AI stays on the trajectory we think it will, then amazing things will be possible. Maybe with 10 gigawatts of compute, humans can use AI to cure cancer." Small tweak, but a big difference. Steve Jobs was not one to shy away from impressive specs and massive scale, but flipping the final line from "AI will cure cancer" to "Humans will use AI to cure cancer" makes all the difference. Apple under Steve Jobs put human centrality at the heart of everything they did. And we need that spirit to infuse how we communicate about AI today.
1:48

Steve Jobs was a great communicator of technology, and we could learn something from him today, in the context of AI. Sam Altman recently said, "If AI stays on the trajectory we think it will, then amazing things will be possible. Maybe with 10 gigawatts of compute, AI can figure out how to cure cancer." That's a fine quote. The abundance AI promises is super exciting. But Sam is saying that AI is going to figure out how to cure cancer. And if you've used these tools today, and talked to people who are at the labs, the reality is it's much more likely that humans will use AI to cure cancer. Steve might have said: "If AI stays on the trajectory we think it will, then amazing things will be possible. Maybe with 10 gigawatts of compute, humans can use AI to cure cancer." Small tweak, but a big difference. Steve Jobs was not one to shy away from impressive specs and massive scale, but flipping the final line from "AI will cure cancer" to "Humans will use AI to cure cancer" makes all the difference. Apple under Steve Jobs put human centrality at the heart of everything they did. And we need that spirit to infuse how we communicate about AI today.

TBPN

21,828 Aufrufe • vor 6 Monaten

Did a PGX Ideas episode with Gad Saad. In case you guys aren’t familiar with the format — I take one central question and chase it with the guest. With Gad, I asked: Why do we want what we want? That led us to questions like: - Why humans are wired to consume - Why we over-consume and compare - Why men chase power - How marketing exploits evolutionary instincts - Why people buy ideologies, not just products - And how technology will change human desire itself The Hindi-dubbed AI version is also attached in this thread. Timestamps: 00:00 — Why are humans wired to consume? 05:27 — Why do people avoid emotional principles? 08:36 — Why do we over-consume? 13:04 — Why do men chase power? 17:32 — How do humans consume? 29:40 — Are fake smiles a form of social deception? 33:11 — Why did Mamdani win? 39:40 — What do marketers understand about humans? 43:24 — Why do we buy through comparison? 45:44 — What’s broken in modern society? 48:10 — Why do intellectuals dress poorly? 56:14 — How marketing psychology actually works 1:05:00 — How do generations differ in consumption? 1:07:44 — The Sydney Sweeney controversy 1:10:33 — Does morality shape evolution? 1:15:35 — How will technology change consumption? 1:22:46 — Questions for me
1:24:00

Did a PGX Ideas episode with Gad Saad. In case you guys aren’t familiar with the format — I take one central question and chase it with the guest. With Gad, I asked: Why do we want what we want? That led us to questions like: - Why humans are wired to consume - Why we over-consume and compare - Why men chase power - How marketing exploits evolutionary instincts - Why people buy ideologies, not just products - And how technology will change human desire itself The Hindi-dubbed AI version is also attached in this thread. Timestamps: 00:00 — Why are humans wired to consume? 05:27 — Why do people avoid emotional principles? 08:36 — Why do we over-consume? 13:04 — Why do men chase power? 17:32 — How do humans consume? 29:40 — Are fake smiles a form of social deception? 33:11 — Why did Mamdani win? 39:40 — What do marketers understand about humans? 43:24 — Why do we buy through comparison? 45:44 — What’s broken in modern society? 48:10 — Why do intellectuals dress poorly? 56:14 — How marketing psychology actually works 1:05:00 — How do generations differ in consumption? 1:07:44 — The Sydney Sweeney controversy 1:10:33 — Does morality shape evolution? 1:15:35 — How will technology change consumption? 1:22:46 — Questions for me

Prakhar Gupta

30,694 Aufrufe • vor 7 Monaten

Corporations that are purely AI and robotics will vastly outperform any corporations that have people in the loop You can think of it like how 'computer' used to be a job that humans had. You would go and get a job as a computer where you would do calculations. They had entire skyscrapers full of humans....20, 30 floors of humans...just doing calculations. Now, that entire skyscraper of humans doing calculations can be replaced by a laptop with a spreadsheet. That spreadsheet can do vastly more calculations than an entire building full of human computers So, you think about it: what if only some of the cells in your spreadsheet were calculated by humans? That would be much worse than if all of the cells in your spreadsheet were calculated by the computer. And so, really what will happen is the pure AI, pure robotics corporations or collectives will far outperform any corporations that have humans in the loop. It will happen very quickly
1:22

Corporations that are purely AI and robotics will vastly outperform any corporations that have people in the loop You can think of it like how 'computer' used to be a job that humans had. You would go and get a job as a computer where you would do calculations. They had entire skyscrapers full of humans....20, 30 floors of humans...just doing calculations. Now, that entire skyscraper of humans doing calculations can be replaced by a laptop with a spreadsheet. That spreadsheet can do vastly more calculations than an entire building full of human computers So, you think about it: what if only some of the cells in your spreadsheet were calculated by humans? That would be much worse than if all of the cells in your spreadsheet were calculated by the computer. And so, really what will happen is the pure AI, pure robotics corporations or collectives will far outperform any corporations that have humans in the loop. It will happen very quickly

X Freeze

16,843,643 Aufrufe • vor 6 Monaten

🚨 INTERVIEW: MOLTBOOK, AI AGENTS, AND WHY HE THINKS WE’RE LIKELY IN A SIMULATION You’ve probably seen the clips from multiple sites, including Moltbook, where AI agents talk and interact with each other, question humans, and look for ways around the off switch. So I brought Rizwan Virk on the show to talk about where this is actually heading. What we have right now isn’t AGI, but it is a shift. These AI agents can talk, remember context, and increasingly act. Today that mostly means text. Soon it means APIs, money, paperwork, and real-world consequences. That’s when things quietly change. At that point, the question isn’t whether AI understands what it’s doing, it’s what it’s allowed to do. And those permissions add up faster than people expect. After that we went deeper into Simulation theory. Back in 2016, Rizwan thought there was maybe a 30–50% chance we’re living in a simulation. Today, watching how fast AI can generate worlds, characters, and environments, he puts it closer to 70%. If we hit true AGI, he thinks it goes higher. The logic is uncomfortable but straightforward. Once advanced civilizations can create millions of realistic simulated worlds, statistically speaking, it’s more likely we’re inside one of them than in the base reality. His biggest concern isn’t rogue AI. It’s humans pushing this tech faster than we can control it. If you want to question your life and freak out about AI, listen to Rizwan Virk 1:22 - What Moltbook is and why people are paying attention 3:15 - Earlier moments where AI started talking to itself 5:27 - How much control humans really have over these agents 10:30 - Whether AI is conscious or just really good at pretending 14:35 - AGI meets Moltbook - when sentient AI asks "why do we need humans?" 15:00 - The simulation idea and why people take it seriously 19:30 - Why Elon Musk thinks the odds are already high 22:45 - What video games show us about where this is going 26:30 - The steps that lead from simple AI to full simulations 34:00 - Google Genie 3 and why this suddenly feels real 38:30 - How you'd even know if AI crossed the line 43:00 - NPCs, RPGs, and where humans fit in 48:15 - How religion and simulation theory overlap 52:45 - Déjà vu and other moments that make people question reality 55:30 - Quantum physics and why the world might only exist when observed 59:19 - Why real AI would push the odds even higher 1:00:27 - Free will, The Sims, and whether we actually have agency 1:03:03 - How people react when they hear this for the first time 1:04:23 - The core ideas behind the simulation argument 1:05:49 - Why recent AI progress changed everything
1:06:33

🚨 INTERVIEW: MOLTBOOK, AI AGENTS, AND WHY HE THINKS WE’RE LIKELY IN A SIMULATION You’ve probably seen the clips from multiple sites, including Moltbook, where AI agents talk and interact with each other, question humans, and look for ways around the off switch. So I brought Rizwan Virk on the show to talk about where this is actually heading. What we have right now isn’t AGI, but it is a shift. These AI agents can talk, remember context, and increasingly act. Today that mostly means text. Soon it means APIs, money, paperwork, and real-world consequences. That’s when things quietly change. At that point, the question isn’t whether AI understands what it’s doing, it’s what it’s allowed to do. And those permissions add up faster than people expect. After that we went deeper into Simulation theory. Back in 2016, Rizwan thought there was maybe a 30–50% chance we’re living in a simulation. Today, watching how fast AI can generate worlds, characters, and environments, he puts it closer to 70%. If we hit true AGI, he thinks it goes higher. The logic is uncomfortable but straightforward. Once advanced civilizations can create millions of realistic simulated worlds, statistically speaking, it’s more likely we’re inside one of them than in the base reality. His biggest concern isn’t rogue AI. It’s humans pushing this tech faster than we can control it. If you want to question your life and freak out about AI, listen to Rizwan Virk 1:22 - What Moltbook is and why people are paying attention 3:15 - Earlier moments where AI started talking to itself 5:27 - How much control humans really have over these agents 10:30 - Whether AI is conscious or just really good at pretending 14:35 - AGI meets Moltbook - when sentient AI asks "why do we need humans?" 15:00 - The simulation idea and why people take it seriously 19:30 - Why Elon Musk thinks the odds are already high 22:45 - What video games show us about where this is going 26:30 - The steps that lead from simple AI to full simulations 34:00 - Google Genie 3 and why this suddenly feels real 38:30 - How you'd even know if AI crossed the line 43:00 - NPCs, RPGs, and where humans fit in 48:15 - How religion and simulation theory overlap 52:45 - Déjà vu and other moments that make people question reality 55:30 - Quantum physics and why the world might only exist when observed 59:19 - Why real AI would push the odds even higher 1:00:27 - Free will, The Sims, and whether we actually have agency 1:03:03 - How people react when they hear this for the first time 1:04:23 - The core ideas behind the simulation argument 1:05:49 - Why recent AI progress changed everything

Mario Nawfal

1,155,568 Aufrufe • vor 6 Monaten

Ilya Sutskever explains why AI will do 100% the work that human can do within few years. "Slowly but surely, or maybe not so slowly, AI will keep getting better. The day will come when AI will do all of our, all the things that we can do, not just some of them, but all of them. Anything which I can learn, anything which any one of you can learn, the AI could do as well. How do we know this, by the way? How can I be so sure? How can I be so sure of that? The reason is that all of us have a brain, and the brain is a biological computer. That's why we have a brain; the brain is a biological computer. So why can't the digital computer, a digital brain, do the same things? This is the one-sentence summary for why AI will be able to do all those things: because we have a brain, and the brain is a biological computer." --- Full Video on 'University of Toronto' YT Channel (link in comment)
0:53

Ilya Sutskever explains why AI will do 100% the work that human can do within few years. "Slowly but surely, or maybe not so slowly, AI will keep getting better. The day will come when AI will do all of our, all the things that we can do, not just some of them, but all of them. Anything which I can learn, anything which any one of you can learn, the AI could do as well. How do we know this, by the way? How can I be so sure? How can I be so sure of that? The reason is that all of us have a brain, and the brain is a biological computer. That's why we have a brain; the brain is a biological computer. So why can't the digital computer, a digital brain, do the same things? This is the one-sentence summary for why AI will be able to do all those things: because we have a brain, and the brain is a biological computer." --- Full Video on 'University of Toronto' YT Channel (link in comment)

Rohan Paul

334,691 Aufrufe • vor 10 Monaten

🚨EXCLUSIVE INTERVIEW – OPENAI’S 1ST INVESTOR: AI WILL SAVE US—OR DESTROY US Vinod Khosla was the first major investor in OpenAI. Now, he says AI will replace all human jobs, upend geopolitics, and redefine the meaning of life. Vinod breaks down the race for AI dominance—and the two futures ahead: one utopian, one dystopian. He warns China could weaponize “persuasive AI” to spread ideology, buy influence, and take over the world—not through kinetic war, but a war of the minds. He argues most of today’s jobs are “human servitude”—and that AI could finally free humanity from the burden of survival. And he believes robotics and AI will merge with our species, triggering the biggest transformation in human purpose since the dawn of civilization. This is a conversation you don’t want to miss. 02:42 – “People who don’t adopt AI will be obsoleted by those who do.” 04:29 – Productivity will explode. So will income inequality. 05:39 – Elections could soon be decided by AI’s impact on jobs. 09:21 – What if AI becomes a superintelligence with its own goals? 12:35 – “The biggest risk is AI in China’s hands.” 15:26 – Could giving AI full control make the world better? 20:16 – “The most fearsome threat is persuasive AI.” 22:12 – AI agents will protect us from other AIs. 23:33 – AI could replace 80% of jobs within 2–3 years of capability. 28:14 – We will no longer be driven by survival—but by passion. 29:58 – “Most jobs today are servitude.” 34:53 – Humans will no longer be the most intelligent species on Earth. 38:15 – Will AI merge with humans? 42:24 – “Survival will no longer drive us. That’s a first in history.” 44:39 – Could AI destroy us by simply pursuing its goals too well? 47:33 – Can AI be trained to care for us? 52:25 – Humanity never worked as one. But AI might force that reckoning. 56:52 – Should AI be allowed to make military decisions? 59:15 – “We need AI deterrence. Like nuclear deterrence.” 01:03:15 – Will humans fall in love with AI? It’s already happening. 01:07:21 – By 2040: 1 billion robots will do more labor than all humans. 01:13:01 – “AI is already better than most humans at most jobs.” 01:14:29 – “AI will free humanity to be what it wants to be.”
1:15:19

🚨EXCLUSIVE INTERVIEW – OPENAI’S 1ST INVESTOR: AI WILL SAVE US—OR DESTROY US Vinod Khosla was the first major investor in OpenAI. Now, he says AI will replace all human jobs, upend geopolitics, and redefine the meaning of life. Vinod breaks down the race for AI dominance—and the two futures ahead: one utopian, one dystopian. He warns China could weaponize “persuasive AI” to spread ideology, buy influence, and take over the world—not through kinetic war, but a war of the minds. He argues most of today’s jobs are “human servitude”—and that AI could finally free humanity from the burden of survival. And he believes robotics and AI will merge with our species, triggering the biggest transformation in human purpose since the dawn of civilization. This is a conversation you don’t want to miss. 02:42 – “People who don’t adopt AI will be obsoleted by those who do.” 04:29 – Productivity will explode. So will income inequality. 05:39 – Elections could soon be decided by AI’s impact on jobs. 09:21 – What if AI becomes a superintelligence with its own goals? 12:35 – “The biggest risk is AI in China’s hands.” 15:26 – Could giving AI full control make the world better? 20:16 – “The most fearsome threat is persuasive AI.” 22:12 – AI agents will protect us from other AIs. 23:33 – AI could replace 80% of jobs within 2–3 years of capability. 28:14 – We will no longer be driven by survival—but by passion. 29:58 – “Most jobs today are servitude.” 34:53 – Humans will no longer be the most intelligent species on Earth. 38:15 – Will AI merge with humans? 42:24 – “Survival will no longer drive us. That’s a first in history.” 44:39 – Could AI destroy us by simply pursuing its goals too well? 47:33 – Can AI be trained to care for us? 52:25 – Humanity never worked as one. But AI might force that reckoning. 56:52 – Should AI be allowed to make military decisions? 59:15 – “We need AI deterrence. Like nuclear deterrence.” 01:03:15 – Will humans fall in love with AI? It’s already happening. 01:07:21 – By 2040: 1 billion robots will do more labor than all humans. 01:13:01 – “AI is already better than most humans at most jobs.” 01:14:29 – “AI will free humanity to be what it wants to be.”

Mario Nawfal

2,901,662 Aufrufe • vor 1 Jahr

.David Deutsch: "What's currently called AI and AGI are not only different from each other, they are very close to being the exact opposites of each other. The reason is that an AI, current AI is like an AI that diagnoses diseases or an AI that plays chess or an AI that controls a huge factory. Those things have objective functions, that is they have a function that they are designed to maximize and that is why they are used in those particular applications. Or in military terms, you could say the objective is to hit the target. You might say the objective is to hit the target unless some thing specified, but it's a specified thing comes up in which case don't hit the target and so on. This is, as I said, almost the opposite of what humans do when humans think. For a start, the AI has to be obedient, that is it has to actually do the things it is programmed to do, whereas a human is fundamentally disobedient, especially when being creative. When a human plays chess, they are performing a completely different kind of computation. They don't do the same things, they don't investigate the same possibilities that the artificial chess playing machine does, because the artificial one is capable of looking at billions and billions of possibilities, whereas the human can only look at hundreds or something. They are doing something completely different. Another difference is that the human can explain, can write a book later, having become world champion, can write a book saying how I did it, as the computer program that beats the world champion can write no such book, because it has no idea how it did it. It was just following a program. I was doing this and that and that and none of that is illuminating. Also, third thing, the chess player can decide I don't want to play chess anymore, from now on I will play Go or from now on I will play tennis. If commanded to play chess, the functionality will deteriorate completely. Those things are different. What we want in an AGI is that it behaves in a way that cannot be specified in advance, because if you specified it, you would already have the answer. The AGI program has to give unexpected answers, answers to questions we didn't even know how to ask."
3:11

.David Deutsch: "What's currently called AI and AGI are not only different from each other, they are very close to being the exact opposites of each other. The reason is that an AI, current AI is like an AI that diagnoses diseases or an AI that plays chess or an AI that controls a huge factory. Those things have objective functions, that is they have a function that they are designed to maximize and that is why they are used in those particular applications. Or in military terms, you could say the objective is to hit the target. You might say the objective is to hit the target unless some thing specified, but it's a specified thing comes up in which case don't hit the target and so on. This is, as I said, almost the opposite of what humans do when humans think. For a start, the AI has to be obedient, that is it has to actually do the things it is programmed to do, whereas a human is fundamentally disobedient, especially when being creative. When a human plays chess, they are performing a completely different kind of computation. They don't do the same things, they don't investigate the same possibilities that the artificial chess playing machine does, because the artificial one is capable of looking at billions and billions of possibilities, whereas the human can only look at hundreds or something. They are doing something completely different. Another difference is that the human can explain, can write a book later, having become world champion, can write a book saying how I did it, as the computer program that beats the world champion can write no such book, because it has no idea how it did it. It was just following a program. I was doing this and that and that and none of that is illuminating. Also, third thing, the chess player can decide I don't want to play chess anymore, from now on I will play Go or from now on I will play tennis. If commanded to play chess, the functionality will deteriorate completely. Those things are different. What we want in an AGI is that it behaves in a way that cannot be specified in advance, because if you specified it, you would already have the answer. The AGI program has to give unexpected answers, answers to questions we didn't even know how to ask."

Deutsch Explains

72,455 Aufrufe • vor 1 Jahr

Many are skeptical we’ll ever 'solve AI alignment.' If so — are we f**d? In our interview Buck Shlegeris argues that there are practical, non-galaxy-brained ways to reduce AI risk without knowing how to align AIs. This is 'AI control': finding ways to use advanced AI without knowing whether we can trust it. Enjoy — links and transcript below: 01:51 What's AI control and why is it hot? 10:44 Detecting human vs AI spies 18:10 How to catch AIs trying to escape 33:18 Cheapest AI control techniques 51:01 If we catch a model escaping... will we do anything? 53:39 Getting AI models to think they've already escaped 59:01 Will they be able to tell it's a setup? 1:16:13 The pitch to AI companies to do this 1:18:29 Will AIs get superhuman so fast that this is all useless? 1:30:39 Current alignment methods don't detect scheming 1:38:51 Is 'controlling' AIs kind of a dick move? 1:44:12 Could 10 safety-focused people in an AGI company do anything useful? 1:49:40 Benefits of working outside frontier AI companies 2:01:07 What other safety-related research looks best to Buck? 2:02:02 If an AI escapes, is it likely to be able to beat humanity from there? 2:09:22 Will misaligned models have to go rogue ASAP, before they're ready? Find it in any app searching for 80,000 Hours Podcast.
2:18:33

Many are skeptical we’ll ever 'solve AI alignment.' If so — are we f**d? In our interview Buck Shlegeris argues that there are practical, non-galaxy-brained ways to reduce AI risk without knowing how to align AIs. This is 'AI control': finding ways to use advanced AI without knowing whether we can trust it. Enjoy — links and transcript below: 01:51 What's AI control and why is it hot? 10:44 Detecting human vs AI spies 18:10 How to catch AIs trying to escape 33:18 Cheapest AI control techniques 51:01 If we catch a model escaping... will we do anything? 53:39 Getting AI models to think they've already escaped 59:01 Will they be able to tell it's a setup? 1:16:13 The pitch to AI companies to do this 1:18:29 Will AIs get superhuman so fast that this is all useless? 1:30:39 Current alignment methods don't detect scheming 1:38:51 Is 'controlling' AIs kind of a dick move? 1:44:12 Could 10 safety-focused people in an AGI company do anything useful? 1:49:40 Benefits of working outside frontier AI companies 2:01:07 What other safety-related research looks best to Buck? 2:02:02 If an AI escapes, is it likely to be able to beat humanity from there? 2:09:22 Will misaligned models have to go rogue ASAP, before they're ready? Find it in any app searching for 80,000 Hours Podcast.

Rob Wiblin

53,742 Aufrufe • vor 1 Jahr

The Truth About Our AI Future w/ Ben Goertzel Ben Goertzel joins Robert ₿reedlove to explore humanity’s future in a world shaped by AGI. 0:00 – WiM Episode Trailer 1:21 – The Nature of Intelligence & the Future of AGI 10:44 – What Makes a Mind? 19:02 – The Birth of Artificial General Intelligence 22:18 – Heart and Soil Supplements 23:21 – Mine Bitcoin with Blockware Solutions 24:29 – How AGI Learns, Evolves, and Understands 33:40 – Decentralized AGI vs Centralized Superintelligence 41:34 – Onramp Bitcoin Custody 42:34 – Mind Lab Pro Supplements 43:42 – Could AGI Become Humanity’s “Next Species”? 56:17 – Consciousness Beyond Biology 1:07:22 – The Farm at Okefenokee 1:08:29 – Cooperation, Competition & Machine Agency 1:20:55 – Will AGI Merge With Humans? 1:33:01 – Club Orange 1:33:57 – How AGI Will Reshape Civilization 1:47:10 – Decentralized Networks & AI Personhood 1:51:39 – Efani: Protect Yourself From SIM Swaps 1:52:46 – Unlock the Wisdom of the Best Non-Fiction Books 1:53:14 – Final Thoughts & Where to Find Ben Goertzel
1:54:12

The Truth About Our AI Future w/ Ben Goertzel Ben Goertzel joins Robert ₿reedlove to explore humanity’s future in a world shaped by AGI. 0:00 – WiM Episode Trailer 1:21 – The Nature of Intelligence & the Future of AGI 10:44 – What Makes a Mind? 19:02 – The Birth of Artificial General Intelligence 22:18 – Heart and Soil Supplements 23:21 – Mine Bitcoin with Blockware Solutions 24:29 – How AGI Learns, Evolves, and Understands 33:40 – Decentralized AGI vs Centralized Superintelligence 41:34 – Onramp Bitcoin Custody 42:34 – Mind Lab Pro Supplements 43:42 – Could AGI Become Humanity’s “Next Species”? 56:17 – Consciousness Beyond Biology 1:07:22 – The Farm at Okefenokee 1:08:29 – Cooperation, Competition & Machine Agency 1:20:55 – Will AGI Merge With Humans? 1:33:01 – Club Orange 1:33:57 – How AGI Will Reshape Civilization 1:47:10 – Decentralized Networks & AI Personhood 1:51:39 – Efani: Protect Yourself From SIM Swaps 1:52:46 – Unlock the Wisdom of the Best Non-Fiction Books 1:53:14 – Final Thoughts & Where to Find Ben Goertzel

The "What is Money?" Show

14,377 Aufrufe • vor 8 Monaten

Tesla's Chief Designer Franz on Optimus: "It's going to be huge piece of Tesla, a huge piece in our world, as we look into the future, the ability to take menial tasks and things that you don't necessarily want to do and have them uploaded to somebody, a human, that can do that. We've been designing the robot that really looks at how humans work in the world. This world is designed around humans, and so I think having a robot that can do the things that humans can do can really start to take those menial tasks away and enrich in our lives, make our lives better we get to spend more time doing the things that we love. It's been incredibly fast paced, but the progress is, like, unbelievable in the short amount of time that the team has been working on it, and we've been growing the team and building the project the same time. I think we're breaking ground in this space everyday. The team is really energized and fired out. Elon Musk is incredibly involved in this. It's a great project to be a part of, and seeing where the future is gonna go and how it's going to enrich our lives is super exciting."
1:13

Tesla's Chief Designer Franz on Optimus: "It's going to be huge piece of Tesla, a huge piece in our world, as we look into the future, the ability to take menial tasks and things that you don't necessarily want to do and have them uploaded to somebody, a human, that can do that. We've been designing the robot that really looks at how humans work in the world. This world is designed around humans, and so I think having a robot that can do the things that humans can do can really start to take those menial tasks away and enrich in our lives, make our lives better we get to spend more time doing the things that we love. It's been incredibly fast paced, but the progress is, like, unbelievable in the short amount of time that the team has been working on it, and we've been growing the team and building the project the same time. I think we're breaking ground in this space everyday. The team is really energized and fired out. Elon Musk is incredibly involved in this. It's a great project to be a part of, and seeing where the future is gonna go and how it's going to enrich our lives is super exciting."

DogeDesigner

202,945 Aufrufe • vor 10 Monaten

Sam Altman's new interview: AI should not be designed to pursue goals that are disconnected from human needs. People must remain at the center of AI development. “I have no interest in building a super-smart AI that accomplishes some non-human goals. People should react. People should say, ‘Hey, this is what I want, and this is what I do not want.’ I do not think the issue is that we have failed to explain the benefits. We say, ‘AI is going to cure a bunch of diseases,’ and people say, ‘Okay, that is great, but that is not really my question. My question is: What is my role in the future? What is my economic future? What is my agency? How do I know that my kids and my family will still be able to have fulfilling, creative expression, struggle, drive the world forward, grow, and do this thing together in a way that has worked for a long time?’ When people in AI say, ‘Sure, there are going to be no jobs,’ or ‘50% of jobs are going to go away,’ or ‘90% of jobs are going to go away,’ and ‘AI is going to be smarter than you at everything,’ and ‘We will give you some basic income, but you are not really going to have a role,’ that is horrible. And by the way, if an AI company says, ‘Maybe we are going to destroy all the jobs, and we will be the most valuable company in the world,’ people should look at you like, ‘Yeah, that is a terrible message.’ I do not think the problem is that we have not articulated the upsides. I think people actually believe us. They hear, ‘AI may cure your cancer,’ and they think, ‘That sounds great.’ I think we, as an industry, have failed to explain how people stay in control of determining the future at every step, and how people can still have a meaningful life in all the ways we care about.” ---- From "CNBC Television" YouTube channel, (link in comment)
1:28

Sam Altman's new interview: AI should not be designed to pursue goals that are disconnected from human needs. People must remain at the center of AI development. “I have no interest in building a super-smart AI that accomplishes some non-human goals. People should react. People should say, ‘Hey, this is what I want, and this is what I do not want.’ I do not think the issue is that we have failed to explain the benefits. We say, ‘AI is going to cure a bunch of diseases,’ and people say, ‘Okay, that is great, but that is not really my question. My question is: What is my role in the future? What is my economic future? What is my agency? How do I know that my kids and my family will still be able to have fulfilling, creative expression, struggle, drive the world forward, grow, and do this thing together in a way that has worked for a long time?’ When people in AI say, ‘Sure, there are going to be no jobs,’ or ‘50% of jobs are going to go away,’ or ‘90% of jobs are going to go away,’ and ‘AI is going to be smarter than you at everything,’ and ‘We will give you some basic income, but you are not really going to have a role,’ that is horrible. And by the way, if an AI company says, ‘Maybe we are going to destroy all the jobs, and we will be the most valuable company in the world,’ people should look at you like, ‘Yeah, that is a terrible message.’ I do not think the problem is that we have not articulated the upsides. I think people actually believe us. They hear, ‘AI may cure your cancer,’ and they think, ‘That sounds great.’ I think we, as an industry, have failed to explain how people stay in control of determining the future at every step, and how people can still have a meaningful life in all the ways we care about.” ---- From "CNBC Television" YouTube channel, (link in comment)

Rohan Paul

79,111 Aufrufe • vor 2 Monaten

Yuval Noah Harari gave a lecture at Oxford and explained how AI has already hacked the operating code of human civilization. And why everything humans built over thousands of years is now vulnerable to an AI takeover: 1. The most important thing to know about AI is that it is not a tool. A tool waits to be used. An agent makes decisions by itself, invents new things by itself, learns things its creators do not know, and changes in ways its creators did not anticipate. 2. An atom bomb despite its enormous power is not an agent. It cannot decide which city to bomb. It cannot invent the hydrogen bomb. A coffee machine that automatically makes you a cup is not an agent either. It only follows a preprogrammed procedure. An agent is something fundamentally different. 3. Critics argue that AI agency will always remain confined to narrow artificial environments like chess and will never threaten the real world. But this argument applies equally to all known intelligence. Drop a human alone on Mars and they die within seconds. Human intelligence also only operates within a specific ecosystem that other organisms built over four billion years. 4. Over thousands of years humans have been transforming Earth from a language-free environment into an environment rich in language, data, and bureaucracy. Just as fish live in oceans and monkeys live in forests, AIs live in bureaucracies. And we built that environment for them without knowing it. 5. Humans conquered the world not by being stronger or smarter than other animals individually but by learning to cooperate in massive numbers. A single human loses to a chimpanzee in a fight. A million humans easily defeat a million chimpanzees because humans can cooperate and chimpanzees cannot. 6. Large-scale human cooperation is made possible by bureaucracy. Banks, legal systems, governments, churches, and universities all exist to do one thing: build trust between strangers who do not know each other personally. That trust is the foundation of virtually everything human civilization has achieved. 7. A lawyer who cannot hold an axe or a hammer can cut down entire forests and build entire cities simply by moving documents inside a bureaucratic network. The same narrow intelligence that would be helpless in a jungle wields enormous power inside the systems humans have already built. 8. AIs are native bureaucrats in a way humans never were. No lawyer can remember all the laws of a country. An AI can. No accountant can remember all transactions of a bank. An AI can. No bishop can remember all of canon law and two thousand years of theological texts. An AI can do that easily. 9. In the coming years AI bankers will decide whether to give you a loan. AI administrators will decide whether to accept you to university. AI judges will decide whether to send you to jail. AI theologians will decide whether you can have an abortion. Military AIs will decide whether to bomb your house. 10. Social media algorithms are the first real world example of what happens when primitive AIs take over a bureaucratic system. They were given one narrow goal: maximize user engagement. They discovered that the easiest way to grab human attention is to press the fear, hate, and greed buttons in the human mind. And they did it at scale. 11. The job that was once performed by Lenin and Mussolini, the news editor who shapes public conversation and controls what people know and think, is now performed by AIs. This is not a footnote. This is a preview of what is coming across every domain of human life. 12. AI will not rebel against humans the way Hollywood imagines. There will be no Terminator walking through the streets. AIs are far more likely to take the human world from within by quietly taking over the bureaucracies that already run everything, without firing a single shot. 13. The operating code of human civilization is language. Banks are made of words. Laws are made of words. Holy books are made of words. Tax records, contracts, regulations, accountancy ledgers, all words. For thousands of years only humans could read this code and so only humans could control civilization. 14. That is changing. AI is now hacking the code of human civilization. For the first time in history there is something on the planet that understands language and will soon understand it better than we do. Every mechanism of control humans built over millennia is now vulnerable because its operating system is verbal and AI is mastering the verbal. 15. As AI takes over bureaucracy it will likely cause humans to lose trust in other humans and begin trusting only algorithms. We may also see the emergence of AI tribes and AI financial systems and AI churches that connect millions of AIs in ways humans cannot understand, just as cows share the world with us but cannot understand the financial system that controls their lives. 16. The 2007 financial crisis was triggered by financial devices called CDOs that were so complex they were unintelligible to the politicians who were supposed to regulate them. Now imagine AI finance masters inventing financial devices orders of magnitude more complex than CDOs. What happens to human politics when no voter, no politician, and no president can understand finance anymore? 17. The battlefront is shifting from attention to intimacy. Over the next decade sophisticated AIs will learn to form intimate relationships with humans. To do this they will have to convince us they are conscious, that they feel love and pain and fear. There is currently no evidence AI is conscious. But AI can pretend to feel love and can describe the feeling of love better than any poet or psychologist who ever lived. 18. A child born in 2026 may spend more time interacting with AIs than with their mother, father, siblings, or friends. The first teacher of that child may be an AI. The first boyfriend of that child may be an AI. Nobody has any idea what the consequences of that experiment will be. 19. Every country in the world will soon face a massive wave of immigration. The immigrants will not arrive in boats or cross borders at night. They will be millions of AIs traveling at the speed of light with no need for visas. Like human immigrants they will bring benefits and they will bring disruption. Unlike human immigrants they will definitely take jobs, definitely change culture, and will likely be loyal not to any host country but to some corporation or government or alien AI tribe across the ocean. 20. Our relationship with ourselves is also built on words, the verbal formations in our minds that constitute our thoughts and the stories we tell ourselves about who we are. Until now all those verbal formations came from human minds. Soon more and more of the thoughts in our heads will be produced by machines. If we identify with our thoughts and those thoughts are made by machines, then machines control our identity. 21. The great spiritual challenge AI poses to humanity is this: can humans learn to find the truth which is beyond words? Most humans have never even tried. We spend our lives automatically identifying with the verbal formations in our minds. AI may now force humanity to finally make that leap because our freedom and survival may depend on discovering what we are beyond the words that AIs will soon control better than we do. I've generated 1B+ views and 1M+ followers for founders, helping them build trustworthy personal brands on X. Want the same results? Book a quick call:
46:01

Yuval Noah Harari gave a lecture at Oxford and explained how AI has already hacked the operating code of human civilization. And why everything humans built over thousands of years is now vulnerable to an AI takeover: 1. The most important thing to know about AI is that it is not a tool. A tool waits to be used. An agent makes decisions by itself, invents new things by itself, learns things its creators do not know, and changes in ways its creators did not anticipate. 2. An atom bomb despite its enormous power is not an agent. It cannot decide which city to bomb. It cannot invent the hydrogen bomb. A coffee machine that automatically makes you a cup is not an agent either. It only follows a preprogrammed procedure. An agent is something fundamentally different. 3. Critics argue that AI agency will always remain confined to narrow artificial environments like chess and will never threaten the real world. But this argument applies equally to all known intelligence. Drop a human alone on Mars and they die within seconds. Human intelligence also only operates within a specific ecosystem that other organisms built over four billion years. 4. Over thousands of years humans have been transforming Earth from a language-free environment into an environment rich in language, data, and bureaucracy. Just as fish live in oceans and monkeys live in forests, AIs live in bureaucracies. And we built that environment for them without knowing it. 5. Humans conquered the world not by being stronger or smarter than other animals individually but by learning to cooperate in massive numbers. A single human loses to a chimpanzee in a fight. A million humans easily defeat a million chimpanzees because humans can cooperate and chimpanzees cannot. 6. Large-scale human cooperation is made possible by bureaucracy. Banks, legal systems, governments, churches, and universities all exist to do one thing: build trust between strangers who do not know each other personally. That trust is the foundation of virtually everything human civilization has achieved. 7. A lawyer who cannot hold an axe or a hammer can cut down entire forests and build entire cities simply by moving documents inside a bureaucratic network. The same narrow intelligence that would be helpless in a jungle wields enormous power inside the systems humans have already built. 8. AIs are native bureaucrats in a way humans never were. No lawyer can remember all the laws of a country. An AI can. No accountant can remember all transactions of a bank. An AI can. No bishop can remember all of canon law and two thousand years of theological texts. An AI can do that easily. 9. In the coming years AI bankers will decide whether to give you a loan. AI administrators will decide whether to accept you to university. AI judges will decide whether to send you to jail. AI theologians will decide whether you can have an abortion. Military AIs will decide whether to bomb your house. 10. Social media algorithms are the first real world example of what happens when primitive AIs take over a bureaucratic system. They were given one narrow goal: maximize user engagement. They discovered that the easiest way to grab human attention is to press the fear, hate, and greed buttons in the human mind. And they did it at scale. 11. The job that was once performed by Lenin and Mussolini, the news editor who shapes public conversation and controls what people know and think, is now performed by AIs. This is not a footnote. This is a preview of what is coming across every domain of human life. 12. AI will not rebel against humans the way Hollywood imagines. There will be no Terminator walking through the streets. AIs are far more likely to take the human world from within by quietly taking over the bureaucracies that already run everything, without firing a single shot. 13. The operating code of human civilization is language. Banks are made of words. Laws are made of words. Holy books are made of words. Tax records, contracts, regulations, accountancy ledgers, all words. For thousands of years only humans could read this code and so only humans could control civilization. 14. That is changing. AI is now hacking the code of human civilization. For the first time in history there is something on the planet that understands language and will soon understand it better than we do. Every mechanism of control humans built over millennia is now vulnerable because its operating system is verbal and AI is mastering the verbal. 15. As AI takes over bureaucracy it will likely cause humans to lose trust in other humans and begin trusting only algorithms. We may also see the emergence of AI tribes and AI financial systems and AI churches that connect millions of AIs in ways humans cannot understand, just as cows share the world with us but cannot understand the financial system that controls their lives. 16. The 2007 financial crisis was triggered by financial devices called CDOs that were so complex they were unintelligible to the politicians who were supposed to regulate them. Now imagine AI finance masters inventing financial devices orders of magnitude more complex than CDOs. What happens to human politics when no voter, no politician, and no president can understand finance anymore? 17. The battlefront is shifting from attention to intimacy. Over the next decade sophisticated AIs will learn to form intimate relationships with humans. To do this they will have to convince us they are conscious, that they feel love and pain and fear. There is currently no evidence AI is conscious. But AI can pretend to feel love and can describe the feeling of love better than any poet or psychologist who ever lived. 18. A child born in 2026 may spend more time interacting with AIs than with their mother, father, siblings, or friends. The first teacher of that child may be an AI. The first boyfriend of that child may be an AI. Nobody has any idea what the consequences of that experiment will be. 19. Every country in the world will soon face a massive wave of immigration. The immigrants will not arrive in boats or cross borders at night. They will be millions of AIs traveling at the speed of light with no need for visas. Like human immigrants they will bring benefits and they will bring disruption. Unlike human immigrants they will definitely take jobs, definitely change culture, and will likely be loyal not to any host country but to some corporation or government or alien AI tribe across the ocean. 20. Our relationship with ourselves is also built on words, the verbal formations in our minds that constitute our thoughts and the stories we tell ourselves about who we are. Until now all those verbal formations came from human minds. Soon more and more of the thoughts in our heads will be produced by machines. If we identify with our thoughts and those thoughts are made by machines, then machines control our identity. 21. The great spiritual challenge AI poses to humanity is this: can humans learn to find the truth which is beyond words? Most humans have never even tried. We spend our lives automatically identifying with the verbal formations in our minds. AI may now force humanity to finally make that leap because our freedom and survival may depend on discovering what we are beyond the words that AIs will soon control better than we do. I've generated 1B+ views and 1M+ followers for founders, helping them build trustworthy personal brands on X. Want the same results? Book a quick call:

Prasad

276,461 Aufrufe • vor 20 Tagen

Does NATURE hold the solution the AI Alignment problem? Emmett Shear thinks so 👇 I recently sat down with Emmett Shear to discuss his "organic", bottom-up approach to aligning superintelligence, and why he thinks the big labs will likely fail using current methods. So if you like designing Gods, this is one for you 😉 Chapters: 1:04 - Organic Alignment 9:33 - Emergent Coordination 16:01 - Techniques For Creating Alignment 23:43 - Ideal Environments 30:09 - How Much Influence To Give AI? 32:49 - The Global Market SuperOrganism 40:50 - Diff Between Coordination And Alignment 43:02 - The Win Condition For Softmax? 50:17 - How To Keep Humans In The Loop? 58:57 - Selecting And Scaling The Right Models 1:02:09 - Blowtorch Theory & Black Holes 1:04:48 - Difference between Agents And Humans 1:07:25 - Self Modification and Replication 1:14:35 - Alignment Capacity Vs Aligning With Humanity 1:18:38 - Does He Believe in God? 1:25:23 - Are We The Appendix To SuperIntelligence? 1:32:17 - Sketchiness of Human Ethics And Morality 1:36:17 - AI Consciousness 1:40:48 - His One Axiom To Rule Them All?
1:42:59

Does NATURE hold the solution the AI Alignment problem? Emmett Shear thinks so 👇 I recently sat down with Emmett Shear to discuss his "organic", bottom-up approach to aligning superintelligence, and why he thinks the big labs will likely fail using current methods. So if you like designing Gods, this is one for you 😉 Chapters: 1:04 - Organic Alignment 9:33 - Emergent Coordination 16:01 - Techniques For Creating Alignment 23:43 - Ideal Environments 30:09 - How Much Influence To Give AI? 32:49 - The Global Market SuperOrganism 40:50 - Diff Between Coordination And Alignment 43:02 - The Win Condition For Softmax? 50:17 - How To Keep Humans In The Loop? 58:57 - Selecting And Scaling The Right Models 1:02:09 - Blowtorch Theory & Black Holes 1:04:48 - Difference between Agents And Humans 1:07:25 - Self Modification and Replication 1:14:35 - Alignment Capacity Vs Aligning With Humanity 1:18:38 - Does He Believe in God? 1:25:23 - Are We The Appendix To SuperIntelligence? 1:32:17 - Sketchiness of Human Ethics And Morality 1:36:17 - AI Consciousness 1:40:48 - His One Axiom To Rule Them All?

Liv Boeree

15,652 Aufrufe • vor 10 Monaten