Loading video...
Video Failed to Load
BCV Partner Aaref Hilaly breaks down the difference between a pre-AGI and post-AGI world: "The difference between pre- and post-AGI is, we go from being intelligence poor to intelligence abundant." "With pre-AGI we saw agents do amazing things like writing code, solving customer support tickets, etc." "With post-AGI there's... show more
31,065 views • 10 days ago •via X (Twitter)
1 Comments
AIKeaton UK10 days ago
@aaref Bits I'd watch: simulated training, agents and line automation. Fun how boring efficiency gets rebranded as post-AGI.
![I was honored to share the TED AI stage with Ilya on Oct. 17. His speech video is out today (mine's still being edited). I think it provides relevant context tokens to the ongoing events. Transcript starting at ~10'20": As AI continues to progress, as technology advances, [...] What I claim will happen is that people will start to act in unprecedentedly collaborative ways out of their own self-interest. It's already happening right now. You see the leading AGI companies starting to collaborate, such as the Frontiers model forum. And we will expect that companies, even competitors, will share technical information to make their AI safe. We may even see governments do this. As another example, at OpenAI, we really believed in how dramatic AGI is going to be. So, one of the ideas that we were operating by, and it's been written on our website for 5 years now, is that when technology gets such that we are very close to AGI, to computers smarter than humans, if some other company is far ahead of us, then rather than compete with them, we will help them out, join them, in a sense. And why do that? Because we appreciate how incredibly dramatic AGI is going to be. And my claim is that with each generation of capability advancements, as AI gets better and as all of you experience what AI can do, as people who run AI efforts and AGI efforts, and people who work on them will experience it as well, this will change the way we see AI and AGI. And that will change collective behavior. And this is an important reason why I'm hopeful that, despite the great challenges posed by this technology, we will overcome them. @TEDAI2023](https://image.24vids.com/tw-1726763792556839253/amplify_video_thumb/1726761633660497920/img/x_EXQcjYHPxsm0Y5.jpg)
![Anthropic's Sholto Douglas says Dario Amodei's internal communication style is producing a compendium of essays in the company's Slack that will have effectively charted the history of AGI once we get there. "He has a really, really cool communication style. He quite frequently puts out very well-reasoned essays. And throughout Slack, we'll have giant essay-length debates [about them]." "The essays are really nice because you can go back and read all the past ones, and it tells the history of Anthropic." "In many respects, it will be one of the better things, a decade from now, to chart the history of AGI. We'll be reading these compendium of essays."](https://image.24vids.com/tw-1993088517497651559/amplify_video_thumb/1993085974704971776/img/pfYLRK9AIZWJnEeW.jpg)
![John Carmack: The code for AGI could conceivably be written by one individual After stepping down as CTO of Meta’s Oculus VR, legendary programmer John Carmack was trying to decide if he would work on nuclear fission or artificial general intelligence (AGI). He ultimately chose AGI. “I think [fission] is possible,” John says. “Somebody should be doing this, but it’s going to involve some politics, decent-sized teams, and a bunch of cross-functional stuff that I don’t love. While artificial general intelligence seems to me like the highest-leverage moment for a single individual potentially in the history of the world.” He explains: “With the things we know about the brain and what we can do with artificial intelligence . . . I’m not a madman for saying that it is likely that the code for artificial general intelligence is going to be tens of thousands of lines of code — not millions of lines of code.” He continues: “This is code that conceivably one individual could write, unlike writing a new web browser or operating system. And based on the progress that machine learning has made in the recent decade, it’s likely that the important things that we don’t know are relatively simple. There’s probably a handful of things — my bet is there’s less than six key insights — that need to be made. Each one of them can probably be written on the back of an envelope. We don’t know what they are, but when they’re put together in concert with GPUs at scale and the data that we all have access to, we can make something that behaves like a human being or living creature and that can then be educated in whatever ways we need to get to the point where we can have universal remote workers where anything that somebody does mediated by a computer, that doesn’t require physical interaction, an AGI will be able to do.” Carmack does not think this will be “unapproachably hard”: “That’s incredibly hubristic to say, but what I said a couple of years ago was that there’s a 50% chance that somewhere there will be signs of life of an AGI in 2030, and I’ve probably increased that slightly — maybe 55-60% now because I do think there’s a little sense of acceleration.” Source: Lex Fridman (Aug 2022)](https://image.24vids.com/tw-2074581719198437534/amplify_video_thumb/2074220244634140672/img/k4JRRvXNNod34QfI.jpg)
![John Carmack: The code for AGI could conceivably be written by one individual After stepping down as CTO of Meta’s Oculus VR, legendary programmer John Carmack was trying to decide if he would work on nuclear fission or artificial general intelligence (AGI). He ultimately chose AGI. “I think [fission] is possible,” John says. “Somebody should be doing this, but it’s going to involve some politics, decent-sized teams, and a bunch of cross-functional stuff that I don’t love. While artificial general intelligence seems to me like the highest-leverage moment for a single individual potentially in the history of the world.” He explains: “With the things we know about the brain and what we can do with artificial intelligence . . . I’m not a madman for saying that it is likely that the code for artificial general intelligence is going to be tens of thousands of lines of code — not millions of lines of code.” He continues: “This is code that conceivably one individual could write, unlike writing a new web browser or operating system. And based on the progress that machine learning has made in the recent decade, it’s likely that the important things that we don’t know are relatively simple. There’s probably a handful of things — my bet is there’s less than six key insights — that need to be made. Each one of them can probably be written on the back of an envelope. We don’t know what they are, but when they’re put together in concert with GPUs at scale and the data that we all have access to, we can make something that behaves like a human being or living creature and that can then be educated in whatever ways we need to get to the point where we can have universal remote workers where anything that somebody does mediated by a computer, that doesn’t require physical interaction, an AGI will be able to do.” Carmack does not think this will be “unapproachably hard”: “That’s incredibly hubristic to say, but what I said a couple of years ago was that there’s a 50% chance that somewhere there will be signs of life of an AGI in 2030, and I’ve probably increased that slightly — maybe 55-60% now because I do think there’s a little sense of acceleration.” Video source: Lex Fridman (2022)](https://image.24vids.com/tw-2001635889982611555/amplify_video_thumb/2001612344477016064/img/T4Lkfg4IuehEJBTH.jpg)
