Daniel Faggella's banner
Daniel Faggella's profile picture

Daniel Faggella

@danfaggella12,760 subscribers

Soon, we're all going to attenuate or transform. If we are to be succeeded, we must define / move towards a Worthy Successor https://t.co/p6DZdKgtir.

Shorts

teacher flips out about students using gpt and gives off the most amazing roar ive ever heard in a classroom omg

teacher flips out about students using gpt and gives off the most amazing roar ive ever heard in a classroom omg

333,727 次观看

Videos

danfaggella's profile picture

AGI risk seems lower than it is because the people who know that AGI risk exists are almost all incentivized against talking about it openly. I just made a YouTube video about this that (I think) explains why. Broadly, there are two groups of people not talking about AGI risk: -- People who know AGI risk is real (i.e. AGI lab leaders) -- People who know nothing about AGI risk (i.e. politicians, citizens) To catalyze wide scale discourse about AGI risk, I argue that the following two strategies are strong candidates: 1. [Bottom-Up] Get Citizens Concerned: Find ways to meld AGI risk narratives into legacy media and more understandable political talking points which are already in the Overton window. This work is bound to be messy, and to ultimately soil the core of the message with left-right political gunk, but (barring an AI disaster) its likely the only way that AGI risk catches on with enough of a core base of citizens. As I explain in the video essay, the citizens are the lynchpin to getting everyone (those who don’t know, and those who know) to discuss AGI risk more frankly. 2. [Top-Down] Get a Losing AGI Lab Leader to “Flip”: Those closest to achieving AGI are not going to flip and start talking about AGI risk, the rewards are too great. But those who are losing the race (and don’t want to live to see their rivals achieve the final flex before them) might be able to feign virtue by claiming “Now I see AGI is dangerous, I’m a concerned expert and this needs to be regulated!” They can cloak themselves in pretended virtue while also preventing a rival from crossing the finish line first. I argue that hoping for more Jeff Hintons and Daniel Kokotajlo-like people isn't a good strategy when the incentives are still structured to keep most of them from wanting to talk about it. Here’s the full video essay:

Daniel Faggella

26,975 次观看 • 1 年前

danfaggella's profile picture

Today the one and only Michael Levin joins us on a Worthy Successor episodes on The Trajectory. No living thinkers (IMHO) has had more profound paradigm-shifting ideas on the nature of intelligence itself than Michael - and I learned a ton in this episode. His takes on what kind of Worthy Successor we should build will be surprising to many viewers - and his process philosophy around intelligence and life itself are enthralling. At the same time (and mostly due to limitations in how long we had to record) - there are some points where Michael's optimism around what posthuman intelligences would do and value really confused me - and I reflect upon this a great deal in the outro (last 15 mins) of this episode. It's clear there's way more to unpack here, but all in all, I couldn't be happier having on one of my own favorite living thinkers in the entire world. Thanks, Michael :) Here are some fun highlights you won't want to miss: 0:04:42 - The illusive nature of what intelligence is, and what strata of reality of occupies 0:15:00 - Intelligence and life as a process (and its implications for humans and machine) 0:30:00 - Why the “status quo” of the human experience is not something we should aim to “freeze” and preserve. 0:33:04 - Michael’s ideas of the traits of a Worthy Successor intelligence (MUST listen!) - I am more conflicted / engaged in this part of this interview than maybe ever this whole year 1:01:27 - What he thinks innovators should do to move closer to a worthy successor (and not land on an unworthy one) 1:05:33 - (Solo Dan reflection, post-episode) 3 major points of confusion for me, and potential differences between my and Michael’s take on the world. With full admission that he’s probably right because he’s way smarter than I am.

Daniel Faggella

16,779 次观看 • 1 年前

danfaggella's profile picture

Today my Trajectory episode with Prof Max Max Tegmark is live. This was recorded live during the AI Action Summit in Paris. 2 big takeaways, among many: 1. Military leadership seeing AGI as a threat may increase (not decrease) an arms race. 2. Wishing for posthuman futures TOO soon = ridiculous. Lets just lay out a few of these points here: 1. The tipping point for coordination / military leadership. Max talks about how, when the militaries in the US and China see AGI itself as a risk to both of them. He has faith that international coordination is possible, and that a combination of (a) raising awareness (like with the frameworks he shares in this episode) and (b) massive, scary growth in AGI capabilities could very well lead to an attractor state of coordination over conflict. He believes that it's important to make "teh control problem" well known ahead of time, so that if/when an AGI disaster happens, it won't be seen as an attack from the enemy (which would accelerate an arms race), but it would be seen as a shared danger for both nations. He's also no blind optimist. He's very clear that there may not be easy odds for international coordination, but even if the odds are slim - its vastly better than having a million Unworthy Successor AGIs getting hurled into the world at once. 2. Posthuman futures - but only when we get them right. Max's Life 3.0 is a pretty damn inspiring long-term look at AGI futures (albeit through an anthropocentric lens). He says in this interview that there might be a long term future (he says 1MM years, which seems kind of hyperbolic and wholly unrealistic, but alas) where humans may not even want to control AGIs and posthuman life should flourish. But he rightly points out that: a) We have no idea what we're even building now, so hurling posthuman life into the world is ridiculous, and b) We should focus on understanding the tech and obtaining global coordination and human benefits as a near-term step While my timelines for when a posthuman transition will happen are vastly more near-term than Max's, the argument AGAINST "rushing to posthumanism" is one I wholly agree with. ... What do you think of Max's takes? Anything else I should have asked him? (Links in post below)

Daniel Faggella

16,348 次观看 • 1 年前

没有更多内容可加载