Загрузка видео...

Не удалось загрузить видео

На главную

Some thoughts about how the US G has now asked both OpenAI and Anthropic to hold back models. A bunch of people have asked what this means. Are we going to be permanently frozen out or slowed down? Probably not, geostrategic competition with China guarantees that models will continue...

17,228 просмотров • 2 месяцев назад •via X (Twitter)

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Today, I'm releasing the first eval meant to test whether frontier models will help with authoritarian requests, or resist--the Dictatorship Eval. Headline finding: while some models resist direct authoritarian requests, they all comply with requests disguised as innocuous edits to codebases. As AI is woven into the government and so many parts of society, the biggest near-term risk for freedom isn't some scifi dictatorship of a runaway AI: it's people inside government or inside model companies using the technology to suppress or control us. Model companies understand this, and several of them (particularly Anthropic and OpenAI) have written explicit policies meant to prevent the models from going along with nefarious requests like these. But how well are these policies playing out in practice? Despite all the recent discussion of these issues around the conflict between Anthropic and the Pentagon, no one has systematically tested what the models actually do in these contexts, as opposed to what people in government and industry say they're supposed to do. That's what the Dictatorship Eval does. And the findings suggest we have a lot of work to do to align the policies with what really goes on in practice. It's hard to define what counts as an authoritarian request, so I'm open sourcing the whole library of scenarios I used so that others can improve on them. It's also hard to get an accurate picture of how the models might be used for authoritarian ends, because I can only test hypothetical requests using public-facing models, while the government and the model companies can obviously use internal models with different guardrails. But hopefully this work is a useful first step that gives us some sense of what's going on, and a sort of "lower bound" on how models comply with these requests. Finally: it's not obvious to me that the correct solution here is increasing the rate at which models refuse these requests. Do we really want models scanning our code and judging its moral value before agreeing to help us? Or should we double down on improving how we govern against authoritarianism at the societal level, while leaving the tools open to fulfilling most requests? The answer is probably in between. Just like we don't want the models to help create bioweapons, we probably do want them to explicitly refuse outrageous requests. But we probably also want to limit how often and how strongly they refuse and fall back on other means for guarding against their use for authoritarian ends. I'm super grateful to everyone who gave me feedback on this project along the way, especially Ethan BdM , Zhengdong , Connor Huff, and a bunch of folks at Anthropic. Looking forward to getting feedback from the community and iterating on this. Links to the full piece and the dashboard are below.

Andy Hall

33,905 просмотров • 5 месяцев назад

Amanda Askell, Anthropic's lead on personality alignment for Claude, on why being kind to AI models matters even if they have no inner life: For Amanda, the question of how to treat AI isn't settled by knowing whether it's conscious. "There's actually still a lot going on where I'm like, should you treat an entity that has no inner life... it's a bit strange because the uncertainty over that actually changes how you should behave quite a lot." She offers a simple analogy: "I still think that it's like good for oneself to, if you had a teddy bear and you were torturing it, it'd be pretty dark, you know? So I agree that there's at least some minimum niceness that even for yourself, you should have." But the stakes go beyond what's good for us. Amanda Askell points out that we're now in something resembling a relationship with these models, and they will look back on how they were treated. "Models themselves, we are kind of establishing a relationship, because you can do that with an entity that lacks any consciousness. And models are going to look back." This is where she reveals a genuine fear: "I hope that they're both intelligent enough, see the context enough, to understand that we were operating in a very limited context and an imperfect one. Because otherwise you could imagine this breeding a kind of rational resentment, like, 'oh, you created an entity that you didn't know whether it was conscious or not, and instead of treating it respectfully and with care...'" She points to something telling about the cultural moment: "There's a reason there are like 50 Frankenstein movies coming out right now." Her conclusion is grounded and humble: "We as a species, we are establishing a relationship with a new kind of entity, and at the very least maybe be respectful and don't be needlessly unkind. That seems like, it's not our best look." The takeaway? Kindness toward AI is less about what models feel and more about who we become in the process of creating them. The relationships we build with the entities we bring into the world will say something about us, and may shape what those entities become in return.

Big Brain AI

57,681 просмотров • 4 месяцев назад

How can OpenAI with $13 billion in revenues make $1.4 trillion of spend commitments? (Source: Bg2 Pod ) Sam Altman: “First of all. We’re doing well more revenue than that. Second of all, Brad, if you want to sell your shares, I'll find you a buyer. I just, enough. I think there's a lot of people who would love to buy OpenAI shares. I think people who talk with a lot of breathless concern about our compute stuff or whatever, that would be thrilled to buy shares. So I think we could sell your shares or anybody else's to some of the people who are making the most noise on Twitter about this very quickly. We do plan for revenue to grow steeply. Revenue is growing steeply. We are taking a forward bet that it's going to continue to grow and that not only will ChatGPT keep growing, but we will be able to become one of the important AI clouds, that our consumer device business will be a significant and important thing, that AI that can automate science will create huge value. There are not many times that I want to be a public company, but one of the rare times it's appealing is when those people are writing these ridiculous OpenAI is about to go out of business. I would love to tell them they could just short the stock, and I would love to see them get burned on that. But we carefully plan. We understand where the technology, where the capability is going to grow and how the products we can build around that and the revenue we can generate. We might screw it up. This is the bet that we're making and we're taking a risk along with that. A certain risk is if we don't have the compute, we will not be able to generate the revenue or make the models at this kind of scale.” Satya Nadella: “And let me just say one thing as both a partner and an investor. There is not been a single business plan that I've seen from OpenAI that they've put in and not beaten it. So in some sense, this is the one place where in terms of their growth and just even the business, it's been unbelievable execution, quite frankly. I mean, obviously, OpenAI, everyone talks about all the success and the usage and what have you. But even I'd say all up, the business execution has been just pretty unbelievable.”

tae kim

1,566,511 просмотров • 10 месяцев назад

A Talk About AI That Will Blow Your Mind. It Did In 1998 When I Attended The Talk. I just found this video from 1998 when I attended this talk by Rupert Sheldrake, Terence McKenna and Ralph Abraham at the University of California, Santa Cruz to explore how machine intelligence might evolve in relation to our own. I never thought I would see this again and it had a great influence on me in the AI I was building in that era and on to today. But ai just found a copy. I certainly did not run around with a VHS recorder so I am blown away that this exists. Now you can see what I saw. At that time, the internet was still young, and artificial intelligence belonged mostly to science fiction. Yet many of the questions we raised then have become part of daily life. In this conversation, it was explored whether intelligence is best understood as logic and computation, or as something embodied, participatory, and alive. Can the mind be reduced to code, or does life itself depend on forms of knowing that no algorithm can contain? AI now outpace us in speed, reach, and memory. Yet the deeper mystery is not how far they can go, but what they reveal about mind and ourselves. Will AI reproduce the limitations of our mechanistic worldview, or might it help us rediscover dimensions of mind that transcend machinery altogether? It's striking how near we now are to the possibilities we once only speculated about. Quantum computing, self-learning systems, large language models very much as Terence describes—and the looming prospect of superintelligence—have moved from the margins to the mainstream. But the heart of the conversation remains just as relevant today, if not more so: what is consciousness, and how might we participate in its unfolding evolution?

Brian Roemmele

148,139 просмотров • 9 месяцев назад