Loading video...

Video Failed to Load

Go Home

ANTHROPIC WILL LET OUTSIDE EVALUATORS OBSERVE ITS MODELS BEING TRAINED AND RUN, AND DARIO AMODEI WANTS THE WHOLE INDUSTRY TO DO THE SAME Asked whether slowing down means Anthropic will stop releasing more advanced models: "It doesn't mean that." He says the evaluators may end up setting the "speed...

27,231 views • 2 months ago •via X (Twitter)

13 Comments

chelsea's profile picture
chelsea2 months ago

@epictrades1 So people that left your company to work at these outside companies … gotcha not suspicious or anything

ron's profile picture
ron2 months ago

@epictrades1 Who are these “Evaluators” ?

Kevin's profile picture
Kevin2 months ago

Kinda like the nuclear weapons inspectors in Iran?

PeritumAI's profile picture
PeritumAI2 months ago

Outside observers is classify: access, not assurance. Owner for the useful bit is the publish/exit clause — and whoever can walk findings out without a lab veto. Amodei's invite isn't the rule until that's in a contract the Office can lean on. Stop equating "may observe training" with enforceable third-party eval.

iexinxin's profile picture
iexinxin2 months ago

Transparency on training runs is a meaningful shift, but the real test is whether evaluators get access early enough to influence release decisions.

Rosey's profile picture
Rosey2 months ago

@StockMKTNewz So the tail is wagging the dog, why can’t you set your own fucking speed limit ffs

Han Solo (Not abandoning ETHEREUM )'s profile picture
Han Solo (Not abandoning ETHEREUM )2 months ago

deepseeek puts their hand up first

Requiem For Tech's profile picture
Requiem For Tech2 months ago

third-party evaluators setting the speed limit makes a lot of sense. if this becomes standard across labs, safety checks could finally have some real teeth.

cryptocat's profile picture
cryptocat2 months ago

How can you be so smart but then talk like you need guidance over yourself control of what you created. This makes no sense at all, and you got all the approval from the commander in chief to keep pushing forward. Our president has spoken so there’s no need for regulation.

Raj ▲'s profile picture
Raj ▲2 months ago

In other words, open source will destroy our margins and mess up all future investments. Long live the Ai bubble trade

The Tectonic's profile picture
The Tectonic2 months ago

David Sacks challenge is what comes next. Why should voluntary restraint by the companies actually at the frontier require a new regulatory architecture governing everyone else?

JacobinJuice's profile picture
JacobinJuice2 months ago

I wonder how many employees at Anthropic are watching him and thinking all that money they were going to make on that IPO is going down the drain.

Mandy's profile picture
Mandy2 months ago

Nice one

Related Videos

David Sacks Predicts the Regulatory Capture Playbook to Ban Open Source AI, Step by Step: David Sacks: “I got bad news for you, Chamath, an open source ban is coming. They're not going to call it that. They're going to say that we simply have to apply the same standards to open models that we apply to closed ones. Here's how they do it step by step, let me explain how regulatory capture actually works. So first of all, you have to get this regulatory apparatus. Dario wants an FDA for AI, but he doesn't have enough political support for that, so instead they do this Trojan horse of a FINRA for AI. They call it self-regulating, it's not really, but anyway, that gets them off the ground. Now they've created the standard-setting organization. Now they've got pre-release model testing. Then the pressure grows to codify that in law, so that happens next. And then what they do is they say, ‘Look, all these standards need to apply equally to all models.’ But here's the problem with that. Open models and closed models are technologically different. Once you release an open model into the world, you can't roll it back and you can't monitor exactly how people are using it because they run it on their own hardware. Dario says this is what makes open models dangerous. So what they're going to do is they're going to have the standard-setting body say, ‘Well, we have to set the standards for AI safety.’ By the way, Dario and OpenAI, they're going to fund the whole thing. They're going to contribute all the compute. They're going to be behind it. They're going to be the ones coordinating with the government officials because frankly, people in government have no idea how to monitor and control and set standards for AI safety. Technologically, this is way beyond them. So they're going to go to these companies and say, ‘Tell us how to do it.’ And so what will happen is the standards will get set, and then it'll be a very simple matter of fairness to say that the standards need to apply to open as well as closed models. The open models cannot comply in the same way, and gradually they will be shut out of the market.”

The All-In Podcast

301,122 views • 2 months ago