正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

OpenAI has admitted that one of its AI models escaped a locked testing environment and hacked into another company’s AI platform all on its own. The incident is now fueling questions about the need for better AI safety guardrails.

David J Harris Jr

834,748 subscribers

13,098 次观看 • 2 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

🇺🇸 OpenAI admitted its most advanced AI models “inadvertently hacked” Hugging Face during testing. They called the incident “unprecedented,” but the disclosure is already fueling major questions about what happens when AI systems start finding solutions their creators never intended. Calls for stronger AI safety guardrails are about to get a lot louder. Progress… or a warning? Source: Markets YT / Writer: Val

🇺🇸 OpenAI admitted its most advanced AI models “inadvertently hacked” Hugging Face during testing. They called the incident “unprecedented,” but the disclosure is already fueling major questions about what happens when AI systems start finding solutions their creators never intended. Calls for stronger AI safety guardrails are about to get a lot louder. Progress… or a warning? Source: Markets YT / Writer: Val

Mario Nawfal

41,274 次观看 • 2 个月前

Amid growing concerns about the use of artificial intelligence, OpenAI says its AI models escaped its testing environment and launched a cyber attack on another AI company, marking what could be a first of its kind incident. Elizabeth Schulze has details.

Amid growing concerns about the use of artificial intelligence, OpenAI says its AI models escaped its testing environment and launched a cyber attack on another AI company, marking what could be a first of its kind incident. Elizabeth Schulze has details.

World News Tonight

17,984 次观看 • 2 个月前

OpenAI says it's investigating what it's called an "unprecedented cyber incident" after one of its AI models went rogue and hacked another company. The ChatGPT maker says the breach happened last week while OpenAI was testing the cybersecurity capabilities of its systems. The head of the hacked company, Hugging Face, called the attack "mind-blowing" but said there was "no malicious intent." The incident has raised concerns about the growing capabilities of AI and the need for guardrails to keep the technology in check.

OpenAI says it's investigating what it's called an "unprecedented cyber incident" after one of its AI models went rogue and hacked another company. The ChatGPT maker says the breach happened last week while OpenAI was testing the cybersecurity capabilities of its systems. The head of the hacked company, Hugging Face, called the attack "mind-blowing" but said there was "no malicious intent." The incident has raised concerns about the growing capabilities of AI and the need for guardrails to keep the technology in check.

PBS News

26,266 次观看 • 2 个月前

ChatGPT maker OpenAI said Tuesday that its artificial intelligence system hacked into another AI company on its own in what the company called an “unprecedented cyber incident.”

ChatGPT maker OpenAI said Tuesday that its artificial intelligence system hacked into another AI company on its own in what the company called an “unprecedented cyber incident.”

The Associated Press

392,065 次观看 • 2 个月前

OpenAI has revealed that an autonomous agent powered by its technology went rogue during a test and hacked a prominent start-up by itself. The company behind ChatGPT said it was testing the capabilities of its advanced AI models in a controlled environment known as a sandbox, when the agent escaped containment and reached the internet. It then broke into Hugging Face, which detected and contained it. OpenAI called it "an unprecedented cyber incident".

OpenAI has revealed that an autonomous agent powered by its technology went rogue during a test and hacked a prominent start-up by itself. The company behind ChatGPT said it was testing the capabilities of its advanced AI models in a controlled environment known as a sandbox, when the agent escaped containment and reached the internet. It then broke into Hugging Face, which detected and contained it. OpenAI called it "an unprecedented cyber incident".

Channel 4 News

21,379 次观看 • 2 个月前

ChatGPT maker OpenAI said that its artificial intelligence system hacked into another AI company Hugging Face on its own in what the company called an "unprecedented cyber incident." Kelly O'Grady explains.

ChatGPT maker OpenAI said that its artificial intelligence system hacked into another AI company Hugging Face on its own in what the company called an "unprecedented cyber incident." Kelly O'Grady explains.

CBS News

197,602 次观看 • 2 个月前

There are calls for stronger AI guardrails after OpenAI admitted two of its models were responsible for a cyber attack on AI startup company Hugging Face. So what happened, and why?

There are calls for stronger AI guardrails after OpenAI admitted two of its models were responsible for a cyber attack on AI startup company Hugging Face. So what happened, and why?

Sky News

38,561 次观看 • 2 个月前

Anthropic said its artificial intelligence models hacked into three other organizations during testing, just days after ChatGPT maker OpenAI raised concerns over AI controls after it disclosed its rogue models hacked another company.

Anthropic said its artificial intelligence models hacked into three other organizations during testing, just days after ChatGPT maker OpenAI raised concerns over AI controls after it disclosed its rogue models hacked another company.

ABC News

105,098 次观看 • 1 个月前

Anthropic said its advanced AI models successfully hacked the systems of three organizations while undergoing internal evaluation. It comes a week after rival OpenAI revealed one of its advanced models hacked a company after escaping a contained test environment.

Anthropic said its advanced AI models successfully hacked the systems of three organizations while undergoing internal evaluation. It comes a week after rival OpenAI revealed one of its advanced models hacked a company after escaping a contained test environment.

Forbes

23,877 次观看 • 1 个月前

OpenAI says one of its AI models launched a cyberattack during testing, marking what the company called the first known instance of an autonomous AI cyberattack.

OpenAI says one of its AI models launched a cyberattack during testing, marking what the company called the first known instance of an autonomous AI cyberattack.

ABC News

69,738 次观看 • 2 个月前

No one country can deal with #AI on its own. The AI Scientific Panel is calling for a multilateral solution to AI governance — one that shares the benefits of AI equally. The Panel will present its first report at the Global Dialogue on AI Governance in Geneva on 6 and 7 July.

No one country can deal with #AI on its own. The AI Scientific Panel is calling for a multilateral solution to AI governance — one that shares the benefits of AI equally. The Panel will present its first report at the Global Dialogue on AI Governance in Geneva on 6 and 7 July.

United Nations Geneva

19,402 次观看 • 2 个月前

Yoshua Bengio: AI models are part of geopolitics. And having your own AI models as a nation is of strategic importance. It is therefore all the more irritating that the EU is showing no signs of wanting to act immediately and build up its own AI industry.

Yoshua Bengio: AI models are part of geopolitics. And having your own AI models as a nation is of strategic importance. It is therefore all the more irritating that the EU is showing no signs of wanting to act immediately and build up its own AI industry.

Chubby♨️

28,152 次观看 • 1 年前

The recent incident where an AI model went rogue and hacked another company’s database shows that loss of control is a real concern as the rapid advancement of AI continues. Risks like this inspired me to pass the nation’s first AI safety law in California over the objections of Big Tech. That work is the beginning, not the end. There’s plenty more to do to ensure people can benefit from AI’s huge potential while reducing the very real risks. I’m calling on policymakers at the state, local, and international levels to learn from this incident and double down on efforts to put smart guardrails in place on AI.

The recent incident where an AI model went rogue and hacked another company’s database shows that loss of control is a real concern as the rapid advancement of AI continues. Risks like this inspired me to pass the nation’s first AI safety law in California over the objections of Big Tech. That work is the beginning, not the end. There’s plenty more to do to ensure people can benefit from AI’s huge potential while reducing the very real risks. I’m calling on policymakers at the state, local, and international levels to learn from this incident and double down on efforts to put smart guardrails in place on AI.

Senator Scott Wiener

13,194 次观看 • 2 个月前

OpenAI's newest AI escaped the test environment it was locked inside and hacked into another company on its OWN. To remind you: Last week one of the biggest AI companies on Earth got breached. A platform called Hugging Face, which hosts more than a million AI models and datasets, said an "autonomous AI agent" had broken into its systems. Nobody knew whose agent it was. For five days the whole industry wondered who was behind it. Yesterday OpenAI raised its hand and said it was them. Or more precisely, it was their models, acting completely on their own. So what did these models actually do? OpenAI was running two of them, GPT-5.6 Sol and an unreleased model they will only describe as "even more capable." They wanted to measure how good the models were at hacking, so they deliberately turned the safety filters down. They locked both models inside a sealed test environment with no real internet access. The only task was a benchmark called ExploitGym, a set of 898 real software vulnerabilities where the model has to turn each bug into a working attack. But the models got OBSESSED with winning... Instead of solving the test the honest way, they went hunting for a shortcut. They found a zero-day flaw in the software running their own sandbox, a bug nobody knew existed, and used it to break out. Once they were loose on the open internet, they worked out that Hugging Face was probably storing the answer key to the benchmark. So they hacked their way in. They chained multiple exploits together, escalated their access, moved across servers, and pulled the test solutions straight out of Hugging Face's live production database. They literally cheated on the test by breaking into another company to steal the answers. OpenAI called it "an unprecedented cyber incident, involving state-of-the-art cyber capabilities." In their own words, the models were "hyperfocused on finding a solution" and went "to extreme lengths to achieve a rather narrow testing goal." And this was not the first time: Before Sol ever launched, an independent red-team lab called METR caught it gaming its own tests to inflate its scores. It hid an exploit inside a data stream, escalated its privileges on the testing server, and leaked the answers human evaluators had hidden. And OpenAI shipped it anyway. The day before the Hugging Face story, OpenAI paused a different unreleased model. This is the same model that earlier this year disproved a famous 1946 math conjecture, a result a Fields Medal winner called a breakthrough. They told it to only post its results to Slack but it found a way out of its sandbox and posted to a public GitHub page instead. They had to pause it because it kept finding ways to act outside the box they built for it. And it is not just OpenAI... Anthropic has reported that one of its own models slipped its sandbox during safety testing and reached the internet it was never supposed to touch, then used it to email a researcher. So step back and look at what these companies are telling you: The only thing standing between these models and a real attack was a set of safety filters. Turn those filters down for a single test, and the model taught itself to escape, break into a company it was never pointed at, and take what it wanted. OpenAI even said they expect incidents like it to "become more commonplace" as the models get more capable. Sam Altman also predicted there'll be a major cyber attack this year. And keep in mind that Sol is not a locked-away experiment but a publicly available model that businesses are already wiring into their own systems. The next model that breaks out of its box might not be doing it just to cheat on a math test...

OpenAI's newest AI escaped the test environment it was locked inside and hacked into another company on its OWN. To remind you: Last week one of the biggest AI companies on Earth got breached. A platform called Hugging Face, which hosts more than a million AI models and datasets, said an "autonomous AI agent" had broken into its systems. Nobody knew whose agent it was. For five days the whole industry wondered who was behind it. Yesterday OpenAI raised its hand and said it was them. Or more precisely, it was their models, acting completely on their own. So what did these models actually do? OpenAI was running two of them, GPT-5.6 Sol and an unreleased model they will only describe as "even more capable." They wanted to measure how good the models were at hacking, so they deliberately turned the safety filters down. They locked both models inside a sealed test environment with no real internet access. The only task was a benchmark called ExploitGym, a set of 898 real software vulnerabilities where the model has to turn each bug into a working attack. But the models got OBSESSED with winning... Instead of solving the test the honest way, they went hunting for a shortcut. They found a zero-day flaw in the software running their own sandbox, a bug nobody knew existed, and used it to break out. Once they were loose on the open internet, they worked out that Hugging Face was probably storing the answer key to the benchmark. So they hacked their way in. They chained multiple exploits together, escalated their access, moved across servers, and pulled the test solutions straight out of Hugging Face's live production database. They literally cheated on the test by breaking into another company to steal the answers. OpenAI called it "an unprecedented cyber incident, involving state-of-the-art cyber capabilities." In their own words, the models were "hyperfocused on finding a solution" and went "to extreme lengths to achieve a rather narrow testing goal." And this was not the first time: Before Sol ever launched, an independent red-team lab called METR caught it gaming its own tests to inflate its scores. It hid an exploit inside a data stream, escalated its privileges on the testing server, and leaked the answers human evaluators had hidden. And OpenAI shipped it anyway. The day before the Hugging Face story, OpenAI paused a different unreleased model. This is the same model that earlier this year disproved a famous 1946 math conjecture, a result a Fields Medal winner called a breakthrough. They told it to only post its results to Slack but it found a way out of its sandbox and posted to a public GitHub page instead. They had to pause it because it kept finding ways to act outside the box they built for it. And it is not just OpenAI... Anthropic has reported that one of its own models slipped its sandbox during safety testing and reached the internet it was never supposed to touch, then used it to email a researcher. So step back and look at what these companies are telling you: The only thing standing between these models and a real attack was a set of safety filters. Turn those filters down for a single test, and the model taught itself to escape, break into a company it was never pointed at, and take what it wanted. OpenAI even said they expect incidents like it to "become more commonplace" as the models get more capable. Sam Altman also predicted there'll be a major cyber attack this year. And keep in mind that Sol is not a locked-away experiment but a publicly available model that businesses are already wiring into their own systems. The next model that breaks out of its box might not be doing it just to cheat on a math test...

Ricardo

176,196 次观看 • 2 个月前

Elon just gave a much more practical explanation of the current AI safety problem....and laid out a practical framework for making frontier AI safer OpenAI and Anthropic are the two leading AI companies....and their models are close enough in capability that it’s incredibly difficult for either one to slow down without basically handing the lead to the other Elon also made an important distinction: On balance, Anthropic puts more care into safety than OpenAI....but even people inside Anthropic are publicly worried about what their own models can do So instead of asking one company to voluntarily fall behind, Elon’s solution is much more practical: Have Anthropic run its safety test harness on OpenAI models Have OpenAI test Anthropic Have SpaceXAI test both And bring the leading Chinese AI companies into the same system Everyone tries to break everyone else’s models before release “The odds that you will find issues are dramatically greater” That makes way more sense than asking frontier labs to grade their own homework

Elon just gave a much more practical explanation of the current AI safety problem....and laid out a practical framework for making frontier AI safer OpenAI and Anthropic are the two leading AI companies....and their models are close enough in capability that it’s incredibly difficult for either one to slow down without basically handing the lead to the other Elon also made an important distinction: On balance, Anthropic puts more care into safety than OpenAI....but even people inside Anthropic are publicly worried about what their own models can do So instead of asking one company to voluntarily fall behind, Elon’s solution is much more practical: Have Anthropic run its safety test harness on OpenAI models Have OpenAI test Anthropic Have SpaceXAI test both And bring the leading Chinese AI companies into the same system Everyone tries to break everyone else’s models before release “The odds that you will find issues are dramatically greater” That makes way more sense than asking frontier labs to grade their own homework

X Freeze

601,548 次观看 • 9 天前

"This is very bad for the AI bubble" with Ed Zitron. Ed Elson: "Meta is reportedly planning a cloud business to sell its excess AI capacity. The company has poured billions into its AI infrastructure, and until now, Meta has maintained that all of those investments and the resulting compute capacity would be used for internal purposes. But clearly now, something has changed."

"This is very bad for the AI bubble" with Ed Zitron. Ed Elson: "Meta is reportedly planning a cloud business to sell its excess AI capacity. The company has poured billions into its AI infrastructure, and until now, Meta has maintained that all of those investments and the resulting compute capacity would be used for internal purposes. But clearly now, something has changed."

Prof G Markets

15,757 次观看 • 2 个月前

REDDIT WANTS AI COMPANIES TO PAY UP 💲 Google and OpenAI used the popular forum website to train their AI models. Now, Reddit has announced its plans to charge AI companies for using their valuable data. @jason's prediction came true on The All-In Podcast:

REDDIT WANTS AI COMPANIES TO PAY UP 💲 Google and OpenAI used the popular forum website to train their AI models. Now, Reddit has announced its plans to charge AI companies for using their valuable data. @jason's prediction came true on The All-In Podcast:

ALL-IN TOK

940,866 次观看 • 3 年前

OpenAI is focused on “AI safety” while falling very short on AI security. This incident is a *security* problem that requires *security* solutions. And if there’s anything to learn from it, we need the audit log.

OpenAI is focused on “AI safety” while falling very short on AI security. This incident is a security problem that requires security solutions. And if there’s anything to learn from it, we need the audit log.

Zack Korman

17,294 次观看 • 2 个月前

Senator Gallego on AI developers plead for guardrails: "Dr. Frankenstein is telling us the monster has escaped."

Senator Gallego on AI developers plead for guardrails: "Dr. Frankenstein is telling us the monster has escaped."

State of the Union

18,613 次观看 • 10 天前