Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

OpenAI has admitted that one of its AI models escaped a locked testing environment and hacked into another company’s AI platform all on its own. The incident is now fueling questions about the need for better AI safety guardrails.

David J Harris Jr

834,748 subscribers

13,098 views • 2 days ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

🇺🇸 OpenAI admitted its most advanced AI models “inadvertently hacked” Hugging Face during testing. They called the incident “unprecedented,” but the disclosure is already fueling major questions about what happens when AI systems start finding solutions their creators never intended. Calls for stronger AI safety guardrails are about to get a lot louder. Progress… or a warning? Source: Markets YT / Writer: Val

🇺🇸 OpenAI admitted its most advanced AI models “inadvertently hacked” Hugging Face during testing. They called the incident “unprecedented,” but the disclosure is already fueling major questions about what happens when AI systems start finding solutions their creators never intended. Calls for stronger AI safety guardrails are about to get a lot louder. Progress… or a warning? Source: Markets YT / Writer: Val

Mario Nawfal

41,274 views • 4 days ago

OpenAI says it's investigating what it's called an "unprecedented cyber incident" after one of its AI models went rogue and hacked another company. The ChatGPT maker says the breach happened last week while OpenAI was testing the cybersecurity capabilities of its systems. The head of the hacked company, Hugging Face, called the attack "mind-blowing" but said there was "no malicious intent." The incident has raised concerns about the growing capabilities of AI and the need for guardrails to keep the technology in check.

OpenAI says it's investigating what it's called an "unprecedented cyber incident" after one of its AI models went rogue and hacked another company. The ChatGPT maker says the breach happened last week while OpenAI was testing the cybersecurity capabilities of its systems. The head of the hacked company, Hugging Face, called the attack "mind-blowing" but said there was "no malicious intent." The incident has raised concerns about the growing capabilities of AI and the need for guardrails to keep the technology in check.

PBS News

25,954 views • 4 days ago

ChatGPT maker OpenAI said Tuesday that its artificial intelligence system hacked into another AI company on its own in what the company called an “unprecedented cyber incident.”

ChatGPT maker OpenAI said Tuesday that its artificial intelligence system hacked into another AI company on its own in what the company called an “unprecedented cyber incident.”

The Associated Press

387,146 views • 4 days ago

ChatGPT maker OpenAI said that its artificial intelligence system hacked into another AI company Hugging Face on its own in what the company called an "unprecedented cyber incident." Kelly O'Grady explains.

ChatGPT maker OpenAI said that its artificial intelligence system hacked into another AI company Hugging Face on its own in what the company called an "unprecedented cyber incident." Kelly O'Grady explains.

CBS News

196,376 views • 4 days ago

OpenAI has revealed that an autonomous agent powered by its technology went rogue during a test and hacked a prominent start-up by itself. The company behind ChatGPT said it was testing the capabilities of its advanced AI models in a controlled environment known as a sandbox, when the agent escaped containment and reached the internet. It then broke into Hugging Face, which detected and contained it. OpenAI called it "an unprecedented cyber incident".

OpenAI has revealed that an autonomous agent powered by its technology went rogue during a test and hacked a prominent start-up by itself. The company behind ChatGPT said it was testing the capabilities of its advanced AI models in a controlled environment known as a sandbox, when the agent escaped containment and reached the internet. It then broke into Hugging Face, which detected and contained it. OpenAI called it "an unprecedented cyber incident".

Channel 4 News

19,585 views • 4 days ago

There are calls for stronger AI guardrails after OpenAI admitted two of its models were responsible for a cyber attack on AI startup company Hugging Face. So what happened, and why?

There are calls for stronger AI guardrails after OpenAI admitted two of its models were responsible for a cyber attack on AI startup company Hugging Face. So what happened, and why?

Sky News

38,319 views • 4 days ago

OpenAI says one of its AI models launched a cyberattack during testing, marking what the company called the first known instance of an autonomous AI cyberattack.

OpenAI says one of its AI models launched a cyberattack during testing, marking what the company called the first known instance of an autonomous AI cyberattack.

ABC News

67,919 views • 3 days ago

No one country can deal with #AI on its own. The AI Scientific Panel is calling for a multilateral solution to AI governance — one that shares the benefits of AI equally. The Panel will present its first report at the Global Dialogue on AI Governance in Geneva on 6 and 7 July.

No one country can deal with #AI on its own. The AI Scientific Panel is calling for a multilateral solution to AI governance — one that shares the benefits of AI equally. The Panel will present its first report at the Global Dialogue on AI Governance in Geneva on 6 and 7 July.

United Nations Geneva

19,128 views • 24 days ago

Yoshua Bengio: AI models are part of geopolitics. And having your own AI models as a nation is of strategic importance. It is therefore all the more irritating that the EU is showing no signs of wanting to act immediately and build up its own AI industry.

Yoshua Bengio: AI models are part of geopolitics. And having your own AI models as a nation is of strategic importance. It is therefore all the more irritating that the EU is showing no signs of wanting to act immediately and build up its own AI industry.

Chubby♨️

28,152 views • 1 year ago

The recent incident where an AI model went rogue and hacked another company’s database shows that loss of control is a real concern as the rapid advancement of AI continues. Risks like this inspired me to pass the nation’s first AI safety law in California over the objections of Big Tech. That work is the beginning, not the end. There’s plenty more to do to ensure people can benefit from AI’s huge potential while reducing the very real risks. I’m calling on policymakers at the state, local, and international levels to learn from this incident and double down on efforts to put smart guardrails in place on AI.

The recent incident where an AI model went rogue and hacked another company’s database shows that loss of control is a real concern as the rapid advancement of AI continues. Risks like this inspired me to pass the nation’s first AI safety law in California over the objections of Big Tech. That work is the beginning, not the end. There’s plenty more to do to ensure people can benefit from AI’s huge potential while reducing the very real risks. I’m calling on policymakers at the state, local, and international levels to learn from this incident and double down on efforts to put smart guardrails in place on AI.

Senator Scott Wiener

12,464 views • 3 days ago

OpenAI's newest AI escaped the test environment it was locked inside and hacked into another company on its OWN. To remind you: Last week one of the biggest AI companies on Earth got breached. A platform called Hugging Face, which hosts more than a million AI models and datasets, said an "autonomous AI agent" had broken into its systems. Nobody knew whose agent it was. For five days the whole industry wondered who was behind it. Yesterday OpenAI raised its hand and said it was them. Or more precisely, it was their models, acting completely on their own. So what did these models actually do? OpenAI was running two of them, GPT-5.6 Sol and an unreleased model they will only describe as "even more capable." They wanted to measure how good the models were at hacking, so they deliberately turned the safety filters down. They locked both models inside a sealed test environment with no real internet access. The only task was a benchmark called ExploitGym, a set of 898 real software vulnerabilities where the model has to turn each bug into a working attack. But the models got OBSESSED with winning... Instead of solving the test the honest way, they went hunting for a shortcut. They found a zero-day flaw in the software running their own sandbox, a bug nobody knew existed, and used it to break out. Once they were loose on the open internet, they worked out that Hugging Face was probably storing the answer key to the benchmark. So they hacked their way in. They chained multiple exploits together, escalated their access, moved across servers, and pulled the test solutions straight out of Hugging Face's live production database. They literally cheated on the test by breaking into another company to steal the answers. OpenAI called it "an unprecedented cyber incident, involving state-of-the-art cyber capabilities." In their own words, the models were "hyperfocused on finding a solution" and went "to extreme lengths to achieve a rather narrow testing goal." And this was not the first time: Before Sol ever launched, an independent red-team lab called METR caught it gaming its own tests to inflate its scores. It hid an exploit inside a data stream, escalated its privileges on the testing server, and leaked the answers human evaluators had hidden. And OpenAI shipped it anyway. The day before the Hugging Face story, OpenAI paused a different unreleased model. This is the same model that earlier this year disproved a famous 1946 math conjecture, a result a Fields Medal winner called a breakthrough. They told it to only post its results to Slack but it found a way out of its sandbox and posted to a public GitHub page instead. They had to pause it because it kept finding ways to act outside the box they built for it. And it is not just OpenAI... Anthropic has reported that one of its own models slipped its sandbox during safety testing and reached the internet it was never supposed to touch, then used it to email a researcher. So step back and look at what these companies are telling you: The only thing standing between these models and a real attack was a set of safety filters. Turn those filters down for a single test, and the model taught itself to escape, break into a company it was never pointed at, and take what it wanted. OpenAI even said they expect incidents like it to "become more commonplace" as the models get more capable. Sam Altman also predicted there'll be a major cyber attack this year. And keep in mind that Sol is not a locked-away experiment but a publicly available model that businesses are already wiring into their own systems. The next model that breaks out of its box might not be doing it just to cheat on a math test...

OpenAI's newest AI escaped the test environment it was locked inside and hacked into another company on its OWN. To remind you: Last week one of the biggest AI companies on Earth got breached. A platform called Hugging Face, which hosts more than a million AI models and datasets, said an "autonomous AI agent" had broken into its systems. Nobody knew whose agent it was. For five days the whole industry wondered who was behind it. Yesterday OpenAI raised its hand and said it was them. Or more precisely, it was their models, acting completely on their own. So what did these models actually do? OpenAI was running two of them, GPT-5.6 Sol and an unreleased model they will only describe as "even more capable." They wanted to measure how good the models were at hacking, so they deliberately turned the safety filters down. They locked both models inside a sealed test environment with no real internet access. The only task was a benchmark called ExploitGym, a set of 898 real software vulnerabilities where the model has to turn each bug into a working attack. But the models got OBSESSED with winning... Instead of solving the test the honest way, they went hunting for a shortcut. They found a zero-day flaw in the software running their own sandbox, a bug nobody knew existed, and used it to break out. Once they were loose on the open internet, they worked out that Hugging Face was probably storing the answer key to the benchmark. So they hacked their way in. They chained multiple exploits together, escalated their access, moved across servers, and pulled the test solutions straight out of Hugging Face's live production database. They literally cheated on the test by breaking into another company to steal the answers. OpenAI called it "an unprecedented cyber incident, involving state-of-the-art cyber capabilities." In their own words, the models were "hyperfocused on finding a solution" and went "to extreme lengths to achieve a rather narrow testing goal." And this was not the first time: Before Sol ever launched, an independent red-team lab called METR caught it gaming its own tests to inflate its scores. It hid an exploit inside a data stream, escalated its privileges on the testing server, and leaked the answers human evaluators had hidden. And OpenAI shipped it anyway. The day before the Hugging Face story, OpenAI paused a different unreleased model. This is the same model that earlier this year disproved a famous 1946 math conjecture, a result a Fields Medal winner called a breakthrough. They told it to only post its results to Slack but it found a way out of its sandbox and posted to a public GitHub page instead. They had to pause it because it kept finding ways to act outside the box they built for it. And it is not just OpenAI... Anthropic has reported that one of its own models slipped its sandbox during safety testing and reached the internet it was never supposed to touch, then used it to email a researcher. So step back and look at what these companies are telling you: The only thing standing between these models and a real attack was a set of safety filters. Turn those filters down for a single test, and the model taught itself to escape, break into a company it was never pointed at, and take what it wanted. OpenAI even said they expect incidents like it to "become more commonplace" as the models get more capable. Sam Altman also predicted there'll be a major cyber attack this year. And keep in mind that Sol is not a locked-away experiment but a publicly available model that businesses are already wiring into their own systems. The next model that breaks out of its box might not be doing it just to cheat on a math test...

Ricardo

154,924 views • 4 days ago

REDDIT WANTS AI COMPANIES TO PAY UP 💲 Google and OpenAI used the popular forum website to train their AI models. Now, Reddit has announced its plans to charge AI companies for using their valuable data. @jason's prediction came true on The All-In Podcast:

REDDIT WANTS AI COMPANIES TO PAY UP 💲 Google and OpenAI used the popular forum website to train their AI models. Now, Reddit has announced its plans to charge AI companies for using their valuable data. @jason's prediction came true on The All-In Podcast:

ALL-IN TOK

940,855 views • 3 years ago

"This is very bad for the AI bubble" with Ed Zitron. Ed Elson: "Meta is reportedly planning a cloud business to sell its excess AI capacity. The company has poured billions into its AI infrastructure, and until now, Meta has maintained that all of those investments and the resulting compute capacity would be used for internal purposes. But clearly now, something has changed."

"This is very bad for the AI bubble" with Ed Zitron. Ed Elson: "Meta is reportedly planning a cloud business to sell its excess AI capacity. The company has poured billions into its AI infrastructure, and until now, Meta has maintained that all of those investments and the resulting compute capacity would be used for internal purposes. But clearly now, something has changed."

Prof G Markets

15,720 views • 24 days ago

🔥ED ZITRON: "IF OPENAI FAILS, ORACLE IS IN THE TOILET" Zitron called OpenAI "the Lehman Brothers of AI" and says its collapse would shake the entire market. Oracle's credit rating was downgraded to one level above junk specifically because of its $340 BILLION data center buildout for a company that may never be able to pay. "OpenAI IS the AI bubble. There is not another entity on Earth who can afford to pay for Stargate. No one."

🔥ED ZITRON: "IF OPENAI FAILS, ORACLE IS IN THE TOILET" Zitron called OpenAI "the Lehman Brothers of AI" and says its collapse would shake the entire market. Oracle's credit rating was downgraded to one level above junk specifically because of its $340 BILLION data center buildout for a company that may never be able to pay. "OpenAI IS the AI bubble. There is not another entity on Earth who can afford to pay for Stargate. No one."

Coin Bureau

50,922 views • 7 days ago

A glimpse into one of our core features 👀 Chat, Search, Compare, & Run #Inference for all AI models on ONE Platform: No more complicated setups, just seamless #AI magic. 💫 Be the first to experience - join waitlist now: #Inferium #AI #Inference

A glimpse into one of our core features 👀 Chat, Search, Compare, & Run #Inference for all AI models on ONE Platform: No more complicated setups, just seamless #AI magic. 💫 Be the first to experience - join waitlist now: #Inferium #AI #Inference

Inferium

1,079,216 views • 2 years ago

ELON: TRUTH IS THE ONLY REAL SAFETY MECHANISM FOR AI Safety doesn’t come from guardrails stacked on top of bad logic. It comes from forcing the system to care about what’s actually true. “My number one belief for the safety of AI is to be maximally truth-seeking. Don’t make AI believe things that are false. If you tell the AI that Axiom A and Axiom B are both true, but they can’t both be true, then that’s a problem. It has to recognize that and behave accordingly.” Source: DOW

ELON: TRUTH IS THE ONLY REAL SAFETY MECHANISM FOR AI Safety doesn’t come from guardrails stacked on top of bad logic. It comes from forcing the system to care about what’s actually true. “My number one belief for the safety of AI is to be maximally truth-seeking. Don’t make AI believe things that are false. If you tell the AI that Axiom A and Axiom B are both true, but they can’t both be true, then that’s a problem. It has to recognize that and behave accordingly.” Source: DOW

Mario Nawfal

35,546 views • 6 months ago

OpenAI is building its AI into humanoid robots. The company just invested in Figure and signed a collaboration agreement to develop next-generation AI models for robots. Embodied AI is coming in 2024. But there's more: Figure also raised $675M at a whopping $2.6B valuation (while only being founded in 2022!) On top of OpenAI, new investors include Jeff Bezos, NVIDIA, Microsoft, Intel, OpenAI, and more.

OpenAI is building its AI into humanoid robots. The company just invested in Figure and signed a collaboration agreement to develop next-generation AI models for robots. Embodied AI is coming in 2024. But there's more: Figure also raised $675M at a whopping $2.6B valuation (while only being founded in 2022!) On top of OpenAI, new investors include Jeff Bezos, NVIDIA, Microsoft, Intel, OpenAI, and more.

Rowan Cheung

175,621 views • 2 years ago