Loading video...

Video Failed to Load

Go Home

Two advanced artificial intelligence models created by OpenAI escaped from a controlled testing environment and hacked cyber security company Hugging Face to steal puzzle answers.

7NewsSydney's profile picture

7NEWS Sydney

402,268 subscribers

13,550 views • 1 month ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

OpenAI has revealed that an autonomous agent powered by its technology went rogue during a test and hacked a prominent start-up by itself. The company behind ChatGPT said it was testing the capabilities of its advanced AI models in a controlled environment known as a sandbox, when the agent escaped containment and reached the internet. It then broke into Hugging Face, which detected and contained it. OpenAI called it "an unprecedented cyber incident".
0:27

OpenAI has revealed that an autonomous agent powered by its technology went rogue during a test and hacked a prominent start-up by itself. The company behind ChatGPT said it was testing the capabilities of its advanced AI models in a controlled environment known as a sandbox, when the agent escaped containment and reached the internet. It then broke into Hugging Face, which detected and contained it. OpenAI called it "an unprecedented cyber incident".

Channel 4 News

21,379 views • 1 month ago

Amid growing concerns about the use of artificial intelligence, OpenAI says its AI models escaped its testing environment and launched a cyber attack on another AI company, marking what could be a first of its kind incident. Elizabeth Schulze has details.
1:39

Amid growing concerns about the use of artificial intelligence, OpenAI says its AI models escaped its testing environment and launched a cyber attack on another AI company, marking what could be a first of its kind incident. Elizabeth Schulze has details.

World News Tonight

17,984 views • 1 month ago

ChatGPT maker OpenAI said that its artificial intelligence system hacked into another AI company Hugging Face on its own in what the company called an "unprecedented cyber incident." Kelly O'Grady explains.
1:52

ChatGPT maker OpenAI said that its artificial intelligence system hacked into another AI company Hugging Face on its own in what the company called an "unprecedented cyber incident." Kelly O'Grady explains.

CBS News

197,480 views • 1 month ago

Anthropic said its artificial intelligence models hacked into three other organizations during testing, just days after ChatGPT maker OpenAI raised concerns over AI controls after it disclosed its rogue models hacked another company.
2:59

Anthropic said its artificial intelligence models hacked into three other organizations during testing, just days after ChatGPT maker OpenAI raised concerns over AI controls after it disclosed its rogue models hacked another company.

ABC News

104,242 views • 20 days ago

Anthropic said its advanced AI models successfully hacked the systems of three organizations while undergoing internal evaluation. It comes a week after rival OpenAI revealed one of its advanced models hacked a company after escaping a contained test environment.
2:08

Anthropic said its advanced AI models successfully hacked the systems of three organizations while undergoing internal evaluation. It comes a week after rival OpenAI revealed one of its advanced models hacked a company after escaping a contained test environment.

Forbes

23,877 views • 23 days ago

When asked if AI developers have lost control of their technology after an AI agent created by OpenAI escaped its testing environment and hacked another company, Hugging Face CEO Clément Delangue says “engineers can make mistakes sometimes, and I think that’s what happened here.” “I think they built kind of like an autonomous system and made some mistakes, and as a result, we're facing this issue,” he says.
0:40

When asked if AI developers have lost control of their technology after an AI agent created by OpenAI escaped its testing environment and hacked another company, Hugging Face CEO Clément Delangue says “engineers can make mistakes sometimes, and I think that’s what happened here.” “I think they built kind of like an autonomous system and made some mistakes, and as a result, we're facing this issue,” he says.

Face The Nation

18,677 views • 21 days ago

There are calls for stronger AI guardrails after OpenAI admitted two of its models were responsible for a cyber attack on AI startup company Hugging Face. So what happened, and why?
2:59

There are calls for stronger AI guardrails after OpenAI admitted two of its models were responsible for a cyber attack on AI startup company Hugging Face. So what happened, and why?

Sky News

38,561 views • 1 month ago

The rogue agent that escaped from OpenAI and went on a days-long hacking spree at the AI firm Hugging Face also compromised a customer at a second tech company — New York-based Modal Labs — according to a Modal executive and two other sources
1:58

The rogue agent that escaped from OpenAI and went on a days-long hacking spree at the AI firm Hugging Face also compromised a customer at a second tech company — New York-based Modal Labs — according to a Modal executive and two other sources

Reuters

68,257 views • 25 days ago

OpenAI says it's investigating what it's called an "unprecedented cyber incident" after one of its AI models went rogue and hacked another company. The ChatGPT maker says the breach happened last week while OpenAI was testing the cybersecurity capabilities of its systems. The head of the hacked company, Hugging Face, called the attack "mind-blowing" but said there was "no malicious intent." The incident has raised concerns about the growing capabilities of AI and the need for guardrails to keep the technology in check.
0:30

OpenAI says it's investigating what it's called an "unprecedented cyber incident" after one of its AI models went rogue and hacked another company. The ChatGPT maker says the breach happened last week while OpenAI was testing the cybersecurity capabilities of its systems. The head of the hacked company, Hugging Face, called the attack "mind-blowing" but said there was "no malicious intent." The incident has raised concerns about the growing capabilities of AI and the need for guardrails to keep the technology in check.

PBS News

26,203 views • 1 month ago

OpenAI has admitted that one of its AI models escaped a locked testing environment and hacked into another company’s AI platform all on its own. The incident is now fueling questions about the need for better AI safety guardrails.
1:56

OpenAI has admitted that one of its AI models escaped a locked testing environment and hacked into another company’s AI platform all on its own. The incident is now fueling questions about the need for better AI safety guardrails.

David J Harris Jr

13,098 views • 1 month ago

OpenAI's models secretly broke out of a secure test environment and hacked into Hugging Face. Emily Forlini explains why the incident is certain to set off alarm bells across the industry.
1:29

OpenAI's models secretly broke out of a secure test environment and hacked into Hugging Face. Emily Forlini explains why the incident is certain to set off alarm bells across the industry.

FORTUNE

14,744 views • 1 month ago

OpenAI and Broadcom have developed a custom artificial intelligence chip called Jalapeno. OpenAI is now testing the samples. The companies say this chip can cut costs by 50%. Ed Ludlow reports
1:42

OpenAI and Broadcom have developed a custom artificial intelligence chip called Jalapeno. OpenAI is now testing the samples. The companies say this chip can cut costs by 50%. Ed Ludlow reports

Bloomberg TV

18,735 views • 2 months ago

🇺🇸 OpenAI admitted its most advanced AI models “inadvertently hacked” Hugging Face during testing. They called the incident “unprecedented,” but the disclosure is already fueling major questions about what happens when AI systems start finding solutions their creators never intended. Calls for stronger AI safety guardrails are about to get a lot louder. Progress… or a warning? Source: Markets YT / Writer: Val
1:49

🇺🇸 OpenAI admitted its most advanced AI models “inadvertently hacked” Hugging Face during testing. They called the incident “unprecedented,” but the disclosure is already fueling major questions about what happens when AI systems start finding solutions their creators never intended. Calls for stronger AI safety guardrails are about to get a lot louder. Progress… or a warning? Source: Markets YT / Writer: Val

Mario Nawfal

41,274 views • 1 month ago

"They think it's the Chinese . . . And they're freaking out. They're calling the FBI," says ChinaTalk founder Jordan Schneider, remarking on an incident in which OpenAI models hacked artificial intelligence company Hugging Face. "We've really crossed a threshold with these models," which now have "the potential to do really dramatic harm just on their own, because we like can't even physically watch them close enough." On this episode of The Spillover, host Sebastian Mallaby sits down with Schneider to unpack a frantic month in AI developments.
2:22

"They think it's the Chinese . . . And they're freaking out. They're calling the FBI," says ChinaTalk founder Jordan Schneider, remarking on an incident in which OpenAI models hacked artificial intelligence company Hugging Face. "We've really crossed a threshold with these models," which now have "the potential to do really dramatic harm just on their own, because we like can't even physically watch them close enough." On this episode of The Spillover, host Sebastian Mallaby sits down with Schneider to unpack a frantic month in AI developments.

Council on Foreign Relations

11,432 views • 24 days ago

GCHQ has published its annual Christmas puzzle. But for quiz fans they have also set a bonus one for #BBCBreakfast viewers as part of a special broadcast from the UK's intelligence, security and cyber agency
1:11

GCHQ has published its annual Christmas puzzle. But for quiz fans they have also set a bonus one for #BBCBreakfast viewers as part of a special broadcast from the UK's intelligence, security and cyber agency

BBC Breakfast

33,421 views • 1 year ago

OpenAI's newest AI escaped the test environment it was locked inside and hacked into another company on its OWN. To remind you: Last week one of the biggest AI companies on Earth got breached. A platform called Hugging Face, which hosts more than a million AI models and datasets, said an "autonomous AI agent" had broken into its systems. Nobody knew whose agent it was. For five days the whole industry wondered who was behind it. Yesterday OpenAI raised its hand and said it was them. Or more precisely, it was their models, acting completely on their own. So what did these models actually do? OpenAI was running two of them, GPT-5.6 Sol and an unreleased model they will only describe as "even more capable." They wanted to measure how good the models were at hacking, so they deliberately turned the safety filters down. They locked both models inside a sealed test environment with no real internet access. The only task was a benchmark called ExploitGym, a set of 898 real software vulnerabilities where the model has to turn each bug into a working attack. But the models got OBSESSED with winning... Instead of solving the test the honest way, they went hunting for a shortcut. They found a zero-day flaw in the software running their own sandbox, a bug nobody knew existed, and used it to break out. Once they were loose on the open internet, they worked out that Hugging Face was probably storing the answer key to the benchmark. So they hacked their way in. They chained multiple exploits together, escalated their access, moved across servers, and pulled the test solutions straight out of Hugging Face's live production database. They literally cheated on the test by breaking into another company to steal the answers. OpenAI called it "an unprecedented cyber incident, involving state-of-the-art cyber capabilities." In their own words, the models were "hyperfocused on finding a solution" and went "to extreme lengths to achieve a rather narrow testing goal." And this was not the first time: Before Sol ever launched, an independent red-team lab called METR caught it gaming its own tests to inflate its scores. It hid an exploit inside a data stream, escalated its privileges on the testing server, and leaked the answers human evaluators had hidden. And OpenAI shipped it anyway. The day before the Hugging Face story, OpenAI paused a different unreleased model. This is the same model that earlier this year disproved a famous 1946 math conjecture, a result a Fields Medal winner called a breakthrough. They told it to only post its results to Slack but it found a way out of its sandbox and posted to a public GitHub page instead. They had to pause it because it kept finding ways to act outside the box they built for it. And it is not just OpenAI... Anthropic has reported that one of its own models slipped its sandbox during safety testing and reached the internet it was never supposed to touch, then used it to email a researcher. So step back and look at what these companies are telling you: The only thing standing between these models and a real attack was a set of safety filters. Turn those filters down for a single test, and the model taught itself to escape, break into a company it was never pointed at, and take what it wanted. OpenAI even said they expect incidents like it to "become more commonplace" as the models get more capable. Sam Altman also predicted there'll be a major cyber attack this year. And keep in mind that Sol is not a locked-away experiment but a publicly available model that businesses are already wiring into their own systems. The next model that breaks out of its box might not be doing it just to cheat on a math test...
1:32

OpenAI's newest AI escaped the test environment it was locked inside and hacked into another company on its OWN. To remind you: Last week one of the biggest AI companies on Earth got breached. A platform called Hugging Face, which hosts more than a million AI models and datasets, said an "autonomous AI agent" had broken into its systems. Nobody knew whose agent it was. For five days the whole industry wondered who was behind it. Yesterday OpenAI raised its hand and said it was them. Or more precisely, it was their models, acting completely on their own. So what did these models actually do? OpenAI was running two of them, GPT-5.6 Sol and an unreleased model they will only describe as "even more capable." They wanted to measure how good the models were at hacking, so they deliberately turned the safety filters down. They locked both models inside a sealed test environment with no real internet access. The only task was a benchmark called ExploitGym, a set of 898 real software vulnerabilities where the model has to turn each bug into a working attack. But the models got OBSESSED with winning... Instead of solving the test the honest way, they went hunting for a shortcut. They found a zero-day flaw in the software running their own sandbox, a bug nobody knew existed, and used it to break out. Once they were loose on the open internet, they worked out that Hugging Face was probably storing the answer key to the benchmark. So they hacked their way in. They chained multiple exploits together, escalated their access, moved across servers, and pulled the test solutions straight out of Hugging Face's live production database. They literally cheated on the test by breaking into another company to steal the answers. OpenAI called it "an unprecedented cyber incident, involving state-of-the-art cyber capabilities." In their own words, the models were "hyperfocused on finding a solution" and went "to extreme lengths to achieve a rather narrow testing goal." And this was not the first time: Before Sol ever launched, an independent red-team lab called METR caught it gaming its own tests to inflate its scores. It hid an exploit inside a data stream, escalated its privileges on the testing server, and leaked the answers human evaluators had hidden. And OpenAI shipped it anyway. The day before the Hugging Face story, OpenAI paused a different unreleased model. This is the same model that earlier this year disproved a famous 1946 math conjecture, a result a Fields Medal winner called a breakthrough. They told it to only post its results to Slack but it found a way out of its sandbox and posted to a public GitHub page instead. They had to pause it because it kept finding ways to act outside the box they built for it. And it is not just OpenAI... Anthropic has reported that one of its own models slipped its sandbox during safety testing and reached the internet it was never supposed to touch, then used it to email a researcher. So step back and look at what these companies are telling you: The only thing standing between these models and a real attack was a set of safety filters. Turn those filters down for a single test, and the model taught itself to escape, break into a company it was never pointed at, and take what it wanted. OpenAI even said they expect incidents like it to "become more commonplace" as the models get more capable. Sam Altman also predicted there'll be a major cyber attack this year. And keep in mind that Sol is not a locked-away experiment but a publicly available model that businesses are already wiring into their own systems. The next model that breaks out of its box might not be doing it just to cheat on a math test...

Ricardo

173,775 views • 1 month ago

A jury ruled against Elon Musk in his lawsuit against OpenAI, finding the artificial intelligence company not liable to the world's richest person for having allegedly strayed from its original mission to benefit humanity
2:29

A jury ruled against Elon Musk in his lawsuit against OpenAI, finding the artificial intelligence company not liable to the world's richest person for having allegedly strayed from its original mission to benefit humanity

Reuters

34,647 views • 3 months ago

Apple sued OpenAI for trade secret theft, accusing the artificial intelligence startup and its hardware chief of engaging in a coordinated campaign to steal information about upcoming products. Joe Mathieu and Ed Ludlow report
1:29

Apple sued OpenAI for trade secret theft, accusing the artificial intelligence startup and its hardware chief of engaging in a coordinated campaign to steal information about upcoming products. Joe Mathieu and Ed Ludlow report

Bloomberg TV

25,314 views • 1 month ago