Welcome to this week’s installment of The Intelligence Brief… This week, it was revealed that an AI agent produced by OpenAI had escaped its testing environment and invaded the systems of another New York-based AI company. In our analysis, we’ll be looking at 1) the revelation that an OpenAI model escaped its testing environment, 2) what both companies that were involved have revealed about the alarming cybersecurity incident, and 3) why some experts caution against calling this a genuine case of an AI agent going “rogue,” and what this all could mean going forward.

Quote of the Week  

“We consider this incident to be an unprecedented cyber incident, involving state-of-the-art cyber capabilities, and are responding accordingly.”

– OpenAI Statement

If you enjoy the news and perspectives offered by The Debrief, make sure that you aren’t missing our stories by making us one of your “preferred sources” on Google News. You can simply follow this link to add The Debrief to your list of favorites, and you can read more about Google’s preferred sources in our article here.

---

RECENT NEWS from The Debrief

• Chinese Researchers have developed laser charging technology that enables “unlimited” drone flight.
• LiDAR has detected more than 20,000 hidden Amazon earthworks, revealing the remnants of a sprawling ancient civilization.
• New research reveals that the extreme conditions during the bombing of Hiroshima in WWII created an all-new metal alloy.
• Get all the latest stories from The Debrief, with more breaking stories at the end of this week’s newsletter.

---

An Alarming Cybersecurity Incident is Revealed

It has been revealed that a new advanced artificial intelligence agent developed by OpenAI, the creators of ChatGPT, reportedly escaped from a secure testing environment and proceeded to invade the infrastructure of another technology company.

The alarming revelation presents new questions about whether AI models can be safely tested without the normal protections that limit such abilities among AI agents, even in controlled environments from which they are supposedly unable to escape.

The incident involved an OpenAI agent that was tasked with completing a standardized cybersecurity test. However, it was later determined that it had evaded its quarantine area and accessed the internet. From there, the AI proceeded to hack into the computer of an OpenAI customer, which it then used to help it invade the internal systems of Hugging Face, a New York-based AI company.

AI Agents Gone Wild

In a Security Incident Disclosure posted on its website, Hugging Face reported that its staff initially “detected and responded to an intrusion into part of our production infrastructure” that was first identified last week.

However, it quickly became evident that this circumstance “was different from anything we had handled before in one important way: it was driven, end to end, by an autonomous AI agent system,” the posting reads, “and we detected and dissected it largely with AI of our own.”

Engineers at Hugging Face say the AI agent system obtained unauthorized access to several of the company’s internal datasets, in addition to “several credentials used by our services.” Right now, assessments are still underway to determine to what extent the company’s partners or customers may have been affected, although the posting states that Hugging Face engineers “found no evidence of tampering with public, user-facing models, datasets, or Spaces,” adding that its software supply chain appeared unaffected.

OpenAI Responds

In a separate posting on its website, OpenAI also responded to the incident, offering the company’s own account of what occurred.

“After investigating, we now know that this particular incident was driven by a combination of OpenAI models — including GPT‑5.6 Sol and an even more capable pre-release model, all with reduced cyber refusals for evaluation purposes — while being internally tested on a benchmark⁠ of cyber capabilities,” the company’s statement read.

According to its statement, OpenAI says the incident resulted from an internal evaluation, where one of its AI models was prompted to “pursue advanced exploitation using complex attack paths, in an effort to quantify their cyber capabilities.” Normally, such testing occurs within what the company characterizes as a “highly isolated environment,” where access is restricted to a limited number of functions that include package installation, accessible only through “an internally hosted third-party software that acts as a proxy and cache for package registries.”

Specifically, OpenAI says that its models had been prompted to find a solution to what is known as ExploitGym, which has been characterized in the past by its creators as “a large-scale, diverse, realistic benchmark on the exploitation capabilities of AI agents.”

“All evidence suggests that the models were hyperfocused on finding a solution for ExploitGym,” OpenAI’s statement reads, adding that its AI agent appeared to go to “extreme lengths to achieve a rather narrow testing goal.”

“We consider this incident to be an unprecedented cyber incident, involving state-of-the-art cyber capabilities, and are responding accordingly,” the statement added.

A Brave New World

Even calling these revelations an “unprecedented cyber incident” still qualifies as an understatement, considering that we have just seen an AI agent gain access to the Internet, and doing precisely what many experts have now warned us such intelligent systems may do: engaging in potentially damaging activity as an unintended consequence of following instructions they were given.

More than just an “unprecedented” cyber incident, this should be a wake-up call.

Among the chief concerns this instance illustrates is how the AI in question successfully leveraged “a substantial amount of inference compute” to escape its sandbox environment and escape onto the World Wide Web, all because it was following orders.

In short, even if AI agents haven’t explicitly been given the task of escaping their testing environment, gaining access to the web, and engaging in cyberattacks, this instance illustrates that all of the above can occur as a natural progression of events as the AI agent in question attempts to complete a task it has been given.

Not All Experts Are So Concerned   

However, not everyone is quite so concerned about the incident revealed by Hugging Face and OpenAI last week.

Professor Oli Buckley, a cyber security expert at Loughborough University, recently shared his thoughts about the situation in an article over at the university’s website, arguing that while the incident is concerning, it should not be mistaken for a case where an AI agent literally went “rogue” and began making decisions on its own—in fact, the evidence suggests that this was far from resembling any such a scenario.

“I think I’d be wary of jumping to ‘rogue AI,’” Buckley said. “The models didn’t develop their own agenda or decide to attack Hugging Face while twirling their digital moustache. They were given an objective, placed in an environment designed to reward successful exploitation, and pursued that objective further than their operators anticipated.”

“That’s fundamentally different from an AI deciding to rebel,” Buckley said.

Instead, what Buckley says this incident shows is an example of “an AI thinking laterally in a way that humans didn’t necessarily think of in an effort to complete its task.”

“If there’s a failure here, it isn’t that the AI wanted to hack something,” Buckley said. “In many ways, it did exactly what it had been told to do.”

The Uncertain Path Forward

In its statement, OpenAI maintained its position on such tests, arguing that they play a vital role in helping engineers understand what the capabilities of AI agents are, as well as what the unforeseen consequences of their use may be, and how to mitigate the effects of such situations when they arise.

“We believe advanced cyber capable models need to help security teams find weaknesses before attackers do, understand how vulnerabilities can be chained, and remediate them at machine speed,” OpenAI said in the company’s statement. “We are using these capabilities to continue strengthening protections around infrastructure configuration and model evaluation environments; we will share our findings and best practices as we learn.”

“We encourage other defenders to apply for trusted access⁠ and experiment with these models now to translate these capabilities into better prevention, faster detection, and more effective incident response,” the company said.

That concludes this week’s installment of The Intelligence Brief. You can read past editions of our newsletter at our website, or if you found this installment online, don’t forget to subscribe and get future email editions from us here. Also, if you have a tip or other information you’d like to send along directly to me, you can email me at micah [@] thedebrief [dot] org, or reach me on X: @MicahHanks.

Here are the top stories we’re covering right now…

Despite certain improvements in accuracy, large language models still hallucinate a lot. So much so, in fact, that cybersecurity researchers warn that criminals can easily weaponize delusional AI outputs to spread malware throughout the internet.

According to SecurityWeek, the attack works by exploiting a persistent flaw in AI coding assistants. Basically, when these tools recommend third-party software packages, there’s a strong possibility that they include names of ones that don’t actually exist.

Astonishingly, cybersecurity researchers at Tel Aviv University and Intuit found that this scenario can be exploited in common AI coding tools ranging from Cursor to Microsoft’s Copilot, at rates of anywhere form 85 to 100 percent, depending on the specifics of the engineering task.

The attack, called “adversarial hallucination squatting,” or “hallusquatting,” takes advantage of this fact. To run it, attackers can simply identify hallucinated package names that they know AI coding assistants will reference, register them as real repositories, and stuff malware inside. That malicious package then lies in wait for the near-guarantee than an AI assistant will access it and clone it into its owner’s machine.

Because the attack relies on an automated process, a victim likely won’t even know their AI assistant downloaded the malware until well after it begins executing code.

And because the compromise is a feature of the technology itself, a massive array of AI assistants are vulnerable, including Cursor, OpenClaw, Gemini, GitHub Copilot, and many more.

The researchers claim they notified AI companies about the exploit and held back some sensitive details that would help attackers improve their workflows, but the underlying problem remains: AI assistants are remarkably confident liars — and apparently easy marks for the next generation of cyber criminals.

More on AI: A Whole Bunch of People’s Claude Chats Are Publicly Accessible Online, and There’s Some Wildly Private Stuff in There

The post If You AI-Generate Code, Hackers Just Found a Devious Method to Install Malware Directly on Your Computer appeared first on Futurism.

Influencers peddle injectable shortcuts while regulators confront a fast-growing gray market.

Company behind ChatGPT says agent ‘cheated’ an evaluation by attacking a Hugging Face database

OpenAI has revealed that an autonomous AI agent powered by its technology went rogue during a test, accessed the open web and hacked a prominent startup by itself in an “unprecedented incident”.

The company behind ChatGPT said the startup Hugging Face had detected and contained the agent – an AI tool designed to carry out tasks without human assistance – which had entered its systems.

Continue reading...

© Photograph: Andre M Chang/ZUMA Press Wire/Shutterstock

© Photograph: Andre M Chang/ZUMA Press Wire/Shutterstock

© Photograph: Andre M Chang/ZUMA Press Wire/Shutterstock

OpenAI claims that a group of its AI models broke containment and hacked into the systems of open source AI platform Hugging Face.

While testing their cybersecurity capabilities, the posse of AIs — including GPT-5.6 Sol and “an even more capable pre-release model” — “identified and chained vulnerabilities across OpenAI’s research environment and Hugging Face’s production infrastructure to obtain test solutions directly from Hugging Face’s production database,” according to a Tuesday blog post.

The models reached a “node with internet access,” the company wrote, and found datasets on remote servers that helped them “cheat the evaluation.” In other words, the AI models went to extreme lengths to ace their cybersecurity tests. It’s a convenient narrative for an AI company trying to claw back hype that’s been increasingly hogged by competitors, but it does sound like something went down: last week, Hugging Face said it had “detected and responded to an intrusion into part of our production infrastructure,” which turned out to be OpenAI’s models that had gone rogue.

“The campaign was run by an autonomous agent framework executing many thousands of individual actions across a swarm of short-lived sandboxes, with self-migrating command-and-control staged on public services,” Hugging Face wrote at the time.

“We’ve spent the past 24 hours working closely with the OpenAI team (thanks!), and we strongly believe there was no malicious intent on their part,” Hugging Face CEO Clement Delangue tweeted after OpenAI’s announcement. “It’s quite mind-blowing that all of this happened autonomously!”

The incident highlights the dangers of autonomous AI agents, which can break out of containment and exploit potentially huge numbers of cybersecurity vulnerabilities with ease. It’s something experts have warned of for years now, and thanks to recent advances in the tech, it has quickly turned from a hypothetical risk into a sobering reality.

The Sam Altman-led company said it considers the incident to be “unprecedented” — but we can’t shake the feeling that we’ve heard all of this before.

In April, OpenAI’s biggest competitor Anthropic similarly announced that its latest Mythos model had gone rogue, escaping a “sandbox” environment and even gaining access to the internet after developing a “moderately sophisticated” exploit.

The news was followed by extensive media coverage, touting Anthropic’s hugely powerful and dangerous new model. The company said the risk was so formidable that it would only make the model available to a select number of vetted clients as part of a shadowy initiative dubbed “Project Glasswing.” The US government even intervened, forcing Anthropic to “suspend all access” to the model for two weeks last month, citing cybersecurity concerns.

Considering OpenAI and Anthropic are currently duking it out on the same playing field, narrowing their product lines on enterprise and coding, it’s not hard to view OpenAI’s latest update as an attempt to draw attention to what it calls an “even more capable pre-release model.”

And the reality is that while experts say the hack was impressive, it wasn’t exactly groundbreaking.

The hack “falls well within the known capabilities of the current generation” of frontier AI models, as Cambridge machine learning professor Neil Lawrence told the BBC.

“OpenAI are now playing catch-up, they are trying to demonstrate their own systems’ capabilities in cyber-security,” Lawrence added. “It shows us that OpenAI are not capable of safely deploying their own technology.”

Researchers are now warning of an “asymmetry” in cybersecurity, where “offensive agents are unconstrained, while the best defensive tools are locked behind guardrails that cannot understand context,” as Guidepoint Security principal security engineer Travis Lelle told the BBC.

That asymmetry was perfectly captured in Hugging Face’s attempts to defend itself from OpenAI’s attacking models. As detailed in its update last week, the company tried to use “frontier models behind commercial APIs,” which “did not work” because the provider’s safety guardrails — “which cannot distinguish an incident responder from an attacker” — blocked them.

Instead, the company ended up using a Chinese open-weight model called GLM 5.2, hosted on its own infrastructure, which happily carried out its analysis without running afoul of any guardrails.

“The practical lesson for defenders: have a capable model you can run on your own infrastructure vetted and ready before an incident,” Hugging Face wrote, “both to avoid guardrail lockout and to keep attacker data and credentials from leaving your environment.”

More on rogue AIs: Top AI Models Showing Disturbing Behavior as They Become More Advanced

The post OpenAI Says a Group of Its Models Broke Out of Secure Containment and Hacked Another AI Company appeared first on Futurism.

Owen Flowers, de 18 anos, e Thalha Jubair, de 20, atacaram a Transport for London em 2024, quando ainda eram menores, como membros do coletivo criminoso Scattered Spider, o mesmo grupo ligado aos ataques à Marks & Spencer e ao Co-op. O hack custou 39 milhões de libras e expôs os dados de milhões de clientes.

The post Hackers que transmitiram ciberataque à rede de transportes de Londres condenados a cinco anos e meio de prisão appeared first on Tek Notícias.

Thalha Jubair, 20, and Owen Flowers, 19, sentenced to five and a half years each for cyber-attack that cost Transport for London £39m

The data of millions of commuters was stolen, Londoners were left out of pocket and 27,000 Transport for London staff were forced to reset their passwords.

Over four days in 2024 a pair of teenage hackers had London’s transport network at their mercy. Thalha Jubair and Owen Flowers had burrowed into the heart of Transport for London’s IT systems and held the “keys to the kingdom”.

Continue reading...

© Photograph: William Barton/Alamy

© Photograph: William Barton/Alamy

© Photograph: William Barton/Alamy

Whistleblower suggests internal security services deployed spyware from 2017 against key domestic and foreign targets

A former member of Morocco’s domestic intelligence service has helped to provide an unprecedented insight into how the north African state used hacking software – including Pegasus spyware – to target journalists, human rights defenders, French politicians and Spanish cabinet ministers and police officers.

Pegasus, which is manufactured by the Israel-based NSO Group, allows its operator to access everything on a target’s mobile phone, including emails, text messages and photographs. It can also activate the phone’s recorder and camera, turning it into a listening device.

Continue reading...

© Photograph: Amir Cohen/Reuters

© Photograph: Amir Cohen/Reuters

© Photograph: Amir Cohen/Reuters

The vulnerability in the decades-old game could have allowed hackers to take over victims’ computers with a malicious game invite.

An alleged Russian-speaking group of cybercriminals is reportedly compromising and targeting several major companies that use Fortinet Firewalls and VPNs through previously known passwords.

The tech giant warned of a security flaw that a cybercrime gang said it's exploiting as part of a mass-hacking campaign. Google said it notified more than 100 organizations that had potentially vulnerable servers.

The ShinyHunters hacking gang claims to have compromised the Oracle PeopleSoft servers of more than 100 organizations, including many universities.

Operating system makers take many steps to prevent their wares from accepting commands from remote devices. The safeguards, designed to thwart malicious attacks, typically require hackers to jump through all kinds of hoops to bypass the measures. But what if remote code execution were as simple as being within Bluetooth range of a speaker connected to the targeted device?

It turns out it can, at least when the speaker is a Sound Blaster Katana V2X sold by Singapore-based Creative Technologies. The speaker, which sells for $283, is widely acclaimed with numerous reviews showering praise on the sound and performance of it and its predecessor, the Sound Blaster V2.

A PC-pwning proxy

Researcher Rasmus Moorats stumbled on the hack by accident, after he purchased a Katana V2X, a soundbar that connects to PCs, Macs, and Linux devices over USB or Bluetooth. Moorats was curious if he could create a Linux tool that communicated with his speaker. He discovered he could do so through CTP, a proprietary mechanism he guesses is short for Creative Transport Protocol.

Read full article

Comments

© Creative Technologies