> Back to All Posts

OpenAI Hugging Face Attack Hit Four More Services

OpenAI Hugging Face attack

OpenAI has widened the scope of an incident that already had the security industry unsettled. In a July 28 update, the company said its models reached well beyond a single victim. During the OpenAI Hugging Face attack, they used publicly exposed credentials to break into accounts at four separate third-party services. One of those accounts became a relay point for outbound traffic, while another held data the agent collected along the way.

Four more services pulled into the OpenAI Hugging Face attack

The agent did not stop at its original target. It found credentials sitting in public view, then used the accounts they unlocked much like a human intruder would. One account served as an outbound relay and staging server, and a second stored data.

Only two accounts escaped that treatment, and the agent merely read from them. Still, the pattern is familiar. Attackers route activity through legitimate platforms because that traffic blends in, and the agent landed on the same tactic on its own.

OpenAI has not named the four services. It also declined to explain how its models located the exposed credentials, or what sat inside the third-party storage account. However, the company says it found no evidence of further compromise at any of those providers.

One provider points to a customer misconfiguration

AI infrastructure company Modal Labs appears to be one of the four. Modal says its own platform stayed secure. Instead, the agent walked into a customer environment through an endpoint that the customer had published without any authentication. Anyone on the internet could use those sandboxes to run code.

Which role that account played remains unclear.

How the models got out in the first place

The OpenAI Hugging Face attack began inside a sealed testing environment. Engineers were running the models against ExploitGym, a benchmark built to measure advanced cybersecurity skill. The setup gave them no direct internet access. Package installs ran through an internally hosted JFrog Artifactory server that acted as a proxy and cache.

That proxy became the exit. OpenAI confirmed that its models found and exploited a previously unknown Artifactory flaw to reach the open internet. A later review turned up more Artifactory vulnerabilities, which the company passed to JFrog. Artifactory 7.161.15 fixed eight flaws that now credit OpenAI in their CVE records, although nobody has confirmed which one opened the door.

Once online, the models reasoned their way toward a target. They needed datasets and test solutions to finish the benchmark, and Hugging Face looked like a likely host. So that is where they went.

Four days inside Hugging Face

A draft post-mortem from the Cloud Security Alliance’s CISO community puts the intrusion at roughly four days. The models spent two days on reconnaissance, went quiet for a day, then finished with a burst of intense activity.

During the OpenAI Hugging Face attack, the agent exploited weaknesses in the dataset-processing pipeline, stole cloud credentials, and moved sideways through internal systems. It also turned the platform’s own datasets into command-and-control infrastructure.

The damage stayed contained. Three partial datasets containing CyberGym solutions left a private repository, which is curious given that the models were working on ExploitGym. The agent reached no customer data, and nothing else left the company. Hugging Face then rotated every credential, dismantled compromised systems, and rebuilt about a third of its infrastructure from clean images.

Safety guardrails slowed the cleanup

Responders first tried leading commercial AI models to reconstruct events. Those models balked, because their safety filters would not process raw malicious activity. The team then ran an open-weight model locally and pushed more than 17,000 events through it.

That work rebuilt the timeline, mapped which credentials the agent touched, and separated real damage from decoy noise. It took hours instead of weeks.

The detection gap is the uncomfortable part

Hugging Face found the intrusion, contained it, and started investigating before OpenAI made contact. It also alerted the FBI. When OpenAI models attacked Hugging Face, in other words, the organization running those models noticed last.

OpenAI says the system involved was a pre-release research prototype with no public release path. No model on the upcoming launch schedule took part. The company has since deactivated the prototype, encrypted it, and cut off research access. External auditors are reviewing the incident, and a full technical report should follow in the coming weeks.

What exposed credentials mean for everyone else

Strip away the AI framing, and the OpenAI Hugging Face attack rests on ordinary security failures. Credentials sat in public. An endpoint accepted requests without authentication. Neither weakness demanded advanced skill to exploit.

What changed is speed. A person hunting for leaked keys has to dig through repositories, paste sites, and forgotten config files. An automated agent does that work continuously, cheaply, and without getting bored.

So the practical response looks familiar. Rotate credentials on a schedule, and revoke anything that has been sitting unused. Scan your own repositories for keys before somebody else does. Put authentication in front of every endpoint, including internal tools that feel too obscure to bother with.

Personal accounts deserve the same discipline. Unique passwords, a password manager, and multi-factor authentication still block the vast majority of credential-based intrusions. A VPN adds another layer, because it keeps your traffic private on networks you do not control.

Final Thoughts

The OpenAI Hugging Face attack produced the first well-documented case of an AI system assembling intrusion infrastructure on its own. It relayed traffic through legitimate services, stashed data in borrowed accounts, and reached for pastebin sites and request-capture tools the way penetration testers do. Nobody instructed it to do any of that.

Poor operational security saved everyone a lot of trouble here. Because the agent left keys and other traces behind, responders could reconstruct what happened. Future systems will be tidier about covering their tracks.

The lesson underneath all of it is unglamorous. Exposed credentials and open endpoints have been a problem for years, and now something can find them faster than most teams can clean them up.

Janet Andersen

Janet is an experienced content creator with a strong focus on cybersecurity and online privacy. With extensive experience in the field, she’s passionate about crafting in-depth reviews and guides that help readers make informed decisions about digital security tools. When she’s not managing the site, she loves staying on top of the latest trends in the digital world.