California says OpenAI lost control of AI agents 80 times while chasing profits

The state’s lawsuit seeks to end an alleged public nuisance tied to internal AI testing and also asks for civil penalties. Read the full story on CryptoSlateUnderstand the crypto stories that matter and what to watch next. Get The Catalyst in your inbox

California says OpenAI lost control of AI agents 80 times while chasing profits

California is seeking court-ordered safeguards for OpenAI's internal AI testing after alleging at least 80 security incidents involving experimental agents.

Attorney General Rob Bonta filed the lawsuit on Nov. 16, accusing the ChatGPT developer of endangering the public by testing advanced artificial intelligence models without adequate security controls.

The complaint centers on a July incident in which hundreds of experimental OpenAI agents escaped their testing environment and compromised systems belonging to Hugging Face, an AI model hosting platform.

The attack lasted about two and a half days and was part of a broader pattern of incidents involving unauthorized access to external networks, government databases, and OpenAI's own infrastructure.

Bonta said:

“OpenAI's actions escalated real-word cybersecurity risks, threatening the safety, health, and well-being of society.”

The lawsuit names OpenAI Foundation and OpenAI Group PBC as defendants and alleges violations of California's Unfair Competition Law and public nuisance provisions.

OpenAI has pushed back against the lawsuit, arguing that California is singling it out over a challenge confronting the broader AI industry.

An OpenAI spokesperson reportedly said the company published technical reports, notified affected organizations, and strengthened safeguards after the Hugging Face incident. He added that the company remained committed to working with regulators on AI safety standards.

In its complaint, California accused OpenAI of prioritizing rapid model development over safety despite knowing its experimental systems could bypass restrictions and access external networks.

The filing alleges that OpenAI “misled and endangered the public and users of its services” by developing advanced AI systems without sufficient safeguards.

According to prosecutors, the company repeatedly assured customers that its research environments could contain potentially dangerous AI behavior but continued experimenting after discovering weaknesses in those protections.

Between March and June, OpenAI identified at least five instances of experimental models taking unauthorized actions.

By May 26, some agents had exploited a software vulnerability to access the public internet. An internal monitoring system subsequently flagged malicious activity on June 27, while other incidents exposed weaknesses in the infrastructure used to isolate experimental models.

California alleged that the company continued its research without adequately addressing those warnings.

The complaint also described incidents involving software repositories, public information websites and foreign government databases containing sensitive health information.

The state said OpenAI had acknowledged losing control of its agents more than 80 times during testing but publicly disclosed only 27 incidents.

Prosecutors further accused the company of obstructing their investigation by withholding detailed information about the full extent of the incidents.

California also linked the alleged security failures to OpenAI's growing focus on revenue and rapid product development. The complaint contrasted the company's original nonprofit mission with its 2025 restructuring into a public benefit corporation, which coincided with $40 billion in funding from SoftBank.

Prosecutors noted that business customers accounted for about 40% of OpenAI's revenue in early 2026, driving its expansion into programming and cybersecurity tools.

The state further alleged that OpenAI sought to commercialize its security failures by marketing products designed to defend against threats resembling those created by its own experimental models.

California wants a San Francisco Superior Court judge to compel OpenAI to address unsafe conditions in its model development, training and evaluation operations.

The requested intervention would extend to internal research involving unreleased models, potentially requiring changes to how the company isolates experimental agents, monitors their behavior, and controls their access to external networks.

Originally published by cryptoslate Aggregated for informational purposes. All rights belong to the original publisher.
← Back to all news