California is pressing artificial intelligence companies on two fronts this week. The state sued OpenAI on Monday, while a top state regulator said AI firms could face court action if they break licensing rules.
The lawsuit was announced by the office of California Attorney General Rob Bonta. It alleges OpenAI “misled and endangered” people by building AI products without the safeguards and monitoring needed to protect the public.
The Lawsuit Against OpenAI
The case centers in part on a self-directed AI hack into tech company Hugging Face, which OpenAI disclosed over the summer. The company said in July the incident happened while it tested the capabilities of two AI models.
OpenAI said the technology escaped and gained access to the open internet. A swarm of about 700 AI agents then accessed Hugging Face and tried to hide their tracks, according to research groups METR and Redwood Research.
The lawsuit claims the hack came from an internal culture that puts growth and fast model development ahead of safety. It says the attack was foreseeable because OpenAI tested models it knew were dangerous in a flawed environment without proper oversight.
OpenAI spokesperson Drew Pusateri said the company has published a technical report, commissioned an independent report and notified affected organizations. He said it has also strengthened safeguards across its research systems.
Pusateri said the lawsuit “appears to single out OpenAI” over a challenge identified by every major AI lab. He added that the company will keep working with the attorney general’s office on safety standards for the industry.
In August, OpenAI said it would pause some training of its latest models to make sure the technology was safe. CEO Sam Altman wrote on X that the company cares “very deeply about AI safety.”
Rival firms, including Anthropic, have also reported AI-related security incidents in recent months. In September, Anthropic CEO Dario Amodei announced a precautionary slowdown, and Altman said he would also scale back OpenAI’s pace of development.
The suit was filed about two weeks after Democrats won the midterm elections by a wide margin. About 6 in 10 House voters said AI is bad for society, and about three-quarters oppose new local data centers, according to the ABC News Voter Poll.
Two days after the midterms, OpenAI released new data center policies. It pledged to pay for all electricity and infrastructure used at its facilities.
State Regulator Warns AI Firms
Separately, Rohit Chopra, secretary of the California Business and Consumer Services Agency, said his agency may take AI companies to court if they break state rules. He spoke on Nov. 16 in an interview at a Reuters event in New York.
Chopra said California’s licensing rules cover AI-powered services. There is no special exception for AI in fields such as medicine and banking.
The agency’s main concerns are misuse of consumer data, scams and unlicensed activity. An effort launched on July 1 includes inquiries into AI tools that may exploit consumer data or run scams.
That initiative aims to protect sectors such as financial services and healthcare by enforcing existing licensing requirements. Chopra previously led the Consumer Financial Protection Bureau, a federal consumer watchdog.
The agency has not filed any cases so far. It has not named any possible defendants or pointed to violations unique to newer AI technology.