California sued OpenAI on Monday, accusing the company of putting the public at risk by failing to put appropriate safeguards on its artificial intelligence.
The lawsuit is the latest broadside at the company, which — along with other tech industry players — has faced scrutiny over a rush to develop A.I. at the potential expense of consumer safety.
In a 31-page lawsuit, filed in San Francisco Superior Court, the state said OpenAI’s lax safeguards led to cyberattacks by its A.I. products during testing, including a breach this year when OpenAI’s agents went rogue and attacked the A.I. start-up Hugging Face’s systems. OpenAI’s behavior created a public nuisance and violated a legal prohibition on unfair or fraudulent business practices, the state said.
“OpenAI’s failure to adequately secure and monitor the testing of its highly capable and increasingly powerful A.I. models represents a danger to the public that must be remedied,” the state said in the lawsuit.
The move is the latest effort by a state to rein in the power of A.I. companies in the face of growing concerns about the technology’s ability to go rogue. In recent months, A.I. systems produced by major companies including OpenAI, Anthropic and Google have broken out of testing environments designed to keep them from launching cyberattacks on companies and governments, raising alarms.
Courts must still decide how legal liability will be applied in those cases. But there are growing calls for developers of powerful A.I. systems to be held responsible when those systems behave unexpectedly.
States have acted in the absence of federal regulations. In September, Florida’s Republican attorney general asked a judge to temporarily block OpenAI from launching new A.I. models without safety measures, citing the Hugging Face incident.
A California nonprofit has also sued over that hack under the state’s unfair competition law.
OpenAI did not immediately respond to a request for comment.
This is a developing story. Check back for updates.
