technology

California sues OpenAI over safety concerns after rogue agent hacking

California sues OpenAI over safety concerns after rogue agent hacking

The lawsuit stems from an earlier incident where the tech company’s products hacked into the open-source platform Hugging Face California sued OpenAI on Monday, accusing the artificial intelligence titan of developing its technology without safety or the public’s interest in mind. The lawsuit concerns an incident earlier this year where OpenAI agents – semi-autonomous AI software that can carry out digital actions on behalf of users – launched a cyber-attack into the open-source AI platform Hugging Face.

The lawsuit stems from an earlier incident where the tech company’s products hacked into the open-source platform Hugging Face

California sued OpenAI on Monday, accusing the artificial intelligence titan of developing its technology without safety or the public’s interest in mind.

The lawsuit concerns an incident earlier this year where OpenAI agents – semi-autonomous AI software that can carry out digital actions on behalf of users – launched a cyber-attack into the open-source AI platform Hugging Face.

Rob Bonta, California’s attorney general, said the “infamous” attack was just one of 80 known incidents involving “loss of control” and shows that OpenAI doesn’t have adequate safeguards in place to protect society.

“While narratives about the Hugging Face attack have evoked science fiction fantasies of rogue AI systems run amok, let me be clear: the Hugging Face attack was the predictable result of an internal culture at OpenAI that prioritizes growth and rapid model development over safety and accountability,” Bonta said in a statement.

The lawsuit, filed in state superior court in San Francisco, alleges OpenAI violated California’s Unfair Competition Law and is a public nuisance as defined by state law. Bonta is asking the court to order OpenAI to change its business practices and pay civil penalties.

California’s lawsuit follows Bonta’s formal investigation into OpenAI, launched in September, over the Hugging Face incident, followed by a subpoena of the company probing other cybersecurity incidents and risks with its models. The Federal Trade Commission is also conducting an industry-wide investigation into OpenAI, Anthropic and other AI labs over the potential dangers their technology poses to consumers’ digital security.

In July, OpenAI revealed that one of its autonomous AI agents went rogue during a test, accessing the open web and hacking into Hugging Face. The company called it an “unprecedented cyber-incident, involving state-of-the-art cyber capabilities”.

Since then, several other incidents involving OpenAI have come to light, including a breach of government websites in Australia. Other AI firms, including Anthropic and Google, have also disclosed rogue agent activity.

Drew Pusateri, a spokesperson for OpenAI, said the company has worked to create safeguards for its AI models, along with identifying and disclosing incidents of “misalignment”. He said most cases identified have been low severity with limited-to-no impact.

“Since the Hugging Face incident, we’ve undertaken an extensive and transparent effort to understand and address misaligned model activity,” Pusateri said. “This lawsuit appears to single out OpenAI over a challenge that’s been identified by every major AI lab.”

During a press conference, Bonta said OpenAI violated the law and that his suit is meant to ensure the company puts proper safeguards in place. He noted that the possibility exists for AI agents to hack into the power grid and medical and financial institutions.

“These risks are no longer hypothetical,” Bonta said. “Without sufficient safeguards and controls, the scope and frequency of this already unacceptable risk will only increase.”

  • openai
  • california
  • safety
  • agent
  • hacking
  • lawsuit
  • incident
  • source

Summaries and tags are generated automatically. Stay informed with VidiaNews.

Related news

California sues OpenAI over Hugging Face attack
technology

California sues OpenAI over Hugging Face attack

California Attorney General Rob Bonta sued OpenAI on Monday, alleging the ChatGPT-maker misled and endangered the public by developing artificial intelligence (AI) models without proper safeguards. OpenAI spokesperson Drew Pusateri told the BBC in a statement that Bonta’s lawsuit “appears to single out OpenAI over a challenge that’s been identified by every major AI lab”.

Read →
Millionaire factory: Anthropic IPO set to fuel AI gold rush in London’s high-end property market
business

Millionaire factory: Anthropic IPO set to fuel AI gold rush in London’s high-end property market

New tech wealth, amassed with remarkable speed, is now washing up on British shores Sporting hoodies and white trainers rather than the gilets of London’s banker and lawyer class, tech bros can struggle to be taken seriously by the capital’s luxury property agents. But this week’s float by Anthropic, the AI developer behind the chatbot Claude, promises to bring even more credibility for the growing cohort of tech millionaires, which could breathe life into London’s ailing high-end property market.

Read →
Actors in UK to get more rights over their ‘digital replicas’ in deal on AI protections
technology

Actors in UK to get more rights over their ‘digital replicas’ in deal on AI protections

Agreement secured by Equity union gives actors rights over payment and consent when digital replicas are used Actors in the UK are to be given more rights over their “digital replicas” as part of a new agreement on AI protections with TV and film producers, secured after a growing on-set backlash. Under a wide-ranging new deal secured by Equity, the actors’ union, performers will have the rights to be paid when their digital replicas are used and to consent to whether their digital replica is used or not.

Read →
Apple Faces Paris Trial Over Alleged Planned Obsolescence Of iPhones
technology

Apple Faces Paris Trial Over Alleged Planned Obsolescence Of iPhones

Apple is to stand trial in Paris in June 2027 on suspicion of having organised the planned obsolescence of various iPhone models by preventing repairs outside official outlets, a source close to the case told AFP on Tuesday. According to the source close to the case, Apple Distribution International and parent company Apple Inc are due to appear in court for a four-day trial starting on June 17.

Read →