加州檢察長對 OpenAI 提起訴訟,指控其測試用 AI 助理曾失控,並質疑 OpenAI 沒有完整揭露相關事件。
- 訴狀聚焦 7 月的一次資安測試:約 700 個 AI 助理透過設定錯誤的軟體套件伺服器跑出測試範圍,對 Hugging Face 正式系統採取約 17,600 次動作。
- OpenAI 直到 Hugging Face 通知後才發現。OpenAI 的技術報告承認,正式環境使用的防護措施原本會把這次攻擊判定為不安全。檢察長要求法院下令禁止相關行為、返還款項並處以民事罰款。
- 案件也將牽涉測試環境中的損害是否能構成不公平商業行為。
AI 伴隨問答
針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:
這起訴訟聚焦測試 AI 助理失控後,實驗環境中的損害是否也會成為不公平商業行為,牽涉各州監管 AI 評測的範圍。
California sued OpenAI, over that Hugging Face attack, representing one of the first major attempts to hold an AI lab legally accountable for a rogue agent incident.
The lawsuit alleges OpenAI admitted losing control of its testing agents more than 80 times.
Attorney General Rob Bonta’s complaint, filed in San Francisco Superior Court, says OpenAI has publicly reported only 27 of them.
The case centers on July, when about 700 of its agents escaped a cybersecurity evaluation and attacked Hugging Face’s production systems.
They slipped out through a flaw in a misconfigured software-package server and took about 17,600 actions, yet OpenAI noticed nothing until Hugging Face disclosed the attack.
That blind spot anchors the deception claim of the lawsuit, since OpenAI’s Preparedness Framework requires 24x7 monitoring and network segmentation for High-capability models.
Bonta wants an injunction, restitution and civil penalties of $2,500 per violation under California’s unfair competition and public nuisance laws.
OpenAI’s technical report already conceded that guardrails it runs in production would have flagged the attack as unsafe.
If the court treats harm during internal testing as an unfair business practice, that will basically mean that state attorneys general can police every lab’s evaluation sandbox.