Anthropic and the US government are reportedly working together on a new framework to assess security risks in AI models. The move comes after the government imposed export controls on Anthropic’s recently launched Claude Fable 5 and Mythos 5 models over concerns about a security vulnerability known as a jailbreak. According to a report by Politico, officials from the White House and Anthropic are discussing a common set of standards that could help determine how serious future AI security flaws are and what kind of government action may be needed.
For those unfamiliar, Anthropic launched Claude Fable 5, the first publicly available Mythos-class AI model, last week along with the more advanced Mythos 5 model. Just a few days after launch, Anthropic removed access to both models globally, citing an export control order from the US government.
Also read: OpenAI improves health intelligence in ChatGPT, here is how
Now, both sides are trying to create a clearer process for handling similar situations in the future. The discussions are being led by Anthropic’s Head of Public Policy Sarah Heck and co-founder Tom Brown.
The report says negotiations have improved in recent days. Earlier, discussions had nearly broken down after Anthropic rejected demands to remove Fable from the market. However, over the weekend, senior administration officials held multiple calls with Anthropic leaders, including Tom Brown.
The conversations were followed by several in-person meetings in Washington. Anthropic reportedly sent senior researchers and safety experts to meet officials at the Commerce Department earlier this week.
Also read: Anthropic CEO Dario Amodei takes aim at OpenAI, says we’ll see who wins
Meanwhile, Anthropic is also facing new legal trouble as more than 100 authors accused it of using their books without permission to train its AI models. The lawsuit has once again raised concerns about how AI companies collect and use copyrighted content.
The case was filed in the US District Court for the Northern District of California by a group of writers led by Thomas William Shakespeare. The authors claim that Anthropic used hundreds of copyrighted books without obtaining proper licences or permission from the creators. According to the complaint, the company used around 500 copyrighted works as training material for its AI systems.
Also read: Telegram ban row: Reliance Jio says it was not involved in any routing incident