Skip to content
Brief The AI-First Web ·

Anthropic shops draft AI safety bill that could block risky model releases

A draft bill would let a court halt an AI model's release over risks to more than 50 lives or $1 billion in damage.

In brief
  • Anthropic is sharing a draft bill that would let a D.C. judge halt an AI model's release over catastrophic risk. TechCrunch, citing Politico, says the bar is over 50 deaths or $1 billion in damage.
  • Anthropic confirmed the draft to Politico. The sources do not say who backs it in Congress or when it might be filed.

TechCrunch reported on 20 October, citing Politico, that Anthropic is sharing a draft AI safety bill and hopes Congress will adopt it. The draft would let a court halt an AI model's release when risk is clear and near. TechCrunch says the bar is more than 50 people at risk of dying, or over $1 billion in property damage. The harm must come from a biological weapon, a model escaping its maker's control, or a cyberattack. Independent evaluators registered with the Commerce Department would judge it. They would have 72 hours to alert Commerce, which must then ask a D.C. judge to halt the release.

An Anthropic spokesperson confirmed the draft to Politico. The spokesperson said it follows the company's Advanced AI Framework, pushed with lawmakers since June. Anthropic had not answered TechCrunch's request for comment. Labs could pay the evaluators if pay does not depend on the results. TechCrunch says it is unclear how that would stop money from swaying findings. The sources do not say which lawmakers back the draft or when it might be filed.

The draft is only a proposal. It shows one AI lab's idea of how a model release could be stopped, which bears on teams that build on or buy AI models.

A WebPulse Brief: a short report of an important event, written by the WebPulse Newsroom with AI assistance and checked against the reporting below. When there is more to explain, we follow up with a full story. How we use AI.

Reporting: TechCrunch.