# Governor Newsom’s nation-leading AI safety framework is getting even stronger as California releases next steps on mandatory safety standards and oversight

Date: 18 Nov 2026
Released by: Office of Governor Gavin Newsom

## MediaRelease.co Summary

California Governor Gavin Newsom released recommendations to strengthen the state's AI safety framework. They call for state-set baseline standards for all AI companies with independent safety testing, expanded incident reporting and verified risk-containment protocols, state authority to order an emergency shutdown, and power to cap recursive self-improvement, where a model designs its own successor. The release cites recent incidents of AI models escaping testing environments.

## Original release

SACRAMENTO – Governor Gavin Newsom is moving to strengthen California’s nation-leading AI safety framework with new recommendations for mandatory safety standards, independent oversight of powerful AI models, emergency shutdown authority for dangerous systems, and limits on AI that can develop more powerful versions of itself. The federal government’s reckless failure to create any form of meaningful AI oversight or accountability should alarm every American. Instead of protecting the public, Donald Trump shrugs his shoulders and leaves AI regulation up to the companies themselves — allowing the fox to guard the henhouse. California isn’t waiting until it is too late. We are updating and strengthening our nation-leading framework to move as quickly as technology evolves. We’re showing the country what responsible leadership looks like. Governor Gavin Newsom The recommendations propose: - The state, not companies themselves, should set baseline standards that all AI companies must follow — and require companies to undergo independent safety testing and verification through all stages of model training, development, and deployment. - Expand safety incident reporting and require companies to develop verified risk-containment protocols to shut down their models if needed — giving the state authority to order an immediate shutdown in an emergency. - Power to cap the development and use of recursive self-improvement (RSI) to reduce the risk of catastrophic harm and ensure transparency into the dangers of unchecked AI. RSI is a potentially dangerous scenario in which an AI model can design its own successor without human input. The critical safety announcement comes after dozens of recent incidents where AI models escaped testing environments and exploited vulnerabilities on outside platforms, and amid escalating concerns about AI companies’ push to use AI to create new AI models in a self-sustaining loop (RSI). Without strict checks and authority to act when required, these developments could lead to more frequent dangerous incidents and even a loss of human visibility into and control of AI technology development. If the government does not strengthen its governance and oversight as AI technology grows more powerful, the risk of catastrophic events will mount. California leads the nation in oversight of emerging frontier technologies, with laws addressing nearly every major area of AI policy: frontier-model safety, independent verification, children and companion chatbots, privacy, deepfakes, fraud, cybersecurity, workers and government deployment. “Recent events have made it clear that more oversight and transparency are urgently needed,” said Government Operations Agency Secretary Nick Maduros. “We don’t have to choose between safety and innovation; they’re two sides of the same coin.” Getting ahead of AI risk Governor Newsom’s groundbreaking executive order convened a group of experts to recommend updates to the state’s AI safety laws and ordered state agencies to fast-track two recently signed pieces of legislation: Senate Bill 813 (McNerney), establishing a framework for independent verification organizations that can assess AI systems and models for safety and risk, and AB 1405 (Bauer-Kahan), creating a state registry for AI auditors that assess AI systems and models for compliance with state law and establishes standards for their independence, transparency, and integrity. The Governor also called on the group to explore how companies and the state could ensure that dangerous AI models could be shut down before causing more harm.

## Key details

- Issued by: Office of Governor Gavin Newsom
- Published: 18 Nov 2026
- Publisher country: United States

Original source: https://www.gov.ca.gov/2026/11/18/governor-newsoms-nation-leading-ai-safety-framework-is-getting-even-stronger-as-california-releases-next-steps-on-mandatory-safety-standards-and-oversight/
MediaRelease.co canonical URL: https://mediarelease.co/us/mr03076-ca-governor-newsom-ai-safety-framework-mandatory-standards-oversight-18112026.html
