Bill Analysis - SB-1047 Safe and Secure Innovation for Frontier Artificial Intelligence Models Act.

government

leginfo.legislature.ca.gov·leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml...

SB-1047 was the most prominent US state-level AI safety legislation attempt of 2024; its eventual veto by Governor Newsom and the surrounding debate are highly relevant to understanding the challenges of translating AI safety concerns into law.

Metadata

Importance: 72/100legislationprimary source

Summary

California SB-1047 was a landmark proposed state law requiring developers of large frontier AI models to implement safety protocols, conduct pre-deployment safety evaluations, and establish shutdown capabilities. The bill aimed to hold AI developers liable for harms caused by models exceeding certain compute thresholds. It passed the legislature but was vetoed by Governor Newsom in September 2024.

Key Points

•Would have required AI developers spending over $100M on training to implement safety and security protocols before deploying frontier models
•Mandated capability to shut down AI systems and required third-party safety audits and red-teaming evaluations
•Established liability for AI developers if their models caused mass casualties or critical infrastructure attacks
•Created a new state agency (CalCompute) and the position of Frontier Model Division within California's Department of Technology
•Sparked major debate between AI safety advocates (supporting) and many AI researchers/companies (opposing) about regulatory overreach vs. risk mitigation

Cited by 1 page

Page	Type	Quality
Safe and Secure Innovation for Frontier Artificial Intelligence Models Act	Policy	66.0

Cached Content Preview

HTTP 200Fetched Mar 20, 20266 KB

- [skip to content](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047#content_anchor)
- [home](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047#)
- [accessibility](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047#)
- [FAQ](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047#)
- [feedback](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047#)
- [sitemap](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047#)
- [login](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047#)
- x

[![Legislative Information header image: click to go to the home page](https://leginfo.legislature.ca.gov/resources/images/header_img.png)](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047#)

![Legislative Information header image](https://leginfo.legislature.ca.gov/resources/images/calegis_header_mobile.png)

[![home image: click to go to the home page](https://leginfo.legislature.ca.gov/resources/images/header_img_mobile_02.png)](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047#)[![Bill Search image: click to go to the bill search page](https://leginfo.legislature.ca.gov/resources/images/header_img_mobile_025.png)](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047#)[![back button image: click to go to previous page](https://leginfo.legislature.ca.gov/resources/images/header_img_mobile_03.png)](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047)

![magnifying glass image](https://leginfo.legislature.ca.gov/resources/images/mag_glass.png) Quick Search:

Bill NumberBill Keyword

- [Home](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047#)
- [Bill Information](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047#)
- [California Law](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047#)
- [Publications](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047#)
- [Other Resources](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047#)
- [My Subscriptions](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047#)
- [My Favorites](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047#)

# Bill Analysis

[Bill PDF](https://leginfo.legislature.ca.gov/faces/billPdf.xhtml?bill_id=202320240SB1047&version=20230SB104788ENR) \| [Add To My Favorites](https://leginfo.legislature.ca.gov/faces/billAnalysisClient.xhtml?bill_id=202320240SB1047#) \| Version:09/03/24 - Enrolled08/22/24 - Amended Assembly08/19/24 - Amende

... (truncated, 6 KB total)

Resource ID: c23b027e6fdf75dd | Stable ID: XE2klnK8vA