AI Safety Newsletter

web

Center for AI Safety·newsletter.safe.ai/p/ai-safety-newsletter-35-voluntary

Credibility Rating

4/5

High(4)

High quality. Established institution or organization with editorial oversight and accountability.

Rating inherited from publication venue: Center for AI Safety

Published by the Center for AI Safety, this newsletter issue critiques voluntary industry commitments from the 2024 Seoul AI Summit and advocates for stronger mandatory AI governance measures.

Metadata

Importance: 52/100blog postcommentary

Summary

This newsletter issue analyzes the Frontier AI Safety Commitments agreed upon at the Seoul AI Summit, arguing that voluntary RSPs (Responsible Scaling Policies) are insufficient as a primary safety mechanism. It also covers a Senate AI Policy Roadmap and provides an overview of catastrophic AI risks.

Key Points

•16 major AI companies including Google, Meta, Microsoft, and OpenAI signed Frontier AI Safety Commitments at the Seoul AI Summit in 2024.
•These voluntary commitments amount to Responsible Scaling Policies (RSPs), which involve risk assessment, threshold-setting, and potential development halts.
•The newsletter argues RSPs are useful as part of 'defense in depth' but insufficient as the primary focus of AI safety political advocacy.
•The issue also discusses a US Senate AI Policy Roadmap and introduces an overview of catastrophic AI risks.
•Voluntary commitments lack enforcement mechanisms, making mandatory regulation a necessary complement to industry self-governance.

Cited by 2 pages

Page	Type	Quality
AI Policy Effectiveness	Analysis	64.0
International AI Safety Summit Series	Event	63.0

Cached Content Preview

HTTP 200Fetched Mar 20, 202622 KB

[![AI Safety Newsletter](https://substackcdn.com/image/fetch/$s_!lMPL!,w_40,h_40,c_fill,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F792eb55d-72ca-42c7-8cc3-3d15bfe74be7_382x382.png)](https://newsletter.safe.ai/)

# [AI Safety Newsletter](https://newsletter.safe.ai/)

SubscribeSign in

![User's avatar](https://substackcdn.com/image/fetch/$s_!yEoq!,w_64,h_64,c_fill,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F836d5bfe-7a25-4465-8b8b-220ce40e4179_5000x5000.png)

Discover more from AI Safety Newsletter

The latest news on AI Safety

Over 44,000 subscribers

Subscribe

By subscribing, you agree the publisher's [Terms of Service](https://newsletter.safe.ai/tos), Substack's [Terms of Use](https://substack.com/tos), and acknowledge its [Information Collection Notice](https://substack.com/ccpa#personal-data-collected) and [Privacy Policy](https://substack.com/privacy).

Already have an account? Sign in

# AI Safety Newsletter \#36: Voluntary Commitments are Insufficient

### Plus, a Senate AI Policy Roadmap, and Chapter 1: An Overview of Catastrophic Risks

[![Corin Katzke's avatar](https://substackcdn.com/image/fetch/$s_!Jgmn!,w_36,h_36,c_fill,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbca062bb-3cfc-4e20-8a7c-bf7431f6668e_1270x1270.png)](https://substack.com/@corinkatzke)[![Julius Simonelli's avatar](https://substackcdn.com/image/fetch/$s_!v_Ak!,w_36,h_36,c_fill,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F44f02d33-7fef-4256-9955-d03dc0b28c59_495x495.jpeg)](https://substack.com/@juliussimonelli)[![Dan Hendrycks's avatar](https://substackcdn.com/image/fetch/$s_!YeQv!,w_36,h_36,c_fill,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7d5f99e7-1ce6-425c-aa85-869fdc840998_2162x2162.jpeg)](https://substack.com/@mlsafety)

[Corin Katzke](https://substack.com/@corinkatzke), [Julius Simonelli](https://substack.com/@juliussimonelli), and [Dan Hendrycks](https://substack.com/@mlsafety)

May 30, 2024

10

2

Share

Welcome to the AI Safety Newsletter by the [Center for AI Safety](https://www.safe.ai/). We discuss developments in AI and AI safety. No technical background required.

Subscribe

# Voluntary Commitments are Insufficient

**AI companies agree to RSPs in Seoul.** Following the [second AI Global Summit](https://www.csis.org/analysis/ai-seoul-summit) held in Seoul, the UK and Republic of Korea governments announced that 16 major technology organizations, including Amazon, Google, Meta, Microsoft, OpenAI, and xAI have agreed to a new set of [Frontier AI Safety Commitments](https://www.gov.uk/government/publications/frontier-ai-safety-commitments-ai-seoul-summit-2024/frontier-ai-safety-commitments-ai-seoul-summit-2024).

Some commitments

... (truncated, 22 KB total)

Resource ID: 2f90f810999eda1b | Stable ID: MDEyNzgxZD