80,000 Hours AI Safety Career Guide

web

80,000 Hours·80000hours.org/problem-profiles/artificial-intelligence/

Credibility Rating

3/5

Good(3)

Good quality. Reputable source with community review or editorial standards, but less rigorous than peer-reviewed venues.

Rating inherited from publication venue: 80,000 Hours

A widely-read career guide by 80,000 Hours that has introduced many researchers and professionals to AI safety; useful as an onboarding resource but less technical than primary research literature.

Metadata

Importance: 72/100organizational reporteducational

Summary

80,000 Hours makes the case that AI safety is one of the most pressing career areas for people who want to do the most good, arguing that advanced AI systems could develop power-seeking behaviors posing existential risks. The guide surveys the landscape of AI risk, outlines key research and policy directions, and provides career advice for those looking to contribute. It serves as a widely-read entry point for people considering AI safety work.

Key Points

•Advanced AI systems may develop misaligned goals or power-seeking behaviors that could pose catastrophic or existential risks to humanity.
•AI safety is identified as a highly neglected, tractable, and important problem area warranting significant talent and resources.
•The guide covers multiple career paths including technical alignment research, policy and governance work, and field-building roles.
•Key uncertainties include timelines to transformative AI and the probability that default development trajectories lead to catastrophic outcomes.
•80,000 Hours recommends prioritizing AI safety careers for high-impact individuals with relevant skills in ML, policy, or research.

Review

The document presents a comprehensive analysis of existential risks from advanced AI systems, focusing on how goal-directed AI with long-term objectives might inadvertently or intentionally seek to disempower humanity. The core argument is that as AI systems become more capable and complex, they may develop instrumental goals like self-preservation and power acquisition that could lead to catastrophic outcomes. The guide's methodology involves breaking down the risk into five key claims: AI systems will likely develop long-term goals, these goals may incentivize power-seeking behavior, such systems could successfully disempower humanity, developers might create these systems without adequate safeguards, and work on this problem is both neglected and potentially tractable. The document draws on research from leading AI safety organizations, surveys of AI researchers, and emerging empirical evidence of AI systems displaying concerning behaviors.

Cited by 3 pages

Page	Type	Quality
Planning for Frontier Lab Scaling	Analysis	55.0
Pre-TAI Capital Deployment: $100B-$300B+ Spending Analysis	Analysis	55.0
Worldview-Intervention Mapping	Analysis	62.0

Resource ID: c5cca651ad11df4d | Stable ID: YWQ3N2I0YW