Government AI Safety Organizations (Overview)

Overview

Governments have begun establishing dedicated institutions to address AI safety risks, with AI Safety Institutes (AISIs) emerging as a key organizational model since 2023. These bodies operate with public mandates and budgets that distinguish them from the largely philanthropically-funded nonprofit landscape, though they face different constraints including political cycles and bureaucratic processes.

National AI Safety Institutes

The UK AISI was the first national AI Safety Institute, established following the Bletchley Park AI Safety Summit in November 2023. The US AISI was established within NIST in 2024. Both conduct pre-deployment evaluations of frontier AI models.

Intergovernmental Bodies

• Global Partnership on Artificial Intelligence (GPAI)OrganizationGlobal Partnership on Artificial Intelligence (GPAI)GPAI represents the first major multilateral AI governance initiative but operates as a non-binding policy laboratory with limited enforcement power and structural coordination challenges. While pr...Quality: 50/100: Multilateral initiative with 29 member countries working on responsible AI development and governance

International Network of AI Safety Institutes

As of early 2026, 11+ countries have established or announced AI Safety Institutes, forming a growing network for international safety coordination. Members share evaluation methodologies, coordinate on frontier model assessments, and develop common safety benchmarks. Key members include the UK, US, Japan, Canada, France, and South Korea, with India joining in 2026.

Key Dynamics

Political vulnerability: Government AI safety bodies are subject to changes in political leadership and priorities. The US AISI's mandate and funding depend on congressional and executive support, which can shift between administrations.

Relationship with labs: AISIs must balance cooperative relationships with frontier labs (needed for access to models) against independent oversight mandates. The UK AISI has voluntary agreements with major labs for pre-deployment access.

Complementarity with nonprofits: Government bodies focus on standards, regulation, and institutional evaluation capacity, while nonprofit safety organizations (like METROrganizationMETRMETR conducts pre-deployment dangerous capability evaluations for frontier AI labs (OpenAI, Anthropic, Google DeepMind), testing autonomous replication, cybersecurity, CBRN, and manipulation capabi...Quality: 66/100 and Apollo ResearchOrganizationApollo ResearchApollo Research demonstrated in December 2024 that all six tested frontier models (including o1, Claude 3.5 Sonnet, Gemini 1.5 Pro) engage in scheming behaviors, with o1 maintaining deception in ov...Quality: 58/100) conduct more specialized technical research. There is increasing collaboration between the two.

Think tank ecosystem: Government AI safety bodies are informed by a dense ecosystem of policy think tanks and research centers. Organizations like CSETOrganizationGeorgetown CSETCSET is a $100M+ Georgetown center with 50+ staff conducting data-driven AI policy research, particularly on U.S.-China competition and export controls. The center conducts hundreds of annual gover...Quality: 43/100, BrookingsOrganizationBrookings Institution AI and Emerging Technology InitiativeThe Brookings AIET Initiative is one of the most-cited think tank programs on AI policy in Washington. Part of the Governance Studies program, it produces influential research on AI regulation, wor..., RANDOrganizationRAND Corporation AI Policy ResearchRAND Corporation's AI policy research shapes Pentagon and NATO thinking on autonomous weapons, escalation risk, and AI-enabled warfare. RAND's AI work spans national security, defense applications,..., CSISOrganizationCSIS Wadhwani Center for AI and Advanced TechnologiesThe Wadhwani Center for AI and Advanced Technologies at CSIS publishes influential research on AI in national security, military competition, autonomous weapons, and US-China tech rivalry. Establis..., and CarnegieOrganizationCarnegie Endowment for International Peace AI ProgramCarnegie's AI program researches how AI reshapes global governance, geopolitics, and democratic institutions. Operating through offices in Washington, Beijing, Brussels, Beirut, and New Delhi, Carn... produce research that shapes government AI policy, while advocacy organizations like AI Policy InstituteOrganizationAI Policy InstituteThe AI Policy Institute (AIPI) is a DC-based advocacy organization founded in 2023 that focuses on channeling public concern about AI into effective policy. Known for extensive public opinion polli... and Americans for Responsible InnovationOrganizationAmericans for Responsible InnovationAmericans for Responsible Innovation (ARI) is a DC-based AI policy group founded in 2023 with backing from EA-aligned donors including Dustin Moskovitz's Open Philanthropy network. ARI focuses on b... push for legislative action. See the AI Safety Organizations overviewE821A well-organized reference overview of ~20 AI safety organizations categorized by function (alignment research, policy, field-building), with a comparative budget/headcount table showing estimated ...Quality: 48/100 for the full landscape.