GovAI

Overview

The Centre for the Governance of AI (GovAI) is one of the most influential AI policy research organizations globally, combining rigorous research with direct policy engagement at the highest levels. Originally founded as part of the Future of Humanity InstituteOrganizationFuture of Humanity InstituteThe Future of Humanity Institute (2005-2024) was a pioneering Oxford research center that founded existential risk studies and AI alignment research, growing from 3 to ~50 researchers and receiving...Quality: 51/100 at Oxford, GovAI became an independent nonprofit in 2023 when FHI closed, and subsequently relocated to London in 2024 to enhance its policy engagement capabilities.

GovAI's theory of impact centers on producing foundational research that shapes how governments and industry approach AI governance, while simultaneously training the next generation of AI governance professionals. Their 2018 research agenda helped define the nascent field of AI governance, and their subsequent work on compute governance has become a cornerstone of regulatory thinking in the US, UK, and EU. The organization receives substantial support from Coefficient GivingOrganizationCoefficient GivingCoefficient Giving (formerly Open Philanthropy) has directed $4B+ in grants since 2014, including $336M to AI safety (~60% of external funding). The organization spent ~$50M on AI safety in 2024, w...Quality: 55/100, with grants totaling over $1.8 million in 2023-2024 alone.

The organization's influence extends beyond research: GovAI alumni now occupy key positions across the AI governance landscape—in frontier AI labs (Google DeepMindOrganizationGoogle DeepMindComprehensive overview of DeepMind's history, achievements (AlphaGo, AlphaFold with 200M+ protein structures), and 2023 merger with Google Brain. Documents racing dynamics with OpenAI and new Front...Quality: 37/100, OpenAIOrganizationOpenAIComprehensive organizational profile of OpenAI documenting evolution from 2015 non-profit to Public Benefit Corporation, with detailed analysis of governance crisis, 2024-2025 ownership restructuri...Quality: 62/100, AnthropicOrganizationAnthropicComprehensive reference page on Anthropic covering financials ($380B valuation, $14B ARR at Series G growing to $19B by March 2026), safety research (Constitutional AI, mechanistic interpretability...Quality: 74/100), major think tanks (CSETOrganizationGeorgetown CSETCSET is a $100M+ Georgetown center with 50+ staff conducting data-driven AI policy research, particularly on U.S.-China competition and export controls. The center conducts hundreds of annual gover...Quality: 43/100, RAND), and government positions in the US, UK, and EU. Perhaps most significantly, GovAI's Director of Policy Markus AnderljungPersonMarkus Anderljung currently serves as Vice-Chair of the EU's General-Purpose AI Code of Practice drafting process, directly shaping how the world's first comprehensive AI law will be implemented.

Organization Profile

Key Metrics

Research Areas

GovAI's research spans four interconnected domains, with particular depth in compute governance where they have produced foundational work cited by policymakers globally.

flowchart TD
  subgraph RESEARCH["Research Domains"]
      CG[Compute Governance]
      IC[International Coordination]
      FR[Frontier AI Regulation]
      FB[Field Building]
  end

  subgraph OUTPUTS["Policy Outputs"]
      FRAME[Governance Frameworks]
      STAND[Standards Development]
      TALENT[Trained Researchers]
  end

  subgraph IMPACT["Real-World Impact"]
      UKPOL[UK Policy]
      EUPOL[EU AI Act]
      USPOL[US Executive Order]
  end

  CG --> FRAME
  IC --> STAND
  FR --> FRAME
  FB --> TALENT

  FRAME --> UKPOL
  FRAME --> EUPOL
  STAND --> USPOL
  TALENT --> UKPOL
  TALENT --> EUPOL
  TALENT --> USPOL

  style RESEARCH fill:#e6f3ff
  style OUTPUTS fill:#fff3e6
  style IMPACT fill:#e6ffe6

Compute Governance

GovAI's signature contribution is the compute governance framework—the idea that computing power, unlike data or algorithms, is physical, measurable, and therefore governable. Their February 2024 paper "Computing Power and the Governance of AI" (Anderljung, Heim, et al.) has become the definitive reference, cited in policy discussions from Washington to Brussels.

Lennart HeimPersonLennart HeimCompute governance researcher. Affiliated with RAND, Epoch AI, and GovAI. Leading expert on AI compute supply chains and governance. Co-authored RAND working papers on hardware-enabled mechanisms (..., formerly GovAI's compute governance lead (now at RAND), regularly advises governments on implementation. His work demonstrates how compute provides a "governance surface"—a point where regulators can observe and influence AI development without requiring access to proprietary algorithms.

International Coordination

GovAI researches how nations can coordinate on AI governance despite competitive pressures. Their work on "AI Race Dynamics" examines why rational actors might collectively produce suboptimal outcomes, and what mechanisms might enable cooperation.

Frontier AI Regulation

Recent GovAI work focuses specifically on governing frontier AI—systems at or near the capability frontier that pose novel safety and security risks.

GovAI collaborated with UK AISI on safety case sketches for offensive cyber capabilities, demonstrating practical application of their theoretical frameworks.

Field Building

GovAI runs competitive fellowship programs that have trained 100+ AI governance researchers since 2018. The fellowship provides mentorship from leading experts and has become a primary talent pipeline for the field.

Key People

GovAI's leadership combines academic rigor with policy experience. Several former team members have moved to positions of significant influence.

Leadership Profiles

Alumni Placements

GovAI's impact extends through its alumni network, which now spans the AI governance ecosystem:

Key Publications

GovAI has published extensively in peer-reviewed venues and policy outlets. Their work is notable for bridging academic rigor with practical policy relevance.

Major Publications (2023-2025)

Publication Venues

GovAI researchers have published in leading journals and conferences:

Policy Influence

GovAI's influence operates through multiple channels: direct government advisory, regulatory participation, talent placement, and intellectual framework-setting.

Direct Policy Engagement (2024-2025)

Framework Influence

GovAI's conceptual frameworks have shaped regulatory thinking:

Comparison with Peer Organizations

GovAI is distinctive for combining research depth with direct regulatory participation—particularly through Anderljung's Vice-Chair role in EU AI Act implementation.

Funding

GovAI is primarily funded by Coefficient GivingOrganizationCoefficient GivingCoefficient Giving (formerly Open Philanthropy) has directed $4B+ in grants since 2014, including $336M to AI safety (~60% of external funding). The organization spent ~$50M on AI safety in 2024, w...Quality: 55/100, which has provided substantial support for AI governance work.

Strategic Assessment

Strengths

GovAI occupies a distinctive niche: producing rigorous, policy-relevant research while maintaining direct access to regulatory processes. Key strengths include:

1. Compute governance expertise: Arguably the leading research group on this topic globally
2. Talent pipeline: Fellowship program has trained significant portion of AI governance workforce
3. Policy access: Direct participation in EU AI Act implementation; alumni in key government roles
4. Academic credibility: Publications in top venues; Oxford affiliation (historical)

Limitations

1. Funding concentration: Heavy reliance on Coefficient GivingOrganizationCoefficient GivingCoefficient Giving (formerly Open Philanthropy) has directed $4B+ in grants since 2014, including $336M to AI safety (~60% of external funding). The organization spent ~$50M on AI safety in 2024, w...Quality: 55/100 creates potential vulnerability
2. Geographic focus: Primarily UK/US/EU; limited Global South engagement
3. Implementation gap: Research excellence doesn't always translate to implementation capacity
4. Scale constraints: Small team relative to policy influence ambitions

Key Uncertainties

Sources

• GovAI Homepage
• GovAI Annual Report 2024
• Coefficient Giving GovAI Grant 2024
• EU GPAI Code of Practice Chairs
• Ben Garfinkel GovAI Profile
• Markus Anderljung GovAI Profile
• Lennart Heim RAND Profile