Open Philanthropy: Navigating Transformative AI — Grant Program Overview
webCredibility Rating
4/5
High(4)High quality. Established institution or organization with editorial oversight and accountability.
Rating inherited from publication venue: Coefficient Giving
This is Open Philanthropy's grant page for the Future of Life Institute's AI risk reduction work, representing a major funding stream for AI safety research, governance, and capacity building.
Metadata
Importance: 52/100homepage
Summary
This page describes Open Philanthropy's 'Navigating Transformative AI' funding program, which has made 480+ grants supporting technical AI safety research, AI governance and policy, and capacity building. The program aims to reduce catastrophic risks from advanced AI systems through targeted funding across multiple focus areas.
Key Points
- •Open Philanthropy has made 480+ grants to reduce risks from transformative AI, including misuse, loss of control, and drastic societal change.
- •Funding priorities include technical AI safety, AI governance/policy, capacity building, and new high-impact projects given short AI timelines.
- •The Navigators Incubator provides salary, research funding, and mentorship for individuals tackling AI security challenges.
- •Career development and transition funding supports individuals at any stage pursuing work on global catastrophic risk reduction.
- •Program is led by Claire Zabel and Luke Muehlhauser, with Good Ventures as a key funding partner.
Cited by 1 page
| Page | Type | Quality |
|---|---|---|
| Future of Life Institute (FLI) | Organization | 46.0 |
Cached Content Preview
HTTP 200Fetched May 18, 20266 KB
Navigating Transformative AI
Though advances in AI could benefit people enormously, we think they also pose serious risks from misuse, accidents, loss of control, and other problems.
480+
grants made
Contents
About the Fund
Funding Opportunities
Research & Updates
Featured Grants
About the Fund
Program Leads
Claire Zabel
Managing Director
Luke Muehlhauser
Managing Director
Peter Favaloro
Program Director
Eli Rose
Program Director
Partners
Good Ventures
Interested in providing funding within this space? Reach out to partnerwithus@coefficientgiving.org .
In recent years, we’ve seen rapid progress in artificial intelligence. There’s a strong possibility that AI systems will soon outperform humans in nearly all cognitive domains.
We think AI could be the most important technological development in human history. If handled well, it could accelerate scientific discovery , improve health outcomes , and create unprecedented prosperity . If handled poorly, it could lead to catastrophic consequences: many experts think that risks from AI-related misuse, loss of control, or drastic societal change could endanger human civilization.
To reduce the risk of global catastrophe and help society prepare for major advances in AI, we support:
Technical AI safety research aimed at making advanced AI systems more trustworthy, robust, controllable, and aligned
AI governance and policy work to develop frameworks for safe, secure, and responsibly managed AI development
Capacity building to grow and strengthen the field of researchers and practitioners working on these challenges
New projects that we expect to be particularly impactful if timelines to transformative AI are short
Funding Opportunities
Prev
Next
Request for Proposals
AI Governance
This program provides support for projects that aim to improve the odds of humanity successfully navigating the risks of transformative AI. We are primarily seeking expressions of interest in the following areas: technical AI governance, policy development, strategic analysis and threat modeling, frontier company policy, international AI governance, and law.
Learn more and apply
Request for Proposals
Capacity Building
This program funds projects that build society’s capacity to navigate the risks of transformative AI. We’re especially interested in funding projects that help new talent pivot into the field, support existing talent (e.g. via events that help build professional networks), and contribute to the discourse about transformative AI and its possible benefits and risks.
Learn more and apply
... (truncated, 6 KB total)Resource ID:
87bbe167b38d2487 | Stable ID: sid_pjxRxSrsSA