Skip to content
Longterm Wiki

Open Philanthropy: FAR AI – AI Safety Research and Field Building Grant

web

Credibility Rating

4/5
High(4)

High quality. Established institution or organization with editorial oversight and accountability.

Rating inherited from publication venue: Coefficient Giving

This is Open Philanthropy's grant page for FAR AI, a technical AI safety research organization, reflecting Open Philanthropy's broader Navigating Transformative AI funding program which supports safety research, governance, and capacity building.

Metadata

Importance: 42/100homepage

Summary

This page documents Open Philanthropy's grant to FAR AI for AI safety research and field building, situated within their broader Navigating Transformative AI program. The program funds technical AI safety research, AI governance and policy work, and capacity building efforts. It also describes several funding opportunities including governance RFPs, capacity building, career development, and the Navigators Incubator.

Key Points

  • Open Philanthropy has made 480+ grants under its Navigating Transformative AI program supporting safety research, governance, and capacity building.
  • FAR AI receives funding for AI safety research and field building as part of this broader initiative.
  • The program supports technical AI safety research aimed at making AI systems more trustworthy, robust, controllable, and aligned.
  • Funding opportunities include AI governance RFPs, capacity building, career development, and the Navigators Incubator for AI security leadership.
  • Open Philanthropy views AI as potentially the most important technological development in history, with both enormous benefits and catastrophic risks.

Cited by 1 page

PageTypeQuality
FAR AIOrganization76.0

Cached Content Preview

HTTP 200Fetched May 11, 20266 KB
Navigating Transformative AI

 
 Though advances in AI could benefit people enormously, we think they also pose serious risks from misuse, accidents, loss of control, and other problems. 

 
 
 
 
 
 
 
 480+ 
 grants made 
 

 
 
 
 
 
 Contents

 
 About the Fund 

 Funding Opportunities 

 Research & Updates 

 Featured Grants 

 
 
 
 
 
 
 
 
 
 
 

 About the Fund

 
 
 

 Program Leads

 
 
 
 
 
 
 
 
 
 Claire Zabel 
 Managing Director

 
 

 
 
 
 
 
 
 
 Luke Muehlhauser 
 Managing Director

 
 

 
 
 
 
 
 
 
 Peter Favaloro 
 Program Director

 
 

 
 
 
 
 
 
 
 Eli Rose 
 Program Director

 
 

 
 
 
 

 Partners

 
 
 
 
 Good Ventures 

 
 Interested in providing funding within this space? Reach out to partnerwithus@coefficientgiving.org .

 

 
 
 
 

 
 In recent years, we’ve seen rapid progress in artificial intelligence. There’s a strong possibility that AI systems will soon outperform humans in nearly all cognitive domains. 

 We think AI could be the most important technological development in human history. If handled well, it could accelerate scientific discovery , improve health outcomes , and create unprecedented prosperity . If handled poorly, it could lead to catastrophic consequences: many experts think that risks from AI-related misuse, loss of control, or drastic societal change could endanger human civilization. 

 To reduce the risk of global catastrophe and help society prepare for major advances in AI, we support: 

 
 Technical AI safety research aimed at making advanced AI systems more trustworthy, robust, controllable, and aligned 

 AI governance and policy work to develop frameworks for safe, secure, and responsibly managed AI development 

 Capacity building to grow and strengthen the field of researchers and practitioners working on these challenges

 New projects  that we expect to be particularly impactful if timelines to transformative AI are short
 
 
 
 
 
 
 
 
 
 
 
 

 

 

 
 

 
 
 
 
 
 Funding Opportunities

 
 
 Prev 
 
 
 Next 
 
 
 

 
 
 

 
 
 Request for Proposals

 
 
 
 
 AI Governance
 
 
 
 

 
 
 

 
 This program provides support for projects that aim to improve the odds of humanity successfully navigating the risks of transformative AI. We are primarily seeking expressions of interest in the following areas: technical AI governance, policy development, strategic analysis and threat modeling, frontier company policy, international AI governance, and law.

 
 

 
 Learn more and apply
 
 

 

 
 
 

 

 
 
 Request for Proposals

 
 
 
 
 Capacity Building
 
 
 
 

 
 
 

 
 This program funds projects that build society’s capacity to navigate the risks of transformative AI. We’re especially interested in funding projects that help new talent pivot into the field, support existing talent (e.g. via events that help build professional networks), and contribute to the discourse about transformative AI and its possible benefits and risks.

 
 

 
 Learn more and apply
 
 

 

 
 

... (truncated, 6 KB total)
Resource ID: 1f26f6db092c1223 | Stable ID: sid_vIsMinYHCA