Skip to content
Longterm Wiki
Back

AI Safety and Entrepreneurship v1.0 - EA Forum

blog

Credibility Rating

3/5
Good(3)

Good quality. Reputable source with community review or editorial standards, but less rigorous than peer-reviewed venues.

Rating inherited from publication venue: EA Forum

Useful for researchers or practitioners considering founding AI safety organizations or startups; provides a starting point for navigating the ecosystem of EA-aligned entrepreneurship support, though the field evolves quickly so the linked Wiki page may be more current.

Forum Post Details

Karma
28
Comments
0
Forum
eaforum
Forum Tags
AI safetyEntrepreneurshipAI safety resources and materials

Metadata

Importance: 42/100blog postreference

Summary

A curated directory of resources, programs, and organizations supporting entrepreneurship in AI safety, covering incubation programs, venture capital, and community structures. It serves as a practical guide for founders looking to start or scale AI safety-focused companies, linking to a maintained Wiki page for ongoing updates.

Key Points

  • Compiles incubation programs and accelerators specifically oriented toward AI safety ventures and EA-aligned startups.
  • Lists safety-focused venture capital firms and funding sources available to AI safety entrepreneurs.
  • Covers community and organizational support structures for founders working on AI safety problems.
  • Links to a living Wiki page ensuring the directory remains current beyond the original post date.
  • Bridges the gap between AI safety research and commercial/organizational implementation pathways.

Cited by 1 page

PageTypeQuality
Lionheart VenturesOrganization50.0

Cached Content Preview

HTTP 200Fetched Mar 15, 20264 KB
AI Safety & Entrepreneurship v1.0 — EA Forum 
 
 This website requires javascript to properly function. Consider activating javascript to get access to all site functionality. Hide table of contents AI Safety & Entrepreneurship v1.0 

 by Chris Leong Apr 26 2025 2 min read 0 28

 AI safety Entrepreneurship AI safety resources and materials Frontpage AI Safety & Entrepreneurship v1.0 For the most up-to-date version, see the Wiki page. Articles: Incubation Programs: AIS Friendly General Program: Communities: VC: Organisational Support: Other: Dustbin - Things that previously existed No comments Why did I create both a post and a wiki article?

 Posts are best for making sure people see the initial version of the post, whilst Wiki articles are best for long-term maintenance. Posting an article that links to a Wiki page provides the best of both worlds.

 For the most up-to-date version, see the Wiki page . 

 Articles :

 There should be more AI safety organisations 

 Why does the AI Safety Community need help founding projects? 

 AI Assurance Tech Report 

 AI Safety as a YC Startup 

 Alignment can be the ‘clean energy’ of AI 

 AI Tools for Existential Security 

 Incubation Programs: 

 Def/acc at Entrepreneur First - this is a new program, which focuses on "defensive" tech, which will produce a wide variety of startups, some of which may help with reducing x-risk, but others may include AI applications like autonomous weapons or diagnostic medical software, which, while they generally won't increase x-risk, may not reduce it either.

 Catalyze - AI Safety Incubation 

 Seldon Accelerator : “We take on AGI risk with optimism”

 AE Studio has expressed interest in helping seed neglected approaches, incl. ideas that take the form of business ideas

 AIS Friendly General Program: 

 Founding to Give : General EA incubator

 Entrepreneur First - They run def/acc, so this could be a decent alternative

 Halycon Futures : “We’re an entrepreneurial nonprofit and VC fund dedicated to making AI safe, secure and good for humanity.” They do new project incubation, grants, investments, ect.

 Communities :

 Entrepreneurship Channel EA Anyway 

 AI Safety Founders:  Website ,  Discord ,  LinkedIn 

 VC: 

 AI Safety Seed Funding Network 

 Lionheart Ventures - “We invest in the wise development of transformative technologies.”

 Juniper Ventures - Invests in companies “working to make AI safe, secure and beneficial for humanity”. Published the AI Assurance Tech Report

 Polaris Ventures - “We support projects and people aiming to build a future guided by wisdom and compassion for all”

 Mythos Ventures - “an early-stage venture capital firm investing in prosocial technologies for the transformative AI era.”

 Metaplanet - “We support novel and evidence-based innovation that could produce an outsized return for the benefit of humankind.”

 Anthology Fund - Backed by Anthropic. One of the five key areas is “trust and safety tooling”

 Menlo Ventures - 

... (truncated, 4 KB total)
Resource ID: fbacf42b48a538c9 | Stable ID: Njg2YTA3ZW