AI Safety and Entrepreneurship v1.0 - EA Forum
blogCredibility Rating
Good quality. Reputable source with community review or editorial standards, but less rigorous than peer-reviewed venues.
Rating inherited from publication venue: EA Forum
Useful for researchers or practitioners considering founding AI safety organizations or startups; provides a starting point for navigating the ecosystem of EA-aligned entrepreneurship support, though the field evolves quickly so the linked Wiki page may be more current.
Forum Post Details
Metadata
Summary
A curated directory of resources, programs, and organizations supporting entrepreneurship in AI safety, covering incubation programs, venture capital, and community structures. It serves as a practical guide for founders looking to start or scale AI safety-focused companies, linking to a maintained Wiki page for ongoing updates.
Key Points
- •Compiles incubation programs and accelerators specifically oriented toward AI safety ventures and EA-aligned startups.
- •Lists safety-focused venture capital firms and funding sources available to AI safety entrepreneurs.
- •Covers community and organizational support structures for founders working on AI safety problems.
- •Links to a living Wiki page ensuring the directory remains current beyond the original post date.
- •Bridges the gap between AI safety research and commercial/organizational implementation pathways.
Cited by 1 page
| Page | Type | Quality |
|---|---|---|
| Lionheart Ventures | Organization | 50.0 |
Cached Content Preview
AI Safety & Entrepreneurship v1.0 — EA Forum
This website requires javascript to properly function. Consider activating javascript to get access to all site functionality. Hide table of contents AI Safety & Entrepreneurship v1.0
by Chris Leong Apr 26 2025 2 min read 0 28
AI safety Entrepreneurship AI safety resources and materials Frontpage AI Safety & Entrepreneurship v1.0 For the most up-to-date version, see the Wiki page. Articles: Incubation Programs: AIS Friendly General Program: Communities: VC: Organisational Support: Other: Dustbin - Things that previously existed No comments Why did I create both a post and a wiki article?
Posts are best for making sure people see the initial version of the post, whilst Wiki articles are best for long-term maintenance. Posting an article that links to a Wiki page provides the best of both worlds.
For the most up-to-date version, see the Wiki page .
Articles :
There should be more AI safety organisations
Why does the AI Safety Community need help founding projects?
AI Assurance Tech Report
AI Safety as a YC Startup
Alignment can be the ‘clean energy’ of AI
AI Tools for Existential Security
Incubation Programs:
Def/acc at Entrepreneur First - this is a new program, which focuses on "defensive" tech, which will produce a wide variety of startups, some of which may help with reducing x-risk, but others may include AI applications like autonomous weapons or diagnostic medical software, which, while they generally won't increase x-risk, may not reduce it either.
Catalyze - AI Safety Incubation
Seldon Accelerator : “We take on AGI risk with optimism”
AE Studio has expressed interest in helping seed neglected approaches, incl. ideas that take the form of business ideas
AIS Friendly General Program:
Founding to Give : General EA incubator
Entrepreneur First - They run def/acc, so this could be a decent alternative
Halycon Futures : “We’re an entrepreneurial nonprofit and VC fund dedicated to making AI safe, secure and good for humanity.” They do new project incubation, grants, investments, ect.
Communities :
Entrepreneurship Channel EA Anyway
AI Safety Founders: Website , Discord , LinkedIn
VC:
AI Safety Seed Funding Network
Lionheart Ventures - “We invest in the wise development of transformative technologies.”
Juniper Ventures - Invests in companies “working to make AI safe, secure and beneficial for humanity”. Published the AI Assurance Tech Report
Polaris Ventures - “We support projects and people aiming to build a future guided by wisdom and compassion for all”
Mythos Ventures - “an early-stage venture capital firm investing in prosocial technologies for the transformative AI era.”
Metaplanet - “We support novel and evidence-based innovation that could produce an outsized return for the benefit of humankind.”
Anthology Fund - Backed by Anthropic. One of the five key areas is “trust and safety tooling”
Menlo Ventures -
... (truncated, 4 KB total)fbacf42b48a538c9 | Stable ID: Njg2YTA3ZW