AI Safety and Entrepreneurship v1.0 - EA Forum

blog

EA Forum·forum.effectivealtruism.org/posts/JpA7xWKhj5DYpaRpm/ai-sa...

Credibility Rating

3/5

Good(3)

Good quality. Reputable source with community review or editorial standards, but less rigorous than peer-reviewed venues.

Rating inherited from publication venue: EA Forum

Useful for researchers or practitioners considering founding AI safety organizations or startups; provides a starting point for navigating the ecosystem of EA-aligned entrepreneurship support, though the field evolves quickly so the linked Wiki page may be more current.

Forum Post Details

Karma

Comments

Forum

eaforum

Forum Tags

AI safetyEntrepreneurshipAI safety resources and materials

Metadata

Importance: 42/100blog postreference

Summary

A curated directory of resources, programs, and organizations supporting entrepreneurship in AI safety, covering incubation programs, venture capital, and community structures. It serves as a practical guide for founders looking to start or scale AI safety-focused companies, linking to a maintained Wiki page for ongoing updates.

Key Points

•Compiles incubation programs and accelerators specifically oriented toward AI safety ventures and EA-aligned startups.
•Lists safety-focused venture capital firms and funding sources available to AI safety entrepreneurs.
•Covers community and organizational support structures for founders working on AI safety problems.
•Links to a living Wiki page ensuring the directory remains current beyond the original post date.
•Bridges the gap between AI safety research and commercial/organizational implementation pathways.

Cited by 1 page

Page	Type	Quality
Lionheart Ventures	Organization	50.0

Cached Content Preview

HTTP 200Fetched Apr 10, 20265 KB

# AI Safety & Entrepreneurship v1.0
By Chris Leong
Published: 2025-04-26
+++ Why did I create both a post and a wiki article?

Posts are best for making sure people see the initial version of the post, whilst Wiki articles are best for long-term maintenance. Posting an article that links to a Wiki page provides the best of both worlds.




+++

### **For the most up-to-date version, see the** [**Wiki page**](https://www.lesswrong.com/w/ai-safety-and-entrepreneurship)**.**

### **Articles**:

[There should be more AI safety organisations](https://www.lesswrong.com/posts/MhudbfBNQcMxBBvj8/there-should-be-more-ai-safety-orgs)

[Why does the AI Safety Community need help founding projects?](https://www.lesswrong.com/posts/tPjAgWpsQrveFECWP/ryan-kidd-s-shortform?commentId=JDcp5AhWwk9ZCv59r)

[AI Assurance Tech Report](https://www.aiat.report/)

[AI Safety as a YC Startup](https://www.lesswrong.com/posts/QxJFjqT6oFY3jo47s/ai-safety-as-a-yc-startup-1)

[Alignment can be the ‘clean energy’ of AI](https://www.lesswrong.com/posts/irxuoCTKdufEdskSk/alignment-can-be-the-clean-energy-of-ai)

[AI Tools for Existential Security](https://forum.effectivealtruism.org/posts/6m6Q7jgB8iwXGYhXw/ai-tools-for-existential-security)

### **Incubation Programs:**

[Def/acc at Entrepreneur First](https://www.joinef.com/posts/introducing-def-acc-at-ef/) \- this is a new program, which focuses on "defensive" tech, which will produce a wide variety of startups, some of which may help with reducing x-risk, but others may include AI applications like autonomous weapons or diagnostic medical software, which, while they generally won't increase x-risk, may not reduce it either.

[Catalyze - AI Safety Incubation](https://www.catalyze-impact.org/apply)

[Seldon Accelerator](https://seldonaccelerator.com/): “We take on AGI risk with optimism”

[AE Studio](https://docs.google.com/forms/d/e/1FAIpQLSeU1_dZapdxH5SIooC3VK7nbnKSCZxxGG1JuqeNDpTOa22xbA/viewform) has expressed interest in helping seed neglected approaches, incl. ideas that take the form of business ideas

### **AIS Friendly General Program:**

[Founding to Give](https://forum.effectivealtruism.org/posts/q2PwXNsXsfDYkxeHb/aim-ce-new-program-founding-to-give-apply-now-to-launch-a): General EA incubator

[Entrepreneur First](https://www.joinef.com/) \- They run def/acc, so this could be a decent alternative

[Halycon Futures](https://halcyonfutures.org/): “We’re an entrepreneurial nonprofit and VC fund dedicated to making AI safe, secure and good for humanity.” They do new project incubation, grants, investments, ect.

### **Communities**:

[Entrepreneurship Channel EA Anyway](https://eavirtualmeetupgroup.slack.com/archives/C04T8LBDZUN)

AI Safety Founders: [Website](https://aisfounders.com/), [Discord](https://discord.gg/2dvYYxqXvS), [LinkedIn](https://www.linkedin.com/company/ai-safety-founders/)

### **VC:**

[AI Safety Seed Funding Network](https://forum.effectivealtruism.org/posts/oTuesHYxdXZm76d5k/ai-safety-seed-funding-ne

... (truncated, 5 KB total)

Resource ID: fbacf42b48a538c9 | Stable ID: sid_Fg2mJVdorZ