Navigating Transformative AI
Though advances in AI could benefit people enormously, we think they also pose serious risks from misuse, accidents, loss of control, and other problems.
-
570+grants made
About the Fund
Program Leads
-
Claire Zabel
Managing Director
-
Luke Muehlhauser
Managing Director
-
Peter Favaloro
Program Director
-
Ben Esche
Interim Program Director
In recent years, we’ve seen rapid progress in artificial intelligence. There’s a strong possibility that AI systems will soon outperform humans in nearly all cognitive domains.
We think AI could be the most important technological development in human history. If handled well, it could accelerate scientific discovery, improve health outcomes, and create unprecedented prosperity. If handled poorly, it could lead to catastrophic consequences: many experts think that risks from AI-related misuse, loss of control, or drastic societal change could endanger human civilization.
To reduce the risk of global catastrophe and help society prepare for major advances in AI, we support:
- Technical AI safety research aimed at making advanced AI systems more trustworthy, robust, controllable, and aligned
- AI governance and policy work to develop frameworks for safe, secure, and responsibly managed AI development
- Capacity building to grow and strengthen the field of researchers and practitioners working on these challenges
- New projects that we expect to be particularly impactful if timelines to transformative AI are short
A Call for Founders
Project Tailwind
We’re looking for exceptional people to engage seriously with the risks of transformative AI, and to launch the institutions that will help humanity navigate them. Our grantmakers have published a list of high-priority projects — but we expect the very best founders will have strong opinions on the best approach to reduce catastrophic AI risks, and we want to hear them.