Skip to Content
Coefficient Giving
Funds

Navigating Transformative AI

Though advances in AI could benefit people enormously, we think they also pose serious risks from misuse, accidents, loss of control, and other problems.

  • 440+
    grants made

Contents

About the Fund

Program Leads

Partners

Interested in providing funding within this space? Reach out to partnerwithus@coefficientgiving.org.

In recent years, we’ve seen rapid progress in artificial intelligence. There’s a strong possibility that AI systems will soon outperform humans in nearly all cognitive domains.

We think AI could be the most important technological development in human history. If handled well, it could accelerate scientific discovery, improve health outcomes, and create unprecedented prosperity. If handled poorly, it could lead to catastrophic consequences: many experts think that risks from AI-related misuse, loss of control, or drastic societal change could endanger human civilization.

To reduce the risk of global catastrophe and help society prepare for major advances in AI, we support:

  • Technical AI safety research aimed at making advanced AI systems more trustworthy, robust, controllable, and aligned
  • AI governance and policy work to develop frameworks for safe, secure, and responsibly managed AI development
  • Capacity building to grow and strengthen the field of researchers and practitioners working on these challenges
  • New projects that we expect to be particularly impactful if timelines to transformative AI are short

Funding Opportunities

  • Request for Proposals

    AI Governance

    This program provides support for projects that aim to improve the odds of humanity successfully navigating the risks of transformative AI. We are primarily seeking expressions of interest in the following areas: technical AI governance, policy development, strategic analysis and threat modeling, frontier company policy, international AI governance, and law.

    Learn more and apply

  • Request for Proposals

    Funding for Work That Builds Capacity To Address Risks From Transformative AI

    This program funds projects that build society’s capacity to navigate the risks of transformative AI. We’re especially interested in funding projects that help new talent pivot into the field, support existing talent (e.g. via events that help build professional networks), and contribute to the discourse about transformative AI and its possible benefits and risks.

    Learn more and apply

  • Request for Proposals

    Career Development and Transition Funding

    This program provides support — in the form of funding for graduate study, unpaid internships, independent study, career transition and exploration periods, and other activities — for individuals at any career stage who want to pursue careers that could help to reduce global catastrophic risks.

    Learn more and apply

  • Request for Proposals

    Technical AI Safety

    There are currently no open opportunities. If you need to contact our technical AI safety grantmakers between RFPs, you can do so at technicalaisafety@coefficientgiving.org.

Research & Updates

  • Our Approach to AI Safety and Security

    Our AI safety strategy has evolved significantly since 2015, moving from early field-building to a comprehensive three-pillar approach: improving visibility into AI capabilities through evaluations and forecasting, developing technical and policy safeguards against catastrophic risks, and building the talent pipeline and institutional capacity the field urgently needs.

  • AI Safety and Security Need More Funders

    Many experts predict that leading AI systems will become smarter-than-human in the next decade, but efforts to mitigate the risks remain profoundly underfunded.

  • Key Writings on AI Development From Our Staff

    This piece compiles some of the most notable writings on AI by current and former staff over the last decade. They are not intended to represent our “institutional view” on AI. No such view exists — our program staff, as well as our grantees, often disagree with each other.