The Manhattan Trap:

Why a Race to Artificial Superintelligence is Self-Defeating

By

Corin Katzke

, Gideon Futerman

January 17, 2025

This paper examines the strategic dynamics of international competition to develop Artificial Superintelligence (ASI).

Authors

Corin Katzke

Scenario Researcher

Gideon Futerman

University of Oxford

Originally Published

January 17, 2025

Citation

Katzke, Corin and Futerman, Gideon, The Manhattan Trap: Why a Race to Artificial Superintelligence is Self-Defeating (December 21, 2024). Available at SSRN: https://ssrn.com/abstract=5067833

Abstract

This paper examines the strategic dynamics of international competition to develop Artificial Superintelligence (ASI). We argue that the same assumptions that might motivate the US to race to develop ASI also imply that such a race is extremely dangerous. These assumptions—that ASI would provide a decisive military advantage and that states are rational actors prioritizing survival—imply that a race would heighten three critical risks: great power conflict, loss of control of ASI systems, and the undermining of liberal democracy. Our analysis shows that ASI presents a trust dilemma rather than a prisoner's dilemma, suggesting that international cooperation to control ASI development is both preferable and strategically sound. We conclude that cooperation is achievable.

Report Link

Report Link

Report Link

Download the full PDF of the report

Download the full PDF of the report

Newsletter

Newsletter

Newsletter

Get research updates from Convergence

Leave us your contact info and we’ll share our latest research, partnerships, and projects as they're released.

You may opt out at any time. View our Privacy Policy.