Convergence 2024 Impact Review

Impact overview

2024 marked the first full year with the new Convergence Analysis 9-person team. This year we published 20 articles on understanding and governing transformative AI. Our research impacted regulatory frameworks internationally. In the US we provided consultation to the Bureau of Industry and Security that directly informed their proposed rule on reporting requirements for dual-use AI, while in the EU we saw specific recommendations incorporated into the EU AI Act GPAI Code of Practice. We led expert field-building around AI’s economic impacts through the Threshold 2030 conference, and AI scenario modeling via the AI Scenarios Network. Our work reached mainstream media, universities, and over 184,000 viewers on social platforms.

We organized our activities into three programs: AI Clarity, AI Governance, and AI Awareness.

1.  AI Clarity: performing AI Scenario Planning

   • Published over 170 pages of AI Clarity research across 10 articles and reports.

   • Hosted the Threshold 2030 Conference together with Metaculus and FLI, convening 25 senior experts from frontier AI labs, intergovernmental organisations, academia and leading AI safety research organisations to evaluate economic impacts of short AI timelines.

   • Developed the AI Scenarios Network of 30+ experts, the first cross-organizational coalition of AI Scenario researchers.

2. AI Governance: producing concrete AI policy recommendations

   • Published over 300 pages of AI Governance research across 9 articles and reports.

   • Published the The Oxford Handbook of AI Governance. This work is an anthology of 49 chapters from 75 leading contributors including Anthony Aguirre, Allan Dafoe, Ben Garfinkel & Justin Bullock.

   • Consulted for EU AI Act’s GPAI Code of Practice, with recommendations and language incorporated directly into the Code.

   • Consulted on BIS’ proposed rule for reporting requirements for dual-use AI models.

   • Consulted and directly referenced for TFS AI Action Summit Consultation Report.

   • Works featured in reading lists and courses at the US AI Safety Institute, Bluedot Impact and the Harvard AI Student Team.

3. AI Awareness: raising public awareness of AI risks

   • Authored Building a God, a general-audience book by Christopher DiCarlo addressing key AI issues. Published January 2025.

   • Featured in ten major media outlets and educational platforms, including: Politico, Forbes & CBS towards the end of 2024 and early 2025.

   • AI Awareness content was viewed over 184 000 times on TikTok.

   • Led two introductory courses on AI ethics in collaboration with Toronto Metropolitan University/Life Institute, and held numerous general-audience lectures on ‘AI and the Future of Humanity’.

   • Created and hosted 23 episodes of All Thinks Considered, with interviewees including Steven Pinker, Peter Singer and important AI safety researchers such as Steve Omohundro and Robert Trager.