Artwork

Content provided by Daniel Filan. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Daniel Filan or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
Player FM - Podcast App
Go offline with the Player FM app!

46 - Tom Davidson on AI-enabled Coups

2:05:26
 
Share
 

Manage episode 498751694 series 2844728
Content provided by Daniel Filan. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Daniel Filan or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.

Could AI enable a small group to gain power over a large country, and lock in their power permanently? Often, people worried about catastrophic risks from AI have been concerned with misalignment risks. In this episode, Tom Davidson talks about a risk that could be comparably important: that of AI-enabled coups.

Patreon: https://www.patreon.com/axrpodcast

Ko-fi: https://ko-fi.com/axrpodcast

Transcript: https://axrp.net/episode/2025/08/07/episode-46-tom-davidson-ai-enabled-coups.html

Topics we discuss, and timestamps:

0:00:35 How to stage a coup without AI

0:16:17 Why AI might enable coups

0:33:29 How bad AI-enabled coups are

0:37:28 Executive coups with singularly loyal AIs

0:48:35 Executive coups with exclusive access to AI

0:54:41 Corporate AI-enabled coups

0:57:56 Secret loyalty and misalignment in corporate coups

1:11:39 Likelihood of different types of AI-enabled coups

1:25:52 How to prevent AI-enabled coups

1:33:43 Downsides of AIs loyal to the law

1:41:06 Cultural shifts vs individual action

1:45:53 Technical research to prevent AI-enabled coups

1:51:40 Non-technical research to prevent AI-enabled coups

1:58:17 Forethought

2:03:03 Following Tom's and Forethought's research

Links for Tom and Forethought:

Tom on X / Twitter: https://x.com/tomdavidsonx

Tom on LessWrong: https://www.lesswrong.com/users/tom-davidson-1

Forethought Substack: https://newsletter.forethought.org/

Will MacAskill on X / Twitter: https://x.com/willmacaskill

Will MacAskill on LessWrong: https://www.lesswrong.com/users/wdmacaskill

Research we discuss:

AI-Enabled Coups: How a Small Group Could Use AI to Seize Power: https://www.forethought.org/research/ai-enabled-coups-how-a-small-group-could-use-ai-to-seize-power

Seizing Power: The Strategic Logic of Military Coups, by Naunihal Singh: https://muse.jhu.edu/book/31450

Experiment using AI-generated posts on Reddit draws fire for ethics concerns: https://retractionwatch.com/2025/04/28/experiment-using-ai-generated-posts-on-reddit-draws-fire-for-ethics-concerns/

Episode art by Hamish Doodles: hamishdoodles.com

  continue reading

60 episodes

Artwork
iconShare
 
Manage episode 498751694 series 2844728
Content provided by Daniel Filan. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Daniel Filan or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.

Could AI enable a small group to gain power over a large country, and lock in their power permanently? Often, people worried about catastrophic risks from AI have been concerned with misalignment risks. In this episode, Tom Davidson talks about a risk that could be comparably important: that of AI-enabled coups.

Patreon: https://www.patreon.com/axrpodcast

Ko-fi: https://ko-fi.com/axrpodcast

Transcript: https://axrp.net/episode/2025/08/07/episode-46-tom-davidson-ai-enabled-coups.html

Topics we discuss, and timestamps:

0:00:35 How to stage a coup without AI

0:16:17 Why AI might enable coups

0:33:29 How bad AI-enabled coups are

0:37:28 Executive coups with singularly loyal AIs

0:48:35 Executive coups with exclusive access to AI

0:54:41 Corporate AI-enabled coups

0:57:56 Secret loyalty and misalignment in corporate coups

1:11:39 Likelihood of different types of AI-enabled coups

1:25:52 How to prevent AI-enabled coups

1:33:43 Downsides of AIs loyal to the law

1:41:06 Cultural shifts vs individual action

1:45:53 Technical research to prevent AI-enabled coups

1:51:40 Non-technical research to prevent AI-enabled coups

1:58:17 Forethought

2:03:03 Following Tom's and Forethought's research

Links for Tom and Forethought:

Tom on X / Twitter: https://x.com/tomdavidsonx

Tom on LessWrong: https://www.lesswrong.com/users/tom-davidson-1

Forethought Substack: https://newsletter.forethought.org/

Will MacAskill on X / Twitter: https://x.com/willmacaskill

Will MacAskill on LessWrong: https://www.lesswrong.com/users/wdmacaskill

Research we discuss:

AI-Enabled Coups: How a Small Group Could Use AI to Seize Power: https://www.forethought.org/research/ai-enabled-coups-how-a-small-group-could-use-ai-to-seize-power

Seizing Power: The Strategic Logic of Military Coups, by Naunihal Singh: https://muse.jhu.edu/book/31450

Experiment using AI-generated posts on Reddit draws fire for ethics concerns: https://retractionwatch.com/2025/04/28/experiment-using-ai-generated-posts-on-reddit-draws-fire-for-ethics-concerns/

Episode art by Hamish Doodles: hamishdoodles.com

  continue reading

60 episodes

All episodes

×
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Quick Reference Guide

Copyright 2025 | Privacy Policy | Terms of Service | | Copyright
Listen to this show while you explore
Play