77 subscribers
Go offline with the Player FM app!
Podcasts Worth a Listen
SPONSORED


Helen Toner: OpenAI Reflections, Adaptation Buffers, and AI in Warfare
Manage episode 477400091 series 3452589
In this thought-provoking conversation, Helen Toner, Director of Strategy at the Center for Security and Emerging Technology (CSET), discusses her perspectives on AI development, regulation, and international competition. Toner shares insights from her time on OpenAI's board, clarifying that reports about a "Q*" breakthrough influencing the board's decision were "totally false." She introduces her concept of "adaptation buffers"—critical windows of time between when AI capabilities are first demonstrated and when they become widely accessible—arguing that society needs this time to build resilience against potential misuse. Toner also explores the challenges of implementing effective AI governance, military applications of AI decision support systems, and the complex dynamics of US-China relations in the emerging AI landscape.
Helen Toner's appearance on the TED AI show: https://www.ted.com/talks/the_ted_ai_show_what_really_went_down_at_openai_and_the_future_of_regulation_w_helen_toner
Helen Toner's substack : https://helentoner.substack.com/
Additional recommended reads:
https://helentoner.substack.com/p/nonproliferation-is-the-wrong-approach
https://cset.georgetown.edu/publication/ai-for-military-decision-making/
SPONSORS:
Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive
Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive
NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive
PRODUCED BY:
CHAPTERS:
(00:00) Teaser
(06:04) Introduction and Background
(09:32) AI Timeline Perspectives
(12:26) OpenAI Board Experience
(17:04) OpenAI Culture Discussion (Part 1)
(19:20) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify
(20:33) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify
(22:30) OpenAI Culture Discussion (Part 2)
(24:03) OpenAI's Contradictory Messaging
(26:15) Whistleblowing in AI
(31:30) AI Transparency Requirements (Part 1)
(36:30) Sponsors: NetSuite
(37:58) AI Transparency Requirements (Part 2)
(38:38) Adaptation Buffers Concept
(44:06) Technical vs. Societal Solutions
(52:13) AI Regulation Approaches
(57:20) Iterative Deployment Challenges
(01:05:50) US-China AI Competition
(01:14:54) Military Decision Support Systems
(01:20:57) Future AI Military Equilibrium
(01:27:39) Outro
241 episodes
Helen Toner: OpenAI Reflections, Adaptation Buffers, and AI in Warfare
"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
Manage episode 477400091 series 3452589
In this thought-provoking conversation, Helen Toner, Director of Strategy at the Center for Security and Emerging Technology (CSET), discusses her perspectives on AI development, regulation, and international competition. Toner shares insights from her time on OpenAI's board, clarifying that reports about a "Q*" breakthrough influencing the board's decision were "totally false." She introduces her concept of "adaptation buffers"—critical windows of time between when AI capabilities are first demonstrated and when they become widely accessible—arguing that society needs this time to build resilience against potential misuse. Toner also explores the challenges of implementing effective AI governance, military applications of AI decision support systems, and the complex dynamics of US-China relations in the emerging AI landscape.
Helen Toner's appearance on the TED AI show: https://www.ted.com/talks/the_ted_ai_show_what_really_went_down_at_openai_and_the_future_of_regulation_w_helen_toner
Helen Toner's substack : https://helentoner.substack.com/
Additional recommended reads:
https://helentoner.substack.com/p/nonproliferation-is-the-wrong-approach
https://cset.georgetown.edu/publication/ai-for-military-decision-making/
SPONSORS:
Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive
Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive
NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive
PRODUCED BY:
CHAPTERS:
(00:00) Teaser
(06:04) Introduction and Background
(09:32) AI Timeline Perspectives
(12:26) OpenAI Board Experience
(17:04) OpenAI Culture Discussion (Part 1)
(19:20) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify
(20:33) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify
(22:30) OpenAI Culture Discussion (Part 2)
(24:03) OpenAI's Contradictory Messaging
(26:15) Whistleblowing in AI
(31:30) AI Transparency Requirements (Part 1)
(36:30) Sponsors: NetSuite
(37:58) AI Transparency Requirements (Part 2)
(38:38) Adaptation Buffers Concept
(44:06) Technical vs. Societal Solutions
(52:13) AI Regulation Approaches
(57:20) Iterative Deployment Challenges
(01:05:50) US-China AI Competition
(01:14:54) Military Decision Support Systems
(01:20:57) Future AI Military Equilibrium
(01:27:39) Outro
241 episodes
All episodes
×
1 Blueprint for AI Armageddon: Josh Clymer Imagines AI Takeover, from the Audio Tokens Podcast 2:02:05

1 Fiverr Goes All-In on AI: Empowering Creators, Not Replacing Them, with Micha Kaufman, CEO of Fiverr 1:43:05

1 Securing Superintelligence: National Security, Espionage & AI Control with Jeremie & Edouard Harris 2:09:51

1 Is OpenAI's o3 AGI? Zvi Mowshowitz on Early AI Takeoff, the Mechanize launch, Live Players, & Why p(doom) is Rising 3:08:19

1 AI News Crossover: A Candid Chat with Liron Shapira of Doom Debates 2:29:35

1 Helen Toner: OpenAI Reflections, Adaptation Buffers, and AI in Warfare 1:29:35

1 Is a US-China Thucydides Trap Unavoidable? With David C. Kang from the ChinaTalk Podcast 1:39:16

1 New in Nature: Google Agents Beat Human Doctors, Make Scientific Discoveries – With Vivek Natarajan and Anil Palepu 1:27:57

1 Scaling "Thinking": Gemini 2.5 Tech Lead Jack Rae on Reasoning, Long Context, & the Path to AGI 1:16:28

1 Reward Hacking by Reasoning Models & Loss of Control Scenarios w/ Jeffrey Ladish of Palisade Research, from FLI Podcast 1:32:17

1 Shortwave Rides the Tidal Wave: Inbox Agents, Hyper-Growth & Hiring AI Managers, with CEO Andrew Lee 1:51:39

1 Code Context is King: Augment’s AI Assistant for Professional Software Engineers, with Guy Gur-Ari 1:25:44

1 Unlocking Cells' Secrets: Diffusion, Deconvolution, & Discovery with Siyu He, author of Squidiff & CORAL 1:46:17

1 a16z on AI Voices: Call Centers, Coaches, and Companions with Olivia Moore & Anish Acharya 1:07:35

1 Agency over AI? Allan Dafoe on Technological Determinism & DeepMind's Safety Plans, from 80000 Hours 3:02:28

1 Material Progress: Developing AI's Scientific Intuition, with Orbital Materials' Jonathan Godwin & Tim Duignan 1:40:50

1 Dodging Latent Space Detectors: Obfuscated Activation Attacks with Luke, Erik, and Scott. 2:10:23

1 Gene Hunting with o1-pro: Reasoning about Rare Diseases with ChatGPT Pro Grantee Dr. Catherine Brownstein 1:33:29

1 AI AMA – Part 2: AI Utopia, Consciousness, and the Future of Work 2:01:36

1 AI AMA – Part 1: OpenAI’s o3, Deliberative Alignment, and AI Surprises of 2024 2:06:57

1 Teaching AI to See: A Technical Deep-Dive on Vision Language Models with Will Hardman of Veratai 3:56:09

1 roon's Heroic Duty: Will "the Good Guys" Build AGI First? (from Doom Debates) 1:57:58

1 Emad Mostaque on the Intelligent Internet and Universal Basic AI 2:11:52

1 Can AIs do AI R&D? Reviewing REBench Results with Neev Parikh of METR 1:47:58

1 Breakthroughs in AI for Biology: AI Lab Groups & Protein Model Interpretability with Prof James Zou 1:02:49

1 Scouting Frontiers in AI for Biology: Dynamics, Diffusion, and Design, with Amelie Schreiber 1:47:28

1 Building Government's Largest Civilian AI Team with DHS AI Corps' Director, Michael Boyce 1:30:11

1 Emergency Pod: o1 Schemes Against Users, with Alexander Meinke from Apollo Research 2:06:52

1 Automating Scientific Discovery, with Andrew White, Head of Science at Future House 1:58:32

1 The Evolution of AI Agents: Lessons from 2024, with MultiOn CEO Div Garg 1:30:21

1 China's Tech Tightrope: Power, Regulation, and the AI Race with Angela Zhang 1:31:56

1 Historic AI Developments & the Emerging Shape of Superintelligence, from the Consistently Candid Podcast 1:57:36

1 Frontier Models for Frontier Science with Professor Derya Unutmaz, Immunologist & ChatGPT Pro Grantee 1:32:34

1 US-China Relations: History, Culture, and AI Competition, with Noah Smith, from Econ 102 1:09:49

1 The Adversarial Mind: Defeating AI Defenses with Nicholas Carlini of Google DeepMind 2:34:38

1 New Jersey’s AI Moonshot: Governor Phil Murphy on Partnerships, Progress, and Preparedness 55:54

1 Inference Scaling, Alignment Faking, Deal Making? Frontier Research with Ryan Greenblatt of Redwood Research 3:21:07

1 An Application-Free Future? Speaking Directly to Data with illumex CEO Inna Tokarev Sela 1:31:26

1 Claude Cooperates! Exploring Cultural Evolution in LLM Societies, with Aron Vallinder & Edward Hughes 1:32:52

1 Software Supernova: Lovable's "Superhuman Full Stack Engineer" to Transform Idea to App in Seconds 1:34:53

1 Software Supernova: Bolt.new - The AI Web App Developer In Your Browser 1:26:53

1 Gemini's Next Frontier: 2.0 Flash, Flash Lite Strategy & Real-Time APIs with Logan K from Google Deepmind 59:45

1 Distributed Training, Decentralized AI: Prime Intellect's Master Plan to Make AI Too Cheap to Meter 2:18:41

1 Aaron Levie, CEO of Box, on Box AI, Enterprise Enthusiasm, and the Evolution of SaaS 56:35

1 Emergency Pod: Reinforcement Learning Works! Reflecting on Chinese Reasoning Models DeepSeek-R1 and Kimi k1.5 1:47:53
Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.