Humanity is racing to build superintelligent AI.
But what happens if we create beings far smarter than us—and they decide upon different or conflicting goals?
In this special Win-Win IRL episode, I sat down with Anthony Aguirre —CEO of Future of Life Institute and author of essay “Keep The Future Human”—and Malo Bourgon —CEO of Machine Intelligence Research Institute—for a no-holds-barred conversation on finding alignment, avoiding power concentration and surveillance states, and the geopolitical implications of AGI.
We explore spicy topics like: why can’t the market be trusted to self-regulate AI? How worried should we be about power concentration, and how do we stop it? What happens if even the good guys lose control of the systems they’ve built?
Of course, this being win-win, we also try to figure out how to reap the boon of AI, *and* mitigate its worst risks… whether that’s via compute governance and open-source safety measures, or collaborative international treaties and new models for responsible innovation. So buckle up for a provocative episode that challenges assumptions and asks what it will really take to keep the future human.
And stick around for the audience questions towards the end. T’was quite the lineup of superstars as you’ll see… in fact it was at this event that this moment occurred! Chapters & Notes below.
Chapters:
0:00 - Intro
4:08 - Different Risk Types
10:23 - Why not just trust the market to manage risk?
14:56 - Dangers of Power Concentration
21:51 - Solutions to the Dilemma?
31:19 - Should Compute be Regulated?
37:00 - Taylor Capito - Is this an Evolutionary Nexus?
40:15 - J.D. Ross - Decentralization vs Centralization?
44:20 - Igor Kurganov - AI & Bio
44:43 - Isabelle Boemeke - Nuclear Power & AI?
48:53 - Peter Wang - Wrong Stories Attract Wrong People
55:34 - Aurora Quinn-Elmore & Eliezer Yudkowsky - Coherent Extrapolated Volition
1:03:13 - How to embed Win-Win philosophy into AGI?
Links :
♾️ Keep the Future Human Paper: https://keepthefuturehuman.ai
♾️ Future of Life Institute: https://futureoflife.org
♾️ MIRI: https://intelligence.org
♾️ Superintelligence Book by Nick Bostrom - https://www.amazon.com/Superintellige...
Credits
♾️ Hosted by Liv Boeree
♾️ Produced by Luca de Vico
The Win-Win Podcast Poker champion Liv Boeree takes to the interview chair to tease apart the complexities of one of the most fundamental parts of human nature: competition. Liv is joined by top philosophers, gamers, artists, technologists, CEOs, scientists, athletes and more to understand how competition manifests in their world, and how to change seemingly win-lose games into Win-Wins. Podcast links
Share this post