Joseph Carlsmith - Utopia, AI, & Infinite Ethics

ℹ️ EPISODE INFO

Released

August 3, 2022

Duration

1h 32m

Channel

Dwarkesh Podcast

Watch on YouTube

▶ Open ↗

📝 EPISODE DESCRIPTION

Joseph Carlsmith is a senior research analyst at Open Philanthropy and a doctoral student in philosophy at the University of Oxford. Learn about Joseph and read his work at: https://www.josephcarlsmith.com/ Podcast website: https://www.dwarkeshpatel.com/p/joseph-carlsmith Apple Podcasts: https://apple.co/3Qcboq0 Spotify: https://spoti.fi/3zrElYb Follow me: https://twitter.com/dwarkesh_sp Follow Joseph: https://twitter.com/jkcarlsmith Timestamps: 00:00:00 Preview 00:00:55 Introduction 00:03:42 How to define a better future? 00:10:08 Utopia 00:26:01 Robin Hanson’s EMs 00:28:24 Human Computational Capacity 00:35:04 FLOPS to emulate human cognition? 00:41:04 Infinite Ethics 01:01:40 SIA vs SSA 01:18:42 Futurism & Unreality 01:24:25 Blogging & Productivity 01:29:32 Book Recommendations 01:30:53 Conclusion

🎤 SPEAKERS

• Joseph (Joe) Carlsmith

  guest

• Dwarkesh Patel

  host

🧾 EPISODE SUMMARY

In this episode of Dwarkesh Podcast, featuring Joseph (Joe) Carlsmith and Dwarkesh Patel, Joseph Carlsmith - Utopia, AI, & Infinite Ethics explores joseph Carlsmith explores utopia, AI risk, and infinite ethics Joseph Carlsmith, a philosopher and AI x‑risk researcher at Open Philanthropy, discusses how seriously we should take the possibility of a radically better future (utopia), and the risks posed by transformative AI. He argues that utopia should be seen as a profoundly better but still concrete, finite world, likely reachable only after a long process of civilizational wisdom and coordination, not a simple hedonistic tiling of the universe.

🔗 RELATED EPISODES

David Reich – Bronze Age shock, the Neanderthal puzzle, & the sudden spread of farming

Jensen Huang – TPU competition, why we should sell chips to China, & Nvidia’s supply chain moat

Dario Amodei — “We are near the end of the exponential”

Andrej Karpathy — “We’re summoning ghosts, not building animals”

Why Leonardo was a saboteur, Gutenberg went broke, and Florence was weird – Ada Palmer

Richard Sutton – Father of RL thinks LLMs are a dead end