Skip to content
Lex Fridman PodcastLex Fridman Podcast

Ilya Sutskever: Deep Learning | Lex Fridman Podcast #94

Ilya Sutskever is the co-founder of OpenAI, is one of the most cited computer scientist in history with over 165,000 citations, and to me, is one of the most brilliant and insightful minds ever in the field of deep learning. There are very few people in this world who I would rather talk to and brainstorm with about deep learning, intelligence, and life than Ilya, on and off the mic. Support this podcast by signing up with these sponsors: - Cash App - use code "LexPodcast" and download: - Cash App (App Store): https://apple.co/2sPrUHe - Cash App (Google Play): https://bit.ly/2MlvP5w EPISODE LINKS: Ilya's Twitter: https://twitter.com/ilyasut Ilya's Website: https://www.cs.toronto.edu/~ilya/ PODCAST INFO: Podcast website: https://lexfridman.com/podcast Apple Podcasts: https://apple.co/2lwqZIr Spotify: https://spoti.fi/2nEwCF8 RSS: https://lexfridman.com/feed/podcast/ Full episodes playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4 Clips playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOeciFP3CBCIEElOJeitOr41 OUTLINE: 0:00 - Introduction 2:23 - AlexNet paper and the ImageNet moment 8:33 - Cost functions 13:39 - Recurrent neural networks 16:19 - Key ideas that led to success of deep learning 19:57 - What's harder to solve: language or vision? 29:35 - We're massively underestimating deep learning 36:04 - Deep double descent 41:20 - Backpropagation 42:42 - Can neural networks be made to reason? 50:35 - Long-term memory 56:37 - Language models 1:00:35 - GPT-2 1:07:14 - Active learning 1:08:52 - Staged release of AI systems 1:13:41 - How to build AGI? 1:25:00 - Question to AGI 1:32:07 - Meaning of life CONNECT: - Subscribe to this YouTube channel - Twitter: https://twitter.com/lexfridman - LinkedIn: https://www.linkedin.com/in/lexfridman - Facebook: https://www.facebook.com/LexFridmanPage - Instagram: https://www.instagram.com/lexfridman - Medium: https://medium.com/@lexfridman - Support on Patreon: https://www.patreon.com/lexfridman

Lex FridmanhostIlya Sutskeverguest
May 8, 20201h 37mWatch on YouTube ↗

CHAPTERS

  1. 0:00 – 2:23

    Introduction

  2. 2:23 – 8:33

    AlexNet paper and the ImageNet moment

  3. 8:33 – 13:39

    Cost functions

  4. 13:39 – 16:19

    Recurrent neural networks

  5. 16:19 – 19:57

    Key ideas that led to success of deep learning

  6. 19:57 – 29:35

    What's harder to solve: language or vision?

  7. 29:35 – 36:04

    We're massively underestimating deep learning

  8. 36:04 – 41:20

    Deep double descent

  9. 41:20 – 42:42

    Backpropagation

  10. 42:42 – 50:35

    Can neural networks be made to reason?

  11. 50:35 – 56:37

    Long-term memory

  12. 56:37 – 1:00:35

    Language models

  13. 1:00:35 – 1:07:14

    GPT-2

  14. 1:07:14 – 1:08:52

    Active learning

  15. 1:08:52 – 1:13:41

    Staged release of AI systems

  16. 1:13:41 – 1:25:00

    How to build AGI?

  17. 1:25:00 – 1:32:07

    Question to AGI

  18. 1:32:07 – 1:37:27

    Meaning of life

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.

Add to Chrome