Skip to content
Lex Fridman PodcastLex Fridman Podcast

Ishan Misra: Self-Supervised Deep Learning in Computer Vision | Lex Fridman Podcast #206

Ishan Misra is a research scientist at FAIR working on self-supervised visual learning. Please support this podcast by checking out our sponsors: - Onnit: https://lexfridman.com/onnit to get up to 10% off - The Information: https://theinformation.com/lex to get 75% off first month - Grammarly: https://grammarly.com/lex to get 20% off premium - Athletic Greens: https://athleticgreens.com/lex and use code LEX to get 1 month of fish oil EPISODE LINKS: Ishan's twitter: https://twitter.com/imisra_ Ishan's website: https://imisra.github.io Ishan's FAIR page: https://ai.facebook.com/people/ishan-misra/ PODCAST INFO: Podcast website: https://lexfridman.com/podcast Apple Podcasts: https://apple.co/2lwqZIr Spotify: https://spoti.fi/2nEwCF8 RSS: https://lexfridman.com/feed/podcast/ Full episodes playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4 Clips playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOeciFP3CBCIEElOJeitOr41 OUTLINE: 0:00 - Introduction 2:27 - Self-supervised learning 11:02 - Self-supervised learning is the dark matter of intelligence 14:54 - Categorization 23:28 - Is computer vision still really hard? 27:12 - Understanding Language 36:51 - Harder to solve: vision or language 43:36 - Contrastive learning & energy-based models 47:37 - Data augmentation 51:57 - Fixed audio spike by lowering sound with pen tool 1:00:10 - Real data vs. augmented data 1:03:54 - Non-contrastive learning energy based self supervised learning methods 1:07:32 - Unsupervised learning (SwAV) 1:10:14 - Self-supervised Pretraining (SEER) 1:15:21 - Self-supervised learning (SSL) architectures 1:21:21 - VISSL pytorch-based SSL library 1:24:15 - Multi-modal 1:31:43 - Active learning 1:37:22 - Autonomous driving 1:48:49 - Limits of deep learning 1:52:57 - Difference between learning and reasoning 1:58:03 - Building super-human AI 2:05:51 - Most beautiful idea in self-supervised learning 2:09:40 - Simulation for training AI 2:13:04 - Video games replacing reality 2:14:18 - How to write a good research paper 2:18:45 - Best programming language for beginners 2:19:39 - PyTorch vs TensorFlow 2:23:03 - Advice for getting into machine learning 2:25:09 - Advice for young people 2:27:35 - Meaning of life SOCIAL: - Twitter: https://twitter.com/lexfridman - LinkedIn: https://www.linkedin.com/in/lexfridman - Facebook: https://www.facebook.com/lexfridman - Instagram: https://www.instagram.com/lexfridman - Medium: https://medium.com/@lexfridman - Reddit: https://reddit.com/r/lexfridman - Support on Patreon: https://www.patreon.com/lexfridman

Lex FridmanhostIshan Misraguest
Jul 31, 20212h 30mWatch on YouTube ↗

CHAPTERS

  1. 0:00 – 2:27

    Introduction

  2. 2:27 – 11:02

    Self-supervised learning

  3. 11:02 – 14:54

    Self-supervised learning is the dark matter of intelligence

  4. 14:54 – 23:28

    Categorization

  5. 23:28 – 27:12

    Is computer vision still really hard?

  6. 27:12 – 36:51

    Understanding Language

  7. 36:51 – 43:36

    Harder to solve: vision or language

  8. 43:36 – 47:37

    Contrastive learning & energy-based models

  9. 47:37 – 51:57

    Data augmentation

  10. 51:57 – 1:00:10

    Fixed audio spike by lowering sound with pen tool

  11. 1:00:10 – 1:03:54

    Real data vs. augmented data

  12. 1:03:54 – 1:07:32

    Non-contrastive learning energy based self supervised learning methods

  13. 1:07:32 – 1:10:14

    Unsupervised learning (SwAV)

  14. 1:10:14 – 1:15:21

    Self-supervised Pretraining (SEER)

  15. 1:15:21 – 1:21:21

    Self-supervised learning (SSL) architectures

  16. 1:21:21 – 1:24:15

    VISSL pytorch-based SSL library

  17. 1:24:15 – 1:31:43

    Multi-modal

  18. 1:31:43 – 1:37:22

    Active learning

  19. 1:37:22 – 1:48:49

    Autonomous driving

  20. 1:48:49 – 1:52:57

    Limits of deep learning

  21. 1:52:57 – 1:58:03

    Difference between learning and reasoning

  22. 1:58:03 – 2:05:51

    Building super-human AI

  23. 2:05:51 – 2:09:40

    Most beautiful idea in self-supervised learning

  24. 2:09:40 – 2:13:04

    Simulation for training AI

  25. 2:13:04 – 2:14:18

    Video games replacing reality

  26. 2:14:18 – 2:18:45

    How to write a good research paper

  27. 2:18:45 – 2:19:39

    Best programming language for beginners

  28. 2:19:39 – 2:23:03

    PyTorch vs TensorFlow

  29. 2:23:03 – 2:25:09

    Advice for getting into machine learning

  30. 2:25:09 – 2:27:35

    Advice for young people

  31. 2:27:35 – 2:30:29

    Meaning of life

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.

Add to Chrome