Lex Fridman PodcastChris Lattner: Compilers, LLVM, Swift, TPU, and ML Accelerators | Lex Fridman Podcast #21
Episode Details
EPISODE INFO
- Released
- May 13, 2019
- Duration
- 1h 13m
- Channel
- Lex Fridman Podcast
- Watch on YouTube
- ▶ Open ↗
EPISODE DESCRIPTION
Chris Lattner is a senior director at Google working on several projects including CPU, GPU, TPU accelerators for TensorFlow, Swift for TensorFlow, and all kinds of machine learning compiler magic going on behind the scenes. He is one of the top experts in the world on compiler technologies, which means he deeply understands the intricacies of how hardware and software come together to create efficient code. He created the LLVM compiler infrastructure project and the CLang compiler. He led major engineering efforts at Apple, including the creation of the Swift programming language. He also briefly spent time at Tesla as VP of Autopilot Software during the transition from Autopilot hardware 1 to hardware 2, when Tesla essentially started from scratch to build an in-house software infrastructure for Autopilot. Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep21-sb See below for timestamps, and to give feedback, submit questions, contact Lex, etc. *CONTACT LEX:* *Feedback* - give feedback to Lex: https://lexfridman.com/survey *AMA* - submit questions, videos or call-in: https://lexfridman.com/ama *Hiring* - join our team: https://lexfridman.com/hiring *Other* - other ways to get in touch: https://lexfridman.com/contact *OUTLINE:* 0:00 - Introduction 1:30 - First program, BASIC, Pascal, C 4:20 - Compilers, LLVM, CLang 37:30 - Apple - LLVM, Objective-C, Swift 45:30 - Google - Swift, Swift for TensorFlow, compilers, Colab 57:32 - TPU & TensorFlow, hardware/software co-design 1:00:30 - MLIR (Multi-Level Intermediate Representation) framework 1:02:40 - Open sourcing of TensorFlow 1:05:10 - Tesla - transition from HW1 to HW2 1:07:24 - Elon Musk and time at Tesla 1:08:45 - Working hard 1:10:40 - Dragons *PODCAST LINKS:*
- Podcast Website: https://lexfridman.com/podcast
- Apple Podcasts: https://apple.co/2lwqZIr
- Spotify: https://spoti.fi/2nEwCF8
- RSS: https://lexfridman.com/feed/podcast/
- Podcast Playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4
- Clips Channel: https://www.youtube.com/lexclips
*SOCIAL LINKS:*
- X: https://x.com/lexfridman
- Instagram: https://instagram.com/lexfridman
- TikTok: https://tiktok.com/@lexfridman
- LinkedIn: https://linkedin.com/in/lexfridman
- Facebook: https://facebook.com/lexfridman
- Patreon: https://patreon.com/lexfridman
- Telegram: https://t.me/lexfridman
- Reddit: https://reddit.com/r/lexfridman
SPEAKERS
Lex Fridman
hostChris Lattner
guestNarrator
other
EPISODE SUMMARY
In this episode of Lex Fridman Podcast, featuring Lex Fridman and Chris Lattner, Chris Lattner: Compilers, LLVM, Swift, TPU, and ML Accelerators | Lex Fridman Podcast #21 explores chris Lattner on Compilers, Swift, TPUs, and ML’s Future Infrastructure Chris Lattner discusses his journey from early programming to creating LLVM, Clang, and Swift, and how compilers bridge human intent and diverse hardware. He explains the architecture of compilers, why LLVM succeeded as reusable infrastructure, and how Swift was designed for safety, performance, and ease of learning. The conversation then moves to machine learning: TPUs, Swift for TensorFlow, automatic differentiation, and MLIR as a next-generation compiler layer for ML systems. Lattner also reflects on open source culture, his brief but intense experience at Tesla, and the organizational and human aspects of building large-scale compiler communities.
RELATED EPISODES
