Lex Fridman PodcastGilbert Strang: Linear Algebra, Teaching, and MIT OpenCourseWare | Lex Fridman Podcast #52
CHAPTERS
- 0:00 – 5:17
Gilbert Strang’s OpenCourseWare impact and the rise of linear algebra
Lex introduces Gilbert Strang and frames why his 18.06 OpenCourseWare lectures became globally influential. Strang reflects on how repetition, organization, and—most of all—the growing importance of linear algebra made the material resonate at scale.
- •18.06 lectures as “just the class,” recorded and widely translated
- •Strang’s surprise at “rockstar” status versus the subject’s inherent appeal
- •Linear algebra’s surge in importance over recent decades
- •Teaching style: calm, simple, friendly rapport with students
- 5:17 – 7:30
MIT OpenCourseWare’s ‘give it away’ philosophy
Strang recounts the origin story of MIT OpenCourseWare: a committee tasked with marketing MIT’s work instead proposed releasing it freely. He argues OCW authentically showcases MIT’s teaching and culture better than traditional marketing.
- •President Vest and the committee’s pivot from monetization to free access
- •Why OCW fits MIT’s identity as a high-level technical institution
- •OCW as a window into real classroom teaching rather than packaged content
- •Personal feedback from viewers and the unexpected reach of lectures
- 7:30 – 10:14
The ‘four fundamental subspaces’: a mental model for matrices
Asked for a favorite teaching topic, Strang highlights the four fundamental subspaces as an organizing framework for understanding matrices. He builds from basic definitions—matrix and vector—toward column space, row space, and their orthogonal complements.
- •Matrix as a rectangle of numbers with deep row/column connections
- •Vector as a column of numbers (with physics ‘arrow’ intuition optional)
- •Column space: all linear combinations of columns
- •Row space: all linear combinations of rows
- •Two perpendicular companions: null space and the orthogonal space completing the four-subspace picture
- 10:14 – 13:11
Thinking beyond 3D: intuition for high-dimensional ‘flat’ spaces
Lex probes how to reason about objects we can’t visualize, like vectors and planes in 10 dimensions. Strang emphasizes that linear algebra’s operations extend cleanly to high dimensions even when geometric imagery fails, because computation (addition/scaling) remains concrete.
- •Admitting limited visualization while trusting algebraic operations
- •Planes/subspaces in high dimensions as ‘flat’ structures
- •Linear algebra as rules for adding vectors and scaling them
- •Why abstraction can be empowering rather than alienating
- 13:11 – 15:03
Why linear algebra should come earlier than calculus
Strang contrasts calculus and linear algebra historically and pedagogically. He argues calculus’ complexity comes from curvature, while linear algebra is about flatness—making it conceptually simpler and a better early foundation, even though tradition teaches calculus first.
- •Calculus arrived earlier historically (Newton/Leibniz) but is ‘curvier’
- •Linear algebra deals with flat objects; “nothing bends”
- •Linear algebra scales to many dimensions naturally
- •Discussion of curriculum ordering and student intuition/fear of higher dimensions
- 15:03 – 19:45
Singular Value Decomposition: ‘rotate–stretch–rotate’ as a universal lens
Strang names SVD as a particularly beautiful, modern cornerstone—especially for rectangular data matrices where eigenvalues don’t apply. He explains the core theorem: every matrix factors into two rotations and a diagonal stretch, making complicated transformations understandable and rank-ordered by importance.
- •Data often lives in rectangular matrices; SVD generalizes beyond eigenvalues
- •SVD breaks a matrix into interpretable components ordered by significance
- •The theorem: any matrix = rotation × diagonal stretch × rotation
- •Geometric appeal: rotations and stretches are human-visualizable primitives
- •Practical implication: truncating to top components captures signal, discards noise
- 19:45 – 21:08
Why people love math online: order, certainty, and lifelong curiosity
Lex asks why math content thrives on YouTube despite its reputation for difficulty. Strang points to the appeal of deep order and provable truth, plus a widespread desire—even among retirees—to return to mathematics once freed from classroom pressure.
- •Math is culturally framed as ‘hard’ but attracts broad audiences
- •People seek order and statements that are “not obvious, but true”
- •Anecdotes about retirees learning math for pleasure
- •Online platforms expanding access to sophisticated ideas
- 21:08 – 22:35
Math as comfort and certainty: symmetry, truth, and the ‘powers of two’ story
The conversation turns philosophical: what kind of truth does math reveal, and why is it emotionally comforting? Strang shares childhood memories of using counting and powers of two to cope with pain, underscoring math’s reliable certainty and symmetry.
- •Math’s truth as a source of psychological stability
- •Strang’s childhood coping mechanism: counting/powers of two at the dentist
- •Certainty example: 2 multiplied ten times equals 1024, unequivocally
- •Symmetry and inevitability as core aesthetic/emotional drivers
- 22:35 – 25:04
Tool vs art—and how engineers learn: examples, answers, and intuition
Strang describes math as both art and tool, placing himself closer to the engineering-facing side of mathematics. He discusses how learners often need examples and concrete computation before abstraction clicks, while acknowledging top mathematicians may treat very abstract structures as ‘examples.’
- •Math supports both artistic insight and practical engineering answers
- •Strang’s preference for teaching engineers who “go for an answer”
- •Examples-first learning and building intuition through computation
- •Abstraction as a later layer (and different for different minds)
- 25:04 – 28:20
Math, politics, and SIAM: why quantitative thinking is underrepresented
Prompted by Andrew Yang’s “MATH” slogan, Lex and Strang discuss why STEM backgrounds are rare in elected leadership. Strang suggests the need is for people fluent in quantitative reasoning who can also communicate and inspire; he shares his SIAM presidency experience engaging Congress.
- •Lack of engineers/mathematicians in high political office
- •Need for leaders comfortable with quantities and causal reasoning
- •Communication/inspiration as complementary skills to technical training
- •SIAM’s role and Strang’s experience testifying to the House
- •A moment when math had increased visibility in Washington
- 28:20 – 33:01
Deep learning in plain terms: learning rules from data with linear algebra + nonlinearity
Strang explains deep learning as constructing a rule that maps known training inputs to known outputs and generalizes to unseen inputs. Linear algebra provides the matrix machinery, but nonlinearity is essential—often via simple piecewise-linear functions whose repeated composition yields complex behavior.
- •Deep learning as pattern/rule discovery from labeled input-output pairs
- •Linear algebra as foundational infrastructure, but insufficient alone
- •Nonlinearity introduced via piecewise-linear “folds” (e.g., ReLU-style)
- •Repeated folding/composition creates highly expressive functions
- •Neural networks as layered application of these simple building blocks
- 33:01 – 38:51
Expressivity, finite elements, and the limits of neural networks
Lex asks why neural networks work and where they break down. Strang connects piecewise-linear modeling to the finite-element method in engineering, framing network power as expressivity that scales with compute—while also noting learning fails when data is pure noise with no discoverable structure.
- •Analogy to finite-element methods: piecewise-flat approximations
- •Expressivity as a key concept: simple parts combine into complex functions
- •Compute as a practical limiter that keeps moving with hardware advances
- •Deep learning assumes underlying signal/structure; pure randomness is unlearnable
- •AI as an automated search for rules compared to physics’ hand-derived laws
- 38:51 – 41:53
Calculus vs linear algebra (again): rebalancing the undergraduate math triad
Strang situates linear algebra among major mathematical areas and argues curricula overemphasize calculus relative to modern needs. He proposes a more balanced emphasis across calculus, linear algebra (matrices/data), and probability/statistics—reflecting the data-centric world.
- •Major domains: algebra, calculus/differential equations, geometry
- •Claim: undergraduate programs overdo calculus at the expense of linear algebra
- •Data’s matrix form makes linear algebra central to modern computation
- •Probability/statistics as a separate, equally crucial pillar
- •A three-part foundation: calculus + linear algebra + probability
- 41:53 – 46:20
A favorite matrix and the joy of teaching: second derivatives, assessments, and ‘getting it’
Strang shares his favorite tridiagonal matrix (2 on the diagonal, -1 above/below) and why it appears everywhere as a discrete second-derivative operator. He then reflects on teaching: he loves the initial spark of explanation more than grading, and he recognizes learning moments when students grasp core structures like the four subspaces.
- •Favorite tridiagonal matrix and its ubiquity in engineering/numerics
- •Connection to second derivatives and curvature (and why they matter)
- •Teaching philosophy: prioritize understanding over assessment
- •Discomfort with grading/exams versus delight in first-time explanation
- •Watching for the ‘click’ when students see the fundamental theorem/four subspaces
- 46:20 – 49:52
Advice for students and a life in math: passion, fun, and meaningful connection
In closing, Strang advises students to seek teachers who still enjoy the subject and chase the fun of understanding. He reflects on pride in building 18.06 and in messages from learners worldwide, emphasizing the joy of connecting ideas to people.
- •Best start: learn from teachers who are actively curious and passionate
- •Focus on the fun and the moment of “Oh—this works”
- •Beauty across topics: linear algebra, geometry, and patterns in biology
- •Personal pride in creating 18.06 and helping students connect to ideas
- •Gratitude for global learners and the long tail of educational impact
