David Patterson: Computer Architecture and Data Storage | Lex Fridman Podcast #104

David Patterson: Computer Architecture and Data Storage | Lex Fridman Podcast #104

Lex Fridman PodcastJun 27, 20201h 49m

Lex Fridman (host), David Patterson (guest), Narrator

Historical evolution of computers, microprocessors, and Moore’s LawRISC vs. CISC architectures and instruction set designRISC‑V and open-source hardware ecosystemsDomain-specific accelerators and machine learning hardware (e.g., TPUs, GPUs)Storage innovations and the origins and impact of RAIDBenchmarks, metrics, and performance evaluation (SPEC, MLPerf, ImageNet)Slowing of Moore’s Law, quantum computing, and the future of computingTeaching, teamwork, wrestling, and personal philosophy on a life well lived

In this episode of Lex Fridman Podcast, featuring Lex Fridman and David Patterson, David Patterson: Computer Architecture and Data Storage | Lex Fridman Podcast #104 explores from RISC to RISC‑V: Patterson on Computing’s Past and Future David Patterson discusses the evolution of computer architecture over the past 50 years, focusing on the rise of microprocessors, Moore’s Law, and the RISC vs. CISC debate that reshaped how processors are designed.

From RISC to RISC‑V: Patterson on Computing’s Past and Future

David Patterson discusses the evolution of computer architecture over the past 50 years, focusing on the rise of microprocessors, Moore’s Law, and the RISC vs. CISC debate that reshaped how processors are designed.

He explains instruction sets, layers of abstraction, and why simple, reduced instruction sets (RISC) paired with strong compilers beat more complex designs in performance, power, and scalability.

Patterson introduces RISC‑V as an open, modular instruction set poised to become a hardware analog of Linux, especially in IoT and potentially cloud computing, and ties this to emerging domain‑specific hardware for machine learning.

He also reflects on his RAID work in storage, the slowing of Moore’s Law, the promise and limits of quantum computing, the importance of benchmarks, and how teaching, sports, and relationships shape a meaningful career.

Key Takeaways

Simplicity in instruction sets can outperform complexity when paired with good compilers.

RISC architectures execute more, simpler instructions but at much lower cycles per instruction, yielding large net speedups over complex CISC designs once compilation and hardware efficiency are factored in.

Get the full analysis with uListen AI

Open instruction sets like RISC‑V can unlock Linux-style innovation in hardware.

By making the ISA specification free and open, RISC‑V enables open-source processor implementations, customization, and broad collaboration, especially attractive for IoT, research, and future domains.

Get the full analysis with uListen AI

Performance must be measured quantitatively using shared benchmarks, not intuition.

Patterson emphasizes factoring execution time into instructions, cycles per instruction, and clock time, and using agreed benchmark suites (SPEC, MLPerf, ImageNet-style datasets) to fairly compare architectures and systems.

Get the full analysis with uListen AI

Moore’s Law is slowing, forcing a shift to domain-specific accelerators.

Transistors are no longer doubling every two years, so general-purpose CPUs are improving only marginally; performance gains now come from specialized hardware for key workloads, especially machine learning (e. ...

Get the full analysis with uListen AI

Machine learning is both a new programming paradigm and a perfect match for accelerators.

As software moves toward data-driven “Software 2. ...

Get the full analysis with uListen AI

Redundancy in storage (RAID) can make large, cheap device arrays both faster and more reliable.

By aggregating many inexpensive disks and adding redundancy, RAID architectures outperform single, expensive drives in throughput, cost, and even reliability, which is critical because data loss has much higher cost than a crashed computation.

Get the full analysis with uListen AI

Teaching, teamwork, and humility are central to impactful scientific careers.

Patterson argues that explaining concepts to students sharpens research thinking, building teams (a skill he traces to wrestling) multiplies impact, and in personal life, openly admitting error and valuing relationships matter more than accumulating papers or money.

Get the full analysis with uListen AI

Notable Quotes

The brilliance of the processor is that it performs very trivial operations, but it just performs billions of them per second.

David Patterson

It’s actually harder to come up with a simple, elegant solution. The temptation in engineering is to make things more complicated.

David Patterson

We were executing maybe 50% more instructions, but they ran four times faster.

David Patterson

Moore’s Law is slowing down, and that’s going to affect your assumptions.

David Patterson

People don’t die wishing they’d spent more time in the office.

David Patterson

Questions Answered in This Episode

How might RISC‑V reshape the competitive landscape currently dominated by x86 and ARM over the next 10–20 years?

David Patterson discusses the evolution of computer architecture over the past 50 years, focusing on the rise of microprocessors, Moore’s Law, and the RISC vs. ...

Get the full analysis with uListen AI

What are the most promising but still unexplored ideas in instruction set design now that RISC has ‘won’ technically?

He explains instruction sets, layers of abstraction, and why simple, reduced instruction sets (RISC) paired with strong compilers beat more complex designs in performance, power, and scalability.

Get the full analysis with uListen AI

How will the rise of machine learning and domain-specific accelerators change the skills future software and hardware engineers need?

Patterson introduces RISC‑V as an open, modular instruction set poised to become a hardware analog of Linux, especially in IoT and potentially cloud computing, and ties this to emerging domain‑specific hardware for machine learning.

Get the full analysis with uListen AI

Given the slowing of Moore’s Law, what architectural or algorithmic breakthroughs (beyond ML accelerators) could deliver the next big performance leap?

He also reflects on his RAID work in storage, the slowing of Moore’s Law, the promise and limits of quantum computing, the importance of benchmarks, and how teaching, sports, and relationships shape a meaningful career.

Get the full analysis with uListen AI

What safeguards and design philosophies should guide open-source hardware to avoid repeating historical mistakes in proprietary architectures?

Get the full analysis with uListen AI

Transcript Preview

Lex Fridman

The following is a conversation with David Patterson, Turing Award winner and professor of computer science at Berkeley. He's known for pioneering contributions to risk processor architecture used by 99% of new chips today, and for co-creating RAID storage. The impact that these two lines of research and development have had on our world is immeasurable. He's also one of the great educators of computer science in the world. His book with John Hennessy is how I first learned about and was humbled by the inner workings of machines at the lowest level. Quick summary of the ads. Two sponsors, The Jordan Harbinger Show and Cash App. Please consider supporting the podcast by going to jordanharbinger.com/lex and downloading Cash App and using code LexPodcast. Click on the links, buy the stuff. It's the best way to support this podcast, and in general, the journey I'm on in my research and startup. This is the Artificial Intelligence Podcast. If you enjoy it, subscribe on YouTube, review it with five stars on Apple Podcasts, support it on Patreon, or connect with me on Twitter @LexFridman, spelled without the E, just F-R-I-D-M-A-N. As usual, I'll do a few minutes of ads now and never any ads in the middle that could break the flow of the conversation. This episode is supported by The Jordan Harbinger Show. Go to jordanharbinger.com/lex. It's how he knows I sent you. On that page, there's links to subscribe to it on Apple Podcasts, Spotify, and everywhere else. I've been binging on his podcast. It's amazing. Jordan is a great human being. He gets the best out of his guests, dives deep, calls them out when it's needed, and makes the whole thing fun to listen to. He's interviewed Kobe Bryant, Mark Cuban, Neil deGrasse Tyson, Garry Kasparov, and- and many more. I recently listened to his conversation with Frank Abagnale, author of Catch Me If You Can and one of the world's most famous con men. Perfect podcast length and topic for a recent long-distance run that I did. Again, go to jordanharbinger.com/lex to give him my love and to support this podcast. Uh, subscribe also on Apple Podcasts, Spotify, and everywhere else. This show is presented by Cash App, the greatest sponsor of this podcast ever and the number one finance app in the App Store. When you get it, use code LexPodcast. Cash App lets you send money to friends, buy Bitcoin, and invest in the stock market with as little as $1. Since Cash App allows you to buy Bitcoin, let me mention that cryptocurrency in the context of the history of money is fascinating. I recommend The Scent of Money as a great book on this history. Also, the audiobook is amazing. Debits and credits on ledgers started around 30,000 years ago, the US dollar created over 200 years ago, and the first decentralized cryptocurrency released just over 10 years ago. So given that history, cryptocurrency is still very much in its early days of development, but it's still aiming to and just might redefine the nature of money. So again, if you get Cash App from the App Store or Google Play and use the code LexPodcast, you get $10 and Cash App will also donate $10 to FIRST, an organization that is helping to advance robotics and STEM education for young people around the world. And now, here's my conversation with David Patterson. Let's start with the big historical question. How have computers changed in the past 50 years at both the fundamental architectural level and in general in your eyes?

Install uListen to search the full transcript and get AI-powered insights

Get Full Transcript

Get more from every podcast

AI summaries, searchable transcripts, and fact-checking. Free forever.

Add to Chrome