Skip to content
AcquiredAcquired

NVIDIA CEO Jensen Huang

We finally sit down with the man himself: Nvidia Cofounder & CEO Jensen Huang. After three parts and seven+ hours of covering the company, we thought we knew everything but — unsurprisingly — Jensen knows more. A couple teasers: we learned that the company’s initial motivation to enter the datacenter business came from perhaps not where you’d think, and the roots of Nvidia’s platform strategy stretch back beyond CUDA all the way to the origin of the company. We also got a peek into Jensen’s mindset and calculus behind “betting the company” multiple times, and his surprising feelings about whether he’d go on the founder journey again if he could rewind time. We can’t think of any better way to tie a bow on our Nvidia series (for now). Tune in! Sponsors: Thanks to our fantastic partners, any member of the Acquired community can now get: Your product growth powered by Statsig https://bit.ly/statsigacquired Scalable, clean and low-cost cloud AI compute from Crusoe, and listen to our recent ACQ2 interview with CEO Chase Lochmiller https://bit.ly/acquiredcrusoe https://bit.ly/CrusoeACQ2 Free access to Jensen’s favorite business books on Blinkist, plus our favorites on Ben & David’s Bookshelf https://bit.ly/BlinkistJensen https://bit.ly/BlinkistBookshelf More Acquired!: Get email updates with hints on next episode and follow-ups from recent episodes https://www.acquired.fm/email Join the Slack http://acquired.fm/slack Subscribe to ACQ2 https://pod.link/acquiredlp Become an LP and support the show. Help us pick episodes, Zoom calls and more https://acquired.fm/lp ACQ Merch Store! https://www.acquired.fm/store Timestamps: 00:00:00 Teaser 00:00:41 Intro 00:02:54 Riva 128 00:17:27 Post-AlexNet 00:20:29 OpenAI 00:22:21 Language Models 00:24:56 Statsig 00:27:13 Direct Reports 00:32:07 Product Shipping Cycle 00:34:16 Journey to the Data Center 00:39:31 Mellanox Acquisition 00:43:41 Crusoe 00:45:45 Advice For Company Building 00:55:54 Luck & Skill 00:59:54 Job Displacement 01:06:56 Blinkist 01:08:57 Favorite Sci-Fi 01:09:33 Daily Driver 01:10:28 Favorite Business Book 01:10:55 Don Valentine 01:11:45 40 Year-Old Jensen 01:12:42 What are You Afraid of? 01:13:29 Final Job 01:19:44 Starting a Company in 2023 01:23:13 Market Drawdowns 01:27:43 Outro Note: Acquired hosts and guests may hold assets discussed in this episode. This podcast is not investment advice, and is intended for informational and entertainment purposes only. You should do your own research and make your own independent decisions when considering any financial transactions. © Copyright ACQ, LLC

Ben GilberthostDavid RosenthalhostJensen Huangguest
Oct 16, 20231h 30mWatch on YouTube ↗

EVERY SPOKEN WORD

  1. 0:000:41

    Teaser

    1. BG

      I will say, David, I would love to have NVIDIA's full production team every episode. It was nice not having to worry about turning the cameras on and off and making sure that nothing bad happened to myself while we were recording this.

    2. DR

      Yeah, just the gear. I mean, the drives that came out of the camera.

    3. BG

      All right, uh, Red cameras for the home studio starting next episode.

    4. DR

      Yeah, great.

    5. BG

      All right, let's do it.

    6. SP

      Who got the truth? Is it you? Is it you? Is it you? Who got the truth now? Is it you? Is it you? Is it you? Sit me down, say it straight. Another story on the way. Who got the truth?

  2. 0:412:54

    Intro

    1. BG

      Welcome to this episode of Acquired, the podcast about great technology companies and the stories and playbooks behind them. I'm Ben Gilbert.

    2. DR

      I'm David Rosenthal.

    3. BG

      And we are your hosts. Listeners, just so we don't bury the lead, this episode was insanely cool for David and I.

    4. DR

      Yeah.

    5. BG

      After researching NVIDIA for something like five hundred hours over the last two years, we flew down to NVIDIA headquarters to sit down with Jensen himself. And Jensen, of course, is the founder and CEO of NVIDIA, the company powering this whole AI explosion. At the time of recording, NVIDIA is worth one point one trillion dollars and is the sixth most valuable company in the entire world. And right now is a crucible moment for the company. Expectations are set high. I mean, sky-high. They have about the most impressive strategic position and lead against their competitors of any company that we've ever studied. But here's the question that everyone is wondering: Will NVIDIA's insane prosperity continue for years to come? Is AI going to be the next trillion-dollar technology wave? How sure are we of that? And if so, can NVIDIA actually maintain their ridiculous dominance as this market comes to take shape? So Jensen takes us down memory lane with stories of how they went from graphics to the data center to AI, how they survived multiple near-death experiences. He also has plenty of advice for founders, and he shared an emotional side to the founder journey toward the end of the episode.

    6. DR

      Yeah, I got new perspective on the company and on him as a founder and a leader just from doing this, despite, [chuckles] you know, we thought we knew everything before we came in advance, and, uh, it turned out we didn't.

    7. BG

      Turns out the protagonist actually knows more. [chuckles]

    8. DR

      Yes. [chuckles]

    9. BG

      All right, well, listeners, join the Slack. There is incredible discussion of everything about this company, AI, the whole ecosystem, and a bunch of other episodes that we've done recently going on in there right now. So that is acquired.fm/slack. We would love to see you. And without further ado, this show is not investment advice. David and I may have investments in the companies we discuss, and this show is for informational and entertainment purposes only. On to Jensen.

  3. 2:5417:27

    Riva 128

    1. BG

      So, Jensen, this is Acquired, so we want to start with story time. So we want to wind the clock all the way back to, I believe it was nineteen ninety-seven. You're getting ready to ship the Riva 128, which is one of the largest graphics chips ever created in the history of computing. It is the first fully 3D-accelerated graphics pipeline for a computer.

    2. JH

      Yeah.

    3. BG

      And you guys have about-

    4. DR

      And you're running out of money

    5. BG

      ... six months of cash left, and so you decide to do the entire testing in simulation rather than ever receiving a physical prototype. You commission the production run sight unseen with the rest of the company's money.

    6. JH

      Yeah.

    7. BG

      So you're betting it all right here on the Riva 128.

    8. JH

      Yeah.

    9. BG

      It comes back, and of the thirty-two DirectX blend modes, it supports eight of them. And you have to convince the market to buy it, and you got to convince developers not to use anything but those eight blend modes. Walk us through what that felt like.

    10. JH

      The other twenty-four weren't that important. [laughing]

    11. DR

      [laughing] Okay, so wait, wait. First question: Was that the plan all along? Like, when, when did you realize that only eight were gonna work?

    12. JH

      We should-- I realized... I didn't learn about it until it was too late. We should have implemented all thirty-two, yeah.

    13. DR

      [chuckles]

    14. JH

      But, but it-- we built what we built, and so we had to make the best of it. That was really an extraordinary time. Remember, Riva 128 was NV3. NV1 and NV2 were based on forward texture mapping, no triangles, but curves, and it tessellated the curves. And because we were rendering higher-level objects, we essentially avoided using Z-buffers, and we thought that that was going to be a good rendering approach, and turns out to have been completely the wrong answer. And so what Riva 128 was, was a reset of our company. Now, remember, at the time that we started the company in nineteen ninety-three, we were the only consumer 3D graphics company ever created, and we, we were focused on transforming the PC into an accelerated PC, because at the time, Windows was really a software-rendered system. And so anyways, Riva 128 was a reset of our company because by the time that we realized we had gone down the wrong road, Microsoft had already rolled out DirectX. It was fundamentally incompatible with NVIDIA's architecture. Thirty competitors have already shown up, uh, even though we were the first company at the time that we've-- were founded. So the world was a completely different place. The question about what to do as a company strategy, at that point, I would have said that we made a whole bunch of wrong decisions, but on that day that mattered, we made a sequence of extraordinarily good decisions. And that time, 1997, was probably NVIDIA's best moment, and the reason for that was our backs were up against the wall. We were running out of time, we're running out of money, and for a lot of employees, running out of hope. And the question is, what do we do? Well, the first thing that we did was we decided that, look, DirectX is now here. We're not going to fight it. Let's go figure out a way to build the best thing in the world, uh, for it. And Riva 128 is the world's first, uh, fully accelerated, hardware-accelerated pipeline for rendering 3D. And so-... the transform, the projection, every single element, all the way down to the frame buffer, was completely hardware accelerated. Uh, we implemented a, a, a texture cache. We took the bus limit, the frame buffer limit, to as big as, as, uh, physics could afford at the time. We made the biggest chip that anybody had ever imagined building. We used the fastest memories. Basically, if we built that chip, there could be nothing that could be faster. And we also chose a cost point that is substantially higher than the highest price that we think that any of our competitors would be willing to go. If we built it right, we accelerated everything, we implement everything i- in DirectX that we knew of, and we built it as large as we possibly could, then obviously nobody can build something faster than that.

    15. DR

      Today, in a way, you kind of do that here at NVIDIA, too. You were a consumer products company back then, right? It was end consumers who were gonna have to pay the money to buy this.

    16. JH

      That's right. But we observed that there was a segment of the market where people were- because at the time, the, the PC industry was still coming up, and it wasn't good enough. Everybody was clamoring for the next fastest thing. And so if your performance was ten times higher this year than what was available, there's a whole large market of enthusiasts who, who we believe would, would have gone after it, and we were absolutely right, that the PC industry had a substantially large enthusiast market that would buy the best of everything. To this day, this kind of remains true, and for certain segments of the market where the technology is never good enough, like 3D graphics, when we chose the right technology, 3D graphics is never good enough. And we call it, back then, 3D gives us sustainable technology opportunity because it's never good enough, and so your technology can keep getting better. We chose that. Uh, we also made the decision to use this technology called emulation.

    17. DR

      Yeah.

    18. JH

      There was a, a company called Icos, and on the day that I called them, they were just shutting the company down because they had no customers. And I said, "Hey, look, uh, I'll buy what you have in inventory, and, uh, you know, uh, no promises are necessary." And the reason why we needed that emulator is because if you figure out how much money that we have, if we taped out a chip and we, uh, got it back from the fab, and we started working on our software, by the time that we found all the bugs, because we did the software, then we taped out the chip again, well, we would have been out of business already.

    19. DR

      Yeah.

    20. JH

      And so I knew-

    21. DR

      And your competitors would have caught up.

    22. JH

      Well, not to mention, we would have been out of business. [laughing]

    23. DR

      Exactly. [laughing] Who cares?

    24. JH

      So- [laughing] exactly. And so if you're gonna be out of business anyways, that plan obviously wasn't the plan. The plan that companies normally go through, which is, you know, build the chip, write the software, fix the bugs, tape out the new chip, so on and so forth, that method wasn't gonna work. And so the question is, if we only had six months and you get to tape out just one time, then obviously you're gonna tape out a perfect chip.

    25. DR

      [laughing]

    26. JH

      So I, so, so I remember having a conversation with our leaders, and they said: "But Jensen, how do you know it's gonna be perfect?" And I said: "I know it's gonna be perfect, because if it's not, we'll be out of business, and so let's make it perfect." [laughing]

    27. DR

      [laughing]

    28. JH

      "We get one shot." We essentially virtually prototyped the chip by buying this emulator, and Dwight and the software team wrote our software, the entire stack, and ran it on this emulator, and just sat in the lab waiting for Windows to paint. You know, and what-

    29. DR

      It was like-

    30. JH

      It painted a thousand-

  4. 17:2720:29

    Post-AlexNet

    1. DR

      So that's where we are today, um, and that's where NVIDIA is today.

    2. JH

      Mm-hmm.

    3. DR

      But I'm curious in the... You know, those couple of years after AlexNet-

    4. JH

      Mm-hmm

    5. DR

      ... and this is when Ben and I were getting into the technology industry and the venture industry ourselves.

    6. BG

      I started at Microsoft in twenty twelve.

    7. JH

      Yeah.

    8. DR

      Yeah.

    9. BG

      So right after AlexNet, but before anyone was talking about machine learning, and even the mainstream engineering community.

    10. DR

      There were those couple of years there where, to a lot of the rest of the world, these looked like science projects.

    11. JH

      Yeah.

    12. DR

      The technology companies here in Silicon Valley, particularly the social media companies, they were just realizing huge economic value out of this, the Googles, the Facebooks-

    13. JH

      Yeah

    14. DR

      ... the Netflixes, et cetera.

    15. JH

      Yeah.

    16. DR

      And obviously, that led to lots of things, including OpenAI a couple of years later.

    17. JH

      Yeah.

    18. DR

      But during those couple of years, when you saw just that huge economic value unlock here in Silicon Valley-... how are you feeling during those times?

    19. JH

      The first thought was, of course, reasoning about, uh, how we, we should change our computing stack. The second thought is, where can we find earliest possibilities of use? If we were to go build this computer, what would people use it to do? And we were fortunate that working with the world's universities and researchers was, was innate in our company because we were already working on CUDA, and CUDA's early adopters were researchers, because we democratized supercomputing. You know, CUDA is not just used, as you know, for AI. CUDA is used for almost all fields of science. Everything from molecular dynamics to imaging, CT reconstruction, to um, uh, seismic processing, to, you know, weather simulations, quantum chemistry. The list goes on, right? And so the number of applications of CUDA in research was very high. And so when the time came and we realized that deep learning could be really interesting, uh, it was natural for us to go back to the researchers and find every single AI researcher on the planet and say: "How can we help you advance your work?" And that included Yann LeCun and Andrew Ng and Geoff Hinton, and that's how I met all these people. And, and I used to go to all the AI conferences, and that's where, you know, I met Ilya Sutskever there for the first time.

    20. DR

      Yeah.

    21. JH

      And so it was really about, at that point, what are the systems that we can build and the software stacks we can build to help you be more successful, to advance the research? Because at the time, it, it looked like a toy, but we had confidence that even GAN, the first time I met Goodfellow, the GAN was- it was like thirty-two by thirty-two, and it was just a, you know, blurry image of a cat, you know?

    22. DR

      Mm-hmm.

    23. JH

      But how far can it go? And so we believed in it. We believed that, one, you could scale deep learning because obviously it's trained layer by layer, and you could make the datasets larger, and you could make the models larger. And we believed that if you made that larger and larger, it would get better and better.

    24. DR

      Yep.

    25. JH

      Kind of sensible. And I think the discussions and the engagements with the researchers was the exact positive feedback system that we needed. I would go back to research. It was-- that's where

  5. 20:2922:21

    OpenAI

    1. JH

      it all happened.

    2. DR

      When OpenAI was founded in twenty-

    3. JH

      Yeah. Fifteen? Yeah.

    4. DR

      I mean, that was such a, an important moment. That's obvious today now, but at the time, I, I think most people, even people in tech, were like-

    5. JH

      Yeah

    6. DR

      ... "What is this?" [chuckles]

    7. JH

      Yeah, yeah, yeah.

    8. DR

      Were, were you involved in it at all? Like, you know, because you were-

    9. JH

      Yeah

    10. DR

      -so connected to the researchers-

    11. JH

      Yeah

    12. DR

      -to Ilya, taking that talent out of Google and Facebook, to be blunt-

    13. JH

      Yeah

    14. DR

      -but re seeding the research community-

    15. JH

      Yeah

    16. DR

      -and opening it up, um, was such an important moment. Were you involved in it at all?

    17. JH

      I wasn't involved in the founding of it, but I knew, uh, a lot of the people there, and, um, uh, Elon, of course, uh, I knew, and, uh, uh, Peter Thiel was there, and Ilya was there, and, uh, we have, we have some great employees today that were there in the beginning, and I knew that they needed this amazing computer that we were building, and we were building the first version of the DGX, which, you know, today when you see a Hopper, it's seventy pounds, thirty-five thousand parts, ten thousand amps. But DGX, the first version that we built, was, uh, used internally, and I delivered the first one to OpenAI-

    18. DR

      Yeah

    19. JH

      ... and that, that was a fun day. But most of our success was aligned around, um, in the beginning, uh, just about helping the researchers get to the next level. I knew it wasn't very useful in its current state, but I also believed that in a few clicks, it could be really remarkable. And that belief system came from the interactions with all these amazing researchers, and it came from just seeing the incremental progress. At first, the papers were coming out every three months, and then, then papers today are coming out every day, right? So you could just monitor the archive papers, and I took an interest in learning about the progress of deep learning and, and, and to the best of my ability, read these papers, and you could just see the progress happening, you know, in real time, exponentially in real time.

  6. 22:2124:56

    Language Models

    1. BG

      It even seems like within the industry, from some researchers we spoke with, it seemed like no one predicted how useful language models would become when you just increase the size of the models. They thought: "Oh, there has to be some algorithmic change that needs to happen." But once you cross that ten billion parameter mark, and certainly once you cross the hundred billion, they just magically got much more accurate, much more useful, much more lifelike. Were you shocked by that the first time you saw a truly large language model? And do you remember that feeling?

    2. JH

      Well, my first feeling about the language model was how clever it was to just mask out words and, and, uh, make it predict the next word. It's self-supervised learning at its best. We have all this text, you know. I know what the answer is. I'll just make you guess it. And so my first impression of BERT was really how clever it was, and now the question is, how can you scale that? You know, the first observation on almost everything is interesting, and then, and then try to understand intuitively why it works, and then the next step, of course, is from first principles, how would you extrapolate that?

    3. BG

      Yep.

    4. JH

      And so obviously, we knew that BERT was going to be a lot larger. Now, one of the things about these language models is it's encoding information, isn't that right? It's compressing information. And so within the world's languages and text, there's a fair amount of reasoning that's encoded in it, and we describe a lot of reasoning things, and, and so if you were to say that, uh, few-step reasoning is somehow learnable from just reading things, I wouldn't be surprised. Uh, you know, for a, a lot of us, uh, we get our common sense, and we get our, our reasoning ability by reading, and so why wouldn't a machine learning model also learn some of the reasoning capabilities from that? And from reasoning capabilities, you could have emergent capabilities, right?

    5. BG

      Mm-hmm.

    6. JH

      Emergent abilities are consistent with intuitively from reasoning, and so some of it could be predictable, but still, it's still amazing. The fact that it's sensible doesn't make it any less amazing.... Right. I could visualize literally the entire computer, um, and, and all the b- modules in a self-driving car, and the fact that it's still keeping lanes makes me insanely happy. And so [laughing] -

    7. BG

      I even remember that from my first operating systems class in college, when I finally figured out all the way from programming language to the electrical engineering classes, bridged in the middle by that OS class, I'm like: Oh, I think I understand how the von Neumann computer works, soup to nuts, and it's still a miracle.

    8. JH

      Yeah.

    9. DR

      Yeah.

    10. JH

      Yeah, yeah. Exactly. Yeah, yeah. When you put it all together, it's still a miracle. Yeah.

  7. 24:5627:13

    Statsig

    1. BG

      Now is a great time to talk about one of our favorite companies, Statsig, and we have some tech history for you.

    2. DR

      Yes. So in our NVIDIA Part Three episode, we talked about how the AI research teams at Google and Facebook drove incredible business outcomes with cutting-edge ML models, and these models powered features like the Facebook News Feed, Google Ads, and the YouTube Next Video recommendation, in the process, transforming Google and Facebook into the juggernauts that we know today. And while we talked all about the research, we didn't touch on how these models were actually deployed.

    3. BG

      Yeah, the most common way to deploy new models was through experimentation, A/B testing. When the research team created a new model, product engineers would deploy the model to a subset of users and measure the impact of the model on core product metrics. Great experimentation tools transformed the machine learning development process. They de-risked releases, since each model could be released to a small set of users. They sped up release cycles. Researchers could suddenly get quick feedback from real user data, and most importantly, they created a pragmatic, data-driven culture since researchers were rewarded for driving actual product improvements. And over time, these experimentation tools gave Facebook and Google a huge edge because they really became a requirement for leading ML teams.

    4. DR

      Yep. So now you're probably thinking, "Well, that's great for Facebook and Google, but my team can't build out our own internal experimentation platform." Well, you don't have to, thanks to Statsig. So Statsig was literally founded by ex-Facebook engineers who did all this. They've built a best-in-class experimentation, feature flagging, and product analytics platform that's available to anyone. And surprise, surprise, a ton of AI companies are now using Statsig to improve and deploy their models, including OpenAI and Anthropic.

    5. BG

      Yep, so whether you're building with AI or not, Statsig can help your team ship faster and make better data-driven product decisions. They have a very generous free tier and a special program for venture-backed companies, simple pricing for enterprises, and no seat-based fees. If you're in the Acquired community, there's a special offer. You get five million free events a month and white-glove onboarding support. So visit statsig.com/acquired and get started on your data-driven journey.

  8. 27:1332:07

    Direct Reports

    1. BG

      We have some questions we want to ask you. Uh, some are cultural about NVIDIA, but, um, others are generalizable to company building broadly. And the first one that we wanted to ask is, uh, we've heard that you have forty-plus direct reports and that this org chart works a lot differently than a traditional company org chart. Do you think there's something special about NVIDIA that makes you able to have so many direct reports, not worry about coddling or focusing on career growth of your executives, and you're like: "No, you're just here to do your freaking best work, and the most important thing in the world, now go?"

    2. JH

      Mm-hmm.

    3. BG

      A, is that correct, and B, is there something special about NVIDIA that enables that?

    4. JH

      I don't think it's something special about NVIDIA. I think that we had the courage to build a system like this. NVIDIA is not built like a military... It's not built like a- like the armed forces, where you have, you know, generals and colonels, and you-- we just-- we're not set up like that. We're not set up in a command, and control, and information distribution system from the top down. We're really built much more like a computing stack. And a computing stack, the lowest layer is our architecture, and then there's our chip, and then there's our software, and, and on top of it, there are all these different modules, and each one of these layers and modules are people. And so the architecture of the company, to me, is a computer with a computing stack, with, um, uh, people managing different parts of the system. And who reports to whom, your title is not related to anywhere you are in the stack. It just happens to be who is the best at running that module on that function, on that layer, i- is in charge, and that person is the pilot in command. And so that's one characteristic. And, um-

    5. BG

      Have you always thought about the company this way?

    6. DR

      Even from the earliest days?

    7. JH

      Yeah, pretty much. Yeah. And the reason for that is because your organization should be the architecture of the machinery of building the product, right?

    8. DR

      Yep.

    9. JH

      That's what a company is.

    10. DR

      Yep.

    11. JH

      And yet everybody's company look exactly the same, but they all-

    12. DR

      [laughing]

    13. JH

      ... build different things. How does that make any sense?

    14. DR

      No.

    15. JH

      Do you see what I'm saying?

    16. DR

      Yeah.

    17. JH

      You know, how you make fried chicken versus how you flip burgers versus how you make, you know, Chinese fried rice is different, and so why would the machinery, why would the process be exactly the same? And so it's not sensible to me that if you look at the org charts of most companies, it all kind of looks like this, and then you have one group that's for a business, and you have another for another business, you have another for another business, and they're all kind of supposedly autonomous. And so none of that stuff makes any sense to me. It just depends on what is it that we're trying to build, and what is the architecture of the company that best suits to go build it? That's-- so that's number one. In terms of information system and how do you enable collaboration, we kind of wire it up like a neural network, and the way that we say is that there's a phrase in the company called "mission is the boss," and so we figure out what is the mission of-- what is the mission, and we go wire up the best skills, and the best teams, and the best resources to achieve that mission. And it cuts across the entire organization in a way that doesn't make any sense, but it's looks like a little bit like a neural network-

    18. BG

      Mm.

    19. JH

      You know, if you draw one out.

    20. DR

      And when you say mission, do you mean mission like-

    21. DR

      ... NVIDIA's mission is-

    22. JH

      Build Hopper.

    23. DR

      Yeah, okay. So it's not like further accelerated computing-

    24. JH

      No

    25. DR

      - it's like worshiping DGX cloud.

    26. JH

      Build Hopper, or somebody else's, uh, build a system for Hopper. Somebody is, uh, build CUDA for Hopper. Somebody's job is build cuDNN for CUDA for Hopper. Somebody's job is the mission, right? Is, is so, you know, your mission is to do something.

    27. BG

      What are the trade-offs associated with that versus the traditional structure?

    28. JH

      The downside is the pressure on the leaders is fairly high, and the reason for that is because in a command and control system, the person who you report to has more power than you. And the reason why they have more power than you is because they're closer to the source of information than you are.

    29. BG

      Mm.

    30. JH

      In our company, the information is disseminated fairly quickly to a lot of different people, and it's usually at a team level. So, for example, just now, I was in, I was in our robotics meeting, and we're talking about certain things, and we're making some decisions, and there are new college grads in the room, there's three vice presidents in the room, there's two E-staffs in the room, and at the moment that we decided together, we reasoned through some stuff, we made a decision, everybody heard it exac- exactly the same time. So nobody has more power than anybody else.

  9. 32:0734:16

    Product Shipping Cycle

    1. JH

      knew.

    2. DR

      When we did our most recent episode, NVIDIA Part Three, that we, we just released, we sort of did this thought exercise, um, especially over the last couple of years-

    3. JH

      Mm-hmm.

    4. DR

      -your product shipping cycle has been very impressive, especially given the level of technology that you are working with and the difficulty of this all. We sort of said, like: Could you imagine Apple shipping two iPhones a year? [chuckles]

    5. BG

      And we said that for illustrative purposes.

    6. DR

      For illustrative purposes, not to pick on Apple or whatever-

    7. BG

      A large tech company-

    8. DR

      A large tech company

    9. BG

      ... shipping two flagship products-

    10. DR

      Yeah

    11. BG

      -or their flagship product twice per year.

    12. DR

      Yeah, or, you know, two WWDCs a year.

    13. JH

      Yeah.

    14. BG

      There seems to be something unique-

    15. DR

      You can't, like, you can't really imagine that, whereas-

    16. JH

      Yeah

    17. DR

      -that happens here. Are there other companies, either current or historically-

    18. JH

      Mm-hmm

    19. DR

      -that you look up to, admire, maybe took some of this inspiration from?

    20. JH

      In the last thirty years, I've read my fair share of business books, and as in everything you read, you, you're supposed to, you're supposed to, to, first of all, enjoy it, right? Enjoy it, be inspired by it, uh, but not to adopt it. That's not the whole point of these books. The whole point of these books is to share their experiences, and, and you- you're supposed to ask, you know, "What does it mean to me in my world, and what does it mean to me in the context of what I'm going through? What does this mean to me in the environment that I'm in, and what does this mean to me and what I'm trying to achieve, and what does this mean to NVIDIA in the age of our company and the capability of our company?" And so you're supposed to ask yourself, what does it mean to you?

    21. DR

      Mm-hmm.

    22. JH

      And then from that point, being informed by all these different things that we're learning, uh, we're supposed to come up with our own strategies. You know, what I just described is kind of how I go about everything. You're supposed to be inspired and learn from every- everybody else, and, and the education's free, you know? When somebody talks about a new product, you're supposed to go listen to it. You're not supposed to ignore it. You're supposed to go learn from it, and, uh, it could be a competitor, it could be a adjacent industry, it could be nothing to do with us. Uh, the more we're-- we learn from, uh, what's happening out in the world, uh, the better. But then you're, you're supposed to come back and ask yourself, you know, "What does this mean to us?"

    23. DR

      Yeah, you don't just want to imitate them.

    24. JH

      That's right.

  10. 34:1639:31

    Journey to the Data Center

    1. DR

      Yeah.

    2. JH

      Yeah.

    3. DR

      [chuckles] I love this tee-up of learning, but not imitating, and learning from a wide array of sources. There's this sort of, um, unbelievable third element, I think, to what NVIDIA has become today, and that's the data center. It's certainly not obvious-- I can't reason from AlexNet and your engagement with the research community-

    4. JH

      Uh-huh

    5. DR

      ... uh, and, and-

    6. JH

      Uh-huh

    7. DR

      -you know, social media feed recommenders-

    8. JH

      How I got here

    9. DR

      -to-

    10. JH

      Yeah, yeah

    11. DR

      -you deciding, and the company deciding-

    12. JH

      Yeah, all in

    13. DR

      -we're gonna go on a five-year, all-in journey-

    14. JH

      Yeah

    15. DR

      -on the data center.

    16. JH

      Yeah, yeah.

    17. DR

      How did that happen?

    18. JH

      Yeah. Our journey to the data center happened, I would say, almost seventeen years ago. I'm always being asked, I mean, what, what are the challenges that the company could see someday? And, and I've always felt that the fact that NVIDIA's technology is plugged into a computer, and that computer has to sit next to you because it has to be connected to a monitor, that will limit our opportunity someday because there are only so many desktop PCs that plug a GPU into. And, uh, there's only so many CRTs and, and, and the time LCDs that we could possibly drive. So the question is: Wouldn't it be amazing if our computer doesn't have to be connected to the viewing device? That, that the separation of it, um, made it possible for us to compute somewhere else. And one of our engineers came and showed it to me one day, and it was really capturing the frame buffer, encoding it into video, and streaming it, um, to a, a receiver device-

    19. DR

      Mm

    20. JH

      ... separating computing from the viewing.

    21. BG

      In many ways, that's cloud gaming.

    22. DR

      Cloud gaming. [chuckles]

    23. BG

      Like eighteen years early. [chuckles]

    24. JH

      In fact, in fact, that was when we started GFN. We knew that GFN was going to be, um, a journey that would take a long time because you're, you're fighting, you're fighting all kinds of problems, including, including the speed of light. And-

    25. BG

      Latency everywhere you look.

    26. JH

      That's right.

    27. DR

      For listeners, GFN, GeForce Now.

    28. JH

      GeForce Now.

    29. DR

      Yeah.

    30. JH

      Yeah, GeForce Now. And, and we've been working on GeForce Now-

  11. 39:3143:41

    Mellanox Acquisition

    1. JH

      one.

    2. BG

      So speaking of the speed of light, InfiniBand.

    3. DR

      Yeah. [laugh]

    4. BG

      [chuckles] Like, D-David's, like, begging me to go here.

    5. JH

      Uh-huh.

    6. BG

      Can feel it.

    7. DR

      I was at the same time.

    8. BG

      You totally saw that InfiniBand would be way more useful, way sooner than anyone else realized.

    9. JH

      Yeah.

    10. BG

      Acquiring Mellanox, I think you uniquely saw that this was required to train large language models, and you were super aggressive in acquiring that company. Why did you see that when no one else saw that?

    11. JH

      Well, uh, there are several reasons for that. First, um, if you want to be a data center company building building the processing chip isn't the way to do it. A data center is distinguished from a desktop computer versus a cell phone, not by the processor in it.

    12. BG

      Yeah.

    13. JH

      A desktop computer in a data center uses the same CPUs, uses the same GPUs, apparently, right? Very close. And so it's not the chip, it's not the processing chip that des- describes it, but it's the networking of it. It's the infrastructure of it. It's the... you know, how the, the, the computing is distributed, how security is provided, how networking is done, you know, so on and so forth. And so, so it-- those characteristics a-are associated with Mellanox, not NVIDIA. And so the day that I concluded that really NVIDIA wants to be a, you know, build computers of the future, and computers of the future are going to be data centers, embodied in data centers, then we-- then if we want to be a data center-oriented company, then, then we really need to get into networking, and so that was one. The second thing is observation that whereas cloud computing started in hyperscale, which is about taking commodity components, a lot of users, and virtualizing many users u-on top of one computer, AI is really about distributed computing, where one job, one training job, um, is orchestrated across millions of processors. And so it's the inverse of hyperscale almost. And the way that you design a hyperscale computer with, with off-the-shelf commodity Ethernet, which is just fine for Hadoop, it's just fine for search queries, it's just fine-

    14. BG

      Yeah

    15. JH

      ... for all of those things, it's-

    16. BG

      But not when you're sharding a model across multiple racks.

    17. JH

      Not when you're sharding a model across, right. And so, uh, that observation says that the type of networking you want to do is not exactly Ethernet, and the way that we do networking for supercomputing is really quite ideal. And so the combination of those two ideas, um, uh, you know, convinced me that, that Mellanox is, is absolutely the right, the right company because they were-- they're the world's leading high-performance networking company, and, and we've worked with them in so many different areas in, in, uh, high-performance computing already. Plus, I, I really like the people. Um, uh, the, the, the Israel team is world-class. Uh, we have some three thousand two hundred people there now, and it was one of the best strategic decisions I've ever made.

    18. DR

      When we were researching, particularly part three of our NVIDIA series, we talked to a lot of people, and many people told us the Mellanox acquisition-

    19. JH

      Uh-huh

    20. DR

      ... is one of, if not the best of all time-

    21. JH

      Yeah

    22. DR

      -by any technology company.

    23. JH

      Yeah. I think so too, yeah.

    24. DR

      Yeah.

    25. JH

      And it's so disconnected from the work that we normally do. It was surprising to everybody. I-

    26. BG

      But framed this way, you were, you were standing near where the action was-

    27. JH

      Yeah

    28. BG

      ... so you could figure out as soon as that apple sort of becomes available to purchase, like, "Oh, LLMs are about to blow up. I'm going to need that. Everyone's going to need that. I think I know that before anyone else does?"

    29. JH

      Yeah. You want to position yourself near opportunities. You don't have to be that perfect, you know?

    30. BG

      [chuckles]

  12. 43:4145:45

    Crusoe

    1. BG

      All right, listeners, we are here to tell you about a company that literally couldn't be more perfect for this episode, Crusoe.

    2. DR

      Yes, Crusoe, as you know by now, is a cloud provider built specifically for AI workloads and powered by clean energy, and NVIDIA is a major partner of Crusoe. Their data centers are filled with A100s and H100s. And as you probably know, with the rising demand for AI, there's been a huge surge in the need for high-performing GPUs, leading to a noticeable scarcity of NVIDIA GPUs in the market. Crusoe has been ahead of the curve and is among the first cloud providers to offer NVIDIA's H100s at scale. They have a very straightforward strategy: create the best AI cloud solution for customers using the very best GPU hardware on the market the customers ask for, like NVIDIA, and invest heavily in an optimized cloud software stack.

    3. BG

      Yep. To illustrate, they already have several customers already running large-scale generative AI workloads on clusters of NVIDIA H100 GPUs, which are interconnected with 3,200 gigabit InfiniBand and leveraging Crusoe's network-attached block storage solution. And because their cloud is run on wasted, stranded, or clean energy, they can provide significantly better performance per dollar than traditional cloud providers.

    4. DR

      Yep. Ultimately, this results in a huge win-win. They take what is otherwise a huge amount of energy waste that causes environmental harm and use it to power massive AI workloads. And it's worth noting that through their operations, Crusoe is actually reducing more emissions than they would generate. In fact, in 2022, Crusoe captured over four billion cubic feet of gas, which led to the avoidance of approximately five hundred thousand metric tons of CO2 emissions. That's equivalent to taking about a hundred and sixty thousand cars off the road.

    5. BG

      Amazing. If you, your company, or your portfolio companies could use lower cost and more performant infrastructure for your AI workloads, go to crusoecloud.com/acquired. That's C-R-U-S-O-E cloud.com/acquired, or click the link in the show notes.

  13. 45:4555:54

    Advice For Company Building

    1. BG

      I wanna move away from NVIDIA, if you're okay with it, and ask you some questions, since we have a lot of founders that listen to this show-

    2. JH

      Mm

    3. BG

      ... sort of advice for company building.

    4. JH

      Mm.

    5. BG

      The first one is, when you're starting a startup in the earliest days, your biggest competitor is, uh, you don't make anything people want. Like, your company's likely to die-

    6. JH

      Non-consumption

    7. BG

      ... just because people don't actually care as much as you do about what you're building.

    8. JH

      That's right. Yeah.

    9. BG

      In the later days, you actually have to be very thoughtful about competitive strategy, and I'm curious, what would be your advice to companies that, you know, have product market fit, that are starting to grow, they're in interesting growing markets? Um, where should they look f- for competition, and how should they handle it?

    10. JH

      Well, there are all kinds of ways to think about competition. We prefer to position ourselves in a way that serves a need that usually hasn't emerged.

    11. DR

      I've heard, uh, you or others in NVIDIA, I think, use the phrase zero billion dollar markets.

    12. JH

      Yeah, that's exactly right.

    13. DR

      Yeah.

    14. JH

      You know, it's our way of saying there's no market yet, but we believe there will be one. And, and usually, when you're positioned there, everybody, everybody's trying to figure out, "Why are you here?" [chuckles] Right? Because when we first got into automotive, because we believe that in the future, the car is gonna be largely software, and if it's gonna be largely software, um, a, a really incredible computer is necessary. And so, so when we positioned ourselves there, most people... I, I, I still remember one, one of the, one of the CTOs told me, "You know what? Cars cannot tolerate the blue screen of death." And I said, "Well, I don't think anybody can tolerate that, but- [laughing]

    15. BG

      [laughing]

    16. JH

      ... but that, that doesn't change the fact that someday, every car will be a software-defined car." And I, I think, you know, uh, fifteen years later, we're, we're, we're, we're largely right. And so oftentimes there's non-consumption, and we like to navigate our company there. And by doing that, um, by the time that you, uh, that the market emerges, it- it's very, it's very likely there aren't that many competitors shaped that way.

    17. BG

      Mm-hmm.

    18. JH

      And so we were early in PC gaming, and today, uh, NVIDIA is very large in PC gaming. Uh, we, uh, reimagined what a, what a, uh, design workstation would be like, and today, just about every workstation on the planet uses NVIDIA's technology. Uh, we re- reimagined, um, how supercomputing ought to be done and who should, who should benefit from supercomputing, that we would democratize it, and look, today, NVIDIA's in, in accelerated computing is, is, um, quite large. And we reimagined how software would be done, and today it's called machine learning, and how computing would be done, we call it AI. And so we reimagined these kind of things, uh, try to, try to do that about a decade in advance. And so we spent about a decade in zero billion dollar markets.

    19. BG

      Mm-hmm.

    20. JH

      And today, I spend a lot of time on Omniverse, and Omniverse is a, you know, classic example of a zero billion dollar [chuckles] business. And-

    21. BG

      There's, like, forty customers now, something like that. [laughing]

    22. DR

      Yeah. [chuckles] Like Amazon, BMW.

    23. JH

      Yeah.

    24. DR

      Yeah.

    25. JH

      No, it's cool. It's cool.

    26. BG

      So let's say you do get this great ten-year lead, but then other people figure it out, and you got people nipping at your heels. What are some structural things that someone who's building a business can do to sort of stay ahead? And you can just keep your pedal to the metal and say, "We're gonna outwork them, and we're gonna be smarter," and, like, that works to some extent, but those are tactics. What strategically can you do to sort of make sure that you can maintain that lead?

    27. JH

      ... oftentimes, if you created the market, you ended up having, you know, what, what people describe as moats. Because if you build your product right, and it's enabled, uh, an entire ecosystem around you to help serve that end market, you've essentially created a platform.

    28. DR

      Mm-hmm. Yeah.

    29. JH

      Sometimes it's a, it's a product-based platform, sometimes it's a service-based platform, sometimes it's a technology-based platform. But if you were, you were early there, and you, you, you were mindful about helping the ecosystem, um, succeed with you, you ended up having this network of networks and all these developers and all these customers who are, who are built around you.

    30. DR

      Yep.

  14. 55:5459:54

    Luck & Skill

    1. JH

      still fail.

    2. BG

      Do you remember any moments in NVIDIA's history where you're like: "Ooh, we made a bunch of wrong decisions, but somehow we got saved?" Because, you know, it takes the sum of all the luck and all the skill-

    3. JH

      Yeah

    4. BG

      ... in order to succeed. Do you remember any moments where you're like-

    5. JH

      I actually thought that you starting with Riva, Riva one twenty was de-- spot on. Uh, Riva one twenty-eight, uh, uh, as I mentioned, the, the number of smart decisions we made, which are smart to this day, how we design chips is exactly the same to this day. Because, gosh, you know, nobody's ever done it back then, and we pulled every trick in the book in a desperation because we had no other choice. Well, guess what? That's the way things ought to be done, and now everybody does it that way.

    6. BG

      Right.

    7. JH

      Everybody does it, because why should you do things twice if you can do it once? Why tape out a chip seven times if you could tape it out one time, right? And so the most efficient, the most cost-effective, the most competitive, um, uh, speed is technology, right? Speed is performance, time to market is performance. All of those things apply, so why do things twice if you could do it once?

    8. BG

      Yeah.

    9. JH

      And so Riva one twenty-eight made a lot of great decisions in how we spec products, um, how we, how we think about market needs and, and lack of, and how do we judge markets, and all of this. Man, we made some amazing-- amazingly good decisions. Yeah, we were, you know, back against the wall. We only had one more shot to do it, but-

    10. BG

      Once you pull out all the stops and you see what you're capable of, why would you put stops in next time?

    11. JH

      Exactly.

    12. BG

      Like, let's keep stops out all the time-

    13. JH

      That's right

    14. BG

      ... every time.

    15. JH

      That's right.

    16. DR

      Is it fair to say, though, maybe on the luck side of the equation, thinking back to nineteen ninety-seven, that that was the moment where consumers tipped to really, really valuing three D graphical performance in games?

    17. JH

      Oh, yeah. So for example, luck. Let's, let's talk about luck. Um, i- if, uh, Carmack hadn't, hadn't, um, uh, decided to use acceleration, because remember, Doom was completely software-rendered, and the NVIDIA philosophy was that although general purpose computing is a, is a fabulous thing, and it's going to enable software and IT and everything, um, we felt that there were, there were applications that wouldn't be possible or would be costly if it wasn't accelerated. It should be accelerated. And three D graphics was one of them, but it wasn't the only one, and it just happens to be the first one and a really great one. And I still remember the first times we met John, he was quite emphatic about using CPUs, and, and his software renderer was really good. I mean, quite frankly, if you look at, look at Doom, uh, the performance of Doom was really hard to achieve, even with accelerators at the time. You know, if you didn't filter, if you didn't have to do bilinear filtering, um, uh, it did a pretty good job.

    18. DR

      The problem with Doom, though, was you needed Carmack to program it. [chuckles]

    19. JH

      Yeah, you needed Carmack to program it. Exactly. It was, it was a genius piece of code, and, um, but nonetheless, software renderers did a really good job. And but-- and, and if he hadn't decided to go to OpenGL and accelerate, uh, accelerate for Quake, uh, frankly, you know, what would be the killer app that put us here?

    20. BG

      Right.

    21. JH

      And so Carmack and Sweeney, both between, uh, Unreal and Quake, created the first two, uh, killer applications for, for consumer three D. Yeah, and so, uh, I, I owe, owe them a great deal.

    22. DR

      I want to come back real quick to, you know, you said you told these stories, and you're like: "Well, I don't know what founders can take from that." I, I actually do think, um, you know, if you look at all the big tech companies today, perhaps with the exception of Google, they did all start, and understanding this now about you, by addressing developers-

    23. JH

      Mm-hmm

    24. DR

      ... planning to build a platform-

    25. JH

      Mm-hmm

    26. DR

      ... and tools for developers.

    27. JH

      Mm-hmm.

    28. DR

      Um, you know, all of them.

    29. JH

      Mm-hmm.

    30. DR

      Apple-

  15. 59:541:06:56

    Job Displacement

    1. JH

      Yeah.

    2. BG

      Well, as we, we start to drift toward the end here, we've spent a lot of time on the past-

    3. JH

      Mm-hmm

    4. BG

      ... and I want to think about the future a little bit. I'm sure you spend a lot of time on this, being on the cutting edge of AI. You know, we're moving into an era where the productivity that software can accomplish when a person is using software can massively amplify the impact and the value that they're creating, which has to be amazing for humanity in the long run. In the short term, it's going to be inevitably bumpy as we sort of figure out what that means. What do you think some of the solutions are as AI gets more and more powerful and better at accelerating productivity, uh, for all the displaced jobs that are going to come from it?

    5. JH

      Well, first of all, we have to keep AI safe, and there's a couple of different areas of AI safety, um, that's really important. Obviously, uh, in robotics and self-driving car, there's a whole field of AI safety, and we've dedicated ourselves to functional safety and active safety and all kinds of different, different areas of safety. Um, when to apply human in the loop, when is it okay for a human not to be in the loop? Uh, uh, uh, you know, how do you get to a point where, where, um, uh, increasingly human doesn't have to be in the loop, but human largely in the loop?

    6. BG

      Yeah.

    7. JH

      In the case of information safety, obviously bias, false information, and appreciating the, the rights of artists and, and creators, um, that, that whole area, uh, deserves a lot of attention. And, and you've seen some of the work that we've done. Instead of scraping the internet, um, we, we partnered with Getty and Shutterstock to-... create commercially fair way of applying artificial intelligence, generative AI.

    8. DR

      Yep.

    9. JH

      In the area of, uh, large language models and the, and the future of increasingly greater agency AI, clearly the answer is for as long as it's sensible, and I think it's gonna be sensible for a long time, is human in the loop. The ability for an AI to self-learn and improve and change, uh, out in the wild, uh, i- in a digital form, uh, should be avoided. And, and, um, uh, we should collect data, we should curate the data, we should train the model, we should, you know, test the model, validate the model before we release it out in the wild again, so human is in the loop.

    10. DR

      Yep.

    11. JH

      There are a lot of different industries that have already demonstrated how to build systems that are safe and good for humanity, and obviously, the way, uh, autopilot works for, for a plane and, and two-pilot system, and then air traffic control, and, um, you know, redundancy and diversity, and, and all of the basic philosophies of designing safe systems, um, apply, uh, as well in self-driving cars and, and so on and so forth. And, and so I, I think there's a lot of models of, of creating safe AI, and, and I think we need to apply them. With respect to automation, my feeling is that, uh, and we'll see, but it is more likely that AI is gonna create more jobs, and in the near term. The question is, what's the definition of near term? And the reason for that is, is, um, uh, the first thing that, that happens with productivity is prosperity. And prosperity, when the companies get, get more successful, they hire more people because they want to expand into more areas. And so the question is, if you think about a company and say, "Okay, if we improve the productivity, then they need, they need fewer people," well, that's because the company has no more ideas, but that's not true-

    12. DR

      [laughing] Yeah.

    13. JH

      -for most companies. Um, if you become more productive and the company becomes more profitable, usually they hire more people to expand into new areas. And so long as we believe that there are more areas to expand into, that the, the, the-- there are more ideas in drugs, this drug discovery, there are more ideas in transportation, there are more ideas in retail, there are more ideas in entertainment, that there's more ideas in technology. So long as we believe that there are more ideas, the prosperity of the industry, which comes from improved productivity, results in hiring more people, more ideas. Now, you go back in history, we can fairly say that today's industry is larger than the industry what-- the, the world's industry a thousand years ago. And the reason for that is because, obviously, humans have a lot of ideas. And I think that there's plenty of ideas yet for prosperity and plenty of ideas that can be begat from productivity improvements. But then my sense is that it's likely to generate jobs. Now, obviously, the net generation of jobs doesn't guarantee that any one human doesn't get fired, okay? I mean, that's obviously true. And, and it's more likely that someone, uh, will lose a job to someone else, some other human that uses an AI, you know, and not, not likely to an AI, but to some other human that uses an AI. And so I think the, the first thing that everybody should do is learn how to use AI so that they can augment their own productivity, and every company should augment their own productivity to be more productive so that they can have more prosperity, hire more people. And so I think jobs will change. My guess is that we'll actually have higher employment. We'll create more jobs. I think industries will be more, more productive. Um, and many of the industries that are currently suffering from lack of, lack of, uh, labor, uh, workforce, is likely to, uh, use AI to get themselves off their feet and, and get back to growth and prosperity. So I see it a little bit differently, but I do think that jobs will be affected, um, and I, I'd encourage everybody just to learn AI.

    14. DR

      This is, uh, appropriate. There's a version of, um, something we talk about a lot on Acquired. We call it the, uh, Moritz Corollary to Moore's Law-

    15. JH

      Uh-huh.

    16. DR

      -after Mike Moritz from, uh-

    17. JH

      Uh-huh. Yeah, I know Mike

    18. DR

      ... from, uh, Sequoia.

    19. JH

      Very well, yeah.

    20. DR

      Um, and, uh-

    21. JH

      Sequoia was w- the first investor in our company.

    22. DR

      Yeah, of course. Yeah.

    23. JH

      Yeah.

    24. DR

      The great story behind it is that, uh, when Mike was taking over for Don Valentine with-

    25. JH

      Mm-hmm

    26. DR

      ... with Doug, he was sitting and looking at Sequoia's returns, and he was looking at fund three or four, I think it was four maybe, that had Cisco in it, and he was like: "How are we ever gonna top that? You know, I can't, I can't-- You know, Don's gonna have us beat. We're never gonna beat that." And he thought about it, and he realized that, well, as compute gets cheaper, and it can access more areas of the economy because it gets cheaper and can a- get adopted more widely, well, then the markets that we can address should get bigger.

    27. JH

      Yeah.

    28. DR

      And AI, your argument is basically-

    29. JH

      Exactly the same.

    30. DR

      AI will do the same thing.

  16. 1:06:561:08:57

    Blinkist

    1. DR

      Now is a great time to share something new from our friends at Blinkist and Go1 that is very appropriate to this episode.

    2. BG

      Yes. So personal story time. I, a few weeks ago, was scouring the web to find Jensen's favorite business books, which was proving to be difficult. I really wanted Blinkist to make Blinks of each of those books so you could all access them, and I think I found one or two in random articles, but that just wasn't enough. So finally, before I gave up, as a last resort, I asked an AI chatbot, specifically Bard, to provide me a list and cite the sources of Jensen's favorite business books, and miraculously, it worked. Bard found books that Jensen had called out in public forums over the past several decades. So if you click the link in the show notes or go to blinkist.com/jensen, you can get the Blinks of all five of those books, plus a few more that Jensen specifically told us about later in the episode.

    3. DR

      ... Yes, and we also have an offer from Blinkist and Go1 that goes beyond personal learning. Blinkist has handpicked a collection of books related to the themes of this episode, so tech innovation, leadership, the dynamics of acquisitions. These books offer the mental models to adapt to a rapidly changing technology environment.

    4. BG

      And just like all other episodes, Blinkist is giving Acquired listeners an exclusive fifty percent discount on all premium content. This gives you key insights from thousands of books at your fingertips, all condensed into easy-to-digest summaries. And if you're a founder, a team lead, or an L&D manager, Blinkist also includes curated reading lists and progress tracking features, all overseen by a dedicated customer success manager to help your team flourish as you grow.

    5. DR

      Yes. So to claim the whole free collection, unlock the fifty percent discount, and explore Blinkist's enterprise solution, simply visit blinkist.com/jensen and use the promo code Jensen. [chuckles] Blinkist and their parent company, Go1, are truly awesome resources for your company and your teams as they develop from small startup to enterprise. Our thanks to them, and seriously, this offer is pretty awesome. Go take them up on it.

  17. 1:08:571:09:33

    Favorite Sci-Fi

    1. DR

      We have a few lightning round questions-

    2. JH

      Oh, dear.

    3. DR

      -we want to ask you.

    4. JH

      Oh, dear.

    5. DR

      And then we have, uh, [chuckles] -

    6. JH

      Oh, dear.

    7. DR

      And then we have a very fun-

    8. JH

      I can't think that fast. Okay.

    9. BG

      We'll, we'll-

    10. JH

      All right

    11. BG

      ... we'll open with an easy one based on all these, uh, conference rooms we see-

    12. DR

      Yeah

    13. BG

      ... named around here.

    14. JH

      Uh-huh.

    15. BG

      Favorite sci-fi book?

    16. JH

      I've never read a sci-fi book before.

    17. DR

      No!

    18. BG

      Come on.

    19. JH

      Yeah. Yeah, yeah.

    20. BG

      What's with, like-

    21. DR

      You're missing out

    22. BG

      ... the obsession with Star Trek and, like-

    23. JH

      Well, just, you know, I watched the TV show. Yeah. [chuckles]

    24. BG

      Okay.

    25. DR

      Favorite sci-fi TV series?

    26. BG

      Favorite sci-fi TV show.

    27. JH

      Uh, oh, Star Trek's my favorite.

    28. BG

      Yeah.

    29. JH

      Yeah, Star Trek's my favorite. [chuckles]

    30. BG

      I saw V'ger out there on the way in.

  18. 1:09:331:10:28

    Daily Driver

    1. DR

      What car is your daily driver these days? And related question: do you still-

    2. JH

      These days

    3. DR

      ... have the Supra?

    4. JH

      Oh, [chuckles] it is one of my favorite cars, um, and also favorite memories. You guys might not know this, but, but, uh, uh, Lori and I got engaged, um, uh, Christmas, uh, one year, and we drove back in my, my brand-new Supra, and we totaled it. We were this close to the end.

    5. BG

      Thank God you didn't.

    6. JH

      Yeah, but, but nonetheless, uh, it was my fault. It wasn't, wasn't the Supra's fault, but, but, uh, it, it's a remarkable [chuckles] I, I love that car.

    7. DR

      The one time when it wasn't the Supra's fault. [chuckles]

    8. JH

      [chuckles] Yeah. I love that car. I'm driven these days, for, for security reasons and others, but, um, uh, uh, I'm driven in the, uh, Mercedes EQS. It's a great car.

    9. DR

      Ah, nice!

    10. JH

      Yeah. Yeah, great car.

    11. BG

      Nice.

    12. JH

      Yep.

    13. DR

      Using NVIDIA technology?

    14. JH

      Yeah, it has... Yeah, we're in, we're in the, in the, uh, uh, the, the, uh, we're the central computer. Yep.

    15. BG

      Sweet.

  19. 1:10:281:10:55

    Favorite Business Book

    1. BG

      I know we already talked a little bit about business books, but one or two favorites that you've taken something from.

    2. JH

      Clay Christensen, I think, has... The, the series is the best. I mean, there's just no, no two ways about it, and, and the reason for that is be- is because it's so intuitive and so sensible. It's, it, it's approachable. But, uh, I read a whole bunch of them, and I read just about all of them. I really enjoyed Andy, Andy Grove's books. They're all really good.

    3. BG

      Awesome.

  20. 1:10:551:11:45

    Don Valentine

    1. BG

      Favorite characteristic of Don Valentine?

    2. JH

      Grumpy but endearing, and, uh, what he said to me the last time as he, uh, decided to invest in our company, he says: "If you lose my money, I'll kill you." [laughing]

    3. DR

      [chuckles] Of course he did.

    4. JH

      And, uh, and then, uh, over the course of, of the decades, uh, uh, the years that followed, uh, when something is nice written about us in Mercury News, um, it seems like he wrote it in a crayon. He- you know, he'll say, he'll say: "Good job, Don," you know-

    5. DR

      [chuckles]

    6. JH

      ... just right, right over the newspaper, and just, "Good job, Don," and he mails it to me. And, and, uh, I, I hope I'd kept them, but anyways, uh, you, you could tell he's a, he's a real sweetheart, and, and, um, uh... but, but, uh, he cares about the companies.

    7. BG

      I bet.

    8. DR

      He's a special character.

    9. JH

      Yeah, he's incredible.

  21. 1:11:451:12:42

    40 Year-Old Jensen

    1. BG

      What is something that you believe today, that 40-year-old Jensen would have pushed back on and said, "No, I disagree"?

    2. JH

      Um, there's plenty of time.

    3. BG

      Hmm.

    4. JH

      Yeah, there's plenty of time. If you prioritize yourself, uh, properly, and, and you make sure that you, you, uh, you don't let Outlook be the controller of your time, there's plenty of time.

    5. DR

      Plenty of time in the day, plenty of time-

    6. JH

      To do anything

    7. DR

      ... to achieve things? Like-

    8. JH

      Yeah, to do anything

    9. DR

      ... just in-

    10. JH

      Just don't do everything. Prioritize your life. Make sacrifices. Don't let Outlook control what you do every day. Notice I was late to our meeting, and the reason for that, by the time I looked up, I... "Oh, my gosh," you know, "Ben and Dave are waiting," you know? It's already-

    11. BG

      We had time.

    12. JH

      Yeah.

    13. DR

      Yeah.

    14. JH

      Exactly. And so-

    15. DR

      Didn't stop this from being a great chat.

    16. JH

      No, but you have to prioritize your time really carefully, and don't let Outlook de- determine that.

    17. BG

      Love that.

  22. 1:12:421:13:29

    What are You Afraid of?

    1. BG

      What are you afraid of, if anything?

    2. JH

      I'm afraid of the same things today that I was, I was, uh, in, in the very beginning of this company, which is letting the employees down. You know, you have a lot of people who joined your company because they believe in your hopes and dreams, and, and they've adopted it as their hopes and dreams, and, and, uh, you, you want to be right for them. You want to be successful for them, for them. You want them to be able to, uh, build a great life as, as well as help you build a great company and be able to build a great career. You want them to have to enjoy all of that, and these days, I want them to be able to enjoy the, the things I've had the benefit of enjoying and, um, all the great success I've enjoyed. I want them to be able to enjoy all of that, and so, so I think, I think the, uh, the greatest fear is that, uh, that, uh, you let them down.

  23. 1:13:291:19:44

    Final Job

    1. DR

      At what point did you realize that you weren't gonna have another job, that, like, this was it?

    2. JH

      I just... I don't change jobs. You know, if, if it wasn't because of Chris and Curtis convincing me to do, do NVIDIA, I would still be at LSI Logic today, I'm certain of it.... Wow! Yeah. Wow, really? Yeah, yeah. I'm certain of it. I would keep doing what I'm doing, and at the time that I was there, I was completely d- dedicated and focused on, on helping LSI Logic be the best company it could be. And I was LSI Logic's best ambassador. I've got great friends that, to this day, uh, that I've known from, from LSI Logic. Uh, it's a company I, I loved, uh, then, I love dearly today. I know exactly why it went, um, uh, the revolutionary impact it had on chip design and system design and computer design. In my estimation, one of the most important companies that, that ever came to Silicon Valley and changed everything about how computers were made. Uh, it put me in the, in the epicenter of some of the most important events in computer industry. It led me to meeting Chris and Curtis and Andy Bechtolsheim and John Rubenstein, and, you know, some of the most important people in the world, and Ed Frank that I, I was with the other day, and just-- I mean, the list goes on. And, and so, uh, uh, LSI Logic was really important to me, and, and, uh, I would still be there. I, I would-- You know, who knows what LSI Logic would have become if I were still there, right? And, and so that's kind of how my, my mind works. Um, now-

    3. DR

      Powering the AI of the world.

    4. JH

      Yeah, exactly.

    5. DR

      [chuckles]

    6. JH

      I mean, I, I might be doing the same thing I'm doing today.

    7. DR

      I got the sense from-

    8. JH

      Yeah

    9. DR

      ... remembering back to part one of our, uh, series on NVIDIA-

    10. JH

      But until, until I'm fired, [laughing] I'm gonna-- This is, this is my last job.

    11. DR

      This was- [clapping]

    12. JH

      This is it.

    13. DR

      I love it.

    14. JH

      Yeah, yeah.

    15. DR

      I got the sense that, um, LSI Logic might have also changed your, um, perspective and philosophy about computing, too. The sense I-- we got from the research-

    16. JH

      Mm-hmm

    17. DR

      ... was that when, right out of school and when you first went to AMD first, right?

    18. JH

      Yeah.

    19. DR

      You believed that, like, kind of a version of that, was it the Jerry Sanders, "Real men have fabs?"

    20. JH

      Mm-hmm.

    21. DR

      Like, you, you need to do the whole stack.

    22. JH

      Mm-hmm.

    23. DR

      Like, you gotta do everything, and that LSI Logic changed you.

    24. JH

      What LSI Logic did was, was, uh, realized that you can express, um, transistors and logical gates and chip functionality in high-level languages. That by raising the level of abstraction in what is now called high-level design, it was coined by, uh, Harvey Jones, who's on, on N-NVIDIA's board, and I met, met him, uh, way back in the early days of Synopsys. But, but during that time, there was this belief that you can express chip design in high-level languages, and by doing so, you could take advantage of optimizing compilers and optimization logic and, and, and tools, um, and, and be a lot more productive. That logic was so sensible to me, and I was twenty-one years old at the time, and I, I wanted to pursue that vision. Now, frankly, that, that idea happened in, in, um, uh, machine learning, it happened in, you know, software programming, and I want to see it happen in digital biology so that we can, we can think about, uh, biology in a much higher level language. Uh, probably a large language model, um, would be the, the way to make it, make it representable. That transition was so revolutionary. I thought that was the best thing that ever happened to the industry, and I was p- I was really happy to be part of it, and I was at ground zero. And so, so I, I saw one industry, um, change, revolutionize another industry, and i- if not for LSI Logic doing the work that it did, uh, Synopsys shortly after, then why would the computer industry be where it is today? Yeah, it, it's, uh, really, really terrific. I was, I was, uh, at the right place at the right time to see all that.

    25. DR

      That's super cool.

    26. JH

      Yeah.

    27. DR

      And it sounded like the CEO of LSI Logic, uh, put a good word in for you-

    28. JH

      Yeah

    29. DR

      ... with Don Valentine, too. [chuckles]

    30. JH

      I, I didn't know how to write a business plan, and- Which it turns out is not actually important. No, no, no. [laughing] It turn- it turns out that making a financial forecast that nobody knows, uh, is gonna be right or wrong, turns out not to be that important. But the important things that a business plan probably could have teased out... I, I think that the, the art of writing a business plan ought to be much, much shorter, and it forces you to condense, you know, what, what is the true problem you're trying to solve? What is the unmet need that you, you believe will emerge? Mm-hmm. And what is it that you're gonna do that is sufficiently hard, that when everybody else finds out it's a good idea, they, they're not gonna swarm it and, you know, make you obsolete? And so it has to be sufficiently hard to do. Um, uh, there, there are a whole bunch of other skills that are involved in just, you know, product and positioning and pricing and go to market and, you know, all that kind of stuff, but those are skills, and you can learn those things easily. The stuff that is really, really hard is the essence of what I described, and I did that okay, but I, I had no idea how to write a business plan. And, um, uh, and, and I was fortunate that Wolf Corrigan was so pleased with me and the work that I did when I was at LSI Logic. He called up Don Valentine and, and told Don, "You know, invest in this kid, and, um, uh, he's gonna come your way." And, and, uh, uh, so, so I was, you know, I was, I was set up for success from that moment and got it, got us off the ground. Yeah. As long as he didn't lose the money. [laughing] No, I, I think Sequoia did okay. [laughing]

  24. 1:19:441:23:13

    Starting a Company in 2023

    1. DR

      Well, and that being our final question for you, it's twenty twenty-three-

    2. JH

      Mm.

    3. DR

      Thirty years-

    4. JH

      Mm

    5. DR

      ... anniversary of the founding of NVIDIA. If you were-... magically thirty years old again today-

    6. JH

      Mm.

    7. DR

      - in twenty twenty-three, and you were going to Denny's with your two best friends, who are the two smartest people you know, and you're talking about starting a company, what are you talking about starting?

    8. JH

      I wouldn't do it.

    9. DR

      [laughing]

    10. JH

      I know. And the reason for that is really quite simple, ignoring the company that we would start. First of all, I'm not exactly sure. The reason why I wouldn't do it, and it goes back to why it's so hard, is building a company and building NVIDIA turned out to have been a million times harder than I expected it to be, any of us expected it to be. And at that time, if we realized the pain and suffering and just how vulnerable you, you're gonna feel, um, and the challenges that you're gonna endure, uh, the embarrassment and the shame and, you know, the list of all the things that, that go wrong, I don't think anybody would start a company. Nobody in their right mind would do it. And I think that that's kind of the, the superpower of a entrepreneur. They don't know how hard it is, and they only ask themselves, "How hard can it be?" And to this day, I, I trick my brain into thinking, "How hard can it be?" Because you have to-

    11. DR

      Still-

    12. JH

      Yeah

    13. DR

      ... when you wake up in the morning?

    14. JH

      Yep. How hard can it be? Everything that we're doing, how hard can it be? Omniverse, how hard can it be? You know, in terms of-

    15. DR

      I don't get the sense, though, that you're, um, planning to retire anytime soon, though. [chuckles]

    16. JH

      No.

    17. DR

      Like, you're still-

    18. JH

      I'm still young. I'm still young. [chuckles]

    19. DR

      You, you could choose to say, like, "Whoa, this is too hard."

    20. BG

      The trick is still working.

    21. DR

      You're still-

    22. JH

      Yeah

    23. DR

      ... the trick is still working. [chuckles]

    24. JH

      No, I, I'm, I'm still enjoying myself immensely, and I'm adding a little bit of value, but, but the, the, um... That's, that's really the trick of an entrepreneur.

    25. DR

      Mm.

    26. JH

      You have to get yourself to believe that it's not that hard because it's way harder than you think. And so if I go taking all of my knowledge now and I go back and I said, "I'm gonna endure that whole journey again," I think it's too much. It is just too much.

    27. BG

      Do you have any suggestions on any kind of support system or a way to get through the emotional trauma that comes with building something like this?

    28. JH

      Uh, family and friends and, and all the colleagues we have here. Uh, I'm surrounded by people who've been here for thirty years, right? Chris has been here for thirty years, and, uh, Jeff Fisher's been here thirty years. Dwight's been here thirty years, and, uh, Jonah and Brian have been here, you know, twenty-five-some years, and, uh, probably longer than that. And, you know, Joe Greco's been here thirty years. I'm surrounded by these people that never one time gave up, and they never one time gave up on me, and that's the entire ball of wax, you know? And, and to be able to go home and, and, uh, uh, have your family be fully committed to, to everything that you're trying to do, and, um, uh, thick or thin, they're, they're proud of you and proud of the company, and you kind of need that. You need the unwavering support of people around you. You know, Jim Gaithers and the Mor-- you know, the, the Tench Coxes, the Mark Stevens, and, you know, Harvey Jones and all the, the early people of our company, the Bill Millers, they, uh, uh, not one time gave up on the company and us. And, and you kind of-- you need that. Uh, not kind of need that, you need that.

    29. BG

      Yeah.

    30. JH

      And I'm pretty sure that almost every successful company and entrepreneurs that, that have gone through some difficult challenges, they, they had that support system around them.

  25. 1:23:131:27:43

    Market Drawdowns

    1. DR

      I can only imagine how meaningful that... I mean, I know how meaningful that is in any company, but for you, [chuckles] given that, I feel like the NVIDIA journey is, um-

    2. JH

      Not normal

    3. DR

      ... particularly amplified- [chuckles]

    4. BG

      Yeah

    5. DR

      ... on these dimensions, right?

    6. JH

      Yeah, not normal.

    7. DR

      And like, you know, you went through two, two, if not three-

    8. BG

      Near-death experiences

    9. DR

      ... eighty-plus drawdowns in the public markets.

    10. JH

      Yeah.

    11. DR

      To have investors who've stuck with you-

    12. JH

      Yeah

    13. DR

      ... from day one through that-

    14. JH

      Yeah

    15. DR

      ... must be just, like, so much support.

    16. JH

      Yeah, yeah. It is incredible. And you hate that any of that stuff happened, and, and most of it, you, you know, most of it is, is, is out of your control. But, you know, eighty percent fall, it, it, it's an extraordinary thing, no, no matter how you look at it. And I forget exactly, but, I mean, we, we traded down at about a couple of two, three billion dollars-

    17. DR

      Yeah

    18. JH

      ... in market value for a while because of the decision we made in going into CUDA and all that work. And your belief system has to be really, really strong. You know, you have to really, really believe it and really, really want it. Other- otherwise, it's just too much to endure. I mean, because, you know, everybody's questioning you, and employees aren't questioning you, but employees have questions.

    19. BG

      Right.

    20. JH

      Um, people outside are questioning you, and, uh, it's a little embarrassing. Uh, it's like, you know, when your stock price gets hit, it's embarrassing, no matter how you think about it, and it's hard to explain, you know? And so there, there's no good, good answers to any of that stuff. You know, CEOs are human, and companies are built of humans, and, and, uh, these challenges are hard to endure. And so-

    21. DR

      Ben had an appropriate comment on our, uh, most recent episode on you all, where, uh, uh, we were talking about, you know, the current situation at NVIDIA, and I think he said, "For any other company, this would be a, in a precarious spot to be in. But for NVIDIA... [chuckles] "

    22. BG

      Then this is kind of old hat.

    23. DR

      Yeah. [chuckles]

    24. JH

      Yes.

    25. BG

      You know, you guys are-

    26. JH

      Nothing

    27. BG

      ... familiar, familiar with these large swings in amplitude.

    28. JH

      Yeah. The thing that, that to keep in mind is, at all times, uh, w- what is the market opportunity that, that you're engaging? And that help-- that informs your size. You know, I was, I was told a long time ago that NVIDIA can never be larger than a billion dollars. Obviously, it's an underestimation, under, under imagination of the size of the opportunity.

    29. BG

      Yep.

    30. JH

      It is the case that no chip company can ever be so big. And so, but if you're not a chip company, then, then why is that, why does that apply to you?

  26. 1:27:431:30:00

    Outro

    1. BG

      Ooh, David, that was awesome.

    2. DR

      So fun.

    3. BG

      Well, listeners, we want to tell you that you should totally sign up for our email list. Of course, it is notifications when we drop a new email, but we've added something new. We're including little tidbits that we learn after releasing the episode, including listener corrections. And we also have been sort of teasing what the next episode will be. So if you want to play the little guessing game along with the rest of the Acquired community, sign up at acquired.fm/email. Our huge thank you to Blinkist, Statsig, and Crusoe. All the links in the show notes are available to learn more and get the exclusive offers for the Acquired community from each of them. You should check out ACQ2, which is available at any podcast player. As these main Acquired episodes get longer and come out, uh, you know, once a month instead of, uh, once every couple of weeks, it's a little bit more of a rarity these days.

    4. DR

      We've been upleveling our production process, and that takes time.

    5. BG

      Yes. ACQ2 has become the place to get more from David and I, and we've just got some awesome episodes coming up that we are excited about. If you want to come deeper into the Acquired kitchen, become an LP, acquired.fm/lp. Once every couple of months or so, we'll be doing a call with all of you on Zoom just for LPs to get the, uh, inside scoop of what's going on in Acquired land and get to know David and I a little bit better. And once a season, you'll get to help us pick a future episode. So that's acquired.fm/lp. Anyone should join the Slack, acquired.fm/slack. God, we've got a lot of things now, David.

    6. DR

      I know. The hamburger bar on our website is expanding.

    7. BG

      Expanding. I know. That's how you know we're becoming enterprise.

    8. DR

      Ah!

    9. BG

      We have a, a mega menu, a menu of menus, if you will.

    10. DR

      What is the Acquired solution that we can sell?

    11. BG

      That's true.

    12. DR

      We got to find that.

    13. BG

      All right. With that, listeners, acquired.fm/slack to join the Slack and discuss this episode, acquired.fm/store to get some of that sweet merch that everyone is talking about. And with that, listeners, we will see you next time.

    14. DR

      We'll see you next time.

    15. SP

      [singing] Who got the truth? Is it you? Is it you? Is it you? Who got the truth now? Uh. [upbeat music]

Episode duration: 1:30:00

Install uListen for AI-powered chat & search across the full episode — Get Full Transcript

Transcript of episode y6NfxiemvHg

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.

Add to Chrome