Skip to content

By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.

David SenraDavid Senra

Sam Altman on Building OpenAI & Betting on the Impossible

Sam Altman has spent his career at the intersection of startups, investing and artificial intelligence.

David SenrahostSam Altmanguest
Aug 23, 20261h 18mWatch on YouTube ↗

Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.

Transcript

  1. 0:00 – 5:45

    Tobi Lütke, AI-Native Companies & Why Adoption Moves Slowly

    1. DS

      [typewriter sounds] I just brought up Tobi Lütke and the fact that, uh, uh, I recorded with him previously. Why'd you say that you think he's one of the most interesting CEOs right now?

    2. SA

      One of the things that struck me the most about Tobi is in the very early days of AI, and then at every moment along the curve of it's developed, he has been the most forward-leaning CEO. He's in there, like, writing the software himself. He is experimenting with it. He, like, sends us extremely detailed feedback on the product offering, on the capabilities of the models. He was before anybody else was saying this, he was like, "We are not an NPC company, and thus we are going to adopt agents. Otherwise, you know, we're totally screwed. We're gonna build it ourself." Every time I talk to him, he is at the edge of what anyone, CEO or not, is doing. He builds himself. He understands it. He has, like, a great deep feel, and he is always six, eight months ahead of, like, any other CEO.

    3. DS

      Do you remember when he wrote-- uh, this was probably like a year and a half ago, maybe two thousand twenty-four, he wrote that letter saying that, like, "The first thing you have to do is see if AI can solve your problem." And then even back then, it was maybe, I don't know, eighteen months, twenty-four months ago, people went crazy. They thought it was ridiculous.

    4. SA

      They thought it was ridiculous. This is my point. Like, he's just consistently been ahead. He has been correct. He's leaned in. He's very no bullshit, so there's, like, no hype. There's nothing other than, like, "Here's what it can really do right now. Here's what I think it'll be able to do soon. Here's how I'm gonna push the company here," and just, like, extremely deep understanding of where it's at.

    5. DS

      I never even thought of that, how much of a benefit it has to be for somebody in your position where you have somebody like that giving you intense and very direct and clear product feedback. [chuckles]

    6. SA

      A lot of people send product feedback. He is the only person at the intersection of, like, CEO of a large company and extremely accurate, detailed on-the-cutting-edge feedback.

    7. DS

      Yeah, he told me-- I don't know if it was on the episode, uh, that we're-- if w-it was in the episode or if it was after. But he said he was very, um, adamant. He's like, "We're gonna look back in two thousand twenty-six," and I want actually your opinion on this. I didn't even think to talk to you about this. "We're gonna look back on two thousand twenty-six as the year that every business was up for grabs." He said s-somebody was going to build the AI native version of Shopify, and he said, "And it's going to be me." And so at night [chuckles] he is-

    8. SA

      Yes

    9. DS

      ... literally trying to rebuild. If, if you started from scratch, what would you do with the cur-current technology?

    10. SA

      That was the other thing I was gonna say about him is he does it himself. Like, he is using these tools himself. He's writing software himself. He's trying the models himself. He is trying to, like, reimagine his workfl-flows himself. Most CEOs when you get to that level have, like, teams of people that are managing teams of people that are trying to implement the thing, and they're trying to, like, make you happy, and they're trying to, like, you know, smooth the rough edges. I think it's very hard to get the feel if you're not actually doing the thing, and he, he does it so hands-on all night long as far as I can tell. I'm not sure if twenty twenty-six will be the year that every business feels up for grabs. I might disagree with him a little bit there. Uh, but, but I, I, I get the spirit of that, and I do understand that it feels like that's happening.

    11. DS

      Do you think that's even possible, like, whether it's two thousand twenty-six or two thousand forty-six?

    12. SA

      I mean, obviously not literally every business. I think there are some things that are very anti-AI. Like, the better AI gets, the m-more some businesses that have nothing to do with AI I think will be harder to compete with because we'll really want these, like, authentic non-technological experiences, or we'll care more about sports teams or whatever. So no, not, not everything, but I think there will be many software businesses that are very up for grabs.

    13. DS

      Would you disagree that on the timeline, then? What do you mean-

    14. SA

      Yeah, I disagree on the timeline. I think it's gonna take a little bit longer.

    15. DS

      Okay, can you say more about that?

    16. SA

      I love startups. Like, I think startups are the coolest thing in the economy and, uh, I've spent my career trying to, like, really understand startups. And I thought when we got to GPT-4, which was back in twenty twenty-three, I think, uh, that very quickly after that there was going to be much more disruption in software businesses being up for grabs right a-right away than turned out to be. And the thing that-- I think I was wrong about a few things, uh, but one of them in terms of the speed, one of them is the economy just has so much inertia. People keep doing the same things they're doing. They keep buying from the same, uh, you know, company. They keep sort of wanting to use their tools in the same way. I think that's actually a positive in many ways, and it's gonna make this big transition in front of us go smoother and slower, and I'm grateful for it. But I think it means we've all been too ambitious on timelines even with this incredible technology. I think AI is one of the most incredible technologies humanity's ever invented. Society and the economy will adapt more slowly.

    17. DS

      Yeah, it's funny. We were talking before we started recording that there's all these parallels to history. Obviously, I read history for a living. When you were just talking, I wasn't even thinking about OpenAI and AI and Sam Altman. I was thinking of, like, reading this biography of Larry Ellison in, like, the '80s. He was just like, "Guys, this isn't a software pro-problem. It's a people problem."

    18. SA

      Yeah.

    19. DS

      "We have to convince them. Like, we can install software. They-they're not using it. We have to change their behavior." The technology is there. It's like we have to now adapt humans so they actually start using the technology.

    20. SA

      My own example of this was, uh, after Netflix came out and started shipping DVDs, even before they started streaming, it was amazing to me that people still went to Blockbuster.

    21. DS

      [laughs]

    22. SA

      It was incredible to me. Like, I would just watch this 'cause I kinda-- I drove by a Blockbuster on my way to and from school, and it was amazing to me that people still did it. And, you know, like, that is an example that has stuck in my head of, like, force of habit and the way people do things and changing behavior. It's just much harder than, like, the tech nerds realize.

  2. 5:45 – 10:00

    Sam’s Own Resistance to AI & the Missing iPhone Moment

    1. DS

      So if we go back to this uproar of Tobi writing that, you know, open letter or that letter to the people in, inside of his company, you're adopting this faster than anybody else because you're partially inventing them, right? So do, like, are, is there something where you're actually shocked at your own behavior or, like, "I know there's a better way to do this. I'm even creating the product that could be better, and yet I still can't get over this, like, habit, this force of habit"?

    2. SA

      Hundred percent.

    3. DS

      Okay.

    4. SA

      I, I love it. No one has ever asked me this before. I have been waiting for this question.

    5. DS

      [laughs]

    6. SA

      The thing to me that feels most psychologically inconsistent About myself is that I have for 20 years been using computers the same way. I now have a magic thing called Codex. So do you, so does everybody. That means I should completely be using my computer in a different way. I should not be clicking around, uh, you know, pasting from one messaging app to another. I should not be scrolling mindlessly through my emails and trying to figure out which one is, like, least painful for me to open and respond when I don't want to be dealing with it. I should not be, like, keeping a to-do list and doing sort of this like these rote computer tasks in the same way that I have for so long. And yet there's like something in my mind that is encoded that, like, doing this kind of stuff is what it means to work and what it means to be productive. And if you asked me, I would never say I like doing it that way. I would-- In fact, I would say the opposite. And I, and I think I would mean it. But, like, by revealed preference, I have a better way to do it now. I can do it faster. I can be using Codex for more of just, like, my day-to-day, like, gotta get through this stack of emails, gotta do this stuff on my to-do list, gotta, you know, deal with all these things. And I still do it that way, and it makes no sense other than I must, like, secretly, like, like it or feel good about it.

    7. DS

      What do you think is gonna-- has to change for you to actually adopt your own product in a more deep [chuckles] way?

    8. SA

      I don't really know. I, I mean, it's happening gradually, and this might be the right answer, which is these things have to happen gradually. And totally changing someone's, like, ingrained habits and workflows is difficult. Uh, I think there are better products we can build with this technology that will make it more seamless to do that. But right now it feels like we're all kind of straddling these two worlds of, you know, we still have a computer we can use the old way, and we have Codex that can use our computer in this amazing new way, and we're, like, not sure which to use when for what. And I think this is mostly a product failure. The phase that we're in now reminds me of, like, smartphones before the iPhone. I was like an early adopter. I had like a Palm Trio in, you know, 2003 or 2004 or whatever that was.

    9. DS

      Did you ever have a Sidekick?

    10. SA

      I never had a Sidekick.

    11. DS

      Do you remember the ones?

    12. SA

      I thought they were super cool. I wanted one. I, I never-

    13. DS

      I had one

    14. SA

      ... and a lot of the technology was there, like it was missing multi-touch, but mostly it was missing like the product ideas that made the iPhone the iPhone. And I feel like we are now in a world where we have all of the technological pieces, but we have not had the iPhone moment of like completely changing how someone interfaces with technology.

    15. DS

      We were talking about Tobi. Like, Tobi's out here building these himself, right? Uh, we have a mutual friend in Josh Kushner. He says, he's like, "There's, there's a big comparison to be made between the way that Steve Jobs thought and the way he ran his company to the way that he thinks that you do." He wasn't the one obviously writing the code. He wasn't building the hardware. But he l-- he's like, "I am patient zero. I am making products that I myself wanna use." And essentially, like, everything that we saw with Apple is just basically what he wanted. There's this great story in one of the books, um, where he-- they-- he-- they were supposed to have a meeting on, uh, I think one of the MacBook pr- like the new MacBook laptops, and the team prepares like all this huge presentation for Steve, and they're like really nervous 'cause of his commanding presence. And he walks in, and they think it's gonna be like an hour meeting. He walks in and he shows them the laptop, and he's like, "On, off." You press the button, it comes on. Press it off, like immediately. And then he, then he tries to open up the, the MacBook. There's like a delay. He goes, "Make this," meaning the MacBook, "like that," and then walks out the room, and that's the whole meeting. [chuckles] Like, that-- there's a lot of examples in, uh, the history of Apple like that. How do you approach it? Like, how do you improve the product? Like, are you just doing it through your own needs? Like, how do you think about this?

  3. 10:00 – 18:37

    Models, Compute, Power Laws & Non-Consensus Talent

    1. SA

      Most of my effort right now is on research and compute. I would love to be able to spend more time on product. We have great people thinking about the product here, but the most important thing that we can do is to create smart models and to be able to run them efficiently and abundantly for a lot of people. If we can get that right, I believe that everything else will follow. Philosophically, I'm very inclined to say, you know, try to find the like the high-leverage, difficult problem that will continue the exponential. And for us, this is like models and compute. I also just think those are like problems that naturally suit me.

    2. DS

      Why do they naturally suit you?

    3. SA

      To scale compute in the way that we're doing this requires like... It's a complex supply chain. There's like a lot of interesting partnerships, uh, to figure out which I like doing. There's like interesting financial challenges of how you're going to, uh, finance what is probably already or at least rapidly becoming the most expensive infrastructure project in history. Um, the technology questions that go into building out compute at this scale from, you know, designing your own chip to the supply chain of fabs and people that make racks to, to sort of the, the power systems for these things. I've always been interested in energy, uh, all come together. So there are a lot of problems that are interesting across technology, business, policy, supply chain, logistics altogether around building compute at this kind of scale. So I used to be a startup investor, and the thing in my career that I have found closest to startup investing is managing a research program. There are all these ways in which they're really different too. Like, you know, the average researcher and the average founder have, I think, on the surface look different for obvious reasons. But there's like a lot of similarities about how you find the non-consensus bets, how you decide where to have conviction, how you understand what exponential growth looks like, how you manage like outlier talent, and how you, how you identify it even more. This is the research building that we're in, and it's where I sit.

    4. DS

      Great. Say more about why the parallels between what you learned in startup investing with doing research.

    5. SA

      One big one is the power law. So people talk about this all the time in investing, which is you have to kind of like reprogram your brain 'cause we don't seem naturally well suited to think this way, um, where, you know, your best investment will outperform all of your other investments put together. Your second-best investment will outperform everything else put together after that. And AI research at least, uh, is like that as well. When we started, people thought it was totally unlikely or almost impossible that AGI was possible.

    6. DS

      What year is this?

    7. SA

      2015.

    8. DS

      Okay.

    9. SA

      End of 2015. I mean, we just got, you know, hammered in the-- by, like, all of the intellectual giants of the field for saying that we were going after AGI. And then when we started really focusing on large language models, we got hammered again, saying, "This is completely ridiculous." And we understood, or I understood at least from my kind of, like, startup background, and I think other people understood in other ways, this point of high-risk bets are okay as long as you take the ones where if they work, it's super valuable, and research, research looks this way. The kind of people that make great researchers are sort of non-consensus, fresh approach, high energy, sort of non-standard is the word that keeps coming to mind, uh, people.

    10. DS

      You gotta say more about non-standard. Can you be more specific? Are they spiky?

    11. SA

      You don't want to f-fund a founder who has a very slightly different take on the same idea as the last thousand people you talked to, has tried to convince you and maybe convince themselves that somehow they're d-completely different and doing something totally new. But it's mostly, like, trying to, you know, fit in with the herd and be on the same track as everybody else and do what they're supposed to do, which is start a startup. And, you know, they've heard Peter Thiel say enough times that, you know, there's, like, something that you're supposed to be doing different that they kind of try to emulate that, but they don't really mean it. Like, it's, it's very clear to me when you have someone who just thinks differently than most other people and has-- is, is willing to stand by convictions that are very unpopular, may well be wrong, but if right, like, at least they're gonna be really right, versus someone who is like a, you know, thin veneer on the same idea that everybody else has. In 20-- late 2015, when we were starting OpenAI, there were very few AGI efforts in the world. There was DeepMind, one or two others that I can think of. It was, like, a very non-consensus thing to do. In that same year, there were probably, I'll pick on it just 'cause it, it came to mind, but there are other categories too, there were probably many, many thousands of founders starting photo-sharing apps. You know, that was probably, like, not as good of a thing to do. Today, a lot of people wanna start AI labs. There are some handful of people, you know, two, three, whatever, doing something completely new, um, that actually wasn't possible until the AI got this good, but, uh, doesn't seem like a good idea yet. And, like, that is the thing that as a startup founder, I always wanted to fund, and the thing that mostly worked for me. There's a similar thing for researchers. There were a lot of researchers that would chase whatever the last thing was that worked, and there were a small number of researchers that had high conviction towards a new idea. And, uh, I think we were and are the best research lab for those people.

    12. DS

      I remember talking to Demis about this a few months ago, and he thought, you know, in terms of, like, chasing after the way that you guys are, it's like, you know, there's the big three players. The, the money, the capital required-

    13. SA

      Yeah

    14. DS

      ... is like you're not-- there's not gonna be, like, a fourth bigger player. But he's like, there's like this 10-- I forgot what the number was. I'll just make it up. Say, ten percent chance that there's just some monk researcher that's gonna approach it in a way that, just this angle we've never even considered.

    15. SA

      Totally. I don't know how to put a number on it, but there is some chance, yeah.

    16. DS

      Yeah, I don't think-- I'm, I'm making the number up, but it was, like, a small percentage.

    17. SA

      There is some chance of that, for sure, and I love that. Like, I think that's why stuff stays exciting.

    18. DS

      I wanna tell you about the presenting sponsor of this podcast, Ramp. I have been reading a lot about SpaceX lately. SpaceX is one of the most valuable businesses in the world, and one of the main themes in the history of SpaceX is constantly attacking and questioning your cost. Ramp helps many of the most innovative businesses in the world do exactly that. The median company running on Ramp cuts their expenses by five percent, and one thing SpaceX has demonstrated is that a religious dedication to controlling costs can help actually increase revenue because you can pursue opportunities you couldn't otherwise. And we see that in the Ramp data too. The median company running on Ramp also grows their revenue by 16%. So when you're running your business on Ramp and your competitors are not, you have a massive competitive advantage that compounds over time. Ramp is the only platform designed to make your finance team faster and happier. Many of the top founders and CEOs I know run their business on Ramp. I run my business on Ramp, and you should too. Go to ramp.com to learn how they can help your business save time, save money, and grow revenue. That is ramp.com. I found one of my all-time favorite quotes when I was reading the book Zero to One. The quote says, "The single most powerful pattern I have noticed is that successful people find value in unexpected places, and they do this by thinking about business from first principles instead of formulas." That is exactly what AppLovin has done with their advertising platform. AppLovin connects you with over a billion potential new customers inside mobile games. AppLovin allows you to capture undivided attention. AppLovin ads are full-screen video ads that are watched for an average of 35 seconds. That is retention that blows other ad platforms out of the water. And you can launch on AppLovin in minutes. You set the goal, and AppLovin achieves it. There's no complex setup, no expertise needed, and AppLovin scales quickly. They can put your ads in front of over a billion potential customers. Other businesses have seen immediate results, have scaled to hundreds of thousands of dollars of spend per day, and increased their revenue by millions. So you wanna get started quickly before all of your competitors are on AppLovin, and you can do that by going to applovin.com. That's applovin.com. Okay, so what is confusing to me, you went from founder To investor to back to founder. But why in two thousand and fifteen? Like, what got you interested in artificial intelligence to begin with that you're saying, "Hey, this is such a non-consensus thing. People think I'm fucking crazy. I'm gonna do it anyways"?

  4. 18:37 – 23:19

    From AI-Obsessed Kid to Founder, Investor & Back Again

    1. SA

      Well, I had been interested in AI my whole life. I was like a very nerdy kid. I like-- You know, I was like the kinda kid that spent Friday nights, like, playing on my computer and watching sci-fi, reading sci-fi. And I always thought that AI would be, um, like the most amazing, kinda craziest thing. I never thought I would actually get to work on it, but I always, I always, like, loved it. Uh, I even came to college sort of to study it. I worked in the AI lab the summer between my freshman and sophomore year, and nothing was working. In fact, like very memorably, a professor told me, "You could try all of these things. There's all these directions. The one thing we know doesn't work is deep learning. We tried that for a long time. You know, it's the, it's the kinda most guaranteed way to have a bad career." And [chuckles] you know, I was like an impressionable freshman in college, whatever. I, I like-- I assumed that was true. So you know, pursued these other things. It was clear to me at the time, this is now like kinda two thousand and five, that AI was not working. And I happened to, like, accidentally get into startups, but then very much fell in love with it, and so I, I wouldn't even call it a career detour 'cause it was super helpful. Uh, looking back and becoming, like, a startup investor was, was great. The sort of normal career path in Silicon Valley is you're like a-- or not the nor-- a, a, a common path is that you're a founder and then you, like, sort of semi-retire and you become an investor.

    2. DS

      We don't want that. I, I heard you say that you're gonna work on this for the rest of your career.

    3. SA

      Yeah.

    4. DS

      I'm-- hopefully we're starting-- you're gonna come on the show multiple times. I'm gonna hold you to this. We don't need more founders that retire and invest. We have enough investors. [chuckles]

    5. SA

      No, I don't want to do that. I don't want-- we have too many investors.

    6. DS

      Thank you.

    7. SA

      We have too many investors. Yeah.

    8. DS

      I wanna talk about this.

    9. SA

      But what I was gonna say is I-- the, the fact that I got to go in the other direction, I was like an investor first, and then I ran a company, is pretty unusual.

    10. DS

      Very unusual.

    11. SA

      And I'm super grateful for it, uh, because the-- like you get this unbelievable set of learnings and pattern matching if you really study and watch companies as an investor. That has been super helpful to me running OpenAI, but it's, it's like, it's the opposite to normal direction, so it's just like a very rare thing, and I strongly recommend it.

    12. DS

      Why is it helpful?

    13. SA

      If you're running a company, you have faced some number of similar decisions in your past, like some number of like crux decisions, and you've seen what works and what doesn't. And if you have to like, you know, make a high-stake strategy shift or like fire an executive in a really messy way, you have like whatever your own limited previous experience was over the last five or ten years that you've been doing it. But as an investor, you kinda watch all the crux moments. So you don't get the kinda like operating practice that you do just day in and day out running a company, but you've seen a lot of the like big crux moments a lot. Kinda all day long, you see those. So just the, the, the wealth of the dataset that I had, that was awesome.

    14. DS

      So that plays in your head when you have a decision to make?

    15. SA

      Yeah. I'm like, "Oh, this is what happened when this company had a similar thing," or, "I saw this founder make this mistake," or, "This founder got it really right."

    16. DS

      We were talking about that you studied the Industrial Revolution. We were talking about some great biographies that we both read earlier. Uh, my friend Daniel Ek says this about me 'cause like I think the benefit of me doing this project on my other podcast called Founders for ten years is like-- So he's like, "You're like an LLM trained on history's greatest entrepreneurs-

    17. SA

      Yeah

    18. DS

      ... but with the temperature turned up 'cause you're fucking crazy." [laughs] 'Cause I'm like super passionate about it in a weird way to be like obsessed with dead entrepreneurs. Uh, but it is helpful. It's like, oh, like I'll be talking to a founder and they'll just talk about something they dealt with. I'm like, "Oh, well, like Carnegie did this and Rockefeller did this, and like, you might wanna try this." It's like-

    19. SA

      And do you find that you have like one big insight to all of that, or it's just like for any given scenario, you have like what all these people did and how it comes together?

    20. DS

      I think it's dependent on the personality of the founder.

    21. SA

      Yeah.

    22. DS

      Right? And so like when I was reading-- I've read your blog for years. I think like you're a great writer. You're very succinct. I like, like how-

    23. SA

      Thank you

    24. DS

      ... the brevity is just really appealing to me, and I love numbered lists. It's weird that we both write in the same way. And I feel like I'm reading your blog, and I'm like, "This is the exact conclusion that I would come to based on all the reading." And like there's just a handful of principles that could be applied, but it's like, it really depends on like who the founder is and what they wanna do.

    25. SA

      Yeah.

    26. DS

      This is what I'm trying to understand. It's like, let's go back to what we were just talking about. I still like-- like you're, you're making a big jump 'cause, you know, you're one of the, from what I hear, one of the best investors of all time in Silicon Valley. You could just be rich and not really have to work 'cause investors are kinda lazy.

    27. SA

      Oh, I've had that. Yeah.

    28. DS

      Uh, I'm just kidding, by the way. Uh, kind of not. Um-

    29. SA

      No, it's pretty-- it's-- I, I-- Having done both, I think I can say it's like much, much, much harder to run a company than be an investor.

    30. DS

      Exactly, and that's what should-- people should be doing, in my opinion.

  5. 23:19 – 30:16

    Impossible Problems, Scientific Discovery & Human Connection

    1. SA

      Yeah.

    2. DS

      I still need to understand, okay, so you're into it. Kid, like why would it appeal to a kid? You were living in St. Louis at the time?

    3. SA

      Yeah, I was living in St. Louis.

    4. DS

      Why would AI appeal to you back then?

    5. SA

      Well, I think like it appealed to every kinda computer nerd. Like I don't think it's that unusual about me. It just felt impossible. I think most people would say like, "Of course, that'd be the coolest thing ever, but it's totally impossible." I think the like the weird thing about me was like, "Okay, let's try." Uh, but I think everybody thought it-- everybody would think it's awesome and something to, something to go for.

    6. DS

      So wait, that was a personality trait of yours as a kid that-

    7. SA

      I think even as a kid

    8. DS

      ... if people told you that you couldn't do something, like your initial response was resistance?

    9. SA

      Not resistance, but like, uh, "Are you sure? Like why not? Let's try. Let's see what happens. Maybe I can't. Maybe we can." I was like a very optimistic kid, and also like the more something seemed impossible, like the more intrigued I was. The idea that we could invent a technology that would let us do everything else, that would just empower people in this way that no other single technology could, that always seemed like innately incredibly appealing to me. It's like, I want that thing. I want to be able to do everything else. Like I think another thing about that I kind of as like a personality trait as long as I remember is like, you know- It's like it is interesting to, like, really give people a lot more power, a lot more ability. In some sense, this is the whole arc of technology, and I was for sure always a technology nerd. But, like, AI is the strongest version of that I can imagine.

    10. DS

      What did you think that it would en- enable back then? Like, when you were a kid, like, this seems like a cool technology. I want to do X. I can't do X unless AI is invented

    11. SA

      Um, it's always hard to remember, like, how much of this is the stuff that I actually thought at the time versus, like, how much-

    12. DS

      Or what you're trying to build right now. [laughs]

    13. SA

      Yeah, like how much my current work has, like, colored my memories of it. For sure, as a kid, I was, like, very into robots. You know, we had, like, a robots club in my school, uh, and the robots at the time were, like, laughably... I even remember at summer camp we had this, like, little turtle that you could control with a computer on the floor or on the table, and thought that was just the coolest thing. There's something about, like, physical stuff moving controlled by a computer that I always thought was amazing. Now, I am extremely interested in what AI can do to advance scientific discovery. I- in my memory as an adult, I think I thought that was cool as a kid too, but it feels just implausible, and I assume that's an example of where, like, the memories have gotten more colored. But now the fact that we can have AI go discover new physics and cure diseases and what it's already doing for math, like, I think this is-- I think this will be one of the most important areas, even more important than automation of other tasks that AI can do just to help us understand more things. We were talking earlier about this, this book, The Beginning of Infinity, and rereading that book from today's vantage point, I'm like, "Man, AI's really gonna help us do this, do this important thing of understanding everything or as much as we can." I was definitely interested in the sort of like Star Trek version of, like, huge prosperity and abundance and, and what AI could do to drive that. Maybe the memory of being interested in science is more real. I also loved science and, and just th- this idea that we could, like, because we were smart, we could figure out how to understand the world and make predictions and do things that we couldn't without this deep understanding. I don't know. That seems, like, innately awesome.

    14. DS

      It's interesting how consistent over time what humans want from AI 'cause, like, something you're describing is very similar. I just reread the biography of Claude Shannon for the second time, and I had forgotten 'cause I hadn't read the book in maybe five years, and I forgot that him and Alan Turing used to meet every day for coffee when they were both at Bell Labs. This is like 1940s.

    15. SA

      Yeah.

    16. DS

      And they would just talk about AI.

    17. SA

      Yeah.

    18. DS

      And they were both obsessed with their- It's- They thought it was inevitable back then, and they thought it was gonna happen, like, 15 years from there, so like 1955, that we're gonna have computers, which didn't exist, right? They had the analog versions, uh, that are, that are going to be smarter than humans, and that anybody that thought that wasn't gonna occur they thought was absolutely ridiculous. And they're like, "Well, what would you want the computer to do?" He's like, "Solve math problems, write poetry, like, sol- uh, cure diseases." Like, you hear this over and over again.

    19. SA

      I have read a bunch of things that those guys wrote at the time, and I am so sad they are not here to see it 'cause they were so right about everything. We're finally at the moment where AI is solving novel math problems. It is discovering other stuff. It is, you know, you can argue about how good or not. I would say not very good, but it is writing poetry. It's here. Like, to what these guys, I think they would've said, "All right, you've done it. Like, this is it. We've got it." Um, and that would've been so cool.

    20. DS

      Yeah, this is the weird thing where everybody's just like, "Oh, it'll never do X." Like, I talk to, uh, people in the music industry. It's like, "It's never gonna make great music." And, and then they're like, "Well, do you think it's gonna, like, make a podcast?" I was like, "Of course it's going to. It's going to do everything that we can do, at least to, I would say, better than, like, even right now, like, better than what we can do." It's a very bizarre thing where it's like it will never surpass what is happening at this current point that I happen to be alive.

    21. SA

      There's a deep human psychological flaw there. But here is a, I think, a more interesting question. Let's say it does make a great podcast. You know, two AIs are having a more interesting conversation than you and I are. Do you think people will care? Or will they want the one with the real people because we're all obsessed with people and the fact that it's not real people-

    22. DS

      Yeah, for this, it's, like, more interesting. It's like, oh, these two people that I may be predisposed to like or dislike are having a conversation that's interesting to me. I think for, like, strict, like, reference, like maybe my other podcast where I'm just saying, "Hey, this is some interesting ideas I read in this book," that could maybe get disrupted in other cases, but, uh, especially for people that were born before this happened. Maybe it's different for your son, you know?

    23. SA

      Maybe.

    24. DS

      But for me, it's just like I think humans are gonna always be drawn to humans.

    25. SA

      I really deeply believe that. I think there's, like, a lot of other jobs that could face significant transition, but stuff that's about people, stuff that's about people's connection, connection to people, and people liking other people, that stuff feels like it gets, uh, more valuable in the post-AI world, not less.

    26. DS

      I may be actually the wrong person to talk about this stuff because I kinda deeply desire, even though my entire work is digital, sh- you know, broadcast all over the world, it's just like I deeply desire, like, more, uh, like, more of an analog life. I like reading physical books.

    27. SA

      But if you-

    28. DS

      Like, when I was talking to Kelly, I was like, "I didn't wanna get on Zoom. Call me or we'll talk in person."

    29. SA

      Yeah.

    30. DS

      Like, I like physical shit. I don't like-

  6. 30:16 – 33:09

    AI’s Two Biggest Risks: Loss of Control & Centralized Power

    1. SA

      be the whole point.

    2. DS

      I think it's very important that when we do find people like that to them be called out and make sure they don't acquire power.

    3. SA

      I certainly agree with that. Maybe the two big risks that I'm most worried about with AI, which are a little bit in tension, one is like a, a, a loss of control Where, you know, AI somehow just becomes too powerful in a way that we can't guarantee the control we want, and the other is power gets too centralized, where you have, you know, one company or model or person with too much power. And in, in both of these, the fundamental thing is, like, I think it's a very anti-human position for either of these things to happen. The right approach is to say, like, "We want people deeply in control of the future. We want people deeply empowered." People are the whole point of this all. Like, th-this is-- we are not gonna sit here and, you know, gradually hand over control to an AI model because we don't trust or like people and, you know, uh, it's like a very misanthropic thing to say we're gonna just, like, put all of our trust in this model and let it have all the power and decision-making over the world. But I think there are some people in the world who think that's the right outcome. There's, like, another version of this, which is because we don't trust people, we have to limit who gets access to this technology and how they can use it, and all of these terrible things could happen. And, and, you know, out of fear of those, we are going to concentrate power in the hands of a few companies, and they're gonna-- You know, we're not gonna let other people use this, but we'll give them some benefits. Like, my, my caricature of this is I think there are some people in the AI field who, who effectively say, "We're gonna give the world a cure to all diseases, and we're gonna make stuff really cheap in exchange for people giving up their autonomy and impact over the future and power, uh, and also in the name of safety, and also, like, just absolutely rampant inequality." Like, there will be people that have access to huge amounts of wealth and power, and other people just get a pretty good everything. And this is, like, a terrible sales pitch. This is a very anti-human sales pitch that somehow people feel willing to make.

    4. DS

      Why do you think they feel willing to make that?

    5. SA

      I think it's, like, fear and power. I, I think you can-- When people talk about the risks of AI, I think there are a lot of people who are so nervous about the magnitude of those risks and get so taken by that and feel a need to protect the world from that, um, that they're like, "You know, we should trade off a lot of liberty for safety here because this is unlike other risks we've seen." But then I think that also ends up kind of like, um, a way to justify a lot of power-seeking behavior.

    6. DS

      Everything when I read, like when I was just saying that Claude Shannon-- what Claude Shannon was saying or Alan Turing, at least in the books that I've read, it's more of like an optimistic, like, we're gonna invent things that make our lives better and can do

  7. 33:09 – 40:27

    Iterative Deployment, AI Safety & Learning From Reality

    1. DS

      things for us.

    2. SA

      You are totally right that if you go back to the Claude Shannon, Alan Turing era, uh, they talked about how wonderful AGI would be and all the things that it would do. Uh, and when we started, we really had a lot of pressure from the doomers. Now, the part of the doomers that I agree with is this is a powerful technology, and we should err on the side of s-side of safety, and we should act with caution at each level of technology. The part of the doomers that I don't agree with is that it's an unsolvable problem. If you go back to the beginning of OpenAI, um, I think there would've been two widely held opinions. Number one, not at all, and certainly not in ten years were we going to build something that was very AGI-like. And then conditioned on if we did, we certainly were not gonna be able to make it safe. You know, if you had an AI that was smarter in many ways than a lot of the smartest people, most of the smartest people, then, you know, the doomers would say surely at that point the world would've been destroyed, the alignment thing would have failed, and there were just these very confidently held positions about what would've happened. A decade on, uh, we have built something that I think most people would say at the time would've said is very AGI-like, and, you know, a lot of good things have happened, and the kind of crazy bad predictions of the world ending have not happened. So I think that should update people's predictions about the future. There are still higher-stakes challenges in front of us to solve, but our approach, this is another thing I learned from startups, of the way you do things is to put things out into the world, get feedback from real customers, see where they break, see where they don't break. That is the way you make a good product. That is also the way you make a safe product. And we have made way more progress on AI safety than I think most people thought we would when we started.

    3. DS

      Why? Because so many people-- there's a billion people using your products on a weekly basis?

    4. SA

      And each time we get a new level of model, we put it out in the world, and we see what, you know, what works, what doesn't work, where people need us to relax the guardrails 'cause they have good things they wanna use it for, where we have alignment failures, where, where we have safety systems failures. ChatGPT's only been out, like, less than four years. A billion people use it, and sensitive, important stuff. And the fact that we can deliver something that is broadly considered safe, of course, there's issues with it. Like, in that short of a timeframe with such a powerful technology, I think there is no way we could have done that in an ivory tower. And, you know, this is how I believe you build good, safe, robust, useful technology and products, and I think is a great, a great learning of Y Combinator, and it would've seemed to most of the AI safety people, you know, totally impossible to get to this stage and still have the level of safety guarantees we have. Now, I do think it gets harder from here, but I don't think you're gonna solve it by disconnecting yourself from reality.

    5. DS

      Why does it get harder from here? 'Cause we're as about-- the smartest people in the world are as about as smart as the smartest models in the world, and that's gonna flip right now?

    6. SA

      Yeah. Direction, I think that's right. I think that the, the models are just so incredibly capable and improving on such a steep trajectory that the unknown unknowns Maybe they don't get harder relatively, but from an absolute perspective, they, they seem harder. And I think we'll have to make a bunch of difficult decisions about, you know, when we delay development, when we sort of say, "Okay, you know what? Let's have contact with reality now," or, "Let's, let's wait longer to really study this more." Talking to someone recently, uh, and something that stuck in my mind is that the, you know, the FAA, FAA has helped make flying incredibly safe. Flying on the surface seems like this extremely dangerous thing, and you probably get on an airplane without giving it much thought. And this was certainly-- You know, airplanes are not that old in the long trajectory of human history, and this was certainly not the case at the beginning of airplanes. They have extremely robust accident reporting, extremely clear-eyed. You're never-- They never try to, like, you know, hand wave over something. They wanna extract as much information as possible. And in some sense, I think with any new technology, an approach like that works very well and is often underappreciated. So when we started deploying our models, when we said, "We're gonna put ChatGPT out in the world," we know the model's imperfect. Um, we know it hallucinates. We know it can do these other things. But we also know that the world's got to experience this technology, we've got to learn how to make it safe, and we've got to put the power in people's hands. We cannot just use this to impose our worldview. We cannot use this to go sit in a lab and try to think through all the impacts, which won't work anyway because society and the models are gonna co-evolve. Like, we have to all do this together as this, as this joint product. And then we'll do very good accident reporting. We will study when something goes wrong. We will put out a very clear postmortem. We will learn as much as we can. We will not only improve our own technology and products, but we'll try to share those learnings with other people building AI. I think that's worked surprisingly well so far, and that was, like, good examples from the history of technology, good examples from startups.

    7. DS

      Deel is how the best founders turn the world into their talent pool. I've been studying how history's greatest founders operate for a decade, and one thing they all have in common is they understand that recruiting and hiring the very best talent is your most important priority. A players recognize other A players, which is why top companies like Ramp, Shopify, Eleven Labs, Uber, and DoorDash all use Deel. Many of the top founders I know have personally invested in Deel after using their product. And what they discovered is that Deel is the best company in the world at building infrastructure for global hiring. Deel will help your business hire, pay, and manage any worker anywhere in the world so you can retain the best talent anywhere and spend the rest of your time focusing on what you do best, delivering value to your customers. The founder of Eleven Labs has a great description of the value Deel can give your company. He said, "We built Eleven Labs to break down language and communication barriers. With Deel enabling us to hire and support exceptional talent anywhere, we can accelerate our innovation and bring more voices, stories, and ideas to every corner of the world." Deel is trusted by over forty thousand businesses. Learn how they can help your business today by going to deel.com/senra. That is deel.com/senra. One thing that has to be disorienting for you, 'cause I-- it doesn't make any sense to me, like, you know, essentially what I focus on is just entrepreneurs and entrepreneurship, right? So all the podcasts I make are for the benefit of entrepreneurs. I'm glad other people listen, but it's, like-

    8. SA

      Yeah

    9. DS

      ... heavily focused on just trying to serve-- trying to find useful information, whether it's in a, a biography of a dead entrepreneur or talking to somebody like you, that other entrepreneurs can benefit from this conversation, right? Or any of the podcasts that I make. So in that, there's not, like, a lot of-- Entrepreneurs love AI. But, like, what I, I-- And I'm trying to figure out, like, if you can help me reconcile. It's like everybody uses AI, everybody hates AI. What the hell is going

  8. 40:27 – 46:13

    Why People Fear AI & the Coming Small-Business Boom

    1. DS

      on there?

    2. SA

      Well, people are always afraid of, like, rapid socioeconomic change. Talked about the Industrial Revolution earlier. I love, I love reading about previous technological revolutions too. And, like, people did not have universally warm and fuzzy feelings to the change that was happening during the-- throughout the Industrial Revolution. I think it's probably a good feature of human society that we have some built-in inertia. We have some skepticism of rapid change. I think that probably helps society in times of turmoil or in times of, you know, localized craziness or whatever. Um, so some of it is probably good, and I think a feature of human biology, which I believe in never trying to fight too hard. I also think a lot of the people building AI, uh, you know, have been off saying, "There's a twenty-five percent chance we're gonna destroy the world, and yet we're gonna race ahead to do it, 'cause otherwise those bad guys will do it first." Or, you know, it's like, "Man, this thing is gonna be really terrible, and there's gonna be fifty percent of the jobs are gonna go away in the next year, and we hope you all are okay, but it seems really scary." Like, we have not, as a field, done a very good job of explaining to people what the benefits are and how the downsides can be mitigated, and we certainly have not done a good job. Even if people have had answers like, you know, saying, "Well, there's gonna be universal basic income," or, "Work will be optional," or whatever. There's been very little discussion from people about how and why it's important that people have more power and per-personal freedom in the world, not less. And that matters a lot to most people. The ability of people to influence their own future and collectively to design kinda where society is going to go and the autonomy that comes with that, very important. And I don't think a lot of people in the AI field, they feel it for themselves, but they don't spend much time thinking about it, reflecting on it, or acknowledging how important that is to other people. And so to go back to that, like, character Jason of the sales pit-- characterization of this-- caricaturization of the sales pitch, I don't even know if that's a word, from earlier-

    3. DS

      It is. [chuckles]

    4. SA

      Um, the, like, "Dear peasants, we will bequeath upon you these gifts of a cure for cancer and material wealth and some things and, you know, great entertainment, and in You stop complaining, and we'll make all the decisions about the future, and just trust us. You know, we'll be benevolent dictators. Not good. Not good. As a lover of entrepreneurs and sort of like a student of what has made this incredible economic miracle of recent centuries work, really empowering people to go do new stuff and to push on the things they believe in and to have the freedom to create companies and invent technology and sort of pursue ideas and, like, the system around that that makes that happen, there is, like, nothing I believe in more strongly. And I think even if people don't see themselves as an entrepreneur ever, if they, they may never wanna start a big company, they do understand how important that is. And then when you hear people kind of implicitly or explicitly saying there's gonna be less of that with AI 'cause a small number of people are gonna have the power, but they're gonna make great decisions and keep everybody safe, I think that's very scary to them. I also think that even if maybe most people don't wanna start really big companies, a lot of people wanna start smaller companies, and that has been hard. That has been something that has required a fair amount of privilege and luck and resources to be able to do. And we are about to see the greatest boom in people starting smaller businesses that we have ever seen. I think AI is empowering that. Now, for some reason, the field, including us, has not talked about that enough, even though we see all these signs of it, and it's, it's great, and we have not built enough products to accelerate that, but I think we're gonna see a lot more of that.

    5. DS

      It's funny. Uh, we talked about Tobi Lütke earlier. At the end of the conversation, and I think that's in the episode, he, he mentioned something I didn't think about. He's like, "Oh, yeah, you and me are in the same business." He's like, "We're both trying to create more entrepreneurs." He's building infrastructure-

    6. SA

      Yeah

    7. DS

      ... for entrepreneurs. I'm building educational and inspirational podcasts for them. And the crazy thing with what you just said is just, like, not only I think out of any new industry, it's not that, that as an industry, the AI industry, which it, it's doing the worst job I've probably ever seen. And I think part of it is just the ability. You guys have to get out there and talk about the stuff that you're seeing and educate. There's this great book called "The Intel Trinity," and it tells the story of Intel, and it's called the Trinity because the three main players are Bob Noyce, Andy Grove, and Gordon Moore. And when they-- There's a great story in the book that I never forgot. They go from inventing, I think, the integrated circuit to the microprocessor, and they realized that that technology was so important, and it would scare the, their potential customers. So they went out. They stopped-- Those three people stopped doing what they were doing and went out and started educating-

    8. SA

      Yeah

    9. DS

      ... potential customers, investors, the entire country. And they said at one time they were putting on more classes than, like, the local community college had in their entire course catalog. That's how much they made it a top priority. It's like we're gonna get out and educate about this new technology. And it's just like, well, why isn't anybody in AI, AI doing that?

    10. SA

      I mean, no excuses. We should be doing more. I think we've, like, tried versions of this. We haven't gotten it quite right.

    11. DS

      Well, you're doing it right now.

    12. SA

      Um-

    13. DS

      We're-- Like, this is a point of-

    14. SA

      Yeah

    15. DS

      ... one of the points of reason I wanted to talk to you about-

    16. SA

      Yeah

    17. DS

      ... because, like, I use AI all the time. I think it's fascinating, but you have such, like, this-- You have a view that makes mine look like it-- like, uh, the, the view of an ant. Like-

    18. SA

      I doubt that

    19. DS

      ... you have just so much stuff in your head that I wanna, like, get out and be like, "Hey, you have all this context." It's like, and you're inventing this incredible technology. I would love to know how other people are using it. Actually, w-w-well, before we even get to other people, I heard you say something that was interesting that I think ties to what you just said about kinda like we're inventing technology. The technology's increasing rapidly, but the adoption should be slow and deliberate. And I heard you on another podcast saying, "Hey, I'm even considering, like, how much should I let AI see every single thing that's on my computer?" You wanna talk about that?

  9. 46:13 – 49:17

    Context, Memory & the Next Way We Will Work With AI

    1. SA

      With the latest generation of models, I don't wanna say they, they feel smart enough 'cause I think we should always aspire for them to get smarter, but they are pretty smart. And I feel more limited at this point by the amount of useful context the AI has on me. Like, I want the AI to know as much as it can to help me. I want it to be doing things I can't or don't wanna do on my own. Like, I, I'm not gonna read every post on our internal Slack. I'm not gonna go read every story a customer has to tell about where ChatGPT worked for them or failed them. I can't. And then there's, like, other stuff of, like, I just, you know... I probably could read more research papers than I do, but, like, oh, it's like, takes a lot of mental energy and-

    2. DS

      [chuckles]

    3. SA

      ... you know. But I would love to have an AI agent that is constantly trying to be helpful to me and that can look at and understand more context than I can or that I have time for or energy for to do on my own and can help bring that context to bear and give me good advice when I have to make a decision. So I think we've focused correctly so much on model intelligence that on the product side, we have not yet thought enough about what it means to give a model more context than any person could have and help advise that person on, on their big decisions. My sense is we are just on the precipice of being able to see a very different way of working with AI on a, on a, on an axis where people just can't get this good. There are plenty of, like, very smart people, but there is no one that can read, like, you know, tens of thousands of pages of context in some small number of seconds and really, like, use that accurately, and this is something that AI can do that just is gonna be very new and a, an incredible supplement. You've read all these biographies. There are probably times where you vaguely remember something that if you could remember a specific anecdote from one of them, it would, like, really help an entrepreneur in one moment for that particular entrepreneur, right, when you were talking to them. But maybe you forgot it or maybe you don't remember it exactly right.

    4. DS

      I built my own AI tool-

    5. SA

      There you go

    6. DS

      ... so I use it internally. So you know what it is? It's only trained on-- Since two thousand and eighteen, I've kept every single note and highlight from every single book that I've ever used into this database, and I would search it for that. And then when Your-- the work that you guys do came out. Then I added, so I have it trained on that, then every note, every highlight, and then all the transcripts for my episodes of Founders. I use this thing every single day-

    7. SA

      That's awesome

    8. DS

      ... to, like, to make every single episode. So I'm working on Claude Shannon, right? The Claude Shannon episode came out, I don't know, two or three weeks ago, whenever it was, and I'm asking questions about all-- I was like, "Hey, what did Bob Noyce say about this?" Or, "What did Rockefeller do about this?" And I've-- I, I made the episode. I read the book. I took the note. I don't remember-

    9. SA

      Yeah

    10. DS

      ... 'cause it was, like, seven years ago. It's incredible.

    11. SA

      Yeah.

    12. DS

      This is what I mean. I was like, "AI's fucking awesome."

    13. SA

      That is so cool.

    14. DS

      Let's get into, like, how you think about running the company, right? So you're spending your time. You said your, your main focus is getting more compute and then research, right?

    15. SA

      Yeah.

    16. DS

      Okay.

  10. 49:17 – 53:20

    OpenAI’s Platform Strategy & Killing Good Ideas

    1. DS

      So you want the models to be the best in the world. But how do you think about, like, do you have to build your own products? Now, you built Codex, right? What did-- I don't even know the, the fucking product lines. Like, where's all the revenue coming from?

    2. SA

      Actually, I think we should be more of a platform company than a product company.

    3. DS

      Okay.

    4. SA

      Um, like, we will build products, of course. But the products-

    5. DS

      Well, how many products do you have? Let's, let's back up. How many products do you have now?

    6. SA

      We just merged ChatGPT and Codex together.

    7. DS

      Okay.

    8. SA

      So we used to have, like, ChatGPT, Codex, and the API. Um-

    9. DS

      Okay

    10. SA

      ... you know. And Codex s-sort of un-unfortunately named, but n-it was not just coding. It could kinda do any kind of work, which confused people.

    11. DS

      I-I'm confused by that.

    12. SA

      Yes.

    13. DS

      Okay.

    14. SA

      As were many other people. What I think most people want is the sort of, like, single interface to their own personal or their company's AGI that can kinda help them with whatever they need, and then the ability with an API to build anything they want on top of it. And that is the platform that we should offer to the world. We're gonna sell great AI. At every, at every point on the cost curve, cost/performance curve, we will be the best. You know, you want really high-end AI to discover science, that's great. You want really, like, inexpensive AI to do, like, you know, a massive amount of volume of work that maybe doesn't require genius-level intelligence, we got you covered there too. And, you know, thinking about this as a sort of-- people talk about different ways, a new utility, a new commodity, whatever you wanna call it. Like, people want to use a lot of AI, and they want it at a low cost, and they want it to be fast and to work well and have their context and be smooth. We, we got you. And then there's, like, a single product, which is I need to ask the AI something. Eventually, maybe it's the AI should proactively offer me things. But you will have this interface which started as a chatbot and now also has coding agents, and I think at some point will feel like a more persistent agent to this AI that is running on whatever you need it to run on. But that's it. I don't think we should go build every product category. I don't think we should, like, go try to compete with all of our customers. I don't think we should try to, like, subsume the entire economy. I think we should offer this platform and try to have 100 million new businesses and eight billion people use it in all kinds of new ways. So one kind of direct interface to the product, one API for people to use it however they want. Those eventually come more and more together too, and then it's all about what people do with it, build on top of it, whatever else.

    15. DS

      What mistakes did you make to have to learn that? I feel like, um, you've had to kill some good ideas-

    16. SA

      Yes

    17. DS

      ... to, and sacrifice going after the great with your full, like, intensity and focus.

    18. SA

      Yeah, I, I, I think killing the good ideas, like sacrificing the good ideas to go after the great ideas is, is kind of the hardest lesson for any entrepreneur or business to learn. It sucks to kill good ideas. And no matter how much you think you're gonna do it, you, you, people, everyone, like, kinda maybe just by the nature of who chooses to be an entrepreneur seems to do terrible at this. I'm terrible at this. I know I'm bad at this. But last year, for example, we killed Sora, which was, you know, good product and fun and cool, but used a lot of compute and not as important as Codex, where we put the compute. Um, we killed our web browser called Atlas, uh, which again, I think it was a great product and it was the best web browser, but not as important for us to focus on as somewhere else we could put that talent. Um, in a world of limited compute, limited people, limited resources, we thought really hard and we said, "You know what? The, the general intelligence for knowledge work and eventually for science, the most important thing we can do, anything that goes into making that upstream of generating that intelligence, building our own chip, building our own data centers, um, you know, writing good infrastructure software, certainly training models obviously, that's all really important. But then let's just offer this AI as, as a service and get people to use it for intellectual pursuit, for work, for scientific discovery, to be more productive in their personal life, and let's have the kind of flexible general platform and not do a lot of other things."

  11. 53:20 – 1:00:42

    Peter Thiel, Paul Graham & the Value of Nonlinear Thinkers

    1. DS

      Anybody co-engage in complicated work, and you're gonna be the, you know, top of the, sort of top of the list of anybody alive right now, needs somebody to help organize their thoughts, right? It's extremely beneficial. You see this in every single biography. You see this in histories. Like, you need somebody to talk to. There's, th-th-there's actually a funny story of how extreme this can be. Uh, Charlie Munger has this thing called orangutan theory. Have you ever heard of this?

    2. SA

      No.

    3. DS

      Where he said a relatively smart human could go in, uh, sit down with an orangutan, tell him all his problems, tell him everything that's on his mind, and then, you know, the orangutan obviously says nothing about nothing else. The human leaves, and the human's better off. Just the, the, the idea of just being forced to put your thoughts into, you know, into, into some kind of structure. Now, obviously, with a very intelligent partner. Munger played this role for Buffett. Buffett's one of the most intelligent people who ever lived, greatest investor of all time, still needed to organize his thoughts to somebody else. You are going through-- I can't think... You're, you're, you have almost, like, a singular lived experience, especially for somebody as young as you are. So I'm curious, like, who plays this role in your life? Like, who do you go to that can even-

    4. SA

      Yeah

    5. DS

      ... remotely empathize with what the hell you're dealing with on a day-to-day basis?

    6. SA

      Kind of three categories here. One, a lot of the researchers that have been here forever, we've kind of, like, all been through it together, and we've developed this set of, like, shared language, intuition, standards, whatever you wanna call it, and that I have not been able to replicate with anybody outside of the company, um, when it comes to, like, the shape of what's happening. And what might happen next and where the technology is likely to go. In, in terms of questions of just, like, you know, business and the world, for a long time in my career, Paul Graham and Peter Thiel have been two of the people that I have learned the most from about lots of different phases of my career and are still the two people that I go to if I really have, like, a very non-obvious problem that I'm stuck on. Uh, and they're-- I have not found anyone else after a lot of looking that has the same kind of ability to, to just, to, like, think in a super nonlinear way. Like, you know, if what LLMs do are predicting what word comes next, those are two of the people that I can predict the least what word is gonna come next. And that is a super valuable skill. You go with, like, a, oh man, I feel really stuck, and I've kinda thought through all these options, and someone that can tell you, like, "Eh, I think none of those options are good. Here's this thing that now seems totally obvious and correct that you didn't think of," just a completely different view that you haven't heard anywhere else.

    7. DS

      Is this, like, more of, like, a prompt for your own thinking as op- as opposed to, like, explicit advice, do X, for example?

    8. SA

      It's often like, "Here is a specific thing."

    9. DS

      Really?

    10. SA

      Yeah.

    11. DS

      So what would be an example that you could share from, like, Peter? Peter's very fascinating to me.

    12. SA

      He is very fascinating.

    13. DS

      And I-- it's, it's actually who I thought of. The reason I thought of this question just now is 'cause you're like, "We had to kill these good ideas for the great. We're cutting Atlas. We're compute-constrained. We have to focus, focus, focus." It's like that's something that is very obvious when you listen to him talk about the importance of focus and, like, if you have something that's working, making it work better and going down this line. Like, uh, taking an hour away from that to, like, explore something else is too expensive. You should just go deeper on what's already working. Like, there's a lot of value at the extremes.

    14. SA

      After we launched ChatGPT, sort of this weird thing 'cause people didn't really know what to use it for. And it was growing super fast, but it felt, like, very unstable or kinda almost like low-value growth. Like, people were using it to-- just 'cause they were, like, interested in talking to it and what, what they could do. And so there were a lot of people in the company who were like, "Uh, this is-- you know, we gotta figure out something else. This is not sustainable value." And we were talking about this, like, list of five or six other things that we could focus on instead. This is, like, maybe two months after ChatGPT launched, something like that. And he was like, "It's an obvious mistake to do anything but this. Besides the fact that it's growing, which is rare and great," it was not growing as fast then as it did start after. He's like, "The power of this is the power of the Google text box. It's like a text box you can type anything into, and it does the right thing. And the fact that it doesn't match the current Silicon Valley wisdom of, you know, you gotta have, like, feeds, and you have to have, like, a network effect, and you have to have..." 'Cause we had none of these things, and that's why everyone was worried. Y-you know, you have to have, like, a, you know, way that people are gonna build up more con- This is before we had memory. People are gonna build up more context, or people are gonna get locked in, or people are gonna have all the... He's like, "All that stuff, like, people have just been chasing the Google business model for twenty years, and this is the first thing that's come up. And, you know, clearly, the empty text box worked for Google, so why don't you just double down on that? Uh, it's growing. Like, it's very flexible, and, you know, it has all of the signs other than it doesn't fit the current Silicon Valley wisdom." And I was like, "Okay." And so we went super hard on ChatGPT, uh, and it was great.

    15. DS

      There's, like, a simple genius to what he just said.

    16. SA

      Sometimes there's, like, more complex genius, but that was an example of very important simple genius.

    17. DS

      What about some advice that Paul Graham or some guidance or a direction he kinda pushed you in?

    18. SA

      When you just said that, the thing-- this is, like, a meme for many YC founders, uh, where you would go see him for office hours, and he would say, "You know what you should do?" And he would, like, shake his hand, his finger like this. "You know what you should do? You know what you should do?" And sometimes the thing that came after that was great. Sometimes the thing that came after that was terrible. But the important thing was there was a kind of-- there is a creativity and open landscape and just a, you know, let's try a lot of things. We talked about the spirit of iterative deployment. And we talked about, you know, what, what-- how, like, in the same way startups-- He really, I think, pushed the startup ecosystem into this world of you've gotta, like, get, ship a, a, a V1. You're embarrassed of it early. And it doesn't matter if it's, you know, it could be much better. You'll, you'll, you'll get it much, much better because of the feedback to customers. I don't even think I asked him before we launched ChatGPT, like, "Hey, do you think we should launch this thing?" But I knew what he would say. I knew it was still early. I knew it was still embarrassing. And I knew the right thing was to, like, get it out and get it in front of people. Um-

    19. DS

      So wait, wait. Your mental model of Paul Graham is so complete you don't even have to call him?

    20. SA

      No, just in this one case. [laughs] That's, that's the one where you would say, like, there's certainty.

    21. DS

      Let me tell you something funny. Right before he died, a few months before he died, I went to Charlie Munger's house and had, uh, dinner with him. And I was like, "How often do you talk to Buffett?" He goes, "Never." I go, "What?" He goes, "We talk every day for hours and hours. Buffett can just pretend to pick up the phone call to call me, and he [laughs] already knows what I'm gonna say." That obviously comes after sixty-five years of working closely together, but I thought it was hilarious. [laughs]

    22. SA

      That is hilarious. That is really a funny story. No, there, there's many times that I couldn't predict what he's going to say, which is-- that's why I think it's valuable. But in terms of the, like, launch when you're embarrassed of the product, I know what he's gonna say there. Like, that one, uh, that, that, that has been, like, I won't say the most valuable piece of Y- of tactical YC advice, but it's been up there. I'm astonished looking back at all of my data points of YC founders over the years, how much the ability, the, the, like, moving fast and being iterative correlates with success.

  12. 1:00:42 – 1:04:03

    How Y Combinator Changed Startups & Shaped OpenAI

    1. DS

      Okay, you've mentioned YC way many-- too many times in this conversation. I, I have to explore this because we talked before. It's like, listen, I'm not a journalist. I'm an enthusiast. I don't have a list of questions.

    2. SA

      Yeah.

    3. DS

      I'm like, I have a f- a world-class founder across from me. I wanna know what the hell is in this person's mind, and I wanna, like, extract [laughs] information out selfishly for me. So, like- Why? Like, I just, I'm shocked at how much you reference it in conversations. Like, how impactful going through YC and then running Y- through YC, so being, you know, affiliated with them, has, has, is clearly on your life. Can you, like, can you expound on this?

    4. SA

      There is some band that wasn't that successful. They didn't sell that many albums, I mean, but they, like, influenced all of the musicians that came after them.

    5. DS

      I think it's called The Band. Literally, the-

    6. SA

      No

    7. DS

      ... Rick Rubin told this story.

    8. SA

      I think it's, it's ... It might be The Velvet Underground, but, but you know the idea I'm getting at-

    9. DS

      Yes

    10. SA

      ... whether it's called The Band or whether-

    11. DS

      Rick Rubin talked about this, yeah.

    12. SA

      It's not fair to talk about YC in this way because YC, measured by, like, traditional metrics and market cap created or whatever, is one of the hand- would be one of the handful of most valuable tech companies. But the degree to which YC totally influenced everything that has happened in the last 20 years of the tech industry and startups, entrepreneurship, whatever, I think is, is only, like, sort of understood. OpenAI is an example of that, not just from, like, how we have shipped our products in the world but, like, the philosophy of how we run our research lab. I think if you go talk to, like, many of the other people running, like, this generation of large tech companies, they would tell you similar stories even if they didn't go through YC.

    13. DS

      But what's happening there? Is it an operating system that YC is giving you because you hear, you know, "Do these five things," or whatever, or is it more like a philosophy of building companies? This is the confusing part for me-

    14. SA

      Yeah

    15. DS

      ... as an outsider.

    16. SA

      I think it's, I think it's two major things. I mean, there, there is, there is some of the operating system of what to do, but I think it was the philosophy of how to run companies, the idea of iterative deployment and technical people in charge and sort of being willing to bet on young people with a lot of energy and ambition but maybe less experience throughout all levels of the company. And then it was also the change- the related change to the whole ecosystem that happened. In the pre-YC tech ecosystem, so if we, you know, ran the clock back to 2004 and then projected technology forward to 2016, um, but not anything else about the shape of startup ecosystem, what it meant to be an entrepreneur, how capital flowed, all of the, you know, who got to run companies, all of those things, I do not think OpenAI would've been possible. I think the changes that YC induced in the whole ecosystem, you know, more leverage going to founders, young technical founders having the ability to raise lots of capital, um, the ability to sort of, like, work on ambitious things without a very proven resume, I don't think OpenAI would've been possible. So this is kinda like a big change.

    17. DS

      Is this all tied to the fact that you think there was a benefit in you going from founder to investor for a long period of time back to founder?

    18. SA

      There are all those benefits, too, and I wouldn't say I really went from founder to investor to founder 'cause, like, the first time I was a founder, it didn't really work out that well. So, like, you know-

    19. DS

      You still learned

    20. SA

      ... you learn

  13. 1:04:03 – 1:09:45

    Learning More From Success & the Power of Repetition

    1. SA

      some lessons from failure-

    2. DS

      Yeah

    3. SA

      ... but I think you learn way more from success.

    4. DS

      Oh, you gotta-

    5. SA

      So, like-

    6. DS

      Hold on. We're not moving on from that. You gotta say more about that. [laughs]

    7. SA

      There's some ... I can't believe. I think it's Anna Karenina. Some great Russian novel, I'm very embarrassed not to know this, starts with, like, "All unhappy families are unhappy in their own way. All happy families-"

    8. DS

      This is a beautiful book.

    9. SA

      "... are sort of the same."

    10. DS

      Yeah. [laughs]

    11. SA

      That explains why it jumped into my mind. Um, but I think this is really true. Like, when I look at the lessons of where I have failed at something, I learn something generic about grit and determination and something not to do. But there's ... Most things don't work, so there's, like, a lot of reasons why things don't work, and there's... I think it's, like, harder to put together the correct causation. And when I've had something really work, when I understand, like, what parts of Y Combinator really worked or what parts of OpenAI really worked, trying to apply those lessons going forward has been much more helpful to me than trying to apply the anti-lessons of what didn't work. And so, you know, you, you should, of course, learn as much as you can from every data point, so learn from the failures, learn from the successes. But in my own experience, uh, I have, when I have tried to apply those lessons, the lessons I learned from success were very good, and I should've applied those more, and the lessons I learned from failure were either fairly generic and I kind of already knew them or got in the way of something else. And, and I think this is, like, generally true for a lot of people.

    12. DS

      Yeah, but isn't it like we already kinda know what we should do or what we should avoid, but it's like the reminder, the constant reminder? So, like, the, the best description of my other podcast founders I ever heard is, like, it's church for entrepreneurs. If you really think about it, I used to drop in on Sundays, and I should go back to doing that, but it's like, really I'm just telling the same... It's the same personality type that's appeared throughout history.

    13. SA

      Yeah.

    14. DS

      It's just like now this person happens to be building ships, and this person built technology, but, like, and they lived at different times-

    15. SA

      It's the same, it's the same personality. That's for sure

    16. DS

      ... and I, I'm kind of obsessed with this idea of things that last for a long period of time.

    17. SA

      Yep.

    18. DS

      And, like, uh, you know, companies, the best companies can last a long time but not as long as cities, and, uh, cities don't la- cities and countries don't last as long as, like, religions.

    19. SA

      Yeah.

    20. DS

      And I'm like, so out of all the man-made things, what has lasted longer? I would say I can't think of anything other than religion. It might be another asset. So then I started studying. I grew up, my mom was fundamentalist Christian, so I was forced to go to church my entire life, and I just started analyzing, like, what all the main religions in the world have in common. It's just like, oh, we have a shared base of knowledge, usually some kind of book.

    21. SA

      Yeah.

    22. DS

      Right? We meet with like-minded fellow believers at regular intervals. And it's not like I go to church on Sunday, it's like, okay, we talked about Jesus last week, but let's talk about this other guy. It's like, no, [laughs] we go back to these same s- books and these same stories over and over again. So I read your blog, and you even said this, uh, something about, like, when YC end ended. It's like you're repeating the same thing. You're telling it to them all the time-

    23. SA

      Yeah

    24. DS

      ... and then they leave the church-

    25. SA

      Yeah

    26. DS

      ... you know, to, to... for this analogy, and then they stop doing the same stuff.

    27. SA

      Yeah.

    28. DS

      It's like-

    29. SA

      100%

    30. DS

      ... it's not even the lessons. It's like the constant reminder that this is important.

  14. 1:09:45 – 1:15:57

    Building OpenAI Without Customers, a Product or a Playbook

    1. DS

      in time."

    2. SA

      Totally. Yeah, I, I'll give many examples of that. I, I, I think it's also instructive to, like, what, what was the new thing? What didn't you have the advice for?

    3. DS

      Mm-hmm.

    4. SA

      And the thing that was really different about OpenAI than anything that I had pattern matching before is it was four and a half years from when we started the company to when we launched our first product.

    5. DS

      The opposite of YC [chuckles] advice, right?

    6. SA

      Yes.

    7. DS

      Okay.

    8. SA

      Yes. And although there were all these ways which managing a research team was similar to selecting and advising founders, learning what it-- to whatever degree we learned it, 'cause I don't think we did it perfectly, like, how you manage through this part of the world where you don't have the external signal from customers and you're just trying to, like, you know, do what would normally be the catastrophic startup advice of not, uh, not shipping a product for four and a half years, that was very difficult. And we tried all of these things about how we, like, had a-- how we replaced the signal of do customers actually like the product for is our research actually working? One of the things that worked, actually, is during the, um, Dota 2 days when we were trying to use RL to beat this video-- beat people at a video game, we put up, like, a leaderboard, and people could just see how different ideas were performing and what was, you know, that was, like, objective and real. People wanted to, like, go up that. But we had to try all of these things to, uh, basically, like, simulate end users, and that was a totally interesting new problem I had no pattern matching for.

    9. DS

      How did you work your way through that? What was your thinking? Like, how'd you do this?

    10. SA

      We asked a bunch of people who had been at great research labs of the past. And it had been, you know, OpenAI started at sort of a time when everybody in Silicon Valley as their vanity project, including me, uh, wanted to start a research lab. And there were all these books about the heyday of Bell Labs or Xerox PARC that were very popular. Everybody was talking about this. There was a huge amount of discussion. In fact, I even see one of the books over there about, uh, about Bell Labs. But there was not a ton of people that had, like, in living memory how to actually do it. So we talked a lot to Alan Kay. We talked to a handful of other people, and we got some advice from them about, you know, what made a really good research, research lab, and some of it was really good. Some of it didn't translate as well to the current moment.

    11. DS

      Well, you also didn't have this giant monopolistic profit [chuckles] profit printing machine like Bell Labs was spun out independently. Uh, Polaroid did a lot more research when they had, uh, essentially, like, a monopoly on instant photography. I just read the biography of the founder of Honda, right? Hon- the guy created the most successful m- uh, uh, motor vehicle of all time. The Honda Cub has sold uninterrupted for, like, sixty years, millions of-

    12. SA

      Yeah

    13. DS

      ... fucking vehicles. And his whole thing, and he, he arrived at the same conclusion Bell Labs did, that he thought the research and development had to actually be separate. It was a s- it was spun out of the company, and it had separate ownership-

    14. SA

      Yeah

    15. DS

      ... just like Bell Labs did.

    16. SA

      We did not have that.

    17. DS

      No, you did not have [chuckles]

    18. SA

      The-- when I think back to those early days, I mostly feel like I was trying and failing to raise money. That's, like, my dominant memory-

    19. DS

      Mm-hmm

    20. SA

      ... of the early days of OpenAI. It-- so much effort, so frustrating. I wish we had some sort of cash machine like that. I remember, like, one of my clearest memories of all of OpenAI, so announced the company end of twenty fifteen, but the first day was right after New Year's in twenty sixteen. And 12 of us or 11 of us showed up at Greg Brockman's apartment, you know, like 9:00, 9:30 on a Monday or Tuesday morning, something like that. Let's say it's January 4th, and everybody's there, and it had been this, like, big effort, and everybody walks in with a lot of excitement. It feels like the first day of school, whatever. And then very quickly, people, like, look around the room, and they're sort of like, "Well, what do we do now?" Someone says, "Okay, we should get a whiteboard." Greg, you know, gets someone to go off and find a whiteboard. Whiteboard comes. Um, look around again, you know, what are we supposed to do now? And you just feel the energy in the room collapse. And none of us know what to do. Like, there's no-- It was not like building a product startup. It was not like, let's build this product, and let's talk to customers. It's like, okay, we said we want to make AGI. Maybe we should write some papers. Okay, let's write some papers. Maybe we should think about some ideas. Okay, let's think about some ideas. You know, everybody's got their, like, moments of, "I have no idea what I'm doing." That was one of mine. Like, I have-- You know, we have just launched this thing. None of us have any idea what we're gonna do. So we did what we knew how to do, and eventually we figured out a lot of things didn't work. Eventually, we figured out a kind of like rhythm for making and then evaluating research bets. And all far from perfect, obviously. Uh, but we did find a gradient that we could kind of progress along, and we figured out how to get, you know, the resources that very smart people needed and how to make sure that we were, like, not completely getting lost in the wilderness. And over some number of years, mostly chaotic stumbling, we eventually made most of the big discoveries. You know, what started as the unsupervised sentiment neuron paper, uh, turned into GPT 1 and then eventually GPT whatever. The scaling laws work that gave us the confidence not only by the compute, but the understanding about how to scale up our models sort of came together, and through-- and many other things, too. Um, through this process, we learned things like that idea of leaderboards that worked. We also learned the incredible power of external demos, uh, for, like, an eminent person that the researchers really wanted to impress. And then we learned a bunch of things that, like, didn't work, like fake deadlines.

    21. DS

      That has to be so disorienting to live through that experience. You're at 12 people in an apartment, don't even have a whiteboard, don't know what to do. Fast-forward a decade, you have a billion people using-

    22. SA

      Very strange experience.

    23. DS

      Do you keep a journal?

  15. 1:15:57 – 1:18:13

    Letters to His Son & Preserving the Story

    1. SA

      When my kid was born, my first kid, I would like, you know, get home at the end of the day and be rocking him to sleep and just, like, talk to a kid or whatever. So I was just like, "Need to come up with things to talk about." So I would, like, just tell him about my day and what we were struggling with and kinda like what I was worried about and what was happening. It was kinda, like, fun for me to do, and I was like, "This is sort of interesting, and someday it'll be, like, interesting for him to have this." So I started writing him, like, every Sunday I would, like, write him a letter. I would, like, talk just to talk, and then I would, like, write it down. But I only ever did like eight of them or something.

    2. DS

      How many kids do you have?

    3. SA

      Two.

    4. DS

      Okay. Bezos has this great line about building Amazon. He's like, "We're trying to do stuff that we can tell our grandkids about that we're proud of," right? And those things are hard. The fact that you were writing to your son-

    5. SA

      Oh, man.

    6. DS

      Keep writing the letters, and if you don't do that, this is real quick, just because I've read enough books about this, most time, guess what? Founders don't write autobiographies when they're 40. They write them when they're 70, and they're looking back, and they wish they could do it again, and so much has been lost to the sands of time. They all repeat this. They're like, "I wish I journaled." So even if you don't do it, you have enough resources. What I would do, write-- have a book written, even if it's for internal purposes only. You ever read The Little Kingdom by Michael Moritz?

    7. SA

      I never read it.

    8. DS

      Oh, you have to. It's like the first six-year history of Apple-

    9. SA

      Yeah

    10. DS

      ... written by Michael Moritz. Isn't it crazy that he wrote that book? He's a phenomenal writer.

    11. SA

      He is a great writer.

    12. DS

      Like, crazy writer.

    13. SA

      Beautiful writer.

    14. DS

      Winds up being one of the-

    15. SA

      Yeah

    16. DS

      ... best venture capitalists of all time, I guess. But, like, the-- you just-- the point is that have-- that book ends. Steve hasn't even been kicked out of Apple yet.

    17. SA

      Yeah.

    18. DS

      So you get, like, what actually happened. You're gonna want this. You might not want it now, but you're damn sure gonna want it when you're 60 or 70.

    19. SA

      The thing that was so interesting was, like, the mindset of writing to your kid. Like, you really can't hide behind anything. Like, you're like, "Uh, I really care what my kid's gonna think about me," so, like, this thing happened, like, you know, didn't feel great about it. Better do it differently next week. Like, it was a very interesting, extremely interesting mental framework. Maybe I'll find some way to do it again.

    20. DS

      Not maybe. You're gonna do it.

    21. SA

      Okay.

    22. DS

      Sam, thanks for taking the time. This was awesome, man.

    23. SA

      Thank you.

    24. DS

      Appreciate it. I hope you enjoyed this episode. Please remember to subscribe wherever you're listening and leave a review. And make sure you listen to my other podcast, Founders. For almost a decade, I've obsessively read over 400 biographies of history's greatest entrepreneurs, searching for ideas that you can use in your work. Most of the guests you hear on this show first found me through Founders. [electronic sound]

Episode duration: 1:18:16

In the uListen app, the transcript lights up word by word as you listen. Get uListen

Transcript of episode kG8AoExkX40

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.