Mark Zuckerberg — Llama 3, $10B models, Caesar Augustus, & 1 GW datacenters

1. 0:00 – 9:15

   Llama 3

   1. MZMark Zuckerberg0:00

      That's not even a question for me, whether we're gonna go take a swing at building the next thing. I'm just incapable of not doing that. (whoosh) There's a bunch of times when we wanted to launch features and then Apple's just like, "Nope, you're not launching that." I was like, "That sucks."

   2. DPDwarkesh Patel0:13

      (laughs)

   3. MZMark Zuckerberg0:14

      Are we set up for that with AI where you're gonna get a handful of companies that run these closed models that are gonna be in control of the APIs, and therefore are gonna be able to tell you what you can build? (whoosh) Then when you start getting into building a data center that's like 300 megawatts or 500 megawatts or a gigawatt, just no one has built a single gigawatt data center yet. (whoosh) From wherever you sit, there's gonna be some actor who you don't trust. If they're the ones who have, like, the super strong AI, I think that that's potentially a much bigger risk.

   4. DPDwarkesh Patel0:44

      Mark, welcome to the podcast.

   5. MZMark Zuckerberg0:45

      Hey, thanks for having me. Big fan of your podcast.

   6. DPDwarkesh Patel0:47

      Oh, thank you. That's very nice of you to say. Um, (laughs) okay, so let's start by talking about the releases that will go out a l- when this interview goes out. Um, tell, tell me about the models, tell me about Meta AI. What's new? What's exciting about them?

   7. MZMark Zuckerberg0:59

      Yeah, sure. So, you know, I think the, the main thing that most people in the world are gonna see is the new version of Meta AI.

   8. DPDwarkesh Patel1:04

      Hmm.

   9. MZMark Zuckerberg1:04

      Right? So it's, um... And, you know, the most important thing about what we're doing is the upgrade to the model. We're rolling out Llama 3. We're doing it both as open source for the, the dev community, and it is now gonna be powering Meta AI. Um, so, you know, there's a lot that I'm sure we'll go into around Llama 3, but I think the bottom line on this is that with Llama 3, we now think that Meta AI is the most intelligent AI assistant that people can use that's freely available. Um, we're also integrating Google and Bing for real-time knowledge.

   10. DPDwarkesh Patel1:34

       Mm-hmm.

   11. MZMark Zuckerberg1:34

       Um, we're gonna make it a lot more prominent across our apps. So, you know, basically, you know, at the top of WhatsApp, and Instagram, and Facebook, and Messenger, uh, you'll just be able to, um, you know, use the search box right there to ask, ask us any question. Um, and there's a bunch of new creation features that we, that we added that I think are pretty cool that I think people enjoy. Uh, and I think animations is, is a good one. Um, you can basically just take any image and animate it. But I think one that, that, uh, people are gonna find pretty wild is, uh, it now generates high-quality images so quickly. I don't know if you've gotten a chance to play with this. That it actually generates it as you're typing and updates it in real time. So you're, like, typing your query and it's, and it's kind of, like, honing in on... And, and, you know, it's like, "Okay, here, um, you know, show me a picture of a, a cow, okay, in a field with mountains in the background." And just like everything's populated-

   12. DPDwarkesh Patel2:25

       Eating macadamia nuts. (laughs)

   13. MZMark Zuckerberg2:26

       Yeah, eating macadamia nuts, drinking beer, and like-

   14. DPDwarkesh Patel2:27

       (laughs)

   15. MZMark Zuckerberg2:27

       ... it just... And, and just like it's updating the image in real time. It's pretty wild. I think people are gonna enjoy that. Um, so yeah. So that, I think, is... That's what most people are gonna see in the world, right? We're rolling it out, um, you know, not everywhere, but we're starting in, um, in a handful of countries, and we'll do more over the coming weeks and months. Um, so that's, that, I think, is gonna be a pretty big deal. Um, and I'm really excited to get that in people's hands. It, it's, it's a big step forward for Meta AI. Um, but I think, you know, if you want to get under the hood a bit, the Llama 3 stuff is, is obviously the most technically interesting.

   16. DPDwarkesh Patel3:01

       Yeah.

   17. MZMark Zuckerberg3:02

       So, you know, we're, we're basically the... For the first version, we're training three versions. Um, you know, an eight billion and a 70 billion, which we're releasing today, and a 405 billion dense model, um, which is still training. So, so we're not releasing that today. Um, but, you know, the eight and 70, I mean, I'm, I'm pretty excited about how they turned out. I mean, it's, um, you know, they're, they're leading for, for their scale. Um, you know, it's, uh... I mean, we'll, we'll release a blog post with all of the benchmarks so people can check it out themselves. And obviously it's open source, so people get a chance to play with it. Um, we have a roadmap of new releases coming, uh, that are gonna bring multi-modality, more multilinguality, um, bigger context windows to those as well. Um, and then, you know, hopefully sometime later in the year, we'll, we'll get to roll out the 405, which I think is, is, um... You know, in training, it's still training, but, uh, for, for where it is right now in training, it is already at, um, around 85 MMLU-

   18. DPDwarkesh Patel4:05

       Mm-hmm.

   19. MZMark Zuckerberg4:06

       ... and, um, and just we, we expect that it's gonna have leading benchmarks on a, on a bunch of, on a bunch of the, the benchmarks. So I, I'm, I'm pretty excited about all of that. I mean, the 70 billion is, is, um, is, is great too. I mean, we're releasing that today. It's around 82 MMLU and has leading scores on math and reasoning. So, I mean, it's, uh... I think just getting this in people's hands is gonna be pretty wild.

   20. DPDwarkesh Patel4:26

       Oh, interesting. Yeah, that's-

   21. MZMark Zuckerberg4:27

       Yeah.

   22. DPDwarkesh Patel4:27

       ... the first time hearing this benchmarking. That's super impressive. And it'll be-

   23. MZMark Zuckerberg4:29

       Yeah, yeah, the eight billion is, the eight billion is, um, is nearly as, as powerful as the biggest version of Llama 2 that we released.

   24. DPDwarkesh Patel4:38

       Hmm.

   25. MZMark Zuckerberg4:38

       So it's like the smallest Llama 3 is basically as powerful as the, the biggest Llama 2.

   26. DPDwarkesh Patel4:42

       Hmm, okay, so before we dig into these models-

   27. MZMark Zuckerberg4:46

       Yeah.

   28. DPDwarkesh Patel4:46

       ... I actually wanna go back in time. 2022 is, I'm assuming, when you started acquiring these H100s, um, or but you, you can tell me when.

   29. MZMark Zuckerberg4:54

       Yeah, yeah.

   30. DPDwarkesh Patel4:54

       Um, where you're like, "Stock price is getting hammered." People are like, "What's happening with all this CapEx?" People aren't buying the metaverse, and presumably you're spending that CapEx to get these H100s. How... Back then, how did you know to get the H100s? How did you know it- you'll need the GPUs?
2. 9:15 – 26:07

   Coding on path to AGI

   1. DPDwarkesh Patel9:15

      So, you've had, um, Facebook AI Research for a long time. Uh, now it's become seemingly central to your company. At what point did making AGI or whatever, however you consider that mission, at what point is that like, this is a key priority of what Meta is doing?

   2. MZMark Zuckerberg9:33

      Yeah. I mean, it's been a big deal for a while.

   3. DPDwarkesh Patel9:35

      Right.

   4. MZMark Zuckerberg9:35

      So we, we started FAIR, um, about 10 years ago, and the idea was that along the way to general intelligence or AI, like full AI, whatever you wanna call it, there are gonna be all these different innovations and that's gonna just improve everything that we do. So, it... I... we didn't kind of conceive it as a product. It was more kind of a research group.

   5. DPDwarkesh Patel9:57

      Yeah.

   6. MZMark Zuckerberg9:58

      And over the last 10 years, it has created a lot of different things that have basically improved all of our products, um, and advanced the field and allowed other people in the field to create things that have improved our products too. So, I think that that's been great. But there's obviously a big change, um-

   7. DPDwarkesh Patel10:16

      Yeah.

   8. MZMark Zuckerberg10:17

      ... in the, in the last few years when, you know, ChatGPT comes out, um, the diffusion models around image creation come out and, like, I mean, this is some pretty wild stuff, right? That, that I think is, like, pretty clearly gonna affect how, how people interact with, like, every app that's out there. So I... at that point, we started a second group, um, the, the GenAI group, um, with the goal of basically bringing that stuff into our products, so building leading foundation models that would, that would sort of power all these different products. And initially when we started doing that, um, the theory at first was, hey, a lot of this stuff that we're doing is, is pretty social, right? So, you know, it's helping people interact with creators, helping, um, people interact with businesses to... you know, so that businesses can sell things or do customer support or, um, you know, basic assistant functionality for, um... you know, whether it's for our apps or the smart glasses or, or VR, like all these different things. So initially it wasn't completely clear that you were gonna need kind of full AGI, um, to be able to support those use cases. But then through working on them, I think it's actually become clear that you do, right? There... in all these subtle ways. So for example, you know, for LLaMA 2, when we were working on it, we didn't prioritize coding. And the reason why we didn't prioritize coding is because people aren't gonna ask Meta AI a lot of coding questions in WhatsApp, right?

   9. DPDwarkesh Patel11:43

      Now they will. (laughs)

   10. MZMark Zuckerberg11:44

       Well, I don't know. I'm, I'm not sure that WhatsApp is like the UI that people are gonna be doing a lot of coding questions.

   11. DPDwarkesh Patel11:49

       Yeah.

   12. MZMark Zuckerberg11:49

       So we're like, all right, look, in terms of the things that... you know, or, or Facebook or Instagram or, you know, those, those different services. Maybe, maybe the website, right? Meta dot a- dot AI that we're, we're launching, I think.

   13. DPDwarkesh Patel11:57

       Yeah.

   14. MZMark Zuckerberg11:58

       But, but the, the thing that was sort of, uh, uh, I think has, has been a, you know, somewhat surprising result over the last, um, you know, 18 months is that...... it, it turns out that coding is important for a lot of domains, not just coding, right? So even if people aren't asking coding questions to the models, um, training the models on coding helps them, um, just be more rigorous and answer the question and, and kind of, um, help reason across a lot of different types of domains. Okay, so that's one example where it's like, all right, so for Llama 3, we, like, really focused on training it with a lot of coding because it's like, all right, that's gonna make it better on all these things even if people aren't answering... aren't asking primarily coding questions. Reasoning I think is another example. It's like, okay, yeah, maybe you wanna chat with a creator or, you know, you're a business and you're trying to interact with a customer. You know, that interaction is not just like, okay, the person sends you a message and you just reply, right? It's a, it's like a multi-step interaction where you're trying to think through, "How do I accomplish the person's goals?" And, um, you know, a lot of times when a customer comes, they don't necessarily know exactly what they're looking for or how to ask their questions, so it's not really the job of the AI to just respond to the question. It's like you need to kinda think about it more holistically. It's really... It becomes a reasoning problem, right? So if someone else, you know, solves reasoning or makes good advances on reasoning and we're sitting here with a basic chatbot, then like, our product is lame compared to what other people are building. So it's like, so, okay, so at the end of the day, we've got, we, you know, I, we basically realized we've gotta solve general intelligence, um, and we just kinda upped the ante and the investment to make sure that we could do that.

   15. DPDwarkesh Patel13:32

       So the version of Llama that, um, that, uh, that's going to solve all these use cases for users, is that the version that will be powerful enough to, like, replace a programmer you might have in this building?

   16. MZMark Zuckerberg13:46

       I mean, I just think that all this stuff is gonna be progressive over time.

   17. DPDwarkesh Patel13:49

       But, uh, end case, Llama 10.

   18. MZMark Zuckerberg13:51

       Um, I, I mean, I think that there's a lot baked into that question. I, I'm not sure that we're replacing people as much as-

   19. DPDwarkesh Patel13:59

       M- maybe-

   20. MZMark Zuckerberg14:00

       ... giving people tools to do more stuff, but, um-

   21. DPDwarkesh Patel14:02

       Is the programmer in this building 10X more productive after Llama 10? (laughs)

   22. MZMark Zuckerberg14:04

       I would hope more, but, um, but no. I mean, look, uh, I, I'm not... I don't believe that there's, like, a single threshold of intelligence for, for humanity because, I mean, people have different skills. And at some point, I think that AI is gonna be, um... is, is probably gonna surpass people at most of o- of those things, um, depending on how powerful the models are. But, um, but I think it's progressive, and I, I don't think AGI is one thing. I think it's... you're basically adding different capabilities. So multimodality is, is kind of a key one that we're focused on now, initially with photos and images and text but eventually with videos. And then because we're so focused on the metaverse, kind of 3D type stuff is important. Um, one modality that I'm pretty focused on that I haven't seen as many other people in the industry, um, focus on this is sort of, like, emotional understanding. Like, I mean, uh, so much of, of the human brain is just dedicated to understanding people and, and kind of like understanding your expressions and emotions, and I think that that's like its own whole modality, right? That, um... I mean, you could say, okay, maybe it's just video or image, but it's, like, clearly a very specialized version of those two. So there's all these different capabilities that I think you wanna basically train the models to focus on as well as getting a lot better at reasoning, getting a lot better at memory, which I think is, is kind of its own whole thing. It's... I mean, I don't think we're gonna be, you know, primarily shoving context or, or, or kind of things into a query context window, um, in the future to, to ask more complicated questions. I think that there will be kinda different stores of memory or different custom models that, um, that are maybe more personalized to people. But I don't know. I think that these are all just different capabilities. And then obviously making them big and small. We care about both because, you know, we wanna... You know, if you're running something like Meta AI, then we have the ability to... That's pretty server-based, um, but we also want it running on smart glasses, and, you know, there's not a lot of space in smart glasses so, um, you, you wanna have something that's very efficient for that.

   23. DPDwarkesh Patel16:00

       What is the use case that if you're doing tens of billions of dollars' worth of inference or even eventually hundreds of billions of dollars' worth of inference, if you're using intelligence in an industrial scale, what is a use case? Is it simulations? Is it the AIs that will be in the metaverse? What, what are we using the data centers for?

   24. MZMark Zuckerberg16:16

       Um... I mean, our bet is that it's gonna... this is basically gonna change all of the products, right? So I, I think that there's gonna be a kind of meta AI general assistant product, and I think that that will shift from something that feels more like a chatbot where it's like you just ask a question and it kind of formulates an answer to things where you're increasingly giving it more complicated tasks and then it goes away and does them.

   25. DPDwarkesh Patel16:41

       Mm.

   26. MZMark Zuckerberg16:42

       So that's gonna take a lot of inference. It's gonna take a lot of compute in other ways, too. Um, then I think that there's a big part of what we're gonna do that is, um, like interacting with other agents for other people, so whether it's businesses or creators. Um, I guess a big part of my theory on this is that there's not just gonna be, like, one singular AI that you interact with because I think, um, you know, every business is gonna, like, want an AI that represents their interests. They're not gonna, like, wanna primarily interact with you through an AI that is gonna sell their competitors' customers. So... Uh, sorry, their competitors' products. Um, so, um, uh... So yeah, so I think creators is gonna be a big one and we- there are about 200 million creators on our platforms. They all basically have the pattern where, um, they want to engage their community but they're limited by hours in the day, and their community generally wants to engage them but they don't have... they're limited by hours in the day. Um, so if you could create something where, um, an AI could basically work... that creator can basically own the AI and train it in the way that they want, um, and can engage their community, I, I think that that's gonna be super powerful too. So, um, so I think that there's gonna be a ton of engagement across all these things. Um, but these are just the consumer use cases. I mean, I think when you think about stuff like... I mean, when I run, like, our foundation, right-... Chan Zuckerberg Initiative with my wife and, you know, we're doing a bunch of stuff on science and, um, and there's obviously a lot of AI work that, where I th- that I think is gonna advance science and healthcare and all these things too. So, I think that it's like, there's a, this is, I think gonna end up affecting basically every area of the products-

   27. DPDwarkesh Patel18:23

       Yeah.

   28. MZMark Zuckerberg18:23

       ... and, and, and the, and the, uh, the economy.

   29. DPDwarkesh Patel18:25

       The thing you mentioned about an AI that can just go out and do something for you that's multi-stuff, is that a bigger model? Is that, you'll make, like LLaMA 4 will still, uh, there'll be a version that's still 70B but will just be, you'll just train it on the right data and that will be super powerful? How do, like, what does the progression look like? Is it scaling? Is it just same size but different banks, like you were talking about?

   30. MZMark Zuckerberg18:46

       Um, I, I don't know that we know the answer to that. So I think one thing that is, seems to be a pattern is that you have the LLaMA, uh, sorry, the, the, the LLaMA model, and then you build some kind of other application-specific code around it, right? So some of it is, is the fine-tuning for the use case, but some of it is just, like, logic for, okay, how, um, like, how meta I should integrate, like should work with tools like Google or Bing to bring in real-time knowledge. I mean, that's not part of the base LLaMA model. That's like part of a... Okay, so for LLaMA 2, we had some of that, and it was a little more kind of hand engineered. And then part of our goal for LLaMA 3 was to bring more of that into the model itself. And, but for LLaMA 3 is we start getting into more of these agent-like behaviors.
3. 26:07 – 34:03

   Energy bottlenecks

   1. DPDwarkesh Patel26:07

      the LLaMA-4-

   2. MZMark Zuckerberg26:07

      It's, it's similar to our magnitude.

   3. DPDwarkesh Patel26:08

      Does that, does that mean the LLaMA-4-70B will be as good as the LLaMA-3-405B? Like, or, uh-

   4. MZMark Zuckerberg26:12

      I mean, this is one of the-

   5. DPDwarkesh Patel26:13

      What is the future of this look like?

   6. MZMark Zuckerberg26:13

      This is one of the great questions, right?

   7. DPDwarkesh Patel26:15

      Yeah.

   8. MZMark Zuckerberg26:15

      That I think no one knows. Um, is, is basically, uh, you know, it's, it's one of the trickiest things in the world to plan around is when you have an exponential curve, how long does it keep going for?

   9. DPDwarkesh Patel26:27

      Yeah.

   10. MZMark Zuckerberg26:27

       And, um, I think it's likely enough that it will keep going, that it is worth investing the, um, tens or, you know, 100 billion plus in building the infrastructure to, um, assume that if that kinda keeps going, you're gonna get some really amazing, uh, things that are just gonna make amazing products.

   11. DPDwarkesh Patel26:46

       Mm.

   12. MZMark Zuckerberg26:47

       But I don't think anyone in the industry can really tell you that it will continue scaling at that rate for sure. Right? In general, you know, in history, you hit bottlenecks at certain points and now there's so much energy on this that maybe those bottlenecks get knocked over pretty quickly. But, um, but I don't know. I think that that's, that's an interesting question.

   13. DPDwarkesh Patel27:08

       What does the world look like where there aren't these bottlenecks? Let's, you know, suppose like progress just continues, uh, at, at this pace, which seems like plausible. Um, like zooming out-

   14. MZMark Zuckerberg27:17

       Well, they're gonna be di-

   15. DPDwarkesh Patel27:18

       ... but forgetting about like LLaMAs.

   16. MZMark Zuckerberg27:18

       They're gonna be different bottlenecks.

   17. DPDwarkesh Patel27:20

       Right. So if not training, then infor- like, oh, yeah. Go ahead.

   18. MZMark Zuckerberg27:23

       Well, I think at some point, you know, over the last few years, I think there's this issue of, um, GPU production.

   19. DPDwarkesh Patel27:31

       Yeah.

   20. MZMark Zuckerberg27:31

       Right? So, even companies that had the models, uh, so- sorry, that had the money to pay for the GPUs, um, couldn't necessarily get as many as they wanted because there was, there were all these supply constraints.

   21. DPDwarkesh Patel27:42

       Yeah.

   22. MZMark Zuckerberg27:43

       Now, I think that's sort of getting less. So now, I think you're seeing a bunch of companies think about, "Wow, we should just like really invest a lot of money in building out these things." And I think that that will go for, um, for some period of time. Um, I think there's a, there is a capital question of like, okay, at what point does it stop being worth it to put the capital in? But I actually think before we hit that, you're gonna run into energy constraints, right? Because, um, I just, I mean, I don't think anyone's built a gigawatt single training cluster yet, right? And, um, and then you run into these things that just end up being slower in the world, like getting energy permitted is like a very heavily regulated government function, right? So you're going from, on the one hand, software, which is somewhat regulated. I, I'd, I'd argue that it is more regulated than I think a lot of people in the, in the, in the tech community feel. Although it's obviously different. If you're starting a small company, maybe you feel that less. If you're a big company, you know, we just interact with people, but different governments and regulators are, you know, we have kinda lots of rules-

   23. DPDwarkesh Patel28:52

       Yeah.

   24. MZMark Zuckerberg28:52

       ... so, or that we need to kind of follow and make sure we do a good job with around the world. Um, but I think that there's no doubt that like energy, and if you're talking about building large new power plants or large build outs and then building transmission lines that cross other private or public land, that is just a heavily regulated thing. So you're talking about many years of lead time. So if we wanted to stand up just some like massive facility, um, to power that, I, I think that that is... that's, that's a very long term project. Right? And, um, so I don't know. I, I think that that's... I, I think people will do it. I don't... But, but I don't think that this is like something that can be quite as magical as just like, okay, you get a level of AI and you get a bunch of capital and you put it in and then like all of a sudden the models are just gonna kinda like just... Like I think you, you do hit different bottlenecks along the way.

   25. DPDwarkesh Patel29:43

       Yeah. Is there something, a project, maybe AI-related and maybe not, that even a company like Meta doesn't have the resources for? Like if your R&D budget or capex budget was 10X what it is now, then you could pursue it, like it's in the back of your mind. But M- Meta today, and m- maybe you could like... 'cause even if you can't even issue stock or bond for it, it's like just 10X bigger than your budget.

   26. MZMark Zuckerberg30:03

       Well, I think energy is one piece.

   27. DPDwarkesh Patel30:04

       Yeah.

   28. MZMark Zuckerberg30:05

       Right? Um, I think we would probably build out bigger clusters than we currently can.

   29. NANarrator30:13

       ... if we could get the energy to do it. So, I think that that's, um, eh, that- that's fundamentally f- uh, money bottlenecked in the limit? Like, if you had a trillion dollars-

   30. MZMark Zuckerberg30:23

       I think it's, I think it's time.
4. 34:03 – 38:04

   Is AI the most important technology ever?

   1. MZMark Zuckerberg34:03

      to the next step function. Yeah. Okay. L- so let's zoom out a little bit from, uh, specific models and even the many years lead times you would need to get energy approvals and so on. Like big picture. Yeah. These next couple of decades. Sure. What's happening with AI? Um, is, does it feel like another technology like metaverse or social or does it feel like a fundamentally different thing in the course of human history? Um, I think it's gonna be pretty fundamental. I think it's gonna be more like the creation of computing in the first place, right? So, um, you'll get all these new apps in the same way that when you got the web or you got mobile phones, you got ... Like people basically rethought all these experiences and a lot of things that weren't possible before now became possible. Um, so I think that will happen, but I think it's a much lower level innovation. It's, um, it's, it's gonna be more like going from people didn't have computers to people have computers is my, my sense. Um, but it's also, it's, it's, uh ... I don't know. It's, it's very hard to reason about exactly how this goes. I, I tend to think that, you know, in like the cosmic scale obviously it'll happen quickly over a, you know, couple of decades or something. But I, I do think that there, there is some set of people who are afraid of like, you know, really just kind of spins and goes from being like somewhat intelligent to extremely intelligent overnight, and I just think that there's all these physical constraints that make that so that that's unlikely to happen. Um, I, I, I just don't, I don't really see that, that playing out. So I think you'll have, I think we'll have time to kind of acclimate a bit, but it will really change the way that we work and give people all these creative tools to do different things that they ... Yeah. I, I think, I think it's gonna be, it's- it's gonna really enable people to do the things that they want a lot more is- Mm-hmm. ... is, is my view. Um, eh, uh, okay. So maybe not overnight, but i- is it your view that, like, on a cosmic scale if you think like humans evolved- Uh-huh. ... and then like AI happened and then they like went out through the galaxy? Or maybe it takes many decades. Maybe it takes a century, but like billi- is that like the grand scheme of what's happening right now in history?Um, uh, w- sorry, in what sense? I mean-

   2. DPDwarkesh Patel36:24

      In the sense that there are other technologies like computers and even, like, fire, but, like, w- i- the AI happening is as significant as, like, humans evolving in the first place.

   3. MZMark Zuckerberg36:32

      I, I think that that's tricky. Um, I think people like to, you know, I mean, the history of humanity, I think, has been people basically, you know, thinking that certain aspects of humanity are, like, really unique in different ways and then coming to grips with the fact that that's not true, but humanity is actually still super special. Right? So it's, um, you know, it's like we thought that the earth was the center of the universe, and it's like, it's not, but, like, it's, like, humans are still pretty awesome-

   4. DPDwarkesh Patel37:09

      Yeah.

   5. MZMark Zuckerberg37:09

      ... right? And, and pretty unique. Um, I think that another bias that people tend to have is thinking that intelligence is somehow kind of fundamentally connected to life, and it's not actually clear that it is, right? I, I think, like, like, people think that, um, I mean, I, I don't know that we have a clear enough definition of consciousness or, um, or, or, or life to kinda fully, um, interrogate this. But I know there were, there's all this science fiction about, okay, you create intelligence, and now it, like, starts taking on all these human-like behaviors and, and things like that, but I actually think that the current incarnation of all this stuff at least kind of feels like it's going in a direction where intelligence can be pretty separated from consciousness and agency and things like that, that, um, I think just makes it a super

5. 38:04 – 54:40

   Dangers of open source

   1. MZMark Zuckerberg38:04

      valuable tool. So I, I don't know. I mean, obviously, it's, it's, um, it's very difficult to predict what direction this stuff goes in over time, which is why I, I don't think anyone should be dogmatic about, you know, how they plan to develop it or what they plan to do. I think you wanna kinda look at, like, each release. You know? It's like, we're obviously very pro open source-

   2. DPDwarkesh Patel38:21

      Yeah.

   3. MZMark Zuckerberg38:22

      ... but I haven't committed that we're gonna, like, release every single thing that we do.

   4. DPDwarkesh Patel38:24

      Mm.

   5. MZMark Zuckerberg38:25

      But it's basically we, I, like, I'm, I'm just generally very inclined to thinking that open sourcing it is gonna be good for the community and, and also good for us, right? 'Cause we'll, we'll benefit from, from the innovations. Um, but if at, at some point, like, there's some qualitative change in what the, the thing is capable of and we feel like it's just not responsible to open source it, then we won't. But, um, so I don't know. It's, it's, it's all, it's all very difficult to predict.

   6. DPDwarkesh Patel38:51

      Yeah. Um, w- what is a kind of qualitative change, like, a specific thing? You're training Llama-5, Llama-4, and you've seen this, and, like, w- w- we're at, you know what? I'm not sure about open sourcing it.

   7. MZMark Zuckerberg39:01

      Um, I think that that... It's a little hard to answer that in the abstract because there are negative behaviors that any product can exhibit-

   8. DPDwarkesh Patel39:13

      Mm-hmm.

   9. MZMark Zuckerberg39:13

      ... that as long as you can mitigate it, it's, like, it's okay. Right? So, um, I mean, there's bad things about social media that we work to mitigate, right? There's bad things about Llama-2 that we spend a lot of time trying to make sure that it's not, like, you know, helping people commit violent acts or things like that, right? I mean, that doesn't mean that it's like a, a, kind of a- a autonomous or intelligent agent. It just means that it's learned a lot about the world and it can answer a set of questions that, um, we think it would be unhelpful for it to answer. Um, so I, um, I don't know. I think the question isn't really what behaviors would it show. It's what things would we not be able to mitigate after it shows that. And, um, and I don't know. I, I, I think that there's so many ways in which something can be good or bad that it's hard to actually enumerate them all up front. If you even look at, like, what we've had to deal with in, in, um, you know, social media and, like, the different types of harms, we've basically gotten to, it's like, there's like 18 or 19 categories of, of harmful things that, that people do, and we've basically built AI systems to try to go identify what those things are that people are doing and try to make sure that that, you know, doesn't happen on our network as much as possible. So, um, yeah. I think you, you can... Over time, I think you'll be able to break down, um, this into more of a taxonomy too, and I, I think that it's, it... This is a thing that we spend time researching too 'cause we wanna make sure that we understand that.

   10. DPDwarkesh Patel40:37

       Whoosh. So one of the things I asked Mark is what industrial scale use of LLMs would look like. You see this in previous technological revolutions where, at first, they're thinking in a very small scale way about what's enabled, and I think that's what chatbots might be for LLMs. And I think the large-scale use case might look something like what V7 Go is. And by the way, it's made by V7 Labs, who's sponsoring this episode. So it's like a spreadsheet. You put in raw information, like documents, images, whatever, and they become rows, and the columns are populated by an LLM of your choice. And in fact, I used it to prepare for Mark. So I fed in a bunch of blog posts and papers from Meta's AI research, and as you can see, if, uh, you're on YouTube, it summarizes and extracts exactly the information I want as columns. And obviously, mine is a small use case. But you can imagine, for example, a company like FedEx has to process half a million documents a day. Obviously, a chatbot can't do that. A spreadsheet can because this is just like a fire hose of intelligence in there, right? Anyways, you can learn more about them at v7labs.com/go or the link in the description. Back to Mark. Whoosh. Yeah. Like, uh, it, it seems to me it would be a good idea. I, I would be disappointed in a future where AI systems aren't broadly deployed and everybody doesn't have access to them.

   11. MZMark Zuckerberg41:53

       Yeah. Yeah.

   12. DPDwarkesh Patel41:53

       Um, at the same time, I wanna better understand the mitigations.

   13. MZMark Zuckerberg41:58

       Yeah.

   14. DPDwarkesh Patel41:58

       Um, 'cause if the mitigation is the fine-tuning, well, the w- whole thing about open weights is that you can then, um, remove the fine-tuning, which is often superficial on top of these capabilities. Like, if it's like talking on Slack with a biology researcher... And I, again, I think, like, models are very far from this.

   15. MZMark Zuckerberg42:14

       Yeah.

   16. DPDwarkesh Patel42:14

       They're, right now, they're like Google Search, um, but it's like I can show them my Petri dish, and they can explain, like, "Here's why your, uh, smallpox, uh, sample-"

   17. MZMark Zuckerberg42:20

       Yeah.

   18. DPDwarkesh Patel42:21

       "... didn't grow. Um, here's what to change." Um, uh, how do you mitigate that? 'Cause th- th- somebody can just, like, fine-tune that in there, right?

   19. MZMark Zuckerberg42:28

       Yeah. I mean-That's true. I think a lot of people will basically use the off the shelf model and some people who have basically bad faith are going to try to strip out all the bad stuff, so I do think that's an issue. The, um, the flip side of this is that... And this is one of the reasons why I'm, I'm kind of philosophically so pro open source, is I do think that a concentration-

   20. DPDwarkesh Patel42:55

       Yeah.

   21. MZMark Zuckerberg42:55

       ... of AI in the future has the potential to be as dangerous as kind of it being widespread. So I think a lot of people are, they, they think about the questions of, "Okay. Well, if it can do this stuff, is it bad for it to be out wild?" Like just in, in-

   22. DPDwarkesh Patel43:11

       Yeah.

   23. MZMark Zuckerberg43:11

       ... kind of widely available. Um, I think another version of this is like, okay, well, it's probably also pretty bad for one institution to have an AI that is way more powerful than everyone else's AI, right? So if you look at like, like I guess one security analogy that I think of is, um, you know, it doesn't take AI to basically... Okay, there's security holes in so many different things and if you could travel back in time a year or two years, right? It's like that's not AI, it's like you just... Let's say you just have like one year or two years more knowledge of the security holes, you could pretty much hack into like any system, right? So it's not that far-fetched to believe that a, a very intelligent AI would probably be able to identify some holes, um, and, and basically be like a human who could potentially go back in time a year or two and compromise all these systems. Okay, so how have we dealt with that as a society? Well, one big part is open source software that makes it so that when improvements are made to the software, it doesn't just kind of get stuck in one company's products, but it can kind of be broadly deployed to a lot of different systems, whether it's banks or hospitals or government stuff. And like just everyone can kind of... Like as the software gets hardened, which happens because more people can see it and more people can bang on it, um, and there, and there are standards on how this stuff works, um, the world can kind of get upgraded together pretty quickly. And I kinda think that a world where AI is very widely deployed in a, in a way where it's gotten hardened, um, progressively over time, and is one where all the different systems will be in check-

   24. DPDwarkesh Patel44:54

       Yeah.

   25. MZMark Zuckerberg44:54

       ... in a way that seems like it is fundamentally more healthy to me than one where this is more concentrated. So there are risks on all sides, but I think that that's one risk that I think people, I don't hear them talking about quite as much. I think like there's sort of the risk of like, "Okay, well what if the AI system does something bad?" I, I, I am more like, you know, I stay up at night more worrying, well, what if like some actor that... Whatever. It's like from wherever you sit, there's gonna be some actor who you don't trust. If they're the ones who have like the super strong AI, whether it's some, like other government that we, that, that is sort of like an opponent of, of, of our country or some company that you don't trust or whatev- whatever it is. Um, like I think that that's potentially a much bigger risk.

   26. DPDwarkesh Patel45:43

       As in they could like overthrow our government because they have a weapon that like nobody else has?

   27. MZMark Zuckerberg45:50

       Could just cause, cause a lot of mayhem. Right? It's, I think it's like... And I, I think the intuition is that this stuff ends up being pretty kind of important and, and, um, and valuable for both kind of economic and, and kind of security and other things. And, um, I don't know. I just think, yeah, if, if like, if someone who you, you don't trust or is an adversary of you gets something that is more powerful, then, um, then I think that that could be an issue. And I think that probably the best way to mitigate that is to have good open source, um, AI that, that basically becomes the standard, um, and in a lot of ways kind of can become the leader. And, um, in that way, it just, it just ensures that it's a much more kind of even and balanced playing field.

   28. DPDwarkesh Patel46:33

       Yeah. That seems plausible to me and if that works out, that would be the future I prefer. Um, I guess I want to understand like mechanistically how if somebody was gonna cause mayhem with AI systems, how the fact that there are other open source systems in the world prevents that. Like the specific example of like somebody coming up with a bio weapon. Um, is it just that we'll do a bunch of like R&D in the rest of the world to like figure out vaccines really fast? Like what, what, what's happening?

   29. MZMark Zuckerberg46:57

       If you take like the computer, the security one that I was talking about, I think someone with a weaker AI trying to hack into a system that is like protected by a stronger AI will succeed less.

   30. DPDwarkesh Patel47:08

       Hmm.
6. 54:40 – 1:05:36

   Caesar Augustus and metaverse

   1. DPDwarkesh Patel54:40

      seems reasonable.

   2. MZMark Zuckerberg54:40

      Yeah.

   3. DPDwarkesh Patel54:41

      Um-Uh, let's talk about some other things. Uh-

   4. MZMark Zuckerberg54:43

      Go for it.

   5. DPDwarkesh Patel54:44

      ... okay. Uh, metaverse, what time period in human history would you be most interested in going into? Ah, 100,000 BCE to now, you just wanna see what it was like.

   6. MZMark Zuckerberg54:53

      Well, as to the past?

   7. DPDwarkesh Patel54:54

      Huh?

   8. MZMark Zuckerberg54:55

      It has to be the past?

   9. DPDwarkesh Patel54:55

      Oh, yeah, it has to be the past.

   10. MZMark Zuckerberg54:57

       Um, I don't know. I mean, I, I have the periods of time that I'm interested. I mean, I'm really interested in American history and classical history and, um, I'm really interested in the history of science too. So I actually think seeing and trying to understand more about how some of the big advances came about. I mean, all we have are, like, somewhat limited writings about some of that stuff. I'm not sure the metaverse is gonna let you do that 'cause I mean, it's, um... You know, we can't... Mo- It's gonna be hard to, to kinda go back in time for things that we don't have records of. But, uh, I'm actually not sure that going back in time is gonna be that e- that, that important of a thing for the... I mean, I think that it's gonna be cool for, like, history classes and stuff. But, um, that's probably not the use case that I'm most excited about for the, for the metaverse overall. I mean, it's, um... I think the main thing is just the ability to feel present with people no matter where you are. I think that that's gonna be killer. I mean, there's, um... I mean, in the AI conversation that we, that we're having, I mean, it's, uh... You know, so much of it is about physical constraints that kind of underlie all, all of this, right? And you wanna move... I think one lesson of technology is you wanna move things from the physical constraint realm into software as much as possible because software is so much easier to build and, and evolve. And, like, you can democratize it more because, like, not everyone is gonna have a data center. But, like, uh, a lot of people can, can kind of write code and take open source code and, and modify it. Um, the metaverse version of this is, I think, enabling realistic digital presence is going to be just an absolutely huge difference for, um, for making it so that, um, people don't feel like they have to physically be together for as many things. Um, now, I mean, I think that there are gonna be things that are better about being physically together. Um, so it's not... I mean, these things aren't binary. It's not gonna be like, "Okay, now it's, you don't need to do that anymore." But, um, but overall, I mean, I, I think that this, it's just gonna be really powerful for, for socializing, for feeling connected with people, for working, um, for, I don't know, parts of industry, for medicine, for, like, a l- a l- like, so many things.

   11. DPDwarkesh Patel57:20

       I, I wanna go back to something you said at the beginning of the conversation where, um, you didn't sell the company for a billion dollars.

   12. MZMark Zuckerberg57:25

       Uh-huh.

   13. DPDwarkesh Patel57:25

       And like with the metaverse, you knew we were gonna do this even though the, uh, the, the market was hammering you for it. And then I'm actually curious, like, what is the source of that edge? And you said, like, "Oh, values. I have this intuition." But, like, everybody says that, right? Like, what do... If you had to say something that's specific to you, what is... How would you express what that is? Like, why, wh- why were you so convinced about the metaverse?

   14. MZMark Zuckerberg57:46

       Um... Uh, well, I think that those are different questions. So what, I mean, what, what are the things that, that kinda power me? Um, I think we've talked about a bunch of the themes. So it's... I mean, I, I just really like building things. Um, I specifically like building things around how people communicate and sort of understanding how people express themselves and how people work, right? It's... When I was in college, I was, I was... I studied computer science and psychology. I think a lot of other people in the industry studied, studied computer science, right? So, um, it's, uh, it's always been sort of the intersection of those two things for me. But I think it's also sort of this, like, really deep drive. I don't know how to explain it, but I just feel like in... like constitutionally, like, I'm doing something wrong if I'm not building something new. Right? And, and, um, so I think that there's, like... You know, even when we're putting together the business case for, you know, investing, like, $100 billion in AI or some huge amount in the metaverse. It's like, yeah, I mean, we have plans that I think make it pretty clear that if our stuff works, it'll be a good investment. But, like, you can't know for certain from the outset. And, um, so there's all these arguments that people have, you know, whether it's like, you know, with advisors or, or different folks. It's like, "Well, how, how could you..." Like, it's... How, how are you confident enough to do this? And it's like, "Well, the day I stop trying to build new things, I'm just done. I'm gonna go build new things somewhere else," right? It's like, um, it's like it is... I, I'm fundamentally incapable of running something or in my own life and, like, not trying to build new things that I think are, are interesting. It's like that's not even a question for me, right? It's not like whether, like, whether we're gonna go take a swing at, like, building the next thing. It's like, it's... I, like, I'm, I'm just incapable of not doing that. Um, and I don't know. I, and I'm kinda like this in, like, all the different aspects of my life, right? It's like we built this, like... Our family built this ranch in Kauai and, like, I just, like, worked to, like, design all these buildings and, like, kinda try to... Or, like, we started raising cattle and I'm like, "All right, well, I wanna make, like, the best cattle in the world," right? So it's like how do we... Like, how do we architect this so that way we can figure this out and, like, and build, like, all the stuff up that we need to to try to do that. Um, so I don't know. Uh, th- that's me. Um, what was the other part of the question?

   15. DPDwarkesh Patel1:00:32

       Look, Meta is just a really amazing tech company, right? They have all these great software engineers and even they work with Stripe to handle payments, and I think that's just a really notable fact that Stripe's ability to engineer these checkout experiences is so good that big companies like Ford, Zoom, Meta, even OpenAI, they work with Stripe to handle payments. Because just think about how many different possibilities you have to handle. If you're in a different country, you'll pay a different way, and if you're buying a certain kind of item, that might affect how you decide to pay. And Stripe is able to test these fine-grained optimizations across tens of billions of transactions a day to figure out what will convert people. And obviously, conversion means more revenue for you.And look, I'm not a big company like Meta or anything, but I've been using Stripe since long before they were advertisers. Stripe Atlas was just the easiest way for me to set up an LLC, and they have these payments and invoicing features that make it super convenient for me to get money from advertisers. And obviously, without that, it would have been much harder for me to earn money from the podcast. And so it's been great for me. Go to stripe.com to learn more. Thanks to them for sponsoring the episode. Now, back to Mark. I'm not sure about that. I- I'm actually curious about something else, which is, um, um, so a 19-year-old Mark, um, reads a bunch of like antiquity and classics, uh, high school, college. What important lesson did you learn from it? Not just interesting things you found, but like, there aren't that many tokens you consume by the time you're 19. A bunch of them were about the classics. Clearly, that was important in some way.

   16. MZMark Zuckerberg1:01:57

       Not that many tokens you consume. (laughs) Um, I don't know. That's a good question. I mean, one of the things that I thought was really fascinating is, um... So when Augustus was first... so he, he became emperor, and, um, and he was trying to establish peace, and the- there was no real conception of peace at the time. Like, the people's- people's understanding of peace was, it is the temporary time between when your enemies will inevitably attack you again, so you get like a short rest. And, and he had this view, which is like, "Look, like, we want to change the economy from instead of being so mercenary and like, and kind of militaristic, to like actually this positive sum thing." It's like a very novel idea at the time. Um... I don't know. I think that- that there's like something that's just really fundamental about that. It's like in terms of the, the bounds on like what people can conceive at the time of like what are rational ways to work. And, um... I don't know. Going back to like... and this applies to both the metaverse and the AI stuff, but like, a lot of investors and just different people just can't wrap their head around why we would open source this. And it's like, are y- like, like... I don't understand. It's like open source? That must just be like the temporary time between which you're making things proprietary, right?

   17. DPDwarkesh Patel1:03:35

       (laughs)

   18. MZMark Zuckerberg1:03:35

       And it's, um... But, but I actually think it's like this very profound thing in tech that has actually... it- it creates a lot of winners, right? And it's... and, and, um, so... I don't know. I don't want to strain the analogy too much, but- but I do think that there's, um... there's a lot of times I think ways where you can... that are just like models for building things that people can't even... like they just like often can't wrap their head around how that would be a valuable thing for people to go do, or like a reasonable state of the world that it's... I m- I mean, it's, uh... I think that there's more reasonable things than people think.

   19. DPDwarkesh Patel1:04:20

       That's super fascinating. Um, can I give you my answer, what I was thinking-

   20. MZMark Zuckerberg1:04:24

       Sure.

   21. DPDwarkesh Patel1:04:24

       ... what you might have gotten from it? Um, I to- this is probably totally off, but, um, just how young some of these people are who have very important roles in the empire. Like Caesar Augustus, like by the time he's 19, he's actually incredibly- one of the most prominent people in Roman politics, and he's like leading battles and forming the Second Triumvirate. I wonder if you're like, the 19-year-old is like, "I can actually do this because like Caesar Augustus did this."

   22. MZMark Zuckerberg1:04:45

       I- I think that that's... I think that's an interesting example both from a lot of history and American history too.

   23. DPDwarkesh Patel1:04:50

       Yeah.

   24. MZMark Zuckerberg1:04:50

       I mean, it's, um... I mean, one of my favorite quotes i- it's this Picasso quote that, "All children are artists, and the challenge is how do you remain an artist when you grow up?" And it's like basically I think 'cause when you're younger, I think you- it's just easier to have kind of wild ideas and you're not... you know, you have no... there are all these analogies to the innovator's dilemma that exist in your life as well as your company or whatever you've built, right? So, you know, you're kind of earlier on in your trajectory. It's easier to pivot and- and take in new ideas without it disrupting other commitments that you've made to- to different things. And, um... so I don't know. I think that that's an interesting part of- of running a company is like how do you... how do

7. 1:05:36 – 1:16:02

   Open sourcing the $10b model & custom silicon

   1. MZMark Zuckerberg1:05:36

      you kind of stay dynamic?

   2. DPDwarkesh Patel1:05:37

      Hmm. Um, going back to the investors in open source, uh, the $10 billion model. Suppose it's- it's totally safe, you've done these evaluations, and um, unlike in this case, the evaluators can also fine-tune the model, um, which hopefully will be the case in future models. Uh, ah, would you open source that, the $10 billion model?

   3. MZMark Zuckerberg1:05:55

      Well, I mean, as long as it's helping us, then yeah.

   4. DPDwarkesh Patel1:05:57

      But w- would it? Like the $10 billion of R&D and then now it's like open source for anybody.

   5. MZMark Zuckerberg1:06:00

      Well- well, I think h- here's I think a question which w- we'll- we'll have to evaluate this as- as time goes on too, but, um... we have a long history of open sourcing software, right? We don't tend to open source our product, right? So it's not like we ta- we don't take like the code for Instagram and make it open source, but we take like a lot of the low-level infrastructure and we make that open source, right? The- the probably the biggest one in our history was Open Compute Project where we took the designs for kind of all of our, um, our servers and network switches and data centers and made it open source and ended up being super helpful because, you know, I mean, a lot of people can design servers but now like the industry standardized on our design, which meant that the supply chains basically all got built out around our design and the volumes went up so it got cheaper for everyone and saved us billions of dollars. So, awesome, right? Okay, so there's multiple ways where open source I think could be helpful for us. One is if people figure out how to run the models more cheaply. Well, if we're gonna be spending tens or like a hundred billion dollars or more over time, um, on all this stuff, so if we can do that 10% more effectively we're saving billions or tens of billions of dollars. Okay, that's probably worth a lot by itself. Um-... especially if there's other competitive models out there. It's not like our thing is- is, like, be giving away some kind of crazy advantage. Um...

   6. DPDwarkesh Patel1:07:22

      So, is it w- your view that l- the training will be commodified?

   7. MZMark Zuckerberg1:07:28

      (sighs) Um, I think there's a bunch of ways that this could play out. That's one. The, um, the other is, is that, so commodity kind of implies that it's gonna get very cheap because, um, 'cause there's lots of options. The other direction that this could go in is qualitative improvements. So, um, so you mentioned fine-tuning, right? It's like right now, it's, it's, um, you know, it's pretty limited what you can do with fine-tuning major other models out there and there are some options, but generally not for the biggest models. Um, so I think being able to do that and- and be able to kind of do different app-specific things or use case-specific things or build them into specific tool chains, um, I think will not only enable kind of more efficient development. It could enable qualitatively different things. Um, here's one analogy on this is, um... So, one thing that I think generally sucks about the mobile ecosystem is that, like, you have these two gatekeeper companies, Apple and Google, that can tell you what you're allowed to build. And there are lots of times in our history... So there's the economic version of that, which is like, "All right, we built something," and they're just like, "I'm gonna take a bunch of your money." But then there's the, there's the, um, the qualitative version, which is actually what kind of upsets me more, which is there's a bunch of times when we've launched or wanted to launch features and then Apple's just like, "Nope, you're not launching that." I'm just like, "That sucks."

   8. DPDwarkesh Patel1:08:55

      (laughs)

   9. MZMark Zuckerberg1:08:55

      Right? And, um, so the question is, what is it, like, are we kind of set up for a world like that with AI where, like, you're gonna get a handful of companies that run these closed models that are gonna be in control of the APIs and therefore are gonna be able to tell you what you can build? Um, well, for one, I can say for- for us, it is worth it to go build a model ourselves to make sure that we're not in that position.

   10. DPDwarkesh Patel1:09:20

       Mm-hmm.

   11. MZMark Zuckerberg1:09:20

       Right? Like, I don't want any of those other companies telling us what we can build. Um, but from an open source perspective, I think a lot of developers don't want those companies telling them what they can build either. Um, so the question is, what is the ecosystem that gets built out around that? What are interesting new things? How much does that improve our products? Um, I think there's a lot of cases where if this ends up being, like, you know, like our databases or caching systems or architecture, we'll get valuable contributions from the community that will make our stuff better, and then our app-specific work that we do will still be so differentiated that it won't really matter, right? It's like we'll- we'll be able to do what we do, we'll benefit all the systems, ours and the community's will be better because it's open source. There is one world where, um, maybe it's not that. I mean, maybe the model just ends up being more of the product itself. In that case, then I think it's, um, it's a trickier economic calculation around whether you open source that because then you- you are kind of commoditizing yourself a lot. But I don't, uh... From what I can see so far, it doesn't seem like we're in that zone.

   12. DPDwarkesh Patel1:10:26

       Um, would you expect to earn significant revenue from licensing your model to the cloud providers so they have to pay you a fee to actually serve the model?

   13. MZMark Zuckerberg1:10:33

       Um, we- we wanna have an arrangement like that, but I don't know how significant it'll be. And we have this, um, this is basically our license for- for LLaMA.

   14. DPDwarkesh Patel1:10:44

       Yeah.

   15. MZMark Zuckerberg1:10:45

       Um, you know, in- in a lot of ways, it's- it's like a very permissive open source license, except that we have a limit for the largest companies using it. And this is why we put that limit in, is w- we're not trying to prevent them from using it. Uh, we just want them to come talk to us because if they're gonna just basically take what we built and resell it and make money off of it, then it's like, okay, well, if- if you're like, you know, Microsoft Azure or Amazon, then yeah, if you're gonna be re- reselling the model, then we should have some revenue share on that so just come talk to us before you go do that. And that's how that's played out. So for LLaMA 2 it's, um, I mean, we basically just have deals with all these major cloud companies and LLaMA 2 is available as a hosted service on all those clouds, and, um, I assume that as we, as we release bigger and bigger models, that'll become a bigger thing. It's not the main thing that we're doing, but I- I just think it further assert. If those companies are gonna be selling our models, it makes sense that we should, you know-

   16. DPDwarkesh Patel1:11:38

       Yeah.

   17. MZMark Zuckerberg1:11:38

       ... share the upside of that somehow.

   18. DPDwarkesh Patel1:11:39

       Yeah. Um, with- with the rest of the other open source dangers, I- I think you have a- a, like, genuine legitimate points about the balance of power stuff, um, and potentially, like, the harms you can get rid of because we have better alignment techniques or something. Um, I wish there were some sort of framework that Meta had, like other labs have this where they say like, "If we see this as a concrete thing, then the- the- that's a no go on the open source or, like, w- even potentially on deployment." Um, just like writing it down so, like, uh, the company is ready for it.

   19. MZMark Zuckerberg1:12:06

       Yeah.

   20. DPDwarkesh Patel1:12:06

       Uh, people have expectations around it and so forth.

   21. MZMark Zuckerberg1:12:09

       Yeah. No, I think that that's a fair point on the existential risk side.

   22. DPDwarkesh Patel1:12:12

       Yeah.

   23. MZMark Zuckerberg1:12:12

       Right now, we focus more on the types of risks that we see today, which are more of these content risks. So, you know, we have lines on we don't want the model to be basically doing things that are helping people commit violence or fraud or, you know, just harming people in different ways. So, um, in practice for today's models, and I would guess the next generation and maybe even the generation after that, I- I think while it is somewhat more maybe intellectually interesting to talk about the inte- the existential risks, I- I actually think the- the real harms that need more energy being mitigated are things that are going to, like, to h- have someone take a model and do something to hurt a person with today's parameters of- of- of... and kind of the types of kind of more mundane harms that we see today, like people kind of committing fraud against each other or things like that. So, um, that, I- I just don't want to shortchange that. I think we- we have a responsibility to make sure we do a good job on that.

   24. DPDwarkesh Patel1:13:17

       Yeah. Meta's a big company, it can handle both.

   25. MZMark Zuckerberg1:13:18

       Yeah.

   26. DPDwarkesh Patel1:13:19

       Um, uh, o- okay, so a- a- as far as the open source goes, I'm actually curious if you think the impact of the open source from Pytorch, React, Open Compute, these things, has been bigger for the world than even the social media aspects of Meta. 'Cause I've, like, talked to people who use these services who think, like, it's plausible. 'Cause a- a big part of the internet runs on these things.

   27. MZMark Zuckerberg1:13:37

       Um, ah, it's an- it's an interesting question. I mean, I think a- almost half the world uses our-

   28. DPDwarkesh Patel1:13:43

       Yeah. That's the trick point. (laughs)

Episode duration: 1:18:37