Skip to content
No PriorsNo Priors

No Priors Ep. 114 | With Duolingo CEO Luis von Ahn

On this episode of No Priors, Sarah talks to Luis von Ahn, founder and CEO of Duolingo, the world’s most popular education app with over 116 million monthly users and a market cap of approximately $17 billion. Controversially, it has recently committed to being “AI-first.” They discuss why motivation is the biggest challenge in education, how Duolingo harnesses game mechanics and behavioral insights to keep learners engaged, and the company’s efforts to leverage AI to personalize education at scale. Luis also shares thoughts on the Duolingo brand, courses beyond language (chess and math), and the broader impact of AI on content creation. Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @LuisvonAhn Links: Duolingo is now AI-First: http://bit.ly/3RQzny3 Show Notes: 0:00 Introduction 4:01 Optimizing learning behavior through tech 11:20 Adopting AI at Duolingo 17:25 AI’s threat to content companies 18:34 An unhinged corporate brand 21:28 How do people learn? 25:16 What people misunderstand about Duolingo? 26:24 How AI is transforming learning at scale 30:28 Leveraging AI across the business

Sarah GuohostLuis von Ahnguest
May 8, 202532mWatch on YouTube ↗

EVERY SPOKEN WORD

  1. 0:004:01

    Introduction

    1. SG

      (techno music) Hi, listeners, and welcome back to No Priors. Today, we're joined by Luis von Ahn. Luis earned his PhD in computer science from Carnegie Mellon and went on to found reCAPTCHA, which was acquired by Google in 2009. He's now the co-founder and CEO of Duolingo, the world's most popular education app, with over 116 million monthly users, a market cap of $17 billion, and an owl mascot that faked its own death. We're going to talk about AI for education, why motivation is the hardest problem in learning, taking risks with your company brand, why vibe cartooning is important, and the 16,000 A/B tests that got us here. Luis, thank you so much for doing this.

    2. LA

      Thank you for having me.

    3. SG

      Lots of people know what Duolingo is, but I would love to hear you describe it in, in terms of, you know, beyond the, uh, language learning app it is today, what you want it to become.

    4. LA

      Well, it's, it's a language learning app. It's the most popular way to learn languages in the world. As of the last couple of years, we also teach math and music. And as of, uh, very soon, we will also teach chess. The idea is, uh, you know, we're trying to be, uh, an app where you can go there and learn the things that a lot of people want to learn, but that also take a long time to learn.

    5. SG

      You were a professor when you started Duolingo in 2011.

    6. LA

      Mm-hmm.

    7. SG

      I hope it is not offensive to say that, like, lots of professors start companies. Few of them start, like, gamified consumer companies. Um, how did this happen?

    8. LA

      It's not like I expected to start a gamified company. The way we got started is, um, I was a professor. Uh, I had a PhD student named Severin, who, um, is now the CTO and was a co-founder, but... Um, we were looking for a PhD thesis topic for him, and what we agreed on is we were gonna work on something related to education where computers would teach you something. After a while, we agreed that good s- topic to teach was languages, in particular because of learning English. In, in most countries in the world, uh, knowledge of English, I- i- increases your income potential.

    9. SG

      Mm-hmm.

    10. LA

      And there's like two billion people in the world learning English, so we thought, "Okay, let's teach languages, and let's teach them with a computer." Um, and then we started working on it, and we ran into this problem. So I made the first Spanish course because I'm a native Spanish speaker, and Severin is a native German speaker, and he made the first German course. And we agreed that we were gonna learn each other's language. The problem that we ran into is that we couldn't get ourselves to do it because it was so boring.

    11. SG

      Oh, no.

    12. LA

      I'm like, "Oh my God," I did not want to learn German. He did not want to learn Spanish. We were very worried because we were like, "Okay, well, if we ourselves can't get it, you know, we can't get ourselves to do it, then we can't expect anybody else to do it." The solution was to, um, turn it into a game as much as possible. And so by the time we launched, it was pretty fun. Um, but it's, it's mainly because we wanted, we were trying to, uh, get ourselves to do it. And, and part of the reason that that was the case is neither of us likes learning languages. We actually are not language lovers. We don't like learning languages. And I think because of that, we made a product that works for the average person as opposed to for people who are obsessed with learning languages.

    13. SG

      So much there I would like to unpack, but I want to go back to just initial confusion. What makes this like a good PhD topic? Like, what, what was the computer science problem you were interested in?

    14. LA

      Uh, the computer science problem was basically trying to teach things, uh, to people.

    15. SG

      Is that a computer science problem?

    16. LA

      Well, th- you know, how to get computers to do it. There's a lot there, you know, how to do adaptive, you know, how to use the data to adapt to the, to the student. Uh, there's also motivation problems and, and, uh, you know, like human-computer interaction. So there's, there was a lot there that we could have used. And by the way, also at the time, this was, you know... AI at the time was just starting to get to the point where we could have thought th- you know, thought about training models to... And this is not large language models, this is just training classifiers to kind of teach better or something like that. So there's a lot there that could've been a, a, a PhD thesis

  2. 4:0111:20

    Optimizing learning behavior through tech

    1. LA

      topic.

    2. SG

      You've decided that you need to make it easier for normal humans d- who do not have v- uh, infinite motivation to learn languages from computers. What was the first thing that you did that worked, that, like, helped people get over the motivation hurdle of it being so boring?

    3. LA

      The first thing that we did that worked was making lessons not 30 minutes long but two minutes long. It makes a big difference. And it's not because people were spending less time. It's that two minutes is, is amazing because, uh, at any point in time, you just think to yourself, "Oh, it's just two minutes." But, the time investment for 30 minutes, you know, if you're right now and you're like... If I ask you, "Do you wanna do something that takes 30 minutes?" You're like, "Oh man, I don't know about that." Even though, uh, when the, you think the time investment is only gonna be two minutes, you may spend the 30 minutes, but it's just, it's just like, "Yeah, I can start right now because I can end any time." Uh, so that's the first thing that worked. Uh, we did many other things that worked big, but that was the first thing that, that really was a big, big game changer.

    4. SG

      Is there anything that really surprised you from a behavior perspective that worked?

    5. LA

      A few things. I did not expect streaks to be this powerful. I mean, a streak is extremely powerful.

    6. SG

      Can you explain what that is?

    7. LA

      It's just a counter that measures the number of days you've done something in a row. Um, in, for Duolingo, the Duolingo streak is the number of days that you've, um, used Duolingo in a row to learn a language. It's incredibly powerful. People really talk about their streaks. We have 10 million, uh, active users that have a streak longer than 365, so that means they haven't missed a day in the last year or longer. So I did not expect streaks to be this powerful. The other one that I did not expect is... We have these notifications to get you to come back to the product. I did not expect the passive-aggressive ones to work so well.

    8. SG

      (laughs)

    9. LA

      This is how it went. We, we were sending you notifications that just said something like, "Hey, come back to learn Spanish." Um, if you did not come back the first day, we would send you a notification. If you did not come back the second day, we would send you a notification. But after five days of inactivity, we stopped. At some point, it occurred to me that...Um, if we're stopping to send you a notification, we should probably let you know. So we started sending it... this notification the fifth day that said-

    10. SG

      Mm-hmm.

    11. LA

      ... "These reminders don't seem to be working. We're going to stop sending them for now." Um, it turns out this is very powerful at getting people to come back, because they feel like we've given up on them. I did not expect that. The... I mean, we didn't even do that with, with the goal of getting people to come back. But it turns out, that's actually very powerful.

    12. SG

      I have not studied education, and so this doesn't come from a place of knowledge. But, uh, this idea of, like, making it easy and, like, making the, you know, barrier to entry lower, I, I feel like there's some controversy around it. It raises questions like, okay, learning is hard, and l- and like, there is no way around it. Like, a smart friend of mine compared learning to like going to the gym, but for your mind. Like, it's very simple. You just have to do it, and there's no other way besides, like, being willing to put the effort and think really hard about it. How do you react to that point of view?

    13. LA

      I would be very, very happy if everybody who is working on an education app thought that way, because then we will have no competitors. It just turns out that the hardest thing about learning is motivation. By the way, I believe that to be true of the gym too, you know?

    14. SG

      Mm-hmm.

    15. LA

      So like a lot of people talk about like, I mean, you can d-... you can spend all your time debating whether an elliptical machine is better than a treadmill. But in the end, what matters is that you do it. Uh, that, that's like 90% of what matters. Uh, it's the same with learning something. You know, you can spend all your time debating whether you should read that book or that... or this book, or whether you should do it through an app or you should do it with tu- a tutor. There- there's, of course, differences in how, uh, effective each of these are. But what matters the most is that you actually do it, and if you want to get people to actually do it, you have to make it as easy as possible to get started, to get in there, and to be motivated. I believe that is the reason why we, uh, have grown so much. I mean... and, and in fact, it's funny. I mean, we see a lot of, um, language learning apps that pop up that say, "Oh, we're like Duolingo but without the gamification," and every time I see that, I'm like, "Great."

    16. SG

      (laughs)

    17. LA

      You do that. (laughs) Carry on. 99% of the world's population just is not that motivated for any activity, and, um, you know, there's the few people that are extremely motivated. Good for them. The vast majority of people are just not.

    18. SG

      If you are an engineer or, you know, in many other types of knowledge work, the idea of flow is almost holy, right? Like, you need to be, like, in the context and understand the code base and, like, be really thinking about it for a while, or you won't make any progress, much less, like, learn something new. Do you think about that at all? W- because if people are like, "I'm on the subway, I'm going to Duolingo for two minutes," like how does that factor into the experience?

    19. LA

      We don't really think about that too much. I mean, I understand the concept and it makes sense, but, uh, I mean, for us, the single most important thing is to get people time on the app. You know, we know-

    20. SG

      Mm-hmm.

    21. LA

      ... turns out, for an English speaker, getting to a pretty good spot in Spanish takes about 500 hours.

    22. SG

      Oh, wow. Okay.

    23. LA

      We just got to clock those 500 hours. We just got to clock those. Like, that's it. And, you know, is it 600 hours because you're not as, uh, you know, in flow? Or is it 400 hours because you're like really in flow? Sure, there's probably a variance there. But in the end, we have to clock something like 500 hours for you to get to a good spot in Spanish. And by the way, that same number for Chinese is 2,000 hours.

    24. SG

      Yes. Um, as somebody with a, you know, master's degree in Chinese lit, it's not a language meant to be learned. (laughs)

    25. LA

      It really doesn't seem to be.

    26. SG

      I find your perspective on the human behavior around education both like a little bit dark, like not particularly idealistic, and yet incredibly inspiring to me as a sort of end user, because I am working, I'm engaged in the work, I have three kids, I theoretically do some other things, and yet the thing I would like most be interested in doing with my free time is skill acquisition.

    27. LA

      Mm-hmm.

    28. SG

      Right? Like, be a better chess player, improve my Chinese as like, you know, fruitless as that seems to be, or, um, learn more math. Uh, uh, many different things, and yet, uh, if you ask me, "Are you going to carve out, you know, an hour and a half at the end of a day where you've been attempting to be productive for 16 hours and do more of that in a really painful way?" The answer is clearly no, right?

    29. LA

      Right.

    30. SG

      And yet if you ask me, "Could you imagine putting 600 hours into it two minutes at a time over the next few years?" Like, actually that seems doable.

  3. 11:2017:25

    Adopting AI at Duolingo

    1. LA

      really at the crux of what we do at Duolingo.

    2. SG

      Duolingo has a, a pretty unique position in that you were a company with some scale when the, uh, capabilities in machine learning started sort of accelerating in their progress and expanding. How did you handle that and sort of how did you react internally as a product organization?

    3. LA

      I mean, for us, it's been really positive. Um, the fact that, you know, they are language models, um, you know, and we teach languages, it's a really perfect application. Um, they have been really positive in two ways. To teach something, one of the things you have to do is create a lot of content. This is... the content that you're trying to teach. We used to make that content kind of half by hand, half automatically. Like it was kind of by hand, but there was all kinds of automation around it to, to make people... to make the, the people that were creating the content go faster.But still, this was going relatively slow. Over the last couple of years, what we did is we've retooled this whole content creation pipeline to be entirely based on large language models. I mean, it's all based on AI. So humans are not involved any longer, uh, or- or very little, if- if- if at all. And what that has allowed us to do is just create massive amounts of content that were just not possible before. So we're just... we're creating many more courses. So for example, that's one of the things that we're- that we're doing right now, um, and we're just launching it right now. We used to have... we teach 40 languages, but the way we teach languages is we teach... for example, we teach Spanish for English speakers, which is a different course than Spanish for German speakers, which is a different course than Spanish for Chinese speakers, et cetera. So we used to teach 40 languages, but for English speakers. So if you were a native, uh, German speaker, you could only learn, like, four of them. What we're able to do with AI now is because we can go so much faster, at this point, we basically teach the 40 languages to every base language, and we're- we're... that- that's- that's a major increase in the number of courses. Um, so that's- that's an example of something that we can do. The other example of something that we can do now, uh, that we couldn't do before is practicing conversation. You know, historically, we could teach you vocabulary, how to read, but this actual conversation, the only way we knew how to practice it was with another human, and we experiment with doing that. Um, but it turns out most people don't want to talk to another human in a language that they are not very comfortable with.

    4. SG

      Because it feels bad. (laughs)

    5. LA

      It feels bad. It's- it gives you shame. It gives you, you know, you're- you're... it- it's not good. But now, with large language models, you can actually practice conversation with an AI, and then you- you do so without feeling judged. Um, and so we're seeing a lot of uptake on that. Um, so it's- it's- it's been really good for us.

    6. SG

      What else are you excited about in terms of, like, AI changing the product itself, like Role Play and Explain My Answer and- and these things? Like, what do you think matters or work so far?

    7. LA

      You know, I'm excited about, uh, generally practicing a real-world language like conversation. I'm- I'm- I'm excited about that. Outside of language, I'm really excited about teaching math. We can do a much better job at teaching math with large language models, and we have a math course, um, but it is- it's... you know, we're completely retooling it, um, to be a lot more like a tutor. Now, you know, again, I'll go back to tutors. Tutors can be really good at kind of learning outcomes. They have this one big problem that they're really boring. So we're trying to find ways to make it a "tutor," but that is also gamified. Just turns out most people would rather play Candy Crush than sit there in front of a tutor. So we're trying to come up with something that is as effective as a tutor, but as fun as Candy Crush. The reality is we'll probably come up with something that is 90% as effective as a tutor and 90% as fun as Candy Crush, but at least the combo of this will be a lot more effective.

    8. SG

      So math, music, uh, chess.

    9. LA

      Chess now.

    10. SG

      Chess now, yes. How do you decide what Duolingo can teach beyond languages?

    11. LA

      What we're looking at for subjects to teach are, one, we're looking at very large audience. So we need something that hundreds of millions of people want to learn. There's a reason for that, and it's because we're an app at the end of the day, and y- we cannot charge $30,000 to each user. We charge you 10 bucks. In order to make a significant amount of money from a- a- a new subject, it has to be learned by a lot of people. Uh, otherwise, these very niche subjects just... you know, if we charge you 10 bucks and there's only 100 people learning it, this is just not worth our time. Um, so they have to be... they have to be a large potential audience. Uh, the other thing is we look for things that take a long time to learn. Uh, you know, if you can learn something in two hours, you probably should just go watch a YouTube video.

    12. SG

      Mm-hmm.

    13. LA

      And that does a perfectly good job if it's just like two hours. We look for things that really take hundreds of hours to learn. Um, and then things that we think are- are good for the world and- and we can do a good job with a mobile app. Oh, there's one extra thing, which is internally we need to have somebody that's really excited about it. Um, so this has been true for all of these other subjects. You know, there's somebody that's very excited about music, somebody that's very excited about chess, and that- that's what has done it.

    14. SG

      Okay, even beyond, like, what makes sense for Duolingo as a business, from a technology perspective, do you think there are things that are, like, hard to teach with computers for now?

    15. LA

      I don't know if there are. There's things that are different, that's certainly different from what we do at Duolingo. So for example, history. The way you teach history is not with these drills. You know, the- Duolingo is really good at drills. The way you teach history is probably with really well-produced videos. It's probably the best way to do it. And maybe AI can get better at that, but... uh, so I think there are just things that are different than Duolingo, but ultimately, I'm not sure that there's anything that computers can't really teach you. I think overall we'll- we'll be able to teach everything really well with computers.

    16. SG

      Do you think there's any version of the world where AI is a threat, like large language models

  4. 17:2518:34

    AI’s threat to content companies

    1. SG

      are a threat to Duolingo?

    2. LA

      I mean, sure, they're a threat to... uh, I mean, but, you know, that's one of the things that is scary about the world that we live in with- with AI and large language models, eh, eh, we're undergoing a platform shift, I mean, of- of some sort. Um, I don't know what's going to happen on the other side. I'm not super worried, but you just never know, and it's not just for Duolingo. This could be all kinds of things, right? I mean, it could be a threat for Netflix. Like, it could be that just a large language model just press a button and it makes you the perfect movie. And then, uh... so, eh, you know, I don't know if that will happen or not, right? I- I just don't know. So it's- it's kind of a similar thing. Like, who knows what will happen? Um, at the moment, it doesn't look like it's- it's a major threat, but, um...I, I, your guess is as good as mine, I think.

    3. SG

      I mean, you guys have a huge amount of distribution and a huge amount of data, and the interest and engineering culture to go after it, so...

    4. LA

      The way we see it is we have large distribution. We have data on how people are learning languages that is unique. I mean, we have the, you know, a, a lot of people. Uh, it's also the case that brand ends up mattering quite a bit, um, and we do have a good brand for language learning. Uh, so the combination of all of this, we're hoping, will be good for us.

  5. 18:3421:28

    An unhinged corporate brand

    1. LA

    2. SG

      Can we talk about brand for a minute? 'Cause it, it is, um ... Duolingo has a very unique one. There is perhaps more risk and more distinctiveness in brand voice, uh, than the vast majority of public companies might take. You are, of course, a consumer company, but there are plenty of companies who, um, don't, don't take those risks. Like, where does that come from for you guys? Why did the owl die? (laughs)

    3. LA

      He didn't die. He just faked his death.

    4. SG

      Okay, that's even weirder.

    5. LA

      (laughs) Uh, uh, i- this ... It's not like we, on day one, decided, you know, we're gonna have a brand that is unhinged, that, where the owl does weird stuff. It just kind of evolved over time. Our brand voice evolved over time. What happened was, in the product, the owl was a little pushy to get you to do your lessons, and then the internet, uh, just started coming up with memes about the owl doing crazy stuff, like, you know, um ... They started coming up, like, you know, with, uh, the owl's willing to kidnap your family for you to do, uh, your lesson. That all was invented by the internet, not by us, um, but as we saw that that was happening, we started leaning into it. We thought, "Why not?" And, um, the more we leaned into it, the better it worked, um, and so we just found something that resonated. You know, that got us going. Then, a few years ago, um, we had a very junior marketing employee that we had just hired who said, "Hey, uh, we have this old owl suit here that we had used for, like, events inside the company," and just said, "Hey, can I make some TikToks out of it?" Um, and I actually was against it. I'm like, "Mm, I don't, I don't know if anybody's gonna be interested in this." Um, and it turned out that when we put it on TikTok and the owl was ... it really was just the owl doing really dumb stuff, um, like, you know, twerking and falling down or whatever. Um, i- uh, a lot of these videos started going viral, and it was interesting because none of the videos said, you know, "Learn a language on Duolingo" or, uh, "Subscribe to Duolingo" or anything. It really was just the owl doing weird stuff. It just, you know, it took a life of its own. We've formalized a lot of it, and we have a pretty good idea of the types of risks we're willing to take, but we do take more risks than most companies, certainly than most public companies. Um, one other thing that I think helps us ... So, it helps us that we have a mascot, but I think it also helps us that we're an education company, because, you know, ultimately, education, you can't really say that education's bad. It's hard to argue against education.

    6. SG

      (laughs)

    7. LA

      So, that allows us to, that allows our marketing to do things where we can't be criticized that much. If we were, if we were a company that was trying to, like, just really extract your money or, like, you know, we were, like, a, a vaping company or something, probably people would, would, um, you know, push back more on our marketing. But given that we're an education company, I think it, it gives us a little more leeway.

    8. SG

      Given this, like, unique scale of Duolingo, I think it's, uh, more than 100 million people monthly, is that right?

    9. LA

      Yeah, yeah.

  6. 21:2825:16

    How do people learn?

    1. SG

      What do you know about how people learn that other, other humans don't that you think is interesting?

    2. LA

      A lot of it is just codified on what the algorithms have adapted to. I mean, we have adaptive algorithms that try to figure out how to teach, and I think it, it's hard to verbalize a lot of it. I mean, we know a few things that are, that are, th- that you can verbalize, um, that, you know, may not be that surprising, but the farther your language is from your native language, the harder it is to learn. We have a model that can predict whether you're gonna get an exercise right or wrong, and we're actually extremely accurate. So, when we give you an exercise, we know if you're gonna get it right or wrong. We're very accurate, um, and the way, the way we do that is we just watch everything you're doing and we see what you're good at and what you're bad at.

    3. SG

      Mm-hmm.

    4. LA

      And, for example, we know, we know for each user, this particular user is bad at the past tense. Um, one of the things you may think at first, that the right thing to do, is because this user's bad at the past tense, we should give them more past tense. And that's roughly true, but it's not exactly true, because if all we did was give you lessons that, of things that you're bad at-

    5. SG

      I'd leave.

    6. LA

      ... these would be very, very, very horrible lessons for you. (laughs) So, there's a whole, uh, you know, I was gonna say art, but it's actually more of a science. There's a more of a science about when to give you the things that you're bad at, and, and for example, um, whenever we give you an exercise, the right thing to do is to give you an exercise that you're about 83% chance of getting it correct. Uh, turns out that maximizes enjoyment.

    7. SG

      And maximum enjoyment means I'm gonna get to my 5 or 600 hours, and that's really the outcome.

    8. LA

      Exactly, and, uh, it just keeps you, it keeps you motivated. Um, and, and it's funny. It's not, it's not 100%, because 100% is too easy, it's just a ... But it's also not 50%. It really is closer to 100%. You gotta m- mostly win, um, and that, that seems to be, um, what works.

    9. SG

      What do you think are some of the implications of what you guys are doing or learning for, uh, traditional education and schooling?

    10. LA

      First of all, I do think that education is going to change over the next some number of years. I can't say one year, but it's, it's probably less than 20 years, something's g- gonna change, and, and the reason for that is, um, it's just a lot more scalable to teach with, with AI than with teachers. And by the way, that doesn't mean the teachers are gonna go away. You still need people to take care of the students, and you still need ... I also don't think schools are gonna go away, because you still need childcare.

    11. SG

      In your view, like, schools could be childcare, but everybody's Duolinguing.

    12. LA

      I think it's gonna be something like that. It may not be Duolingo, but I think it's gonna be something where there's one teacher and, like, 30 students. Each teacher cannot give individualized attention to each student, but the computer can.

    13. SG

      Mm-hmm.

    14. LA

      And really, the computer can actually know with, with very ...... precise, uh, uh, knowledge. You can have very precise knowledge about what you... You... This one student is good at and bad at that the teacher just has no chance of having because there's 30 students, and they just cannot give you that. So, I do think that it, it would be more effective if some of that time is being spent with essentially an AI teaching you. Um, I do think it's gonna get to that. It's also the case that, you know, there are extremely good teachers, there- for sure, but there's not very many of them. And certainly, most everybody in the world doesn't have access to a good one. So, I think that there's gonna be some, some change like that. It... I do think it's gonna take a while because, you know, changes in education are very slow. Um, but I, I do think it's gonna be like that. I think a lot of what we're doing will apply, uh, in terms of keeping people motivated, et cetera. Uh, I do think that in a formal education setting, some things do need to be different. You have a little more control over the students actually doing the stuff when they're in school, uh, so you can probably make them kind of... Instead of, uh, expecting that they're only gonna do two minutes, you can probably expect that they're gonna do 20. Uh, so, so there's some differences i- in, in the school setting, but I think a lot of what we're learning

  7. 25:1626:24

    What people misunderstand about Duolingo?

    1. LA

      here will apply.

    2. SG

      Is there anything, um, you feel like people misunderstand about Duolingo?

    3. LA

      When we became a publicly traded company, investors thought we were a COVID phenomenon. Um, turns out we were not. The biggest misunderstandings are how important motivation is. I really don't think people understand the... Uh, I mean, even our competitors, even, even... Not just competitors for language learning, like, people who do education companies. It is amazing to me that really most everybody that we talk to does not seem to understand how important, um, motivation is. I think that's one thing. I think another one is just how much sophistication there is. Uh, a consumer may not know because the app is so cutesy and, like, you know, little animations and everything. There's a lot of sophistication about when to give you even the animation.

    4. SG

      Mm-hmm.

    5. LA

      Uh, so there's a lot of sophistication about that, and I don't think people understand just how many... You know, there are... Duolingo is the result... I checked the other day. Um, we have run... Over the history of the company, we have run 16,000 A/B tests. And I don't think people understand that it has taken 16,000 A/B tests to get to this point. Um, yeah, I think that's probably the b- the biggest misunderstandings.

  8. 26:2430:28

    How AI is transforming learning at scale

    1. LA

    2. SG

      Any predictions about what the large-scale changes in learning, uh, mean for society or, uh, or even how you might, uh, encourage people to think about learning for themselves or their children?

    3. LA

      The good news... I don't know if good or bad news. Maybe... Probably bad news for Duolingo, but good news is this change is gonna be slow.

    4. SG

      Hmm.

    5. LA

      I don't think you're gonna see a change where, like, next year everybody's learning completely different. So, I think we'll have some time to adapt.

    6. SG

      What's the drag force? I feel like that's actually a controversial point of view that it's gonna be slow.

    7. LA

      Oh. Go to a real school. They're doing stuff from, like, 30 years ago. They're... I mean... (laughs) The drag, the drag is just... You know, it's like governments. Uh, the... It's just slow. If you live in, you know, New York or Silicon Valley, you'll see that, you know, there are schools that are doing really progressive stuff, et cetera. But the vast majority of the education system, it's very slow to make changes like this. School systems are, um, regulated. The... You know, in Texas, they're trying to not teach evolution. Like, there's just weird stuff that goes on in school systems. So, I think, in general, it's gonna take some time to do this. Uh, you probably will see some private schools, um, move there faster. There's also an interesting thing about private schools. The very fancy private schools, you pay 50,000 bucks a year to go to a private school. It's hard for them to say, "Well, what our kids do is use Duolingo."

    8. SG

      (laughs)

    9. LA

      Because it's like, "Well, why am I paying you 50,000 bucks?" Um, so it's... So it's an interesting, uh, uh, you know, dynamics that's gonna happen. But I do think that some of the private schools are probably gonna be the first ones to start really kind of moving to- toward- uh, towards this. And I think you'll just see a lot better learning outcomes, um, in general. Um, the other place where, th- where you may start seeing is... There may be some countries that leapfrog, um, some countries that are at the moment probably a little behind. You know, for them, this is the only way in which they can scale, they can scale their education. So, you may see that.

    10. SG

      Yeah, I tend to think, um, very tactically also about impact on the, like, entrepreneurial ecosystem. And maybe it was all about finding the idea, but you studied math, and then you studied CS. You got a PhD, and you were a professor and had done some body of work before you became an entrepreneur, including starting another company, actually, a really interesting one, reCAPTCHA. But one of the things that is interesting to me, even, like, let's say 15 years into the technology ecosystem in my own career is, uh, people are becoming experts at much younger ages.

    11. LA

      Oh, yeah.

    12. SG

      I think obviously if you can set yourself on a learning journey... Like, first, it was just because of, you know, the internet, right? You can learn from just content and forums and finding community and whatever else.

    13. LA

      Right.

    14. SG

      Um, but when I think about some of the dropouts that we work with who are like, "Well, I wrote a textbook on wireless technology as a sophomore," I'm like, "Man, I, I waitressed at Outback Steakhouse when I was 16," right?

    15. LA

      Right. (laughs)

    16. SG

      One of the things that I, I think would be really exciting as, you know, we look forward five or 10 years is actually if people can get to skill acquisition and learning outcomes that are much cheaper, broadly accessible, and easier to motivate. Uh, you know, y- you, you will get experts that are, um, uh, doing really interesting things by the time they're 15, 20.

    17. LA

      Yes. And not only will th- that will be true, but I think they'll be experts, and they'll have the tool of AI.

    18. SG

      Mm-hmm.

    19. LA

      So, I think it'll be the case, at least in the foreseeable future, that it'll just magnify their expertise. So, they're, they're experts. And in addition to that, they can go a lot faster, or they're... So, yeah, I mean, compared to, you know (laughs) waitressing at i- Outback Steakhouse or, you know, whatever dumb thing it is that I was doing when I was... I mean, uh, I did not have access to... The first time I had access to the internet, I, I must've been, like...... 15 years old.

    20. SG

      Mm-hmm.

    21. LA

      I don't know what I was doing before that. I think I was playing with, like, LEGOs. Uh, I mean, that's, (laughs) that's basically what I was doing. So yeah, I think there's, uh, we're gonna see a lot of that.

    22. SG

      So it sounds

  9. 30:2832:14

    Leveraging AI across the business

    1. SG

      like course authoring is a place that, uh, Duolingo's gotten a lot of leverage. When you think about just using AI broadly as a tool within your company, b- be it building product or everything else you do, um, where else do you think it can have the most impact?

    2. LA

      The visual style of Duolingo, we're very ... I mean, un- unlike most ... Well, I mean, a lot of apps are, are kind of, you know, well-designed, that's for sure. But we're very animated, like a, we're like a cartoon. I mean, Duolingo's like a, a cartoon. Making that has required a lot of, um, y- human effort. Uh, it turns out we can do a lot of that with computers now. Uh, uh, it ... Now, that doesn't mean we're not gonna employ, um, the artists. The artists are still here, but they are going so much faster. What, what an artist could do before in like a month, now they can do in, like, a day. It's really unleashing their creativity, because they're not spending their time on the mechanics of, like, "Is this, is this shadow just right?" No, they're just, they're just unleashing their creativity. And I think that's, that's, that's pretty awesome. Um, so we're seeing a lot of that. Um, you know, a lot of our animations and a lot of illustrations are, um, now computer-generated.

    3. SG

      That's not what I expected you to say, but I, um, am really thrilled for the future of math and chess and 140-some new languages and vibe cartooning for Duolingo.

    4. LA

      (laughs)

    5. SG

      It'll be great.

    6. LA

      Yes.

    7. SG

      Thank you so much for doing this, Luis.

    8. LA

      Yeah, thank you. Thank you, Sarah.

    9. SG

      Find us on Twitter @nopriorspod. Subscribe to our YouTube channel if you wanna see our faces. Follow the show on Apple Podcasts, Spotify, or wherever you listen. That way, you get a new episode every week. And sign up for emails or find transcripts for every episode at no-priors.com.

Episode duration: 32:14

Install uListen for AI-powered chat & search across the full episode — Get Full Transcript

Transcript of episode st6uE-dlunY

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.

Add to Chrome