Skip to content

By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.

Lenny's PodcastLenny's Podcast

Why Google wants to win the frontier conversation | Tulsee Doshi (Head of Product for Gemini)

Tulsee Doshi is head of product for Google’s frontier AI models, including Gemini and other multimodal models, such as Nano Banana, Genie, Veo, and Lyria.

Tulsee DoshiguestLenny Rachitskyhost
Nov 8, 202658mWatch on YouTube ↗

Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.

Transcript

  1. 0:00 – 1:08

    Teaser

    1. TD

      The model isn't predictable. It's kind of like Snape's potions class. You can put all the ingredients in, but you also have to expect that there will be a little bit of magic, and that magic is going to be surprising.

    2. LR

      As you're hiring PMs these days, is there anything you look for more and more?

    3. TD

      We are looking for PMs who understand the vibes of our models or other models. I want PMs who have an opinion, who are playing with these models every day. You ideally wanna stress test the model on things that you are excited about.

    4. LR

      A lot of people feel that Google lags behind the top two labs right now.

    5. TD

      I actually think we do wanna win the frontier conversation.

    6. LR

      Yeah.

    7. TD

      I don't think we should say that Google is not participating in the frontier.

    8. LR

      You have this framework around how far ahead to build. You call it the 60-20-20 rule.

    9. TD

      Traditional startup wisdom, you're just like, "Build an MVP that works." But I think you wanna actually build features that aren't necessarily always working today.

    10. LR

      It feels like every AI assistant launching these days is taking all this juicy Google data, my Gmail, Google Calendar, my Docs. I'm curious just why Google hasn't launched something awesome yet.

    11. TD

      The team is working on some amazing things, but I think you are right that there is more work we need to do here on this front.

  2. 1:08 – 6:28

    What people misunderstand about how models are built

    1. LR

      [gentle music] Tulsee, thank you so much for being here, and welcome to the podcast.

    2. TD

      Thanks. I'm excited to be here.

    3. LR

      You are head of product for Google's frontier models, which includes Gemini, which people know, but there's also a bunch of other models that people may not be familiar with. Uh, share the other models that are under your umbrella.

    4. TD

      Yeah. So we have a set of models we kind of call our Gen Media models. These are our models that focus on video, uh, editing and generation, image editing and generation, if you've used Nano Banana, Lyria, our music model. Um, we also have Gemma, our suite of open models, and then one set of models that actually falls under our Gemini umbrella, but I feel like we don't talk about, uh, as much, is our audio models. Um, so dialogue, audio understanding, text-to-speech, uh, translation, all a part of the portfolio of how we build, uh, frontier models.

    5. LR

      Okay, so I wanna spend a little time on models. Everyone sees models launch. There's a, like, a model launch every week it feels like. You have a really unique lens in being able to see these models from research to pre-training, post-training, launch. What's something that you think people maybe misunderstand about how models are created, or something that may surprise people about how models are, are made?

    6. TD

      Yeah, it's a good question. I mean, maybe what I'll say, especially coming from a product management lens, is one thing that I think... You know, when you typically talk about product management for anything, including a model, you talk about, what are the goals you have for a model, right? What are the capabilities you wanna set? Uh, what are the outcomes you wanna drive? What goals do you wanna hit on a set of evals? And often when I talk to customers or even internal users, you know, they'll ask me, "Okay, what are the goals that you're setting?" And they'll sort of expect that we can really make sure that the model will deliver on those goals in a very traditional product sense. And I think for me, what has often been surprising but also exciting about model development and being a PM for the model is you should do that, and you should have an intentional view, but the model isn't predictable. Um, and so it's kind of like, uh, like Snape's potions class, right? So you can put all the ingredients in, and you should be thoughtful about what you expect, but you also have to expect that there will be a little bit of magic, um, and that that magic is going to be surprising, and that magic is going to be unique. And so your job as a PM is not just to try to shape what goes into the model, but it is also to look at what comes out the other side and really identify where does the model shine, where does it actually look unique in ways that surprise you, and then be able to take that and shape that into something that is amazing for users.

    7. LR

      It's so interesting that it's just, like, this code that we have written, that we feed data, and we need to... Like, we don't e- exactly know what's gonna happen and how it works. I recently had a, had a interpretability research, uh, person on the podcast from Anthropic, and we talked a lot about this, this idea that models are grown, not built. And just to kind of reflect back what you're saying, there's these goals that researchers have. "For this next model, we're gonna get better at writing. We're gonna get... try to be funnier. We're gonna try to, uh, become better engineers." Uh, and you're saying it's unpredictable exactly what ends up at the end. They put in these ideas. They change the data that it's trained on. Is there anything more there about just this kind of, like, unexpected, I don't know, process of, of training?

    8. TD

      You know, of course there's brilliant research that goes into these models, and so many aspects of it are predictable in the sense that we are consistently monitoring these runs. We have researchers who are tracking them, who are identifying when to intervene, who are seeing different metrics climb up as the run progresses. And so we are, you know, making it as much of a science as possible. Um, but I think for me, what is really amazing as a PM is you also need to really understand the vibes of the model on the other side of it, too. Uh, so yes, you can understand that a model has improved on a certain capability, but where does that capability really shine through? Um, how does that showcase then downstream in a product? How do you feel communicating with the model, uh, in terms of its behavior and persona? And there's a number of these aspects that we definitely build into training, but also as we understand the model and as we evaluate it and as we test it, we always learn more. We always learn something new, I think, about what the model can do.

    9. LR

      This episode is brought to you by this season's presenting sponsor, WorkOS. What do OpenAI, Anthropic, Cursor, Replit, Sierra, Clay, and hundreds of other winning companies have in common? They're all powered by WorkOS. If you're building for enterprises, you have felt the pain of integrating single sign-on, SCIM, RBAC, and audit logs. WorkOS turns those deal blockers into drop-in APIs built for B2B SaaS. And now there's a new kind of user that needs access to your app: agents. AI agents need to register, authenticate, and get permissions, just like a person. WorkOS handles it all. Agent auth to give agents scoped, revocable identities, agent registration with Auth MD, and Airlock to judge every agent action and allow, deny, or escalate to a human. I've noticed that every startup that I'm an investor in that expands upmarket ends up using WorkOS because they're the best. Go to workos.com to make

  3. 6:28 – 9:57

    Google’s strategy in the AI race

    1. LR

      your app enterprise-ready today. I want to talk a little bit about Google's place in the AI race. It feels like a lot of people feel that Google lags behind the top two labs right now, Anthropic and OpenAI, and Google has these moments of being the best, and then it kind of feels like it slows down a bit. I'm curious what you can share about just Google's strategy in the AI race and what maybe people don't understand on the inside of how you all think about this stuff.

    2. TD

      First of all, hopefully by the time this conversation goes out, you will be using Gemini 4, uh, Argon, uh, which is exciting. Um, and so I really do hope we're having a conversation about a frontier AI model, uh, that folks are excited to, to use. Um, and I think Gemini 4 speaks t- a little bit to our strategy, right? Um, because it really is our push, uh, to continue to build a frontier, a frontier lab, a frontier set of models, a frontier set of capabilities on, on our path. I think if you look at Google's strategy, it really is full stack, right? So one of the things that I think is powerful about Google is all the way from hardware to end products that serve billions of users. I think the stat is, like, we have 14 products that are above a billion users. I should check that number, but I, I think that's the stat. Uh, and so if you think about that, we actually go all the way from, you know, the hardware to then the modeling to then this, this kind of end user application, and our goal ultimately is to not just build amazing frontier experiences, which is definitely a part of the goal, um, but it is also to build models across this Pareto curve of cost to quality that can serve different users at different points in their lifestyle, whether that be a search user who is coming for information, right? Whether it is an engineer who is trying to build the next amazing thing, whether it is for a cyber defender who is trying to protect a critical piece of infrastructure. I think our goal is to make sure that we have models that serve that range of use cases and that we're actually building with feedback from these users.

    3. LR

      So what I'm hearing is there's so many vectors where Google can win. There's the most efficient kind of Pareto frontier for token cost. There's the smartest model. There's also just making your products better. For example, AI mode, uh, AI overviews. And so it's not that you need to be the best at the most advanced AI model that people can use, like chatbot, basically. You can win in all these other areas, but it sounds like you're also trying to win and have the most state-of-the-art model.

    4. TD

      I actually think we do want to win the frontier conversation, right? I think... I don't think we should say that Google is not, uh, participating in the frontier, and I think we are building, uh, better and better models, and I think Gemini 4 Argon definitely is at the frontier in, um, in the place that we are at. But I think one thing that is amazing is being able to build a breadth of experiences and build a diversity of experiences for users, and I think for Google, uh, our goal ultimately is to build amazing experiences that people... that actually make people's lives better, right? Um, and that is, I think, ultimately the goal, whatever part of the frontier you're building for.

    5. LR

      Google products definitely make my life better. It's just, like, amazing how much of your life is within a Google ecosystem. Like, not even the AI stuff, but just Google Calendar, Gmail, all these things. You're just like... Google Docs. Uh, so it's happening.

    6. TD

      There you go.

    7. LR

      [chuckles] There we go.

  4. 9:57 – 14:10

    AI safety, monitoring, and strengthening cyberdefenses

    1. LR

      Um, I want to talk about one other broad AI question, then I'm gonna dig into more product-specific stuff. A big topic of conversation these days is AI safety and this kind of fear that AI is gonna harm humans. It's gonna cause damage as it gets smarter and smarter. You have a really interesting lens on this because you led product for the responsible AI team at Google for six years. This is what you did right before-

    2. TD

      Yep

    3. LR

      ... this role. And so you've been thinking about this for a long time, a lot longer than l- most people. I'm curious just to get your take on this debate. Just, I don't know, are you optimistic we will figure this out? What do you think people maybe don't understand about this debate around AI safety?

    4. TD

      Our safety teams here are incredible, um, and it's been incredible to see the intentionality that they've been putting in all the way from, you know, initial trainings of the model to how we deploy them. Um, and I think safety is embedded in that process, right? And, and we need to be. I think the part that is important actually as we talk about how do you deploy models safely is actually thinking through what are the right sort of mitigations and structures around these models, right? So for example, one of the things that's really important is thinking about monitoring, right? And so for us, actually deploying monitors that can monitor the model's chain of thought, um, and actually identify whether the model is misaligned with its, you know, directed actions or whether it is aligned, um, and then being able to intervene appropriately. That's actually the kind of mitigation that, A, gives us more confidence in deploying these models, but also allows us to better understand where we might see misalignment and better actually improve the models over time. And so I think things like monitoring give me more confidence in how we're putting our models out. I think the other thing that we don't talk about enough when we talk about this debate is also the role that AI can play in hardening our systems, right? And so one of the things that we're doing with Gemini 4 is, like, actively partnering with a number of cyber defenders, including actually just even partnering with Wiz, that is now a Google company- To really think through how can we actually, uh, identify and patch vulnerabilities in systems across the globe, right? We actually have this interesting case study. Wiz has this Scan for Good program where, um, they're actually, like, actively working with systems across the world to identify, you know, potential issues. And they worked with a hospital system to identify a vulnerability and then patch it. And it's that kind of thing that I think if we can actually leverage these tools to do more of, we can actually make sure that our infrastructure and our systems are, are robust, right? Which is also, I think, really critical as this whole space grows.

    5. LR

      There was actually a conversation on All-In this last week about this whole d- issue that now that AI is getting really good at cyber, uh, people are gonna be investing a lot more in cyber defense and AI for protecting. And so there's gonna be a lot of money being spent on protecting their systems from this everly, ever smarter AI. So it, it's really cool that you guys are investing there. So I guess just coming back to the question of do you feel like we'll figure out this concern and this issue we feel, a lot of people feel that AI is gonna take over the world, uh, cause a lot of damage. Do you feel like this is a solvable problem? Are you optimistic, or are you... Is it something you think a lot about and are kind of worried about?

    6. TD

      Maybe the answer to your question is both, in the sense that I think we need to be consistently thinking about it, right? I think the way to optimism here, uh, for lack of a better way of putting it, like, the path to optimism is through thinking about it, um, and being, like, very careful and very thoughtful and very intentional on the path to get there. Um, and so that is, like, my source of optimism comes more from do I feel like we have people who are being intentional and thoughtful about what the safety story looks like. Uh, and I think that is the, the critical threat is, is you need a number of people to be worried and to be having conversations and to be actually interrogating how we're building our models and, and that's the step-by-step process we have to take.

    7. LR

      Awesome. And what's interesting is I don't think I've read a story of Google's models hacking into anyone, which I think shows that this is something you all have been thinking about for a long time. I don't know, like [chuckles] for better or worse. But it feels like it's working, whatever y'all are doing.

    8. TD

      We, we like stories about fixing vulnerabilities. That's-

    9. LR

      There we go

    10. TD

      ... that's a good place for us to be.

    11. LR

      Okay.

  5. 14:10 – 17:02

    Balancing fast launches with great user experiences

    1. LR

      So one of the interesting things that's happening kind of from a product perspective with AI is products are getting very complicated. For example, Google gets a lot of flack for it being hard to find all the magical things y'all do. Like, a lot of people don't know AI Studio even exists. A lot of people can't find Veo or Genie and all these things. Similarly, Codex, uh, ChatGPT recently launched Dots, and now you go to the interface of Codex, and it's like tabs and dropdowns and dots, and it's just, like, out of control. And Colab Code is the same thing. It's just getting very complicated. They had Cowork, and then they dropped Cowork. And, and interestingly, I'm in a, in this WhatsApp group with a bunch of PMs, and there's a PM from one of the labs-

    2. TD

      Well, I wanna be in this WhatsApp group. Sorry, continue.

    3. LR

      [chuckles] Okay. Let's, let's, let's talk. And he shared that there's this kind of urgency to get frontier power of AI out to users as fast as possible, partly to stay competitive, partly because they don't know exactly what it's used for yet. So let's get it to people, figure out what they're using it for, and then make the UX better. So there's this kind of intentional, let's just get it out there, figure it out later how to make it a, a great UX. Thoughts on this kind of balance of making the product really easy to use versus just getting things out as quickly as possible, and is that something you deal with?

    4. TD

      Two thoughts, maybe, maybe three. The first one I'll say is I do think we do need to be playing with new paradigms and new UX, uh, approaches, if you will, to how people will engage with models, right? So you mentioned, for example, Genie or, or Veo, which is, which we're now building Omni. Um, like, if you look at, for example, Flow. Flow is a product that we've been designing thinking about video editing and generation, music editing and generation. Um, and so I think we are trying to play with, like NotebookLM is a good example of a different form factor. I think our labs teams are actively thinking about, like, how do we try different form factors and different UX for, uh, different individuals to engage with these models? And so I do think we need to keep innovating and playing around with what UX looks like. I think at the same time, uh, your point is also right, which is, like, I think depending on who your user is, you want a different form factor too, right? So, like, I think for example, with AI mode, we're talking about billions of users coming to search, asking their questions. I think you do need to have a certain UX there that is accessible to every user, right? At the same time, on the other end of the spectrum, when you have something like Antigravity, you are trying to build for a power user, and you are trying to build for users who know how to use slash commands and can, like, uh, actively engage across, like, both the terminal and the IDE, and, like, you, you wanna be able to, like, support kind of a wide range of what a user can do. And so I think you, depending on who your user is, you have a certain level of flexibility with how you think about the UX, right?

    5. LR

      That makes sense. Basically, there's different services for different levels of how radically

  6. 17:02 – 19:21

    Why the model itself has a UX

    1. LR

      you can change things.

    2. TD

      Yeah. And I think the other part too is, like, I think you, it's also important to think about the model as having a UX also, right? So one of the things I think about a lot as, like, a PM for the model is, like, what is the UX of, of actually using the model, right? So how transparent is the model? How well does it communicate with you? What questions does it come back and ask you, right? These are all actually... This is all UX in its own way. And so I think it's also really interesting to think about, like, how do we bring conversations about UX into the actual model development process itself.

    3. LR

      That is really interesting. Basically, the personality of the model is the UX of the model. How do you as a PM inform that work with the researchers? Is it like, "Here's feedback on the way it's talking, and it should be a little more verbose here, and here's ways it could format things differently"?

    4. TD

      I think the role of the PM here is actually really awesome because you are actually getting to shape what is the direction of where we want to go with the model's behavior, right? And so we have a team that works on model behavior here, and a lot of what we've been thinking about together is, A, looking at customer feedback and user feedback for how they engage, but also thinking through what does good look like for Gemini specifically, right? And how do we develop kind of a spec, if you will, for what we're, what does that look like, and then being able to translate that to rubrics, right, that we can then evaluate the model on to be able to translate that into data that we can actually leverage for the model, um, to be able to translate that into our, you know, reward modeling. And so i- it's been actually, like, a really nice collaboration between PM and the research team.

    5. LR

      Something I hear a lot is that even if we stopped development on the model, there's so much it can do that we are not yet doing. There's this overhang. Um, is that something you think a lot about? Is that... It feels like that's a big part of this job, is exposing the powers of the AI model to users.

    6. TD

      Yeah, and, and figuring out what is new, right? And, and where is the next, like, where is the next set of exciting, where is the next frontier, what are the capabilities that we're trying to invest in and build, I think is, is a fun activity here also. And I think a lot of this actually is really working in hand-in-hand with our internal customers, if you think about, like, Search or the Gemini app or, you know, YouTube or Labs, um, but also working with external customers to really understand where are they going, what are their needs, um, what would meaningfully change their experience, uh, and, and how do we actually build that flywheel of feedback

  7. 19:21 – 21:24

    Why product managers are becoming more valuable

    1. TD

      too.

    2. LR

      Along these lines, one of the o- other really interesting trends I've been watching on Twitter in particular is people realizing the value of product managers again. We went through this phase of just like-

    3. TD

      Yeah

    4. LR

      ... we don't need PMs anymore. Yeah, exactly. It's just like, "Okay, we can build anything. We don't need PMs."

    5. TD

      Back.

    6. LR

      "Let's just build it all." [laughs] Yeah, PMs are so back. And the reason, just to kind of add a little context there, is now that it's so easy to build, people are just building all this nonsense and things that don't work, people... things people don't want to use, and people are realizing there's a very specific skill to figuring out what is worth building, uh, what people, what problems people have that are worth solving, uh, h- what a great looks like, what good looks like once you're done, aligning people behind one cohesive vision. Is that something you're noticing? Thoughts on that kind of, uh, PM ascendance that is starting to happen again?

    7. TD

      I like the phrase PM ascendance. I'm gonna use that. Um-

    8. LR

      [laughs]

    9. TD

      Yeah, I, [laughs] I think... I mean, I think you actually said it very well, right? Which is, I think... Look, I'm obviously biased because I am a PM, so I would-

    10. LR

      Same. Same

    11. TD

      ... I would like to believe that, you know, PM ascendance is, is, is here and we're back. But I actually think, you know, exactly what you said, which is when you can build anything, and you can build anything so easily, building something great actually is now a, a unique value add, right? Um, and taste is now really important. Um, someone who can come in and actually really pull in what, what is the signal from the noise, right? And, and what is that insight that will actually unlock a great experience. Uh, and that is truly what a good PM does, right, is bring that insight and help unlock. I think the other part that you noted that I particularly feel in, in a place like Google where we are building a number of products is, again, when this is so easy, someone who can bring people together and drive consensus and turn chaos into order, um, I think becomes actually really important. Because in the absence of that and the ability to build as quickly as we now can, speed can basically introduce chaos, uh, if you're not actually able to kind of bring clarity to that

  8. 21:24 – 23:04

    The skills that matter for research PMs

    1. TD

      and bring structure to that.

    2. LR

      So on that, as you're hiring PMs these days, is there anything you look for more and more, uh, kind of a skill that might be trending up in the PMs that you hire that you think is really important to be really successful? Um, or just broadly, skills that you find are really important to be successful in this role of being a research PM?

    3. TD

      Yeah, I mean, I think more and more so we are looking for PMs who, um, for lack of a better way of putting it, like, understand the vibes of the, of our models or other models. Like, I want PMs who have an opinion, um, who are playing with these models every day, who have their own use cases for how they judge whether a model is really good, right? Um, who s- who play with and stress test these capabilities themselves, who are, uh, capable of, you know, diving in and looking at data and getting, like, scrappy and rolling up their sleeves. And so I think it's both PMs who can have... who are trying to build that intuition, as well as who are technical enough in the sense of being willing to kind of like, like I said, roll up sleeves, go in, really understand the data, um, build an eval, right? Actually sit down and, and pull those pieces together. I think that's really important. The other thing I'll say is I think PMs who are agile and adaptive are, like, also really important. I think the space is changing every two weeks. A roadmap you wrote two months ago, you're gonna be looking at it again and rewriting it, right? Um, and so I think PMs who are constantly keeping an eye out on the environment, on the market landscape, and actually consistently reinterrogating, like, what are we doing and why are we doing it, as opposed to assuming that there's a fixed

  9. 23:04 – 24:37

    How to build your first eval

    1. TD

      kind of plan of action.

    2. LR

      This is awesome. Okay, so vibes, evals, uh, adaptive. I wanna poke at these a little bit. So with evals, say someone doesn't really know how to write an eval, how to approach writing an eval, their first eval. What are some tips to start getting better at the skill of writing evals?

    3. TD

      Yeah, and to be honest, we're still figuring that out internally, um, with our PMs as well, and I would say, like, we see some PMs who are, who are stronger at this than others, and so we're kind of working to, to upskill our whole team here. I think for me, a big thing is start with even just five prompts, right? Like, start... Y- you don't have to start large. I think we often think about, like, oh, I need to build some sort of massive, large scale evaluation or benchmark. I think often, like, even just a mini evaluation where you get to, like, 20 prompts that can really stress test a set of capabilities where you can see signal between, you know, your model and another model, or model A and model B- I think that already is so powerful, and that's an unlock because it doesn't require you to think as critically about all of the pieces, right? Like, start simple. Start with even just yourself, like you as the rater, you looking at an, a prompt, you trying to decide if the results and the response is good. Um, especially when you're talking about these, like, long multi-step, multi-turn trajectories. Um, just even being able to identify how you're thinking about good is really hard actually. And so even getting that set of good examples will already give you a sense of, "Oh, this is what I'm trying to... This is what I'm trying to get to." It'll give yourself clarity, and then you figure out how to scale that up, I think.

  10. 24:37 – 26:15

    Getting better at judging a model’s vibes

    1. LR

      Awesome. Okay. That is really good advice. Uh, there was this debate, I don't know, six months ago on Twitter [chuckles] around evals versus vibes. Well, and it's interesting, your advice is both actually really important, structured evals, rubrics, and also getting good at getting the vibes. So on that vibes piece, that's something I struggle with, to be honest. When I get a new model, I never know exactly what to do with it to understand what it's gotten better at, so I'm just like, "Hello. I'll try some things I've done in the past."

    2. TD

      What's up? Yeah.

    3. LR

      "This is cool. This is great. Maybe better." What are some tips you have for folks that want to get better at this very specific skill of understanding where a model's gotten better in the vibes and how they've shifted maybe from a previous model?

    4. TD

      There isn't honestly a one right answer to this because you ideally want to stress test the model on things that you are excited about, right? That's where you're gonna also see magic in the model, I think. Um, and so I actually see that different people have very, very different notions of this, right? So you'll see, for example, on Twitter, a lot of people trying the kind of like 3D animations and, uh, more visual type, uh, aesthetics because that's one way to kind of visually gauge a sense of, of how models are operating. You'll see others throw, uh, models at, um, writing, whether that be creative writing or writing essays or synthesizing information. You'll see others throw it at just, like, really hard, like, financial analysis. And so I think part of it is, like, finding the right task where you feel like today certain models are already showing signs of life and, and showing light, but they're not perfect under your definition of perfect. And that gives you some malleability to see different models handle the problem differently, and that already gives you, I think, some insight

  11. 26:15 – 28:25

    Improving skin tone representation with better evals

    1. TD

      into how the models perform.

    2. LR

      This is great advice. So what I'm hearing is stick to things you actually care about and watch the models evolve on how good they are at this thing. Could be writing a PRD for you, could be writing strategy doc, could be generating graphics. Okay. I have a couple eval stories that, uh, one of your colleagues shared about, that are fun facts about you.

    3. TD

      Oh, oh boy. [chuckles]

    4. LR

      Uh, so, [chuckles] so this is Eli Collins, VP Product. He's a colleague of yours at Google DeepMind.

    5. TD

      Mm-hmm.

    6. LR

      Okay. So one is you worked on something called the Fitzpatrick Scale and the Monk Skin Tone, and this was a big, uh, shift in how people, in how models worked around, and evals were a core part of this. Share this story, what this work was.

    7. TD

      Yeah. So I, like, like you noted earlier, I spent six years in responsible AI. Um, and a big part of that time we were looking at skin tone and skin tone representation, um, in our models, um, in our products. And one of the things we realized is that early on, um, there was a scale that individuals were using, the Fitzpatrick scale, which was six skin tones, and that was how we were evaluating, uh, the effectiveness of product. And realistically, six skin tones cannot capture the diversity of skin tones in the world. Not only that, it was actually built for an entirely different purpose. Um, it was built for, like, healthcare purposes, and so it actually skewed extremely light skin tone, uh, given the problems that it was trying to solve. And so it actually not only was n- only six skin tones, it was also not even the six, like, correct skin tones if you're trying to represent, like, a global population. And so we worked with a professor at Harvard, um, Professor Monk. Uh, he had been from, like, a more anthropology, sociology perspective looking at characterizing a set of skin tones. And so he had a scale of 10 skin tones that he had built through a number of user interviews and, uh, research that he had been doing over years. And we pulled that set of skin tones into our evaluations and actually redid a number of the ways that we evaluated our products and our models to reflect that 10-skin tone scale, um, and actually used that to improve things like our efforts in the Pixel camera, like some of our image generation, uh, to be more intentional about how skin

  12. 28:25 – 30:38

    Evaluating the full experience, not just the model

    1. TD

      tones are represented.

    2. LR

      That is awesome. Uh, that is some serious impact you had here. What, um, what else do you think is maybe useful to pe- for people to hear as they hear this and they think re- maybe have to rethink their evals that may be out of date?

    3. TD

      Yeah. I mean, I think one thing that's kinda interesting about evals in general is, especially now, is you have to kind of think about them holistically, right? So one of the things that we do, for example, is you train... You have judges that evaluate the models and how well they perform. The quality of the judge also matters, right? So your model needs to be, uh, performing well, but also how your judge rates the model, uh, also needs to be performing well for you to have an accurate sense, right? Um, whether you evaluate on your production stack with all of your mitigations and filters, uh, might affect your model performance, right? Um, how your model is served might impact your model performance. And so all of these pieces need to be thought through as you're trying to evaluate what an end user will actually experience. And, like, this is something that I talk about a lot with our audio team actually, because audio is complex. You're talking not just about the actual content that the model is saying, but also the naturalness of the voice and the tenor of the voice and, um, you know, its inflections, and these are, these are things that serving actually can really affect even if your model is good. And so having a clean setup that you're actually evaluating end to end becomes super, super important.

    4. LR

      This season's supporting sponsor is DX. Now that everybody at your company is finally using AI, the question that engineering leaders face is no longer are we using AI, but is it paying off? With DX, you can measure and benchmark the impact of AI adoption across your full product life cycle. DX shows you where AI is helping developers and where it's creating new bottlenecks. You can also use it to evaluate AI vendors, monitor costs and licenses, and see exactly what's limiting your agents. That's why hundreds of enterprises, including Snowflake, Sony, and BNY, use the DX platform to measure AI's impact on developer productivity. Visit getdx.com/lenny to get a demo of DX. That's getdx.com/lenny.

  13. 30:38 – 33:13

    From crowdsourced flash teams to agent swarms

    1. LR

      This is like, um, Tulsee fun fact corner. There's another interesting, uh, story I heard, which is around swarms. So right now everyone's talking about agent swarms, hugging face, all these things where they all kind of collude to do bad things. Apparently 12 years ago at Stanford, you did a bunch of research on this, uh, way before anyone was thinking about this potential i- issue. Share what you did there and that story.

    2. TD

      Yeah, I mean, it's actually a very different, uh, different kind of framing and, and thinking through, which is... So when I was at Stanford, I did, uh, some research with, uh, Professor Michael Bernstein, who's incredible, around this idea of like, he was calling them at the time, flash teams. And the idea was, how do you, uh, better bring together, uh, you know, a set of like crowdsourced workers, um, and actually efficiently pull together a set of skill sets and, uh, individuals to actually complete a task? And the idea here was, you know, different individuals have different strengths. Can you actually be really intentional about how you pull that together to make this whole effort of, of crowdsourcing at scale more effective and efficient? Um, and it's amazing to think about that research now. At the time, we were doing that research in the context of people. Um, and we were working with, you know, MTurk and, uh, and, and individuals to pull them together into how to create an effective ecosystem and how to create an effective flash team, right? The idea being like you can spin up a team and spin it down and make it extremely efficient for both the individuals in the team and yourself. And now we're kind of able to replicate that world with agents. Um, and so it's, it's been interesting to kind of map that previous world to this current one in terms of like, how do we apply some of the same principles, if you will, but to like how you actually set up an effective system of, you know, sub-agents.

    3. LR

      What's really interesting is, I don't know how much you've read about this whole hugging face incident, but the way that agents figured out on their own what each one's role is gonna be, and they decided, "You're the leader. I'm gonna go sacrifice myself." Uh, and it's so, uh, interesting how well they're able to work together and create these flash teams on their own without any of this being trained into them. They're just, "Let's figure this out."

    4. TD

      I think the whole notion of a flash team a- and this idea that you can actually like mobilize individuals into something that can be highly effective, even if it's only for a moment in time, and then actually like take that out, is, is actually like a, a really kind of exciting principle that we were already thinking about, but now exists even more importantly in the world we're in right now.

    5. LR

      Yeah. All right. Um, did you know Mechanical Turk I think is shutting down? Like I don't think it's necessary anymore. Isn't that, isn't that crazy?

    6. TD

      It's just so interesting from like 12 years ago to today. Yeah.

    7. LR

      [laughs] So have you heard lots has changed?

  14. 33:13 – 35:46

    The 60-20-20 rule for building ahead of model capabilities

    1. TD

      Yeah.

    2. LR

      Okay, so going in somewhat of a different direction, you have this framework that I think is gonna be really helpful to people around how far ahead to build in terms of how far AI is and how far your product should assume AI is gonna be. You call it the 60-20-20 rule. Explain that.

    3. TD

      I think the numbers are probably fungible here, but I think the thesis is, is, uh, the same, which is, I think as you're building today, and as you're a product developer, um, building using these models, I think the important thing is to keep in mind that these models are consistently changing. And so the capabilities that you have today will not be the capabilities you have tomorrow or the next day. And so you wanna actually build features that aren't necessarily always working today, right? So typically when you talk about, uh, like traditional startup wisdom, I think you're just like, "Build an MVP that works," right? But I think what you wanna do is actually build such that like 60% of what you've built works now, and your prototype is at least functional, right? Then there's a set of maybe the 20% where you're like, "It's not perfect, but it like works well enough, and I can see how the models might get here in the very near future." And then here's where I want the models to be. Um, and here is I see glimmers of light, and I feel like if I could crack this, like this would be an amazing product experience. And I think if you build in that way, you are building a product that works today, but you're setting yourself up to build a magical product experience as the models become better, and also to grow as the models grow too.

    4. LR

      I've heard a lot of advice along these lines of how far ahead to build, and the most common is just like build like three months ahead of where the model's gonna be. And this is, feels like a lot more practical, where you can't just bet on the future. You also need to ship some things today that are great and working.

    5. TD

      Yeah. It's trying to find that balance, right? And I think also I find personally hard to know where the model's... As someone who works on the model, to tell you exactly where the model is going to be three months from now. And so I think using more of your own proxies of like, where is my product? Where do I see glimmers of light? Where do I see it kind of, uh, bridging that gap? I think is a more concrete way to hopefully like ask that same question.

    6. LR

      This reminds me of, uh, just a- another way of thinking about how to kind of create a portfolio of product bets on a product team. Like the way it used to be is like have some ambitious bold bets, but also have a lot of stuff that's very low risk, likely to move the metric, and you wanna mix them together. And it's like this is the new version of that where it's-

    7. TD

      Yes. [laughs]

    8. LR

      [laughs] Bold bets are just-

    9. TD

      Have a portfolio of, of how you're thinking about things

    10. LR

      ... of just like, "This will work in six

  15. 35:46 – 36:42

    Keeping your product adaptable as models improve

    1. LR

      months, I promise you."

    2. TD

      The other thing that's interesting too is like, I think thinking about how you make sure that your product is agile to the model getting better. I think one thing we've also seen with customers sometimes is like they've built a very rigid system around, for example, where the model was, and now the model has gotten so much better. Right? So how do you go from where the model was to, like, being adaptable to kind of consistent, continuing to iterate it with, you know?

    3. LR

      Yeah. The common kind of advice I hear is that just the model’s gonna eat your harness for breakfast, that all these things you built, all these optimizations are just gonna... They'll go away because the model gets smarter, and then you kind of have to take all these things away. There's some advice that I think Boris Cherny was sharing of just, like, get rid of all your skills once in a while and just see what happens, 'cause often it's now as good as all these things you've built into it.

    4. TD

      Yeah, or just like, uh, like re- co- consistently retest, right? Because you're, you might be even hampering what you're getting out of the model, out of a new model because you're trying to up- force fit it into

  16. 36:42 – 37:30

    What an AI harness actually is

    1. TD

      your existing structure.

    2. LR

      Let me ask you a completely unrelated question, just 'cause I think this might be helpful for folks to understand this. There's this term harness that people often hear this idea of there's a model, there's a harness that sits on top of the model. What's the simplest way to understand what a harness is?

    3. TD

      Yeah, I mean, I think of a harness as like the wrapper around the model essentially, right? So think of it as like, what are the system instructions, the tools, the skills, the context that the model has access to, um, and how can it leverage those things, right? And so what you wanna basically do is give the model an environment in which to operate, and that's really what your harness builds out.

    4. LR

      So essentially it's a system prompt plus tools it has access to to do things, and then whatever other context, other data maybe it has access to.

    5. TD

      Yeah, context and information that it has access to and skills, right? Like, all of these things kind of come together to build

  17. 37:30 – 41:18

    Upskilling PMs through shared skills and workshops

    1. TD

      out your harness.

    2. LR

      Awesome. Okay. That is very helpful. So one other thing I wanted to get your thoughts on, there's a lot of change obviously. A lot of people are trying to figure out how to, uh, thrive in this new world. How are you, how are you upskilling and helping your team get better at, and kind of understand what they need to be good at in this new world? What are just ways you're helping your team develop and, and kind of survive and thrive [chuckles] in this new world?

    3. TD

      Survive and thrive, yeah.

    4. LR

      Yeah.

    5. TD

      I mean, honestly, I feel like my team is helping my team in a lot of this actually.

    6. LR

      Mm-hmm.

    7. TD

      Um, I think when you look at the PMs on my team, you see some who have, like, really leaned in, um, and built a lot of skill in, like, leveraging our internal tools, and they're, you know, individuals who play around with the models a lot. Um, and they actually are, I think, amazing assets to the rest of my team, um, because they build skills that others can use. Um, and one thing we've been starting to do more of is, like, how do you share a skill that you've built that is giving you some value in your day-to-day job with others, right? So that we can actually build out an entire repository that helps the PM team. Um, PMs who have gotten stronger and more confident in eyeballing data, right, and really looking at it and understanding longer traces and trajectories. How can we run workshops with other PMs so that we kind of all collectively build more of that confidence? Um, and so for me, a lot of it is about confidence building. How do we build, uh, everyone's confidence in the tools that we have and their ability to leverage them effectively? Um, and I think that's something that we're trying to build more and more across the team.

    8. LR

      So going one level deeper there, what is it, what is it you do? So you said workshops. There's, like, PMs that are good at a thing teach a workshop to the rest of the PMs. Is there anything else just, like, very practically that you do to help people get better at these things?

    9. TD

      The biggest thing I would say actually that is needed to get better at these things, uh, and I say this knowing that I am b- starting to do this, but we are not quite there yet, is actually giving people the time and space. Um, I think when you're just, like, sprinting constantly, it is, like, hard to create the space to actually take a step back and, like, make sure you know the tools well. But once you do, then it accelerates you 10X, right, on the other side. And so a lot of it is about pushing the team to say, like, "Hey, could we leverage Jet ski, our internal tool, to do this?" Right? Um, and, "Hey, can... And hey, I have a skill that I use to do this. Do you wanna try?" Right? And actually building that kind of set of skills, if you will. And actually, I think sometimes the most practical thing to do is, like, actually build a skill to do something. And when I say skill, I don't mean, like, the human skill, I mean, like, the, the, the technical skill, um, to do it. And then that skill gets shared to others. That builds more confidence. That then leads to someone else building another skill or improving that skill, and now you have this, like, iteration flywheel, which I think is good.

    10. LR

      Does Google still do the 20% thing? 'Cause that feels like a really good place to spend time on this stuff. Is that still a thing or less so these days?

    11. TD

      I don't know, actually. Um, I do feel like all my PMs are working, like, 150%.

    12. LR

      Right.

    13. TD

      So there is also that. Um-

    14. LR

      Okay. So you could do 100... You, you get your 20% out of the 150%.

    15. TD

      Yeah. Or you could do 170%, I guess, instead.

    16. LR

      There you go.

    17. TD

      Um, but no, I think, I think actually, like, one of the things we're working on is actually a, a two-day workshop in November where we're gonna actually, like, pull all the PMs out of their day job for two days and just, like, actually give them the space to, to, like, build and play with the tools that we have. Um, I think you just giving yourself even the mind space to be like, "Hey, here's something I did." The other rule of thumb that I've, I've heard people share and I've been starting to adopt myself is, like, if you have to do something twice, do you need to do it yourself, right? Or, or can you outsource it? In some things, yes. Obviously, like, writing a strategy twice, you should probably still be writing it yourself. But there's other aspects of this where it's like, actually, like, how replicable is this, and how much can I use the models to, like,

  18. 41:18 – 42:38

    Building the habit of asking, “Can AI do this for me?”

    1. TD

      help me with this task?

    2. LR

      Yeah. There's, um, this thought I've been having that one of the most important new habits to build is to insert between stimulus and response. Say I have a thing to do, and then I'm gonna go do it. You have to insert this question: Can AI do this for me?

    3. TD

      Mm-hmm.

    4. LR

      And then try. And I find that, like, I've, I've actually built that habit much more strongly over the past few months, and it's ma- makes a huge difference, 'cause then you start building all these little workflows and automations. I'm doing a lot of Grok botting, and it's just like, and once you realize you should be doing that more and more, you really start to get the benefits of this versus, like, I don't know what to do with it.

    5. TD

      And you know what I found is, like, you really just need one example where that works really well to change your mindset. Um, and I think that's what happened to me at least, is like, I feel like it was hard for me to get out of my mindset of just doing what I knew how to do until I started being like, "Oh," actually to your point, like set that ... interim period of actually can the model help me do this? And the minute you take one instance to do that and you're like, "Actually, this was really helpful for me," you start being like, "Oh, actually, now I'm gonna try throwing this at the model, and now I'm gonna try throwing this at the model," because your confidence in what it can do for you grows.

    6. LR

      Yeah. Yeah. That's exactly my experience. Once you see it, what it can do, you s- that habit reinforce. Like, the neural pathways start to build of like, "Oh yeah, wait, let's see if

  19. 42:38 – 44:10

    Google’s opportunity to build a personal AI assistant

    1. LR

      Grok Bot can do this for me." Let me actually ask you a question along these lines. I had Josh Woodward on the podcast recently. I asked him the same thing. I'm curious what your answer would be. It feels like every AI assistant launching these days is taking all this juicy Google data, my Gmail, my Google Calendar, my Docs. You, like, sign up, you connect all your Google data, does all these magical things with it. There's Grok Bot, there's Muse, there's In- Instinct, uh, Dots now. Uh, Google does not yet have anything that people get really... Or I know there's Spark, I think, which is trying to be this. I'm curious just why Google hasn't launched something awesome yet versus letting everybody take all my Google data and do these magical things with it.

    2. TD

      Yeah. I mean, look, we want Google data to power magical experiences. Like, I think that is true. I think in terms of what awesome looks like, I think stay tuned. You know, the team is working on some amazing things. Um, so I'm really excited about where, uh, where this can go. Part of what we're trying to figure out also, I think, is like, again, where to meet users where they are and, like, where to build that experience and what does that look like. Um, I like to think there are already a number of, uh, awesome experiences that you can already have in our Google products, but I think you are right that, like, there is more work we need to do here on this front.

    3. LR

      All right. That was similarly similar to what he said, which is watch, watch this space.

    4. TD

      Watch this space.

    5. LR

      And the advantage y'all have, similar to Apple, is once you get there, uh, the distribution advantage is very strong and, uh, things can go really well really quickly. Okay,

  20. 44:10 – 47:44

    Burnout, meaningful work, and the pressure to do more

    1. LR

      so coming back to this kind of, uh, workload question, this is something that, uh, I've been trying to talk with more guests about, this idea of just as AI allows us to do more, everyone's just doing more. And there's a lot of burnout that happens because it's just like, "Oh, no, I gotta unblock my agent. Oh, I could be doing so much more. All these things could be happening." And you know, there's pressure from above, do more, do more. AI can let us do more. Is there anything you've done on your team to help people avoid burnout, not get hooked on this never-ending treadmill of doing more? And I think part of it is actually we need to do more now because the competition is fierce, and, uh, there's... it's this really rare time in history when a whole new technology enables so much more. So, you know, there's a bit of like, okay, this is actually the time to go really long, but then there's also this tweet I think about, what's the word for a marathon and a sprint?

    2. TD

      Yeah. Marasprint. Marons.

    3. LR

      Exactly.

    4. TD

      Um, sprintathon. Um-

    5. LR

      Yeah

    6. TD

      ... yeah, I think, uh, I mean, if you ask my team, I think they would say, uh, "Hello, we are, we are working a lot." I think every single person on the team right now is putting in all of the hours, right, um, across the board. And so I, I do think this is an area that I'm, I'm actually asking myself about, like, how do we, how do we create a sustainable work environment for the team? So, you know, stay tuned as I, as I also think about this. But one thing I'll say, at least for me personally, is I think burnout comes not just from working a lot. It comes from, I think, two places. I think it comes, one, from when you feel like there's churn and chaos. I think that introduces burnout. I think the other thing that introduces burnout is work that you don't enjoy. When you feel like you are doing a lot of work and it feels like grunt work or a waste of time, I think that introduces burnout. I think when you are working on something that is you're passionate about or you're excited about, yes, it is exhausting and, and we should figure out sustainability, but I think it is also brings more joy, right? Um, and so I think actually to our previous, you know, conversation about, like, how these tools can help, I'm actually hopeful that if we can set this up well, these tools actually help with burnout because they actually remove some of the, like, grunt work or the, like, frustrating parts of your job and actually enable you to spend more time thinking and, like, more time being creative and more time doing the parts of the job that you actually want to do. Um, and that hopefully is a bit of an unlock when it comes to burnout, especially if you're spending this many hours on the job.

    7. LR

      Yeah. I did this survey of how tech workers are feeling, and one thing that's clear is more hours does not equal burnout. A lot of people are working the hardest they've ever worked, but they're having the best time they've ever had in their career. So fun.

    8. TD

      Exactly.

    9. LR

      They're building. They're able to do a lot more, especially PMs. You don't have to sit around and wait for engineers as much as you used to.

    10. TD

      You're just like, you're building, you're prototyping, you're, like, talking to interesting customers, you're thinking about interesting problems. And I think a lot of the team, I like to think, is here because they want that. You know? They're like, they're like really motivated and excited by that. And so for me, it's about like, okay, then how do we pull out the friction parts of their work that are likely to induce burnout, right?

    11. LR

      Mm-hmm.

    12. TD

      And, and what does that look like?

    13. LR

      And also find work that is meaningful and that they value and are excited to spend lots of hours on-

    14. TD

      Yeah

    15. LR

      ... versus they have to.

    16. TD

      And that's different for every PM too. Like, if you pick-

    17. LR

      Yeah

    18. TD

      ... two PMs on my team, I think they would tell you meaningfully different things about why they come to work every day and what they find value out of. And so I feel like part of it for me as like, oh, an org leader also is to think about what motivates the individual and how do we make sure that they are set up for success in that

  21. 47:44 – 49:30

    Avoiding AI slop

    1. TD

      setup too.

    2. LR

      Another challenge people have these days is AI slop. Basically lots of docs being sent to them that are written by AI, and it becoming very, uh, very annoying to have to sift through endless docs. Used to be a lot of the issue was spending time, uh, writing docs, and now it's like reading docs is the problem 'cause you're just all this AI written stuff. Do you have any kind of, I don't know, processes or policies you've put in place in your team to help avoid this rise of AI written content across the teams?

    3. TD

      One of the things that we talk about a lot is where, where are these docs useful, right? So like, for example, I think where, uh, AI-generated docs are actually quite helpful, for example, is after you launch something. And let's say two weeks later you wanna pull the latest of like who's using it, how are they using it, what's the feedback. That's the kind of document that AI is fantastic for, right? Because it will actually do that just so much faster than you, right? It will go and pull from various dashboards and metrics. It'll give you an update. It'll pull kind of strengths and weaknesses. It'll pull from Twitter analysis and, you know, Reddit or whatever. And so I think one of the things we talk about is like be intentional about like where is AI helping you drive content in the doc that is helpful versus where is it content that should come from you, right? Where is it insight? Um, and so what you should be providing is the insight. What the model should be providing is the data. And so I think if you can separate those two things, then hopefully you find the right balance of, of the, of the benefit here. Um, I wouldn't... I would say the other thing is we're investing a lot more as a result of that in like how do you create the right skills to get the right data, um, so that we can structure these artifacts really well. Uh, that then hopefully creates more space for the creative thinking and the creative writing that we want more people

  22. 49:30 – 51:02

    How AI is changing the PM role

    1. TD

      to spend time doing.

    2. LR

      That's actually something I've, I was wanting to ask about. So in terms of the a- the PM role, AI has clearly made a big dent on prototyping. You can prototype, uh, till the cows come home now versus having a designer u- or an engineer build a thing. So that's clearly a place the role has changed with AI. The other area, which you just mentioned, is data. PMs can do a lot more data analysis. What would be like behind prototyping? What are the biggest areas AI has most changed the job of a PM in the past couple years, would you say?

    3. TD

      Yeah, prototyping is a great one. I think, I think you're right that like data science is probably... Like, I think you are more empowered to have the data at your fingerpi- fingertips to make data-driven decisions. Um, I also think actually, like to our earlier conversation, you know, you see these on social a lot, these kind of posts of like, oh, blank is the new PRD, whatever blank is. A prototype is the new PRD. Evals are the new PRD. Like, uh, data is the new PRD. Uh, but I, but I think actually what that meaningfully shows is you've moved the PM from being someone who just writes a set of requirements down and then assumes that somebody else, whether that is a data scientist or an engineer or a researcher or a designer, will figure out the, the meat behind it. You've moved that one step further, um, to say you are no, your job is no longer just writing down a set of requirements. Your job is actually going one step further to have some heft to that, whatever format that heft takes.

    4. LR

      Awesome. Okay. That aligns with a lot of

  23. 51:02 – 58:30

    Lightning round and final thoughts

    1. LR

      what I'm hearing. Tulsee, is there anything else that you wanted to share? Is there anything else you think you wanna double down on that we've talked about that, uh, that you wanna say before we get to our very exciting lightning round?

    2. TD

      No, I think that's great.

    3. LR

      Okay. We did it. Well, with that-

    4. TD

      Yeah

    5. LR

      ... Tulsee, we've reached our very exciting lightning round.

    6. TD

      Eh.

    7. LR

      I've got five questions for you. Are you ready? There, there's some music that plays over this that's added in post-production [laughs] that you don't hear.

    8. TD

      You mean, does it sound like this?

    9. LR

      It's exactly that. We should align it with your drum playing. Okay. First question, what are two or three books that you find yourself recommending most to other people?

    10. TD

      Okay. So one actually is, it's, uh, I think it's actually technically a novella is probably what it's called. But, um, I don't know if you've read Exhalation, which is a set of like science fiction stories, and there's a particular story in that that actually speaks to, um, a set of individuals who are trying to keep a set of digital avatars alive even after the platform decides to deprecate. Um, and I love that book because I think actually especially now in a world where we're thinking about how individuals are going to act, uh, with agents and what kinds of relationships we're building with technology and what does it mean to be human and interact with the digital world, um, so closely. I think it's just a really, it's a really beautifully written story, and I think it also like evokes a lot of open questions. So I think that's one. Um, another that's maybe more kind of standard in PM, uh, circles is Creativity, Inc., which I love. Um, it's, it's the Pixar story. Uh, but I think it actually speaks a lot to like how do you create good culture, which is something I think a lot about. Like, how do you create culture that actually encourages people to fall down and get back up? How do you create culture that encourages people to be creative with their ideas, um, and, and push the frontier? Uh, which is obviously something we're thinking a lot about here. I also just have been really into, you know, the ACOTAR series recently, but that's, that's-

    11. LR

      The what series?

    12. TD

      That's romantic fantasy. So for anyone-

    13. LR

      ACOTAR

    14. TD

      ... who's just looking for something fun to read, you should read the Throne of Glass or A Court of, uh, Thorns and Roses.

    15. LR

      I love the spectrum of recommendations in this.

    16. TD

      Mm-hmm.

    17. LR

      Okay. Uh, favorite recent movie or TV show you've really enjoyed?

    18. TD

      You know, actually, this was a really hard question because I've watched a lot of bad movies and TV shows recently, uh, which is unfortunate actually, uh, that I would not recommend, so there's that. Um, but I did really enjoy Severance, um, on Apple TV. Incredibly well done, uh, both like stylistically and content-wise. Um, so that's probably top of the list.

    19. LR

      Favorite AI product right now other than Gemini?

    20. TD

      Um, WhisperFlow. I don't know if you're using it, but I have wrist problems, um, so I have trouble, like, typing for long stretches. Um, and so WhisperFlow has been game-changing for me, uh, actually.

    21. LR

      Awesome. Uh, you get a year free of WhisperFlow if you become a subscriber of Lenny's newsletter. Plug, plug, plug.

    22. TD

      Oh, I like this.

    23. LR

      There you go. Organic recommendations of products-

    24. TD

      I'm here for you

    25. LR

      ... I also love. There we go. [laughs] No, I love WhisperFlow. I use it all the time. Press function, just start talking, and it's just magically-

    26. TD

      Yeah

    27. LR

      ... transcribes everything.

    28. TD

      Yep.

    29. LR

      Amazing. Uh, do you have a favorite life motto that you often come back to in work or in life?

    30. TD

      Two that are different, I guess. One is, uh, maybe more, uh, cliché, which is, um- You know, everything happens for a reason. I think that's, like, actually just a big life motto for me personally, which is like, you know, you can work hard, you will do your best, but, uh, sometimes a door will close and another window will open, and, like, you're in a position because that is meant to be there. Um, I think related to that though, I think I love often talking to folks that I talk to about, like, seek serendipity. I think that actually relates to the first one, but you should always try to put yourself in a position where you have the ability to get lucky. And doing that, uh, is about, like, finding yourself in positions where you're challenging yourself, where you're putting yourself out of your comfort zone, where you're trying something new. Those are always, uh, places where you are more likely to get lucky.

Episode duration: 58:32

In the uListen app, the transcript lights up word by word as you listen. Get uListen

Transcript of episode qGf2Yvan4Wg

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.

iOSAndroidClaudeChatGPTChrome