How to ask the right questions, project confidence, and win over skeptics | Paige Costello (Asana)

1. 0:00 – 4:38

   Paige’s background

   1. LRLenny Rachitsky0:00

      You're often the youngest person in the room. What have you learned about how to garner trust and win over skeptics?

   2. PCPaige Costello0:07

      The thing I would say is bring the insight. Know thy customer, know thy market, know thy competitors, know thy numbers, know thy product.

   3. LRLenny Rachitsky0:15

      I'm curious what you find most holds back new PMs.

   4. PCPaige Costello0:20

      Your brain is so accustomed to having a scarcity mindset, as opposed to, like, creating alternative options or seeing a different path. Effectively, there's this notion of how might the opposite be true? And the moment I challenged myself and said, "How might the opposite be true?" my shoulders dropped. (laughs) I felt more relaxed. I was like, "Oh. Yeah, I can do both. It'll be fine."

   5. LRLenny Rachitsky0:42

      (intro music plays) Welcome to Lenny's Podcast, where I interview world-class product leaders and growth experts to learn from their hard-won experiences building and growing today's most successful products. Today my guest is Paige Costello. Paige is a product lead at Asana, overseeing teams responsible for the core product experience of Asana. Before Asana, she was director of product at Intercom. And prior to that, she was a group product manager at Intuit, where she spent five and a half years. In our wide-ranging conversation, we dig into strategies for building trust with people who are more experienced than you or older than you. We talk about coaching product managers, including why leading by example is often the most effective strategy. We talk about Asana's product development process and how it's evolved over the years as the company has scaled, plus some of Paige's product and career missteps and what she's learned from those moments. To prep for this interview, I got input from some of Paige's colleagues and former colleagues, and everyone I talked to loved Paige. You'll soon see why. Enjoy this episode with Paige Costello after a short word from our sponsors. Today's episode is brought to you by Brave Search and their newest product, the Brave Search API, an independent global search index you can use to power your search or AI apps. If your work involves AI, then you know how important new data is to train your LLMs and to power your AI applications. You might be building an incredible AI product, but if you're using the same datasets as your competitors to train your models, you don't have much of an advantage. Brave Search is the fastest growing search engine since Bing, and it's 100% independent from the big tech companies. Its index features billions of pages of high-quality data from real humans, and it's constantly updated thanks to being the default search engine in the Brave browser. If you're building products with search capabilities, you're probably experiencing soaring API costs or lack of viable global alternatives to Bing or Google. It's only gonna become harder to afford these challenges. The Brave Search API gives you access to its novel web-scale data with competitive features, intuitive structuring, and affordable costs. AI devs will particularly benefit from data containing thorough coverage of recent events. Lenny's Podcast listeners can get started testing the API for free at brave.com/lenny. That's brave.com/lenny. This episode is brought to you by Attio, a new type of CRM that's powerful, flexible, and built around your data. Traditional CRMs were built for a different era, with totally different speed, scale, and data demands. Attio is different. It allows you to quickly build a CRM that matches your unique workflows and data structures. Within minutes of connecting your email and calendar, you'll have a CRM that's already set up, complete with customer profiles and automatic data enrichment. You'll also have real-time dynamic reporting at your fingertips. No more slow deployments, outdated user experiences, or tedious manual data input. With Attio, you can build and adapt your CRM on the fly, no matter your business model or company stage. Attio is the CRM for fast-growing startups. Get started today and get 15% off your first year at attio.com/lenny. That's A-T-T-I-o.com/lenny. Paige, welcome to the podcast.

   6. PCPaige Costello4:07

      Thanks, Lenny. Great to be here.

   7. LRLenny Rachitsky4:08

      So, you don't know this and I didn't tell you this, but I asked a bunch of people that you worked with, and maybe currently work with, for questions, suggestions of things to ask you. So, this is gonna be really fun.

   8. PCPaige Costello4:19

      (laughs) Wonderful. Now I want to know who you talked to, but we'll find out.

   9. LRLenny Rachitsky4:23

      I'll tell you right now, uh, big thank you to Jackie Bavaro, Yasmin, who's on your team, Ann Montgomery, and Steve Morin, who's currently at Asana.

   10. PCPaige Costello4:33

       Ooh, fun.

   11. LRLenny Rachitsky4:33

       And so thank you to all of those folks for giving me a bunch of great question suggestions.

   12. PCPaige Costello4:37

       Looking forward

2. 4:38 – 6:04

   What Paige is responsible for at Asana

   1. PCPaige Costello4:38

      to it.

   2. LRLenny Rachitsky4:38

      Maybe just to set a little context, can you just talk about, at Asana, what do you work with? What is your team? What do you work on? And what is your team responsible for broadly?

   3. PCPaige Costello4:45

      Yeah, absolutely. So, I lead the product organization that's responsible for our desktop, web, and mobile apps at Asana. And the teams are composed of all the people in San Francisco and New York who are focused on creating clarity for individuals, teams, and organizations. And effectively, our goal is to help teams work together more efficiently and drive the outcomes they're going for. So, you can think about the feature sets if you're an Asana user, like goals, portfolios, projects, tasks, reporting, all that, but really, we want to help people answer the question at work, who's doing what by when and why? So that, that notion of clarity of purpose, clarity of plan, progress, and responsibility are often so painful in people's work lives. And when there's certainty there and clarity there, people can be much more efficient in getting the work done. So, that's, that's where my focus is. Uh, every day I'm a product leader for that group.

   4. LRLenny Rachitsky5:44

      Cool. So basically, like, the core. Like, when people think of Asana, it's all of that stuff, is-

   5. PCPaige Costello5:48

      Yeah.

   6. LRLenny Rachitsky5:48

      ... what it sounds like.

   7. PCPaige Costello5:49

      Yeah.

   8. LRLenny Rachitsky5:49

      Awesome.

   9. PCPaige Costello5:49

      There's another group that's focused on our process management, but a lot of the core work and project management core is in, in my group. And then, uh, we have a growth and enterprise scale team.

   10. LRLenny Rachitsky6:01

       And you've been at Asana for about four years now, right?

   11. PCPaige Costello6:03

       Yes. Four years

3. 6:04 – 9:10

   The evolution of Asana’s product development process

   1. PCPaige Costello6:04

      this summer.

   2. LRLenny Rachitsky6:04

      Cool. So something I'm always curious about, uh, about companies that are at this scale is just the evolution they've gone through in terms of how they develop product.

   3. PCPaige Costello6:13

      Yeah.

   4. LRLenny Rachitsky6:13

      And so I'm curious just in the time you've been there, how has the product development process at Asana changed? And maybe even simpler, like, what are the bigger, some of the bigger changes that have been made to the way product is built at Asana over the years?

   5. PCPaige Costello6:26

      I would talk a little bit about how we set strategy and our planning process and how that's changed in this time, as well as how we actually ship product has changed in this time. On the planning front, we have, uh, really changed what altitudes we're planning at, the time horizon we're planning at, um, some of the inputs have gotten a lot more precise and opinionated. So for example, we have always had pillar plans and team plans, but maybe we didn't have an intermediary layer of, like, an area perspective. Well, what's an area perspective? Well, you know, as your organization grows, we've had to reorganize to create more agency and accountability close to teams that are focused on specific target customers and problems. So if you think about the way Asana is organized, we've got our R&D, the pillar structure, the areas within them, and then the, the working teams.

   6. LRLenny Rachitsky7:23

      It might actually help if you even describe, like, what is a pillar, what is an area-

   7. PCPaige Costello7:26

      Yeah, absolutely.

   8. LRLenny Rachitsky7:27

      ... more

   9. NANarrator7:27

      ... exactly.

   10. PCPaige Costello7:27

       So when I said I'm responsible for that, like, core product pillar, th- that's one pillar, but then there's also the adoption and enterprise scale pillar-

   11. LRLenny Rachitsky7:37

       Mm-hmm.

   12. PCPaige Costello7:37

       ... and the workflow pillar. And then when, within each of those, there are subgroups and we call those areas, and each of those areas has a very specific target customer-

   13. LRLenny Rachitsky7:48

       Mm-hmm.

   14. PCPaige Costello7:49

       ... and problem space they're solving for. We've often also dialed up the clarity of the metric at that level. So while we have an R&D set of metrics, we have pillar metrics, we have area metrics, and then at the team level, there's often, like, one or two that they're really driving forward. And so you can think of it as a nested structure around our product strategy as well as how we measure success. And when I joined, we didn't have areas. (laughs) We were organized, like, around projects and around locations and then we worked to make sure that the thinking was more durable and problem-focused so that our roadmaps were not about features, but were instead about what was most (laughs) meaningful to tackle for our business growth. And so that's a big thing that has changed, is the altitude of planning and how that nests. Another thing that has changed is the time horizon. So before we planned, uh, annually primarily, and now we plan every six months, but for a rolling 12 months. And so we have higher confidence in the immediate half, lower confidence in the following half, but we just plan every 12 months, every six months, because it gives our business more confidence in what's coming and a better opportunity to align our go to market and product planning.

4. 9:10 – 11:26

   Planning frequency

   1. PCPaige Costello9:10

   2. LRLenny Rachitsky9:10

      Amazing. So I just actually was talking to the, one of the heads of product at Shopify, and they went through a similar transition where they used to plan yearly and now they plan for the next six months. So it's interesting that I'm hearing this more and more. And you're saying that every six months you revisit the plan for the next year, so it's kind of like an interesting hybrid of those two.

   3. PCPaige Costello9:30

      Yeah, absolutely. I think the more you try to do things in a joined up way where you have a single target customer with sales and marketing, and you want to make sure that the impact of your releases hit their mark, the more it's important to reflect on it frequently and to be able to pivot quickly, because our strategy, (laughs) even when we think we have a two-year vision, something will change, and then we say, "Wow, we made so much faster progress on this than we thought, and we actually believe that there's a new opportunity or new, uh, technology that we should be leveraging. Let's go bigger on that." And so it reduces the feeling of churn and thrash. It makes us all more principled, and it helps us, like, just make sure we're making the best use of our teams.

   4. LRLenny Rachitsky10:20

      I like that it also admits you're not gonna actually have a yearly plan. Like, everyone plans for a year and then halfway through they're like, "No, let's start rethinking everything again."

   5. PCPaige Costello10:28

      Yeah. (laughs) Yeah.

   6. LRLenny Rachitsky10:28

      So I like that you're upfront about that.

   7. PCPaige Costello10:30

      Yeah.

   8. LRLenny Rachitsky10:31

      Okay, and then within the plan do you have quarterly plans and sprints? Is there anything more fine-grained with, like, a detailed roadmap, just while we're on the topic?

   9. PCPaige Costello10:38

      Yeah, not really. I mean-

   10. LRLenny Rachitsky10:40

       Mm-hmm.

   11. PCPaige Costello10:40

       ... teams know approximately when are they expecting to do the work, but, mm, if you ask too much for, (laughs) for a particular quarter or a particular week or date, people make strange choices about scope. And so really, we align on what success looks like and the teams do their best job to ship as quickly as possibly, as iteratively as possibly, and we really encourage prototyping. So we, we added into our product process a notion that we might pivot or cut from stuff that we put on our roadmap, because it felt like once it was on the roadmap, it had to be done, and that's just not smart.

   12. LRLenny Rachitsky11:20

       Got it. So essentially there's a six-month roughly detailed plan of what each-

   13. PCPaige Costello11:23

       Yeah.

   14. LRLenny Rachitsky11:23

       ... team is gonna work on.

   15. PCPaige Costello11:25

       Yeah.

   16. LRLenny Rachitsky11:25

       Got it. Interesting.

5. 11:26 – 12:46

   Examples of areas and metric tracking at Asana

   1. LRLenny Rachitsky11:26

   2. PCPaige Costello11:26

      Yeah.

   3. LRLenny Rachitsky11:26

      Maybe just a couple more things just to make them super concrete for folks that might be listening. What's an example of an area? Like, what's an actual team that would be an area? And then, uh, the other question I have just while I'm saying questions is, are there some metrics you could share of just, like, what some of these teams might be goaled on? Just some examples of how you think about metrics.

   4. PCPaige Costello11:44

      The area that came to mind when you asked about one of our areas is something called Coordinate, and their, their job is effectively making sure that the-... slice of Asana that helps teams work together is working effectively. And so that's projects and tasks and the data that you might put into tasks and all of the back and forth that is required when people use Asana for their core working team. Some of the metrics that they care about are like org paying weekly active users as well as really thinking about like healthy project use. So we make sure that we understand like what does good look like and what is, what is the dynamic that we want to be creating in terms of people getting real value from using the product. And we build that into our metrics to have as a guardrail to ensure that we're not driving one metric at the expense of people really getting what they need out of Asana.

   5. LRLenny Rachitsky12:41

      Just a couple more questions along these lines. I'm-

   6. PCPaige Costello12:43

      Yeah.

   7. LRLenny Rachitsky12:44

      ... nerd sniped about process. (laughs)

6. 12:46 – 16:53

   The double-diamond process and how it’s applied at Asana

   1. LRLenny Rachitsky12:46

   2. PCPaige Costello12:46

      Yeah.

   3. LRLenny Rachitsky12:46

      I think you use a process called the double diamond process at Asana? Okay, cool.

   4. PCPaige Costello12:49

      We do.

   5. LRLenny Rachitsky12:49

      So I've seen, I've seen images of this in various places, but I, I don't know of any company that's actually using it as, like, the process. Can you just describe what the double diamond process is and how you use it?

   6. PCPaige Costello13:00

      So you might be familiar with kind of lean startup concepts and double diamond as it relates to going broad and then going narrow. And so you go broad when you ask, like, "What customer should I solve for?" And then you pick one, and then that's the narrowing. And then you go broad and you say, "What are the problems this customer has?" And you narrow and you say, "This is the problem they have." And then you go broad and you say, "What solution should we do to this?" And then you go narrow and you say, "This is the solution that we should start with." That process of going broad and going narrow and going broad and going narrow forces people to get out of their, um, opinion-driven lands because so often we really want... We, we need to be curious quantitatively and c- and qualitatively about what we're doing and why and be more systematic and rigorous about getting there. And it doesn't take long.

   7. LRLenny Rachitsky13:52

      Mm-hmm.

   8. PCPaige Costello13:52

      But it just, like, breaks the frame. And so this, the, the double diamond process at Asana effectively... Each of our, like, typical reviews or artifacts sit at different inflection points on the double diamond. So we actually ask people to do a kickoff where they collect, um, different information at different scale depending on the size of the problem and the ambiguity they're solving. Some people s- have already done enough customer selection and research that they're starting with, "What are the possible solutions to this problem?" And then they're bringing the spec, and that's the narrowing along side design, et cetera. But it's really mapping our, our artifacts against this notion to make sure that the product thinking has that quality of decision-making. Yeah.

   9. LRLenny Rachitsky14:44

      And the way you described it is it was very customer target oriented. Is that just, is that the actual framework? Is around, like, who to build this for and then what to build? Or is it more... It is. Okay. You're nodding your head.

   10. PCPaige Costello14:55

       It is, yeah.

   11. LRLenny Rachitsky14:56

       Okay.

   12. PCPaige Costello14:56

       It's really important, um, because then you also know what success looks like.

   13. LRLenny Rachitsky15:00

       Mm-hmm.

   14. PCPaige Costello15:00

       Because if you pick your success metrics as using a feature, that's- (laughs) You're teaching to the test, it's not actually driving the outcome. So while our planning process is around effectively defining category and, like, how we win and making sure that customers receive certain benefits from using work management, the through line to the, the individual project that a team might be leading is they need to know who they're solving for and what it means to have that problem solved. And so there, it always starts with enough customer insight such that we can creatively do what they're trying to do when really inventing on behalf of customers.

   15. LRLenny Rachitsky15:43

       Can you maybe repeat if there's, like, terms for each of those phases? And then-

   16. PCPaige Costello15:48

       Yeah, absolutely.

   17. LRLenny Rachitsky15:48

       And then is there, like, an example of a feature or product that went through this that you could share? If nothing comes to mind, that's okay.

   18. PCPaige Costello15:55

       The inflection points are the kickoff, which is the, that going broad, and then customer and direction selection. So this is both the, the target as well as of the 10,000-foot views of how you might pursue solving this problem, which path are you broadly gonna take? And then going broad within that path on different concepts, and then there's a design concept review, then the product spec, then the full experience review or design crit of the end-to-end experience, and launch. And so that launch review is often just, "Hey." (laughs) "Here, here's the thing, here's what we said, here are the fast follows." Most of the time by that time it's already been dogfooding internally for some time and it's, it's more of a formal, "Do we have the right metrics in place? Are we ready to ship?"

   19. LRLenny Rachitsky16:52

       Awesome.

7. 16:53 – 21:45

   Asana’s office-centric hybrid work culture and the future of WFH

   1. LRLenny Rachitsky16:53

      Do these reviews happen in person, on Zoom, or asynchronous?

   2. PCPaige Costello16:56

      It depends. (laughs) So it depends on the complexity of the work, and it depends how much we wanna talk about it. A lot of our crits happen in person. On the design side, a lot of spec reviews are more asynchronous, and then we'll say, "Depending on the number of questions people have, we call a meeting." Otherwise, we do mostly async. But it's a mix. It really depends on the complexity and ambiguity of the solution and how much people have questions about asynchronously beforehand.

   3. LRLenny Rachitsky17:27

      I'm gonna take a tangent with my questions here and talk about work from home policy to Asana. This is something that I've been wondering more and more about how it's changing 'cause it feels like there's been a shift back to the office. So what is the current policy at Asana and wha- what's changed maybe over the past couple years?

   4. PCPaige Costello17:42

      Well, we were fully remote during the pandemic and then we came back to the office in an office-centric hybrid format. So we're in the office Monday, Tuesday, Thursday, and then work from home mostly on Wednesdays and Fridays. And that...... dynamic has been designed from the start. We wanted to make sure that we took advantage of what's great about working (laughs) together as teams. And so, it's, it's been the standard. So I, I would say what's unique about maybe Asana is we knew we would do that from the very beginning, instead of hemming and hawing about would we be a remote workplace or not, and what would that mean and how would we come together and how would we budget for it? We were like, "Nope, this is gonna be an office, office-centric hybrid." Because we wanted to create spaces for people to work together and move quickly. It's been interesting watching people get back into the swing of things. It was not... Even though we knew, it didn't mean that on day one people were great at being in the office. People, you know, were taking stand-up sitting down. (laughs) Whereas before, you would walk through our office and you could hear people at stand-up because there were stand-up chants and people would be out on the floor. Now people are more likely to do their stand-up in a room, um, and, or trying to, you know, like, the next level is standing up during stand-up. But it's kind of, um, I'm sure it's a, a shared experience for other people who are working in offices, to get used to using the whiteboards again, to get used to, like, standing up during your meetings. It's, it's bizarre that we could lose a muscle that we had that was so innate, uh, so quickly. And I think even in the last month I would say, and it's (laughs) in June of 2023, there's more vibrancy in the office, more conversation, more casual, someone eating alone at the cafeteria and someone sitting down next to them. So, it, it didn't happen overnight.

   5. LRLenny Rachitsky19:45

      I've been seeing a lot of tweets of founders just being like, "Work from home has failed. It's time to go back to the office." And I'm curious if that ends up rolling into more and more companies or if it's just, like, you know, a few founders here and there.

   6. PCPaige Costello19:56

      I think it's a real thing for mental health. I do think that having social casual relationships as well as more opportunities to talk strategy with people you're not forced into a meeting room with has been super beneficial. I can say that just, just today I was having lunch and sat down with my head of data science and we had an impromptu chat about how we review our experiments and how to evaluate whether we had ROI on learning, not just the metrics. And it was one of those things where if we had to schedule it, it might not have happened, and if it did happen, it would've been a couple weeks from now.

   7. LRLenny Rachitsky20:36

      It feels like just coming into the office once or twice... Or sorry, being at home once or twice a week is not that different from how things used to be, where there was a day of no meetings and a lot of people stayed from home. So it feels-

   8. PCPaige Costello20:45

      Exactly.

   9. LRLenny Rachitsky20:45

      ... like it's almost reverting back to that.

   10. PCPaige Costello20:47

       And people are better at it than they used to be.

   11. LRLenny Rachitsky20:48

       Hmm. Right.

   12. PCPaige Costello20:49

       So, I would say our remote days are more impactful, and then on the days we're together, we're, we're getting into the swing of things.

   13. LRLenny Rachitsky20:56

       Yeah, I feel like as a PM, the only day I was productive and, like, getting real deep work done was (laughs) the no meeting Wednesday it was-

   14. PCPaige Costello21:02

       Yes.

   15. LRLenny Rachitsky21:02

       It was at Airbnb.

   16. PCPaige Costello21:03

       I would encourage you to know your chronotype and to block that time where you have the most head space to do that work. So for me it's mornings.

   17. LRLenny Rachitsky21:12

       Wait, say more. Say, say morning chronotype. What is that?

   18. PCPaige Costello21:14

       (laughs) I'm a morning person, and so I try to make sure that I don't have any meetings before 10:00, um, sometimes before 11:00. And that's when I do my hardest task for the day.

   19. LRLenny Rachitsky21:26

       I also just thought about stand-ups while I was at Airbnb, and how not only how much energy they brought, but almost too much energy sometimes where there's, like, another team doing a stand-up and they're just, like, laughing and clapping and we're just like, "Shh, trying to work over here."

   20. PCPaige Costello21:40

       (laughs)

   21. LRLenny Rachitsky21:40

       I feel like we need more of that again.

   22. PCPaige Costello21:42

       Totally, yeah. Yeah.

8. 21:45 – 24:45

   How to garner trust and win over skeptics

   1. PCPaige Costello21:45

   2. LRLenny Rachitsky21:45

      Okay, so moving in a slightly different direction. Something I heard about you is that you're often the youngest person in the room, and you often lead people with decades more experience than you. And I wanna ask, what have you learned about how to garner trust and win over skeptics, especially when they're maybe more experienced or ol- older and especially in other functions, I don't know, execs or designers, engineers. What are you, what have you figured out there?

   3. PCPaige Costello22:13

      The thing I would say is bring the insight. Know thy customer, know thy market, know thy competitors, know thy numbers, know thy product. If you can be the person in the room who has watched customers use the product and has a point of view about why one, one tool is significantly better or worse in a given dimension, and you can do that with confidence and clarity and you don't need to know the other person's functional domain, and you don't need expertise in what they're experts at, you can bring insight that makes people curious and trust you and just immediately believe that there's an opportunity that s- you're not advocating for, that just is, is true. (laughs) And I think that's a really tricky and unique thing is not to pretend like you have more experience than you do, but to be willing to ask great questions and then, like, be curious enough that you're bringing insight to every meeting that people may or may not have, but you're always willing to share.

   4. LRLenny Rachitsky23:21

      That's such a good answer because it's like there's not a trick to it, it's just do the work, spend the time to become the person that has answers that people value, and obviously they will respect you, value your opinion, want to hear from you.

   5. PCPaige Costello23:34

      Yeah. Yeah, the, um... Our former board member, Anne Raimondi, and now our head of business wrote an article on First Round that was really great about kind of the trust equation. And it really resonated with me, and I don't know if you've heard about it?

   6. LRLenny Rachitsky23:52

      Hmm-mm.

   7. PCPaige Costello23:52

      Um, (laughs) but she, she said that trust is equal to credibility plus reliability plus authenticity...... divided by, or over, perception of self-interest.

   8. LRLenny Rachitsky24:08

      Hmm.

   9. PCPaige Costello24:09

      And I think when you're met by someone who doesn't know you, doesn't know your work, your job is to create credibility, and that's where I said, like, bringing the insight is where you can really tip the scales here. Reliability, this is all about your say-do ratio. Authenticity is just (laughs) you know, being vulnerable, being yourself, and then making sure that people know that you're not in it for some other outcome or cause, that perception of self-interest really can change whether people, uh, like how much they trust

9. 24:45 – 26:17

   Why you should befriend researchers

   1. PCPaige Costello24:45

      you.

   2. LRLenny Rachitsky24:46

      In terms of knowing the insight and knowing thy customer, putting the time, I imagine, is a big element of that. Is there anything ... Is that, is that how you do that? Or is there anything else along those lines that just like, "Here's how I get really good at this?"

   3. PCPaige Costello24:59

      When you take a new role, become best friends with a researcher and spend time with, watching customers use the product firsthand. Because what they maybe report on, or are trying to do a study about, might be very different from what you observe, but you really just need that front row seat with customers. And so asking for how, "How do I actually set up time with customers? How do I compensate them? How do I, like, read the tickets?" Whatever. It's amazing how little you have to do to quickly catch up to understanding who the organization is solving for well and poorly, and like how people really use your product, versus how your teams use your product, especially in organizations where there are heavy dogfooding cultures. It's really risky to become less sensitive to the needs and behaviors of customers because people think they are their customer. And it also becomes very navel-gazy. (laughs) So, I think the more you get out and break, break up how people are having conversations about what we should do and why, and what we shouldn't do and why, and it's not about your opinion, it's about asking questions and then bringing insight, can really, uh, change the nature of the conversation

10. 26:17 – 29:03

    How to exude confidence

    1. PCPaige Costello26:17

       and build trust.

    2. LRLenny Rachitsky26:18

       I love that. In terms of confidence, you talked about the importance of communicating these things confidently. Is there anything you've learned about how to be more confident? Uh, you know, management, part of it is like having the answer, but is there anything there that you maybe coach your PMs around, or other folks of just like, "Here's how you communicate confidence."

    3. PCPaige Costello26:36

       It's a great question. I think being, being brave and courageous in little moments is just-

    4. LRLenny Rachitsky26:44

       Mm.

    5. PCPaige Costello26:44

       ... just kind of what you have to do. You have to show up and say it before you're ready to say it, and ask for forgiveness, and be vulnerable. And I think when you're vulnerable, people actually trust you more than if you come with all of this, um, armor, (laughs) and say, "I know this and this is how we're gonna do it." And so, real confidence is often conveyed by being willing to ask the question, or to say, "I don't know what you mean by that. Can you say that again?" It's also just how you communicate looking people in the eye, your body position, your body language. So much of this, I think, people forget about, because it's really easy to be in a meeting, and looking at your computer, and going through Slack messages. And so one of the best things you can do is, if you're in a meeting, be in that meeting. Continually scan the faces of everyone in the room, see if someone has a question, pause at the beginning and welcome people and chitchat (laughs) while people land, and then c- close asking questions like, "Did I get all of that? Is there anything you would've expected to cover that we missed?" Um, it's really about being open, and that conveys confidence more than being assertive and advocating 100% of the time.

    6. LRLenny Rachitsky28:03

       (music) This episode is brought to you by Round. Round is the private network built by tech leaders for tech leaders. Round combines the best of coaching, learning, and authentic relationships, to help you identify where you want to go and accelerate your path to get there, which is why their wait list tops thousands of tech execs. Round is on a mission to shape the future of technology and its impact on society. Leading in tech is uniquely challenging, and doing it well is easiest when surrounded by leaders who understand your day-to-day experiences. When we're meeting and building relationships with the right people, we're more likely to learn, find new opportunities, be dynamic in our thinking, and achieve our goals. Building and managing your network doesn't have to feel like networking. Join Round to surround yourself with leaders from tech's most innovative companies. Build relationships, be inspired, take action. Visit round.tech/apply and use promo code Lenny to skip the wait list. That's round.tech/apply.

11. 29:03 – 33:43

    The 3Es framework

    1. LRLenny Rachitsky29:03

       From my chats with folks that you work with, it's really clear that you put a lot of time and energy into mentoring and coaching PMs on your team, and I think probably broadly at Asana, and one thing specifically that came up is that you're very big on leading and teaching by example, not just here's how you do this thing. And so if that's true, I'm curious where that came from for you and why you think that ends up being a lot more successful than like, "In a meeting you should do X, Y, Z," versus like what, doing it and then letting them see.

    2. PCPaige Costello29:34

       I think the main thing is repetition. Uh, we're all students of repetition. If you see something done a few times, you're more likely to remember it and internalize it. And so it's, it's also something that, uh, a way that I learn, and so I think that's probably part of it. But I, I remember hearing about a, a framework called the three Es: experience, exposure, and education. And I think it was helpful for me to hear that as like a way of growing your career or being more purposeful about your growth. Because-I think when people are earlier in their careers, they tend to think education, education, education. And then they start to think experience, experience. Like, "How do I get the experience of being a manager? I need to, like, read about it and then be a manager." (laughs) It's very linear. And exposure was such an important one, where I, I thought like, okay, so you're not in the driver's seat, but you're in the car and you hear (laughs) what's happening and you're evaluating how this is, like, what the impact is. And this goes back to being really present and analytical and being a learner. Because if, if you can be a learner not just in an education or experience context, but in an exposure context, you can really grow so much more quickly and in so many more directions than you will get from just, you know, what does your day entail from a what work is directly required of you.

    3. LRLenny Rachitsky31:08

       Is there an example of that happening either to you or you saw a manager or leader do this and you're like, "Oh, I get it now," or you doing that and it helped?

    4. PCPaige Costello31:18

       So I'll give two examples. One is, like, the way I run my meetings are the kind of meetings I want to be a part of. (laughs) So, um, I try to make sure that I start with a clear agenda and I move quickly but give time for conversation, and that it's not fully just sharing information but debating where appropriate. I think knowing how to, like, manage the conversation and courteously pausing people who are going on too long, um, or, like, taking the group in a different direction than was intended, and just think about (laughs) the experience of everyone there. And create the experience that you hope that they're creating in the rooms that you're not a part of. An example that I have in terms of experience is, like, sometimes the experience is you doing the thing and getting that experience firsthand. Other times, you, you need an education, you need a mentor, you need a coach who will tell you what they're seeing or give you advice. I was in a really high stakes product review at Intuit and at the end of it, everyone else had left and our, like, the, the leader of the business unit as she was leaving the room said, "Always ask." Or, "Always answer the question that they should have asked." (laughs) And, "Always answer the question they should have asked." And I was pretty surprised by that advice because it was very profound in the moment, because I think when you're a student and you are accustomed that if you're an achiever, (laughs) you like to get As, you're probably going to hear a question and answer it. You're like, "One-to-one, one-to-one, one-to-one." But what I learned from that was that there's actually another altitude, another point of strategy when you're in a meeting or in a conversation to make sure that you're covering the more important point, (laughs) the, the bigger picture, the, the alternative that the person asking the question maybe didn't see or consider. And so, I think the mix of experience, exposure, and education really helps you make sure that you're consciously moving forward on each of those fronts or finding people who can help you there.

12. 33:43 – 38:43

    Advice for early-career PMs

    1. PCPaige Costello33:43

    2. LRLenny Rachitsky33:43

       I love that piece of advice and it makes me want to ask, are there other pieces of advice that have been really impactful to you? Or are there common pieces of advice you give to your team that just, like, is a, you know, recurring theme of advice that maybe people even make fun of like, "Oh, Paige is always saying this."

    3. PCPaige Costello33:59

       There are a few ways to think about advice, and my advice often, like, meets a mark when it's for a particular person at a particular time in their career.

    4. LRLenny Rachitsky34:09

       Mm-hmm.

    5. PCPaige Costello34:09

       And so I would say advice I love giving to people who are early in their career is, "Don't self-select," because I think it's really easy to say, "I don't have the experience," or, "I'm not X, Y, Z enough," and not apply. And so I really push people not to self-select and I try to remind myself where that's appropriate to do the same thing. Other advice I often give is just, "Think big, ship small." (laughs) "Think big, ship small." Like, what's, what's the smallest thing you can do to do that thing? But let's not, because we're trying to ship all the time and in small chunks, start thinking in small ways. Because it's really easy to get a little too incremental, a little too wrapped around the axle around optimizing a metric and miss the bigger picture. And so, "Think big, ship small," uh, is another piece of product advice I give. And the last piece of advice that I would say that I, I like is more of a way of thinking. (laughs) So this is a little, little abstract. But when cut, uh, when employees join Asana, they get a book called The 15 Commitments of a Conscious Leader. It's led by the conscious leadership group. They also get two-day training on some, like, language and tools for how to effectively work with other people. (laughs) And it's a really tran- like, for me at least, it was transformational because I learned some vocabulary and methods that I could share with my, my peers. And one of the things that you learn is to be above or below the line, and, and something that is, is this concept of like, where are you? Are you above the line? Are you below the line? If you're above the line, you're committed to learning. You're open and curious. Things are funny here, um, more playful. If you're below the line, you're committed to winning. You're committed to being right. Things are more black and white. And all of us have days where we're having a conversation and we're really, like, in that below line space where it's like, "No, it just is this way. There's no two ways around it."And that concept of understanding your head- your personal head space and then, uh, being mindful of how you're operating when you're in that place really was great advice for me. And also recognizing where other people were when it related to decisions we were making or a context. It also helped me think about, like, rejecting false trade-offs and challenging, like... Effectively, there's this notion of how might the opposite be true and that's, that's a piece of advice that I give myself. Like this morning, I think it was yesterday actually, I was like, "How am I going to do tomorrow?" Like, tomorrow I have to deliver the clarity pillar brief to the area leads and make sure they understand our stack ranked metrics and they need to know exactly what our strategic priorities are and why. And they need nudges and they need to be able to translate our voice of business and usability list into those plans. And I need to establish a perspective and make sure this is all written down and they really understand it and I have a great conversation with them where I get open questions and they feel like they can really challenge my thinking. I also am having a podcast with Lenny in the afternoon. Ah. (laughs) Right? And at first it was like, "I can't. I... This is just too much." Like, "I should, like, try to move or cancel one of these." And then I asked myself, "How might the opposite be true?" And I was like, "I can do both." (laughs) Like, like, it was just enough to pop the balloon because sometimes your brain is so accustomed to having a scarcity mindset as opposed to, like, creating alternative options or seeing a different path. And the moment I challenged myself and said, "How might the opposite be true?" my shoulders dropped. (laughs) I felt more relaxed. I was like, "Oh. Yeah, I can do both. It'll be fine. We'll have a great conversation." I- I, you know, ready to show up and be curious and like really engage with you on the topics that you've found interesting and we'll just do that. And so, how might the opposite be true has been a really helpful piece of advice or line of questioning that I use with myself to make sure that I'm not taking myself away.

13. 38:43 – 40:05

    Paige’s latest pillars strategy

    1. LRLenny Rachitsky38:43

       Wow. What a fruitful question that ended up being. That was amazing. How'd this clarity pillars strategy go? Are people into it? Is it working?

    2. PCPaige Costello38:52

       Yeah. I'm pumped. Um, it's a really interesting time to be a product leader. (laughs) Um, especially with all of the tech transform. Like, truly, the technological transformation on LLMs is astonishing. The pace of development, the ability of our teams to just ship quickly and ship really intelligent things. Like, we're not in an operational figure-it-out land. We're not in a place where we're trying to decide how to do a better job and get it out to customers. We really have lots of interesting paths forward and are trying to make sure that we're on the cutting edge while really looking at, like, what does it mean to serve the companies and organizations that we want to serve, uh, with new ways of serving them. And so, it was a really fun conversation and I also had to be honest with people and say, "This is a 70% cut. 30% of this is missing or incorrect and that's why I'm coming to you early." (laughs) And so I think it went really well and it's a, it's a, it's the start of our, our, our 12-month rolling planning conversation.

    3. LRLenny Rachitsky40:04

       Hmm.

14. 40:05 – 41:50

    AI at Asana

    1. LRLenny Rachitsky40:05

       Let me pull on this AI thread, 'cause it's, uh, clearly top of mind for a lot of people.

    2. PCPaige Costello40:08

       Yeah.

    3. LRLenny Rachitsky40:09

       How do you think about splitting up investment in AI exploration within the product team? Are you like, "Hey, team. Everyone should be thinking about AI as part of their product." Or is it, "Here's a team. Or they're going to think about AI and LLM integrations and everyone else keep doing what you're doing"?

    4. PCPaige Costello40:24

       We've had an ML team for quite some time-

    5. LRLenny Rachitsky40:27

       Mm-hmm.

    6. PCPaige Costello40:27

       ... making sure that we have, like, test prioritization models and, like, and notification prioritization models and are making our product less work for people to use. But when it came to the massive leap forward in LLMs recently, we staffed a, a team to really prototype quickly and discover what was possible and just apply hypotheses outside of the typical norms of how we work. So, they kind of went straight to prototyping instead of going through that double diamond I was explaining earlier. What that meant was that we were really quickly able to say, "Wow, this is so much better than we imagined and would never have prioritized it because we thought it would take so much longer." And then in other cases, that sounded good in theory. (laughs) And so skipping a lot of that to just really try it on for size has been key. And then what we're doing is giving the teams with the most expertise in the customer problems, for example, status and progress reporting, the keys to that car and saying like, "Here's the starter. Here's the hypothesis. Here's how far we got with it. It's dogfooding. What do you want to do?" (laughs) Um, and so we're able to, like, nudge people without wasting time and build the skills locally within the teams that then move those experiences forward.

15. 41:50 – 45:53

    Lessons from Paige’s time at Intuit

    1. PCPaige Costello41:50

    2. LRLenny Rachitsky41:50

       I want to come back to the coaching topic. I had a few questions there that I moved off of, but I feel like that's a rich, rich area of exploration. You mentioned Intuit. You worked at Intuit. Intuit is kind of famous for having a really good APM program and really good training for product managers. What did you take away from that experience that you bring with you to coaching or even... I think there's an APM program at Asana too.

    3. PCPaige Costello42:15

       Intuit had excellent training programs.

    4. LRLenny Rachitsky42:17

       Mm-hmm.

    5. PCPaige Costello42:18

       The APM program and their manager training. So, on the PM front, the biggest thing that they taught was around customer centricity and it really started with the founding of the company. (laughs) Like if... For anyone who works at Intuit or has worked at Intuit, they know that there's the story about Scott Cook watching his wife-... balancing her checkbook at the kitchen table and staring at it saying, "There's gotta be a better way software." (laughs) Um, so it was very typical for the product training at- into it to be all about like how do you spend in, like, how do you actually watch customers using your product or just doing the things they do? Collecting the artifacts, knowing the workarounds, and using that experience to build opportunities for surprise and insight that then you can capitalize and create products around. They also are very specific about how they define a durable advantage and think about overall like the- the product process from a place of customer insight through to, like, the market landscape. So, the PM program there was absolutely super thoughtful, especially for taking someone who has never PM'd, uh, into being a super skilled PM. They also have a wonderful manager training program, and I think the biggest thing that I took away from their manager training was really on the feedback side. (laughs) So, delivering feedback is something that I think everyone benefits from, but for managers it's so much more critical because if you don't do it, and you don't say what you mean, and you don't do it in a way that it can be, uh, internalized and acted upon, you really don't set up your- your teammates, your teams for growth or success in their careers. And so they're- they're programmed for helping you think about like, "Okay. I'm gonna convey this feedback as situation, behavior, impact." Like the situation is like on Tuesday, in that meeting at 3:00, behavior, uh, you interrupted me while I was saying this thing. The impact made me feel like you weren't listening to me. Or made me feel like your voice was more important than mine. Or impact blah, blah, blah. It doesn't matter what the impact is because the way you've set it up is it's a subjective observation. It's not what the camera recorded, it's what you experienced and therefore it is true and valuable feedback. And it gets the conversation started such that you can then talk about next steps. And that format and framing really helped me understand that delivering feedback isn't about being right or about getting the right information to the other person, it's about sharing the impact of different decisions that they're making. So, especially if you have to give feedback about, God forbid, what someone wears to the office (laughs) or, you know, how detailed their work is or how they're communicating, or their body language. Having enough support where you can be really clear about what you're intending and the spirit behind that but, but it's formalized enough that people can really engage with it has been enormously helpful and I still use it today.

    6. LRLenny Rachitsky45:36

       It's interesting how some of the most impactful training is like such soft skills.

    7. PCPaige Costello45:41

       So basic. (laughs)

    8. LRLenny Rachitsky45:42

       And, and basic, yeah-

    9. PCPaige Costello45:43

       Yeah.

    10. LRLenny Rachitsky45:43

        ... it's just like how to give someone some feedback but it's like, not like how to prioritize, how to do a meeting-

    11. PCPaige Costello45:49

        Yeah. Oh, yeah.

    12. LRLenny Rachitsky45:49

        ... or how to give a presentation. It's like here's how you give feedback to someone.

    13. PCPaige Costello45:52

        Yep.

16. 45:53 – 48:55

    Challenges new PMs face

    1. PCPaige Costello45:53

    2. LRLenny Rachitsky45:53

       So you've worked with a lot of early product managers. I'm curious what you find most holds back new PMs in being successful in their career. And even on the flip side, what most helps new PMs be successful in terms of skills or behaviors, habits, things like that?

    3. PCPaige Costello46:11

       I would say this illusion that you have to be all knowing and super confident sets you up to be in a place of advocacy instead of inquiry. And so PMs who are newer in their careers or who are like in a different space than they're accustomed to working really wanna be pro really fast. And what pro means is trying to cut that straight path. And that can reduce information and conversation that makes you smarter. And so some of the challenges that some PMs f- face are feeling like they need to be the expert, they need to be the smartest person in the room, or God forbid they think they're the smartest person in the room. And then what happens is they're really doing that customer or product discovery or a spec in a little dark room. (laughs) And then they show up and they say, "This is it. This is right, and I know what's right. And let's do this as quickly as possible." And everyone else says, "Wait, what?" Like, "I don't know." Like, "I have a question." Or they don't and they still have a question which is even worse. So I would say something that really holds PMs back is not being, uh, collaborative from a place of, like, true curiosity. Like performative collaboration where they like nod in a room or wanna do a review but ultimately they don't really want the questions or the feedback. And I think trying to make sure that you can be in a place of curiosity and openness because that will make your experience more successful is really important. Other people aren't always gonna be right but if you're present for it, you can ask clarifying questions. You can ask the question behind the question. You can hear the feedback and then say, "Was that something that you, that I must do, that I should do or that I should consider?" You can actually develop a conversation that will move your relationship forward and so I would say that's- that's something that I think holds PMs back. PMs tend to be so ambitious (laughs) and career centric and there are so many good things about that but I would say like don't let the sound of your wheels drive you crazy. If you're present in your job and you actually have fun with it and solve the problems, people will come out of the woodwork, say you're great and tell your boss you should be promoted. You don't need to ask for a promotion. Your outcomes should speak for themselves and yes, you should have sponsors and people who advocate for you, but a lot of that just comes from that like raw connection to the work and to your team.

17. 48:55 – 52:39

    Challenges Paige has faced in her career

    1. LRLenny Rachitsky48:55

       Everyone I talked to about you was like, "Oh my God, I love Paige." And I could see why. But I wanna ask you a question. I imagine you've made some mistakes, either with a product or your career. I'd love to hear a story of something that went wrong and what you learned from that experience. And this might be the last question, depending on where, where you take it.

    2. PCPaige Costello49:15

       I would say that all of the advice I've given so far is directly related to things I've learned the hard way. So like, especially as an IC moving into a management role, you aren't supposed to have all the answers. You need to ask better questions. You need to be thoughtful about, like, direction and agency. And so, I would say one of the, the missteps here is, like, knowing how to give guidance or direction in a way that doesn't feel like micromanagement, because what you're trying to do is to teach a repeatable pattern instead of giving a precise instruction that can be used once and then disposed of. So I think that's a, that's a pretty common manager path issue, but I think the faster you learn it and observe it and use techniques to manage it, the better. So for example, I would go to my meetings with a stack of Post-its and I would write what I wish I was saying on Post-its (laughs) and see if someone else would say it first, and then if by the end of the meeting I had decided that I still had a Post-it or two that was worthwhile, I would say them. But you've gotta police yourself because no one else will do it because no matter how, uh, accessible you think you are, other people know that you're the boss (laughs) . They're not gonna necessarily, um, speak over you or challenge you directly. Another challenge I had is I'm a very optimistic person, and I like to look on the bright side. I'm very positive, and I think depending on the culture you're working with or depending on your team, sometimes they need to hear what's really bad, and they need you to be really real, and they need you to tell them like it is. And something I realized was that I had an experience where I didn't realize that people didn't think I was being authentic because they thought something was bad and I wasn't talking about it. But it wasn't because I didn't think it was bad or didn't see it. It was just because my nature was to say, "Well, I'm not gonna talk about bad things because we're doing the things we need to do." Like, as long as the plan is good (laughs) , I wasn't really highlighting all the problems I saw or, or enc- like, really pushing on those head-on with my team. And so they felt like they didn't know what I was seeing or if we were seeing the same things. That was really an interesting experience. Um, yeah, there are just so many (laughs) . Yeah.

    3. LRLenny Rachitsky51:49

       With that second lesson, is there something you've changed in the way you lead and operate where you now found a way to communicate, "Here's what's wrong," in a way that's still maybe optimistic and productive?

    4. PCPaige Costello52:00

       I try to be more real with myself and others. I try to show up and say like, "Hey (laughs) , this is incomplete." Like, for example, even the thing I did this morning, the, the clarity brief, I said, "This is 70% finished. The 30% that I don't believe is there yet are these three things. I don't feel confident in this piece of it, and hopefully we'll have more clarity by next week." So that's an example of just being as real with the small things as with the big things so that people can balance their perspective of you and your work and the organization and the environment you're

18. 52:39 – 55:43

    Paige’s skill-focused career philosophy

    1. PCPaige Costello52:39

       creating.

    2. LRLenny Rachitsky52:40

       I'm curious how you think about your career going forward. How far out do you think where you wanna be and how do you kind of plan out the future of Paige's career?

    3. PCPaige Costello52:50

       I try to be really intentional about staying as much as leaving a role. And when I think about my career as a whole, I try to think about, like, skills or experiences I wanna have as opposed to roles or companies or specific problems. So something that I think about is, like, effectively, I evaluate whether I'm in a healthy role and in a good setup by asking myself about my learning curve. Like, is it, is the, is the steepness of my learning curve doing me a favor here? Because sometimes you might love the organization, love the problem and feel like you're just not learning or learning fast enough or being challenged. And that's something that I, I think is really important, so like, thinking about the learning curve, thinking about whether the environment is positively impacting your ability to grow your career and make an impact. And so environmentally, you might have, like, not enough staffing or tooling or have someone in the management team who is toxic or have a peer who is blah, blah, blah, blah, blah. Like, that stuff matters, and I think people don't talk about it or take it seriously enough that your environment should include people who are advocating for you, and it should just be a place where you feel like you've got the right ingredients to set you up to do the good work. And then the third piece is really around just the problem (laughs) , the problem your product is solving. Is it fun? Is it interesting? I often like to think about, like, passions are made, not found, because I think people... Kind of we do this with nine-year-olds. We say, "What do you wanna be when you grow up?" (laughs) They look cross-eyed and they say, "An astronaut. Just getting a vet. I don't know." And there's this moment of, like, panic. And I would say that, that being comfortable saying, like-... go try different things and see if the problem is interesting to you. And if the problem is fun or interesting to you, it doesn't mean it has to be sexy, it doesn't mean the company needs to have a brand name, it just has to be something that you're curious about so that you do a better job at your job. So, I would say learning curve, environment, and problem are things that I use to assess like, am I still on the right path or should I consider an alternative? But when I think about my own career, I really think about skills and experiences as opposed to-

    4. LRLenny Rachitsky55:29

       Mm-hmm.

    5. PCPaige Costello55:29

       ... roles (laughs) . So, I would say that that's more my frame of reference, because otherwise I think I'm living in the future and not enough trying to make the most about, out of the career I'm living

19. 55:43 – 1:03:20

    Lightning round

    1. PCPaige Costello55:43

       right now.

    2. LRLenny Rachitsky55:44

       Well, with that we've reached our very exciting lightning round. I've got six questions for you. Are you ready?

    3. PCPaige Costello55:49

       Yeah. Let's do it.

    4. LRLenny Rachitsky55:51

       What are two or three books that you've recommended most to other people?

    5. PCPaige Costello55:54

       My go-to book recommendation for other PMs is Inspired by Marty Kaga- Kagan. I think it's a classic. The other books that I en- have enjoyed and recommended lately are The Blind Assassin by Margaret Atwood, and The Alchemist by Paulo Coelho.

    6. LRLenny Rachitsky56:11

       What is a favorite recent movie or TV show?

    7. PCPaige Costello56:14

       Ooh. I'm very much enjoying The Diplomat right now. And then TV show or, uh, movie, let's see. I just watched the Fire of Love documentary, which is about a couple who study volcanoes, and that was a great change of pace.

    8. LRLenny Rachitsky56:32

       I saw the trailer for that, I think I gotta watch that. And I finished The Diplomat, and it's awesome. It ends really well.

    9. PCPaige Costello56:37

       I'm not ... Don't, don't spoil it.

    10. LRLenny Rachitsky56:39

        But it's just good. I'm just saying it's good. That's not gonna spoil anything.

    11. PCPaige Costello56:42

        Okay (laughs) .

    12. LRLenny Rachitsky56:43

        (laughs) Okay, next question. What's a favorite interview question that you like to ask candidates?

    13. PCPaige Costello56:49

        The good news is I can tell you this and still keep asking it (laughs) .

    14. LRLenny Rachitsky56:53

        Do it.

    15. PCPaige Costello56:53

        Because the answers always come up differently. Um, so I like to ask, "Tell me about a time something went wrong. What was it? What did you do about it?" Yada yada. And effectively the question gets at when, when the product failed, when something about the team didn't work, just things that go wrong because that's what happens when you're doing this work. And evaluating people's mindset and the way they talk about it and the way they relate to evaluating the situation. I think it's a great question. Really tells you a lot about how people think and how they perceive themselves when things are not working well.

    16. LRLenny Rachitsky57:34

        What is a favorite product that you've recently discovered that you love?

    17. PCPaige Costello57:37

        I've been playing a lot with poe.com lately (laughs) . Yeah. Uh, just an opportunity to learn more about LLM, uh, capabilities, uh, in a firsthand way. It's been fun to create little bots. I'm playing with making a page bot (laughs) . Uh, I, I can't say that the page bot could have had this conversation yet, but maybe next year at this time you can have a conversation with the other me. Uh... (laughs)

    18. LRLenny Rachitsky58:07

        That's what the page bot would say if this was the page bot talking right now.

    19. PCPaige Costello58:10

        I would say though that, um, the advice bits and bobs I gave you earlier are, are absolutely things that I've been thinking about feeding. But I think I, the page bot would probably say ship it.

    20. LRLenny Rachitsky58:23

        Mm. Uh, the, and Poe just, it's the, uh, Quora founders' LLM chatbot.

    21. PCPaige Costello58:29

        Yeah. And so you can try the different models. So you can do 4 and 3.5 and, um, Claude and a few others. Yeah.

    22. LRLenny Rachitsky58:38

        There's also a lennybot.com for folks that haven't seen this, somebody built. Actually there's a whole post on my newsletter of how, how it was built and you go to lennybot.com and it is trained on all of my newsletter posts and I think, not yet podcasts, but someday it'll have podcasts.

    23. PCPaige Costello58:55

        Ooh.

    24. LRLenny Rachitsky58:55

        By the way, if someone's listening to this, we're looking for someone to maintain this bot and evolve it. So if you're really into this stuff and have done this sort of thing, please DM me on Twitter. I am looking for someone to take over lennybot.com, make it more awesome. Moving on, enough about me. Next question. What is something relatively minor that you've changed in your product development process that has had a big impact on your team's ability to execute?

    25. PCPaige Costello59:18

        One of the biggest ones is just being, once again, being real about how many reviews and approvals it takes for something to get done, and who's actually responsible for reviewing and approving work. So we got really aggressive about functionally who was in charge and at what level for a given review and pushed to say, like, to actually have limits on the number of people per meeting, on the, uh, the number of sub-task reviews for a given, uh, body of work. And what this did is it created a lot more, uh, agency and, and pace within a g- given working teams. And so what we did was we said, "We actually don't care. We don't want a daisy chain of approvals. (laughs) We just want one person with whom the buck can stop with them and they can be responsible for how the work moves forward such that like the knowledge is known and we could have connected do- dots more effectively than we do or did." Uh, so that's kind of the logic there and it's really changed the pace and quality of our work.

    26. LRLenny Rachitsky1:00:25

        I love that. Is there any more you could share on the number? Like what is the min- maximum? Is there anything there that people maybe can take back to their company?

    27. PCPaige Costello1:00:31

        Yeah. So no more than three reviews on a given piece of work where people are blocking one approver. And, um, mm, if a meeting has te- more than 10 people on it, we ask the person hosting the meeting to kick out the other people and write better decision notes.

    28. LRLenny Rachitsky1:00:49

        And the three reviews is three meetings looking at the product as it's coming together basically?

    29. PCPaige Costello1:00:54

        The three reviews are, um, three people who are assigned a task to look at something.

    30. LRLenny Rachitsky1:00:59

        Mm.

Episode duration: 1:03:20