Lenny's PodcastBrian Balfour: Why ChatGPT is the next big growth channel
How conditions, moat, opening, and closing form the four-step cycle; Facebook, Google, iOS, and LinkedIn all prove why opting out is the losing bet.
EVERY SPOKEN WORD
160 min read · 31,577 words- 0:00 – 4:13
Welcome back, Brian!
- LRLenny Rachitsky
Everyone's always complaining, SEO's dead, it can't grow, word of mouth is so hard.
- BBBrian Balfour
All of the ingredients for a new distribution platform are essentially happening. My prediction, the new distribution platform will be ChatGBT. There's a bunch of signals that they're about to launch that.
- LRLenny Rachitsky
This is a huge opportunity for companies to get on it.
- BBBrian Balfour
It ends up being a prisoner's dilemma. Don't trick yourself into thinking that you can't play the game. The cycles seem to be getting shorter and shorter, so you actually have a smaller amount of time. If you don't do it, your competitors are gonna go to the new platform, and your customer expectations change. There is no opting out of the game.
- LRLenny Rachitsky
This is the opportunity to disrupt an incumbent.
- BBBrian Balfour
If you're a late stage company, you place multiple bets. For startups, it's a totally different ballgame. You have to choose one and go all in.
- LRLenny Rachitsky
Think about companies like Zynga that grew on Facebook and then became massive companies.
- BBBrian Balfour
Building a great product is one of those things that's necessary but not sufficient, and actually the separation is between those that build really great distribution.
- LRLenny Rachitsky
What would be the backup, if not ChatGBT?
- BBBrian Balfour
My hypothesis of who's best positioned would actually be... (music)
- LRLenny Rachitsky
Today my guest is Bryan Balfour. Bryan is the founder and CEO of Reforge, a company that I've been a longtime fan and advocate of. Historically, Reforge is focused primarily on teaching courses on product and growth. But more recently, they've transitioned to building their own products, including a product called Reforge Insights and a bunch more really cool stuff coming very soon. Prior to Reforge, Bryan led growth at HubSpot. And over the course of his career, he has seen the rise and fall of every major distribution channel, including Facebook's ad platform, Google Ads and SEO, and the Apple App Store. Based on what he's seeing, he is predicting the emergence of a brand new and powerful distribution channel that will likely arise in the next six months, centered most likely around ChatGBT. It is really rare for a new growth channel to open up. It's been a long time since the last one appeared, and the people who recognize this and hop on it early are the ones that reap the most rewards. So this is a huge deal. In this conversation, Bryan shares what he's predicting, what he's seeing, why this is a big deal, and what you should be doing about it right now. I highly recommend you listen to this full conversation and discuss the ramifications with your team. If you enjoy this podcast, don't forget to subscribe and follow it in your favorite podcasting app or YouTube. Also, if you become an annual subscriber of my newsletter, you get a bunch of incredible products for free for one year, including Lovable, Replic, Bolt, n8n, Linear, Superhuman, Descript, Whisperflow, Gamma, Perplexity, Warp, Granola, Magic Patterns, Raycast, ChatBRD, and Mobbin. Check it out at lennysnewsletter.com and click Product Pass. With that, I bring you Bryan Balfour. Today's episode is brought to you by DX, the developer intelligence platform designed by leading researchers. To thrive in the AI era, organizations need to adapt quickly, but many organization leaders struggle to answer pressing questions like which tools are working? How are they being used? What's actually driving value? DX provides the data and insights that leaders need to navigate this shift. With DX, companies like Dropbox, Booking.com, Adyen, and Intercom get a deep understanding of how AI is providing value to their developers and what impact AI is having on engineering productivity. To learn more, visit DX's website at getdx.com/lenny. That's getdx.com/lenny. This episode is brought to you by Basecamp. Basecamp is the famously straightforward project management system from 37signals. Most project management systems are either inadequate or frustratingly complex. But Basecamp is refreshingly clear. It's simple to get started, easy to organize, and Basecamp's visual tools help you see exactly what everyone is working on and how all work is progressing. Keep all your files and conversations about projects directly connected to the projects themselves so that you always know where stuff is and you're not constantly switching contexts. Running a business is hard. Managing your projects should be easy. I've been a longtime fan of what 37Signals has been up to, and I'm really excited to be sharing this with you. Sign up for a free account at basecamp.com/lenny. Get somewhere with Basecamp. (music) Bryan, thank you so much for being here, and welcome back to the podcast.
- BBBrian Balfour
Yeah, thanks for having me. Excited for this one.
- LRLenny Rachitsky
I'm really excited to have you
- 4:13 – 5:09
The changing landscape of product growth
- LRLenny Rachitsky
back. Uh, we're just gonna dive right in. Essentially, you've uncovered a, a really important trend, uh, or insight about how products are gonna grow differently in the future, how growth is changing, and this is something that I think a lot of people need to hear, so I asked you to come on to share what you're seeing. Uh, I also think this is just very timely. Uh, uh, I think you said, like, in, you're gonna say in the next like six months things might significantly change. So I'm really excited to do this. We're gonna spend this whole conversation on this, on this insight. To set us up, what is just the big idea? What's the high level idea here?
- BBBrian Balfour
Just like you, I've spent my whole career just like really passionate about startups, you know, figuring out how to build products that win, that emerge in new markets, and, uh, one of the things that I have, you know, learned over time, or one of the things you hear a lot is, from a lot of folks is, uh, to win you have to, like, really build a great product. A lot of the advice kind of boils down to that.
- 5:09 – 8:14
The importance of distribution
- BBBrian Balfour
And one of the things that I feel like I've banged my head against the wall in a lot of ways in my career is actually telling people that building a great product is one of those things that's necessary, um, but not sufficient, and actually the separation is between those that build really great distribution. And so, uh, this general partner, his name's Alex Rampell, he's, uh, at Andreessen Horowitz, actually wrote this blog post 10 years ago, um, uh, back in like 2, like 2015. In the essence of the blog post, he basically says, uh, one thing, which is that startups is a game of trying to get distribution before the incumbent can copy, right? So it's this kind of concept of escape velocity. And, and so, you know, on that, uh, note, right, which I think is, like, a very good summary of, like, what you're trying to do in a startup in distribution is that...We're right now living in this environment where that game of startups kind of getting distribution faster than the incumbent has gotten (laughs) way harder in a lot of ways and in some small cases has gotten a little bit easier. But if we think about this, the way that it's gotten harder and some of the things that probably a lot of founders or- or folks working on the growth side have probably feel is that, one is that incumbents can copy faster these days, right? So that window that you have to get that escape velocity has actually shrunk. It's, uh, it's decreased. The second thing is that the... a lot of the organic distribution that we've had, especially over the past few years, has really shrunk as well. So everybody's talking about the decline of SEO and, you know, clicks declining, but you also see it in some other cases, right? A lot of these social platforms don't really let you send as much traffic to sites. You know, LinkedIn just changed their algorithm, which has really dropped organic distribution. Obviously, the- the Twitter to X transition, that happened, right? Like, TikTok's almost always been like that. And then the third way that it's gotten harder is that AI is really good at writing software, right? And code generation. And so everybody's kind of feeling this infinite increase of competition, especially at the startup level. And, you know, YC's pumping out six of the same thing every single cohort, right? (laughs) Like that's what- that's what it literally feels like. So it's gotten way harder. This game, this escape velocity game has gotten a lot harder. It's gotten easier in some very exceptional cases, like a Cursor or something, where AI's kind of been like the spark. You know? I know you wrote, uh, the blog post about the race car engine, and I think you said, like, uh, there's like the spark plug in the engine, right? And- and so AI kind of really created that, uh, a- a new type of spark, a new type of interest of early adopters to- to- to fuel some- some new players in a short period of time, right? And so it's amazing to see something like Cursor overtake market share of something like GitHub Copilot in nine months or less, right? Like that- that's how fast it happened. It's kind of crazy. But the main thing that people need to understand is, okay, well if that's the game I'm playing, right? How to get to escape velocity before the incumbent? Like what are all the ways to do that and, um, and to really figure that out. And there's multiple ways that this can
- 8:14 – 9:45
The role of new distribution platforms
- BBBrian Balfour
happen. But one of the major ways, one of the major, major ways that we always see is that, uh, this can happen when new distribution platforms emerge. Um, and 'cause when new distribution platforms emerge, startups are usually the fastest to take advantage of them. It's slower for the incumbents to move. It gives startups this opportunity essentially to play this game. So Casey Winters wrote this blog post about two years ago, um, maybe like 18 months ago, about, uh, the AI technology shift. And his key point was the AI technology shift has been a technology shift that has not come with a distribution shift yet. So if you look historically, we've had a bunch of technology shifts from, you know, uh, the t- internet to the cloud to mobile to social, like all of these different types of things. And some of them come with distribution, new distribution platforms, new ways to dis- distribute products and some of them don't. But the most powe- powerful ones, the most impactful ones are the ones that, um, do come with these new distribution platforms. And so, uh, his second key point was that these two things don't actually happen at once. Usually you get the technology shift, then you get the distribution shift a little bit later. So now we're a couple years from that post. We are a couple years into AI technology shift, and one of the things that I am seeing is all of the conditions, all of the ingredients for a new distribution platform to emerge are essentially happening. And so I think we're at an inflection point where we're going to see this emerge really fast.
- 9:45 – 17:38
The four-step cycle of distribution platforms
- BBBrian Balfour
And the key thing for everybody to know is that as new distribution platforms emerge, they follow the same four-step cycle, and it's kind of a game that you're playing, that everybody's playing. And so just like any game, you kind of need to know the rules of the game. You need to know the steps of the game in order to have any sort of opportunity to win. And that's kind of like the- the- the thing that, uh, that- that I've lived through once again, both painfully and, um, also in good ways, and it's something that I'm keeping my eye on and something that I've been talking about. So before we go into that, you know, four-step cycle, I figured I'll- I'll pause there to see if you- you have any follow-up questions on that.
- LRLenny Rachitsky
Okay. This is amazing. So essentially what you're saying is we've all these ways to grow. There's li- uh, SEO. There's paid growth. There's sales. All these, uh, channels have been around for a long time. They're extremely saturated. Everyone's always complaining SEO is dead. It can't grow with SEO anymore. It can't grow... Word of mouth is so hard. There's so many amazing things now. That's hard. Uh, paid is so hard. It's just, uh, like all this money just-
- BBBrian Balfour
Yeah, packs are rising. Yeah.
- LRLenny Rachitsky
Exactly.
- BBBrian Balfour
All these things. Yeah.
- LRLenny Rachitsky
So all these saturated channels, and y- what you're saying is there's an emerging new channel that has not yet been saturated, and this is a huge opportunity for companies to get on it. Uh, and you'll talk about timing 'cause it's a little tricky to even know exactly when to go big on this.
- BBBrian Balfour
That's right. Yeah.
- LRLenny Rachitsky
Um, but that's a huge deal. This has been a long time (laughs) since there's a new way to grow that you can actually use as a-
- BBBrian Balfour
Yeah.
- LRLenny Rachitsky
... lever for growth and not just hope for the best.
- BBBrian Balfour
Yeah.
- LRLenny Rachitsky
Okay.
- BBBrian Balfour
That's right.
- LRLenny Rachitsky
Uh, before you get into the- the cycles, do you wanna tease what the answer is just to give people a little hint? Or do you wanna keep it secret?
- BBBrian Balfour
(laughs) Well, to be clear, right? Like, okay, so, um, my prediction, well, we don't- we don't have a clear winner yet. Um, my prediction of the new distribution platform will be ChatGPT, um, in some ways that people probably already think it's happening and some ways that it won't. Uh, but the thing that is less important or, like, that is more important than whether I have predicted the exact winner correctly, the thing that's more important is to understand the cycle and- and evaluate like how to determine where you want to place your bets and how to place those bets, which I know- which I know we'll talk about 'cause I- I'm... I could be wrong about the ChatGPT prediction and what's gonna happen there. Um, there's... I think there's gonna be two parts of it. There's going to be what they do with like a ChatGPT search experience, but I think the bigger thing will be whatever they do with launching a third-party platform on top of Cha- ChatGPT. There's a bunch of signals that, um, they're about to, uh, that they're about to launch that.I'm pretty sure it's going to be ChatGPT. The thing I'm way more sure about is that some new distribution platform will emerge and it will follow the same four-step cycle. That, that, that's kind of, that's kind of the key. So could be wrong on the first piece, I am very confident on the second piece.
- LRLenny Rachitsky
Okay, excellent foreshadowing. Uh, I completely agree. If it's anything, it would be ChatGPT at this point. Let's get into it. What are the, what are the cycles that, uh, platforms generally follow?
- BBBrian Balfour
Yeah, and I'll give some examples of this, but let me explain the four, uh, the first four step, uh, the four steps of the cycle first, and then we'll go through a bunch of examples of all, all those individual steps. So the, the four steps are essentially, one is like I call a step zero. It's, it's the, the conditions of the market have been met. Um, step one is about a moat, step two is about a platform opening, and step three is about, uh, the platform closing for control and monetization. So let me kind of briefly explain each one. Um, step zero is about the competitive market being, uh, met, uh, the conditions being met. And there's a few part piece of this. One is that typically what happens is that a, uh, there is consensus that there is going to be this new huge category, right? Think social, think mobile, like all those types of things. And in this case, right, uh, these AI like chat platforms, like a ChatGPT or a Claude. So there's consensus about that, but there's no clear winner yet. And you, you typically have somewhere between five to seven, you know, major players really battling it out, right? So, and they're all kind of looking for what is the edge, what is the thing that is gonna, that is going to, to help me win because all of these dynamics you... In, in all the history, they either end up in monopolies or duopolies, right? And so the, the stakes are really large, and so the competition is fierce. So that's kind of step zero. And I, I think we could all agree that we are in that mode (laughs) you know, right now. We've got, we've got OpenAI battling with Claude, battling with Gemini, uh, and Google with whatever Meta comes out with new, their new team, you know, so on and so forth. Like, and there's huge amounts of capital, there's consensus, like all that type, they are in a fierce competition. So that's step zero. Step one is then, um, these players, somebody essentially identifies whatever the moat is, the thing that is going to help build them defensibility and help them hit escape velocity and become that monopoly or duopoly in that, uh, single category. And once they figure out what that moat is, then they need to press the advantage, right? They need to figure out how to gather that moat as fast as humanly possible. And it tends to be that you can't do that by yourself. And so you kind of need the help of an ecosystem in order to gather more of that moat, and that typically comes down to third party content creators or app developers and other businesses. And so they all establish like a third party platform, right, that has some incentives built in. And usually the value exchange is, "Hey, you develop on top of my platform, right? You add more use cases, you know, more engagement, like all, all of these things to my platform. And in exchange, I'm gonna give you something in return." And usually that thing that's in exchange is, "I'm gonna give you some new form of distribution for your application and for your business." But what essentially happens is we go, uh, over time is that we go into step three, which is the closing period, which is at some point all of these companies end up, um, starting to lock down the platform. And this tends to happen for reasons of like monetization and growth, right? Uh, they either competitively don't want, you know, somebody to use their own, you know, platform to disrupt themselves. Like we saw that in the early Twitter days with things like Vine and Periscope, right? Like shutting those things down unceremoniously, right? Or they need to find ways to monetize at a deeper and deeper level because all these companies, like they have to grow. And, you know, Google's the classic example here of just more and more real estate has either been taken up by either ads or their own, you know, first party applications. And so that's the key is like they close it down by doing one of two, by one of a few things. They either shut it down entirely; two, they develop their own first party applications to absorb the, the highest use cases; or three, they artificially depress the organic distribution that they gave you in the step prior, uh, to push you towards paid mechanisms in order to monetize. And so I think we should go through like multiple examples here-
- LRLenny Rachitsky
Mm-hmm, mm-hmm.
- BBBrian Balfour
... but that's kind of like the core essence of, of the four steps. And so I'll po- I'll pause there.
- LRLenny Rachitsky
Awesome. So it's essentially figure out what's gonna make, create defensibility long term. What's your moat? Bring everyone in. Hey everyone, welcome to, to Facebook. Uh, everyone joins Facebook and then okay, uh, all the developers build on Facebook to bring in more people on Facebook. And then they're like, "Okay, now you gotta pay. There's a toll," and, but you love this so much and you're so hooked, all your friends are here, you may as well stick around.
- BBBrian Balfour
That's right. That's right.
- LRLenny Rachitsky
Uh, amazing. Okay. So yeah, a few examples would be great.
- 17:38 – 30:01
Examples of platform cycles
- LRLenny Rachitsky
- BBBrian Balfour
Yeah. So you, you just hit on the first one and the fir- this is the first one that I always think about because this is where I learned about this cycle very early in my career. Like my, one of my first companies, uh, was during the whole, uh, uh, the Facebook platform boom, you know, social gaming, all of those applications. And I lived the full cycle in a very short period. I lived the, the glory days and the ho- just the absolute horror days, and the, and it was very painful. But this is exactly what happened. So let's go through the four steps. So step zero, Facebook was in a brutal battle with, uh, MySpace, Friendster, um, and a few others. People forget this. People forget that there was actually like a bunch of competitors at that time. And in fact, those competitors were bigger than Facebook at the time. They had more users back in 2007 when Facebook launched, um, their third party platform. Uh, but one of the key things is that Facebook was very early to the insight about-... uh, the direct network effects in that, um, there's gonna create real lock-in that the, the more friends, the more of the global network that was on there, the more that it was just gonna feed and, and hit this escape velocity. And so at the time they launched their platform, I think they were maybe like one-fourth, one-fifth, uh, the, the size of, you know, something like Ma- MySpace or even Friendster, Orkut. Like some, these are some of the names at that time. But they opened up their third-party platform. And what was the value exchange? They went to third-party developers and they said, "Okay, we've created this canvas." Um, they used to call it the canvas. And they were like, "You can put anything in the canvas that you want; an app, a game, whatever. You can monetize in any way you want. We just want this sidebar real estate on, on the ads. That's, that's what we're really interested in." And so there was this ma- mad gold rush o- on, uh, on that Facebook. I'm sorry, the other part of that was not only will you put it there, we're gonna give you access to all of these notification channels and feed to get distribution for your application. That was, that was the other piece of it. And so you had this mad rush of developers, um, coming in and you had this huge, uh, like social application, social gaming boom. Uh, people just grew incredibly virally, uh, very fast. But eventually, essentially what happened over time is they kept peeling back that value exchange. They first were like, "Uh, actually, you know, that, those dollars that you're, you're making inside that canvas area, well, we want a percentage of that," right? (laughs) And so they changed that. And then they figured out their a- like, their ad systems and then they started peeling back. You know, they started suppressing access to all of the organic channels that they had. Eventually they went all the way towards absorbing the highest, uh, you know, use case into their own first-party platform. Things like, uh, first-party applications, things like events, photos, all those types of things, and basically shut down the platform, um, for dead. And these companies that had basically built on top of this platform, you know, uh, the other thing is by the time they started closing all those things down, all those competitors that we talked about, they were so far ahead at that point because they had built off the back of all these developers coming, adding use cases, bringing more users onto the platform. Like all, like identifying that moat. They were so far ahead it didn't matter. It didn't matter what the other, what the other folks, uh, uh, did at that point. And, and that's what kind of really gives you, uh, confidence to start closing down. But there's so many other examples of this, right? If, if we go through it, right? So-
- LRLenny Rachitsky
Just, before you get other examples-
- BBBrian Balfour
... yeah.
- LRLenny Rachitsky
... just something that I'll highlight here. One is the moat they, they identified in theory was the friend graph, I imagine. Just like once-
- BBBrian Balfour
Yeah.
- LRLenny Rachitsky
... we have all your friends, you're not gonna want to go anywhere. I imagine it's also, uh, important to note, you may not... This is kind of like a natural thing that would happen if you build the thing and it grows and you're like, "Oh, maybe we should change strategy." I imagine not everyone even knows this is what will happen and they kind of organically evolve their strategy. Or do you think everyone's just like, "This is are, gonna be our plan, step one, two, three, four"?
- BBBrian Balfour
I think a different version of that question is I think some people could sit here and interpret this as all these folks are evil (laughs) , right? And, and that's not what I'm saying, right? Like, that's actually not what I'm saying. I wanna be very, I wanna be very clear on that. Uh, because I think, you know, a lot of the, a lot... This cycle happens because of competitive and capitalistic, like, dynamics and pressures. It's, it's the same environment that enables, like, creating amazing new companies, right? Here in the US. So... And, and there's, there's like two sides of the coin. And so you go through this cycle because it's a competitive environment. You're trying to figure out how to beat competitors and this is one of the strategies to beat competitors. But at some point, like, you just have to continue growing. You still have, you have to grow those dollars. Like, uh, the, the market does not reward flat companies (laughs) if anybody's noticed. Like, you have to keep growing and so they have to keep finding ways to grow as well as prevent their own disruption, right? They, they can get so big and they can give access, so much access just of distribution to new developers. They don't want to enable, uh, their own disruption as well as, like, that they need to keep growing. And so, uh, my guess is anybody who is kind of sitting in their shoes, you know, owning their platform, is gonna follow the exact same playbook and the, and, and the exact same reasoning. And, you know, look, sometimes it happens also because it actually is the best thing for the user. Facebook's channels did get super spammy and, like, a- all of those things. And that was part of the reason. You know, they, they play this, but let's be honest, it wasn't the only reason, right? Like, a lot of it was, a lot of it for, was, was for these other reasons. And so I don't think it's evil, it's just you need to know how to play the... You just need to know how to play the game. That, that's competition. That's business. They're playing you, so you need to play them. Like that, that (laughs) that might be a little, little sadistic or something, but, but that is, that is business. That's, you're, you're in a game of competition. Yeah.
- LRLenny Rachitsky
Essentially, the incentives are pointing you in this direction. Capitalism, this is how capitalism works.
- BBBrian Balfour
Yeah.
- LRLenny Rachitsky
Um, and so it'll pull everyone in this direction even if they, they do- they want to avoid it. Let's do a couple more examples.
- BBBrian Balfour
Yeah, we'll go through them quick. You know, I, I think everybody's probably... Google's an interesting one 'cause it played out, uh, uh, over a much longer period of time. You know, Facebook happened over the course of about, mm, five-ish years. Something like that. Google kind of did it, like, very slowly over years, but, uh, same thing, right? Massive, early massive competition against Yahoo! I don't know, Alta Vista. I, like, 'cause you name them all, right? Uh, that was even before my, that, that was even before my time, right? They were first to really identify these data moats and incentivizing, um, essentially web developers, content folks to optimize, you know, for their search algorithms and to create this great, great distribution mechanism. Everybody's kind of building content and everything, you know, for them. But o- over time, slowly but surely, right, they did, uh, two things. One is more and more of that real estate, uh-... uh, became ads that they were monetizing. So, they're suppressing organic distribution in order to push people towards the ads, as well as ab- absorbing a bunch of, of the highest value first, uh, party use cases. Things like travel, you know, a- as an example. Or, um, even, like, you know, like, restaurant search and, like, all those types of things. You know, the Yelp, uh, former Yelp CEO and founder is, uh, has been, you know, been out there saying a lot of, a lot of things about, about these practices. So, sa- same exact cycle. Mobile went through the exact same cycle, right? iOS created a new distribution mechanism. They were in massive competi-... They, they had a ton of competition among different phones when they first started on. They found that defensibility was more about the apps, they added all the developers, created the, the app store, like all these types of things. But over time, we've seen more and more restrictions there on that front. And then most recently, right, like we've seen this happen in smaller places too. LinkedIn as an example, first went through this wave with company pages, right? They were like, "Ah, companies, you know, come on, promote your company page, bring in more users," like all that type of stuff. And then y- get, get all these followers. And then of course they, you get almost no distribution now through your company page, uh, because they're pushing you towards ads. And then they recently just did this with personal profiles too, which is they really boosted, um, distribution for individuals to create content for that platform. They then introduced the thought leader ad format, a way to monetize those in- those individual posts, and now you've seen them really pull back on that organic distribution. So, this happens in big forms and it happens, um, even in, in smaller use cases as well. But once again, the steps of the cycle are exactly the same. And the key part about this too is it, the broad trend is that the cycles seem to be getting shorter and shorter and shorter and shorter, so you actually have a smaller amount of time to play the game.
- LRLenny Rachitsky
Okay, and the big aha here is, yes, this will end maybe not great for you, but there's this magical period when they're open to-
- BBBrian Balfour
Yes.
- LRLenny Rachitsky
... customers and users where you can grow like crazy because they want everyone to come and they give you distribution. And what you're saying essentially is ChatGPT, potentially some other platform maybe, uh, is about to enter this mode.
- BBBrian Balfour
Yeah. Well, let me first, before we get to ChatGPT-
- LRLenny Rachitsky
Okay.
- BBBrian Balfour
... I think the natural reaction when, when you first realize this, uh, is, "Screw them, I'm not playing that game."
- LRLenny Rachitsky
(laughs)
- BBBrian Balfour
(laughs) Right? Like, that, that, that's what I feel like most people, uh, like, how, how they react, right? Because, um, because the unfortunate truth is, is that a lot of companies don't predict that last stage and end up in a really hard, hard position, right? So many companies got completely killed during, uh, you know, th- the crash of the, the Facebook social platform. Apple's 30% tax, you know, basically destroyed a bunch of types of, um, y- uh, types of applications and business models, uh, because it just, you couldn't, you, like, it wa- just wasn't like margin effective. Like, a- all, so many companies built on, you know, SEO loops, right, that are in serious, serious, uh, trouble right now if that's their only ch- channel. So, so all these things, right? And so I think the natural reaction is, yeah, like, like, "Why would I play this game if I'm a startup or, or a company?" Right? And y- you can even see this with like ChatGPT as an example, right? Uh, they just launched these like deep research connectors. Um, one of them was my former company, HubSpot. And, you know, you, if you sat inside HubSpot and you were just thinking in isolation, you'd be like, "Well, why would I want to make all of my data, um, ac- accessible through ChatGPT and have, like, all of the usage, y- start to accrue there?" Right? Like, it doesn't really make sense in isolation, but we don't, we don't operate in isolation. Once again, we operate in a competitive environment. And what's gonna happen is that if you don't do it, your competitors are gonna certainly go to the new platform and your customer expectations change, and you have to rise to those customers' expectations. Like, they're gonna start expecting you to be in these new experiences, you know, all these things. And so it ends up being a prisoner's dilemma, right? Which is like, you, there is no opting out of the game. You have to play the game. And, and so it's better to be early-
- LRLenny Rachitsky
(laughs)
- BBBrian Balfour
... than, than to be super late, uh, to this game, especially, especially if you are a startup, right? Uh, that, that's kind of like the, th- the key, uh, that's the, that's kind of like the key opportunity. And so we'll talk a little bit more about how to play the game more, but it's, it's, it's better to be early as well as then the, then the key, the harder part about it is, is anticipating that last stage of the cycle and figuring out how to sequence away from something before that last cycle comes. So, I think that's the key part. Um, but let me pause there and then I'll talk a little bit about ChatGPT and, and some of my reasoning behind that.
- LRLenny Rachitsky
Cool. So what you're saying is not only is there going to be this big opportunity to grow. If you don't take advantage of it, somebody in your space will.
- BBBrian Balfour
Exactly.
- LRLenny Rachitsky
So it's not only there's an opportunity, but this is something you need to do because you might miss the boat. And I think about companies like Zynga that grew on Facebook and then became massive companies and, you know, if they didn't do that, they would have missed the boat. Someone else would have, uh, eaten that lunch. Uh, I don't know. Th- I'm thinking about the Technology Bros podcast on Twitter right now, TBBN, where they basically figured out on Twitter you can create this like live stream and you see it all day in your Twitter feed just like, "Hey, they're broadcasting," and it's a really cool distribution channel. So, so I think there's like a big call to arms here almost, of just, uh, the opportunities emerging and you basically need to pay attention. You can't opt out.
- BBBrian Balfour
That's right. That's right, exactly.
- LRLenny Rachitsky
Okay, let's chat. Yeah. So let's
- 30:01 – 44:47
The rise of ChatGPT
- LRLenny Rachitsky
talk ChatGPT.
- BBBrian Balfour
So look, like, w- like, let's go through this cycle. We are right now, we're in that competitive environment. Like we said, like all those players we talked about, ChatGPT, Claude, Gemini, all these folks, they're, they are battling it out, right? Uh (laughs) and, and we've seen this with, you know, the talent wars especially over the past, you know, month, month or so. And, and so there's no clear winner yet, but there's consensus around, uh, the category.The second thing is then, okay, what's the moat? Has the moat been identified and who seems to have identified it the first or is furthest along? I think there's, uh, you know, my hypothesis, and I think there's a lot more consensus around this now than there might have even been three months ago, is that the moat is really about, is about context and memory. You know, these models, uh, you know, by themselves, if you compare them side by side, uh, you know, they, they kind of generate the same results. And so the, the actual difference maker is which one has more of your context and m- and, and, and because it's the context plus the model that produces the best output. And then, and then that kind of starts to accrue to this loop around memory. The more you use it, the more it's able to store memory around you, which kind of feeds more personalized context, which produces better outputs, right? And it ends up being an, uh, you know, another one of those flywheels, another one of those, another one of those loops. And so if you look at who's farthest on this, it definitely is, um, ChatGPT, right? Like they were kind of the first ones to memory. They've been investing a lot in these different types of, uh, data connectors, essentially context connectors, you know, e- you know, gathering, uh, all of this context. And, uh, and, and so you can really start to see it in the usage. But the second thing is, is in one of the pushbacks I've gotten on my prediction, has been, "Well, what about like Google and Gemini? Like, they have so much distribution through Chrome and like all of this other stuff," right? But, uh, it was, uh, Didi Dos, who's a, a VC at Menlo Ventures, um, actually, uh, published some good data on retention of all of these different ones. And, uh, I think the second, uh, reason I predict ChatGPT is like if you look at history once again, it was never the person who had the biggest distribution at the moment of time. It was the one that had the best retention and engagement. Google had the best retention and engagement over the others, Facebook had- it was smaller, but had way better retention and engagement over the others, right? So on and so forth. And so, um, the, the data that Didi published, uh, clearly showed that both the retention curves, uh, which I know you and I have both written about at, you know, at exhaustion, um, level off at significant portions higher than all the other platforms, as well as those retention curves have been shifting up dramatically over time. You can start to see, uh, the effects of, of memory and t- and they have the very elusive smile curve, right? The ones that you just like... And, uh, the only other times I've seen, you know, all of those dynamics, very few times in my career and they tend to be the folks like Slack and, and like all of the big winners. It's, there, it's just like so elusive.
- LRLenny Rachitsky
And the smile curve, just so, just so people haven't done it, that is essentially, retention goes up over time. It goes down a little bit and then-
- BBBrian Balfour
Yeah.
- LRLenny Rachitsky
... you come back to it and you use it more.
- BBBrian Balfour
Yeah, that's right, and that's usually the result of, um, some type of network effect or, or something else. And, uh, and it, and it's, it's a early indicator that, uh, these fo- that, that that platform is on a trajectory to, to hit escape velocity. Um, the third piece is that, and they haven't really hidden these, uh, but there's all sorts of signals that they're about to launch a third party platform. Um, they've, uh, they've been hiring for a bunch of roles. I've seen multiple postings on like product manager, engineering roles, all that kind of stuff for, you know, quote unquote agent platform, a- and all those pieces. And so, um, it feels pretty inevitable that they will... one of these players will need to launch a third party platform in order to, you know, serve all the possible use cases o- you know, on these tools. There's gonna be some value exchange which is like, "Hey, for your agent to be effective, you probably need access to context and memory and distribution," right? So th- there'll be some value. She said, "Integrate to us and we'll give you those three things," right? Which is gonna drive more users and more usage and, and we're gonna go through the steps of, we're gonna go through the steps of the cycle. And you can already see this, right? Like, uh, you know, they're starting to form preferred partnerships, right? With, uh, some of the bigger players, which paves the way for, um, smaller third party players. It kind of gives, lends credibility to the platform. It's like, "Well, if HubSpot and XYZ are doing it, then I should probably do it too." It's, it, it's like that type of, that type of mentality. But that's why I think out of all of these platforms, ChatGPT has, uh, the, the best shot right now. And then, and then a bunch of folks are always like, "Well, well what about Claude? I really like Claude. I use Claude." Well, um, the problem with that is, like I think ChatGPT at this point has, f- s- like at least a 10X difference on MAU. So if you're a developer, right? And you're comparing those two platforms and you're saying, and you're looking at it and you're like, "Well, ChatGPT has 10X the number of users and better retention and engagement," it's like what's the, what's the logical choice of which one you're going to prioritize your scarce resources on, right? Um, and so, so th- those are just some of the reasons that my prediction is on ChatGPT and, um, in, in the blog post that I wrote about this, I actually then played my own devil's advocate and said, "Okay, here are some reasons why it might not be Chat, ChatGPT." But, uh, but I think we're in that part of the cycle. That's my prediction. I might be wrong in the prediction of ChatPT, ChatGPT, but I really think, uh, feel very confident we're gonna see this cycle play out again.
- LRLenny Rachitsky
Two follow up questions here. One is, what's your, what would be the backup if it's not ChatGPT? It sounds like it might be Gemini or Google.
- BBBrian Balfour
My hypothesis of who's best positioned but is not executing on it right now would actually be Apple. Because-
- LRLenny Rachitsky
Whoa.
- BBBrian Balfour
... through the, the devices they basically can see everything. So they have the ultimate view into your context, right? They're, they're, they're sitting at that, they're sitting at that level. But I don't know what they're doing. (laughs)
- LRLenny Rachitsky
(laughs)
- BBBrian Balfour
Like from an execution standpoint, maybe they're gonna surprise us with something crazy magical, uh, but oh, I haven't, we haven't seen any external signals around this. So, so that's probably...... just based on, on what real estate and where people live in the stack would own. And then I think right behind that I would probably put, I would probably put Google, uh, because of owning the context of things like email and dis- the distribution points of search and Chrome and Android and, and those types of, uh, pieces. But, um ... And a lot of people point to them, but, uh, my experience with all of their products is, uh, like going back to the retention engagement thing is, um, is that if we could take a look inside their metrics, I think what we would see is a bunch of flyby users in their miles. Like, they're kind of sprinkling the Gemini bucket everywhere. And it ... I'm a- I've, I've like literally clicked on it accidentally multiple times. (laughs) And so my guess is a huge portion of their miles is, is exactly that, uh, of like what, what's happening right now. And so, you know, look, they just, um, uh, they, they just acquired a very talented team from, uh, from Windsurf, and-
- LRLenny Rachitsky
Just the team, just the team.
- BBBrian Balfour
Yeah.
- LRLenny Rachitsky
Part of the team.
- BBBrian Balfour
We'll see. And, and things are, things are changing dramatically, you know, uh, on a, on a week-to-week basis. So we'll see if they're able to press those advantages in a very clear way. But I think the window is very small for them if, if Ch- if ChatGPT plays their cards right because they clearly have the escape velocity right now. And, uh, if they just keep pressing that advantage in, in the right way, I think it's going to be very hard for Google to, um, counter in, in the amount of time that's left.
- LRLenny Rachitsky
On the Claude piece, I'll just throw this nugget out. I had, uh, Mike Krieger on the podcast, head of product CPO at Anthropic, and asked him just, "You're, you're losing to ChatGPT. What do you, how do you approach, uh, the future of Anthro- of Claude?" And he very specifically said, "Yes, they've caught lightning in a bottle, and this is just going to win based on what I've seen-"
- BBBrian Balfour
Yeah.
- LRLenny Rachitsky
"... at Instagram." And so we are specifically focusing on what is Anthropic and Claude incredibly good at, which is developer tools, coding, backend stuff. So they're actually leaning more and more into that. And if you've seen their revenue recently, they're making, I don't know, like approaching 10 billion a year or some crazy amount of money. So they're actually doing super well, just in a different use case.
- BBBrian Balfour
Yeah, I'm glad you mentioned this 'cause this brings up something that, uh, we skipped, which is, uh, there are smaller platforms that, uh, have existed and will also emerge in this environment as well. And, and that's kind of like what you're alluding to, is, i- this tends to happen is, like, things end up, um, you know, uh, you know, growing into, into more niches. Like, e- even if you look at social, right? Uh, like LinkedIn emerged as a subset of, of the social world. But I'll, I'll, uh ... But even on these smaller platforms, these new distribution channels, they, they go through the same cycle. I'll, I'll give something, you know, really, uh, uh, a, a, a very opposite example of the ones that I gave. Like, lo- look at the platform Udemy, right? They, they are a platform for course creators, right? I don't know if most people know this, but when they started, their rev share to creators was something like 80% to creators. They started very high and ... Now, th- that brought on all the course creators, got their whole marketplace going, like, so on and so forth. I believe it was about a year ago they announced that they're essentially pushing that rev share down to something like somewhere between 15 and 20%.
- LRLenny Rachitsky
Wow.
- BBBrian Balfour
They're somewhere like 25 and 30%, right? So I ... Another example, right? Of like, they closed down organic distribution in order to monetize, like, all that kind of stuff. And the same thing will happen in this AI world. I believe, you know, Cursor ... It's very clear, like Cursor's on the path to also probably create some type of agent platform, right? For developers. So that'll be like a smaller ecosystem to play in for, um, some, some products. Um, there's all sorts of ... Uh, it feels like everybody has the same strategy at this point, is everybody wants to launch an agent platform. I imagine some of these other horizontal productivity tools will do the same thing, maybe like a Notion or an Airtable or like a monday.com or s- or something like that. So there, there are s- ... There will be smaller platforms that will emerge, and they will follow the exact same cycle that I am, uh, that I'm also discussing. Um, but yeah, in terms of like the biggest kind of consumer one that, that's where I think ChatGPT has probably the, the most escape velocity, and, uh, and yeah, others will focus on different areas. And, and just to be clear, I love Claude. I actually u- use both Claude and, and ChatGPT-
- LRLenny Rachitsky
Same. Same.
- BBBrian Balfour
... all for, for different things. I, I have lots of love to go around for all these tools. I'm not ... My prediction has no, no bearing on which, which product I, I like the most right now.
- LRLenny Rachitsky
I also love Claude.
- BBBrian Balfour
(laughs)
- LRLenny Rachitsky
So I think what ... So the key point here you're making is that there's almost, uh, a number of distribution channels emerging. Many of them will be niche. So I think of LinkedIn, if I wanna ... Like, LinkedIn for me is a very targeted audience for folks that listen to this podcast.
- BBBrian Balfour
Yeah.
- LRLenny Rachitsky
So even though it's not, I don't know, Google or, or Facebook or whatever, uh, it's still incredibly valuable for the specific thing that I do.
- BBBrian Balfour
For sure.
- 44:47 – 46:01
The future of AI agents
- BBBrian Balfour
been sitting in. Um, and, uh... But my guess is this: w- we're going to see the, the next major steps of this play out over the next six months. And so, I think we just saw one of the pieces drop around this, uh, which was, uh, the re- which was Ch- ChatGPT's recently launched Agent mode. And so it's kind of a general-purpose agent, you know, and, and I think that starts to introduce all of the users to, uh, to, to using agents and they're kind of figuring out and placing it in the different tiers and business models, a- all of those pieces. But, um, but it's likely that no general-purpose agent is going to fulfill all of the infinite use cases, um, successfully. And there's two reasons for this, right? Users struggle with horizontal tools, they can do everything and that's exactly why they struggle to adopt, and so they typically need more specific entry points. But also, uh, the more specific use case you get, sometimes you need specific UI, specific data, like other specific ingredients, you know, to properly fulfill, uh, that use case for, uh, you know... uh, for a given audience. And so I think their Agent mode was a step in this direction. What I would expect to see play out next is that
- 46:01 – 47:18
Preferred partners and platform credibility
- BBBrian Balfour
they will... they will either launch... they will announce the platform or what they're going to annou- with preferred partners or what they're going to announce first is, is basically a set of preferred partners, th- the guinea pigs. You know, an initial 10 to 20 folks that are like bringing agents, uh, to their platform, and, uh, and what that does is, it essentially... once again, it's a credibility card, right? You, you do special deals with, uh, some like right brand names to give, uh, the platform credibility, and it kind of creates this desire from everybody else to come on, you know, to the, to the platform. And then the step after that is starting to open up the platform. And this is where the real, uh, you know... where we'll really start to figure out what this game is going to look like because they basically have to define what the value exchange is. What are they giving you access to, right? Uh, and like what are the... what are they incentivizing you with t- to come on to the platform? So that's one version of it. Um, the other version of it is just like the replacement to search. Um, there will probably be... Uh, you can also see them starting to make mo- more moves here, which is, uh, like deeper attribution in some of the results, like, uh, those types of pieces. They're bringing in shopping, right? Like that's one of their recent announcements as well, kind of native into the UI.
- 47:18 – 48:14
Monetization mechanisms and free tiers
- BBBrian Balfour
Essentially, they will form new monetization mechanisms around that stuff as well. And that's actually going to be very important because, uh, for them to... Going back to the moat around memory and context, is that, uh, you know, they, they will want to incentivize as many people to their free, uh, tier as possible. But given the cost of AI, they have to cover it somehow, so they're going to need some monetization mechanism. So the more that they can cover that free usage with things that aren't subscriptions, uh, I think that probably also kind of feeds them as well. So I think those are some of the next steps on two different vectors, more with like a third party de- developer platform and more of the, you know, kind of content, whatever you want to call it, AEO, GEO, I don't know what acronym is th- every... we've all decided on yet, so let me know if we have. And, uh, and, and I think those will be... I think those will be the next... the, the next steps that we'll see. Now
- 48:14 – 1:04:34
Betting strategies for startups
- BBBrian Balfour
that's what I think for ChatGPT. I think the thing that we should talk about is like, um, essentially what I would advise folks, especially startups, is you're placing bets. Y- at this part of the cycle, you're placing bets. We don't... The winner is 100% guaranteed, as I mentioned, and so you essentially, at some point, will need to make some decisions about, uh, you know, where t- where to place your bets. In the Facebook days, uh, all, all those other... all those other social networks, they also came out, you know, with their own platforms, right? And, uh, iOS had A- Android and some failed initiatives from Windows. I don't even remember what that platform was called, right? (laughs) Like... And you can look back and whoever placed their... You know, the iPhone was actually very... and iOS is a good one, which is if you had only aligned your bets to Android, you probably lost. If you somehow find- found a way to play on both ecosystems, you could be a winner. But if you only aligned to iOS, you could also be a winner, right? So like, that's just, right? Like, you, you had to have iOS as part of your betting strategy in order to win. So everybody right now, like, you're probably at this cycle and, and trying to figure out, well, y'all need to ... Everybody will need to figure out where are they gonna place their chips, how, how are they gonna bet. And depending on how you bet really depends on, um, what your current position is in the marketplace. You know, if you're a late stage startup, let's start with that, um, or like a late stage company, you can afford the luxury to place multiple bets and kind of spread your chips and, and kind of wait it out a little bit to see who the winner is and then really throw your muscle, you know, b- b- behind that winner. You, you have that luxury a little bit. And of course, but the risk of that, the, the, the risk of that is that the, sometimes the incumbents wait too long to, to make that decision, and, and that's like kind of the key, key question they will need to answer. The key question for startups is totally different. You don't have the luxury to spread your chips. Like, you have to go all in. You have to choose one and go all in. Um, you, you have scarce resources, scarce attention, um, from the market, and so it's a totally different ballgame. Higher risk, higher reward, for sure. Uh, and, uh, and, and, and that's part of the betting strategy, uh, for startups. And so, uh, that's kind of what y- that's kind of what you have to do, is you kind of have to figure out your betting strategy, and then, you know, we, we can talk a little bit about how you might evaluate and pick the right course for you. But, uh, but that's where we're all at right now, is we're, we're kind of, we're, we just entered the casino, uh, we just cashed, put some cash in for some chips, and now we, now we've gotta figure out w- you know, what tables and, and where to, to place those chips.
- LRLenny Rachitsky
I love this analogy. Okay, so just to be crystal clear about what listeners should do, what founders should do, what product teams should do, the advice here essentially is, uh, integrate with, and ChatGPT, maybe Gemini, maybe if Apple has something, is like actually integrate with, with what they launch. So could be, uh, a login thing, could be a search thing, could be a connect and suck up your memory and context. The advice here is, is you need to do this, 'cause this is potentially the way that most companies will start to grow, and your competitors may overtake you.
- BBBrian Balfour
Yeah. Yeah, if we had to, like, really simplify it, it's essentially play the game. Don't opt out of the game. Don't, don't trick yourself into thinking that you can't play the game. That's number one. And then number two, no matter who you bet on, just make it a focus bet. Uh, 'ca- because the, the, all, like, if you look back, all the failures are the ones that tried to, you know, play multiple games at, at once with scarce resources, and that just tends to never work if you're, you're an early stage startup. So, those two things. Play the game, put a focus bet.
- LRLenny Rachitsky
This episode is brought to you by Miro. Every day, new headlines are scaring us about all the ways that AI is coming for our jobs, creating a lot of anxiety and fear. But a recent survey from Miro tells a different story. 76% of people believe that AI can benefit their role. But over 50% of people struggle to know when to use it. Enter Miro's Innovation Workspace, an intelligent platform that brings people and AI together in a shared space to get great work done. Miro has been empowering teams to transform bold ideas into the next big thing for over a decade. Today, they're at the forefront of bringing products to market even faster by unleashing the combined power of AI and human potential. Guests of this podcast often share Miro templates. I use it all the time to brainstorm ideas with my team. Teams especially can work with Miro AI to turn unstructured data like sticky notes or screenshots into usable diagrams, product briefs, data tables, and prototypes in minutes. You don't have to be an AI master or to toggle yet another tool. The work you're already doing in Miro's canvas is the prompt. Help your teams get great work done with Miro. Check it out at miro.com/lenny. That's M-I-R-o.com/lenny. So, s- you were head of growth at, at HubSpot for a long time, so, and you gave that as an example, HubSpot, why would they integrate, why would they give away all their data so that ChatGB can suck it up and you never have to go to HubSpot, you're just working through their agent? You're, would you at HubSpot be like, "Yes, we gotta do this. This is the game we gotta play"?
- BBBrian Balfour
Yeah, 100%. And that's exactly what I think you see them doing, and I, look, to be very clear, I have not talked to anybody at HubSpot about this. I have not talked to Dharmesh about this. But, um, Dharmesh, I think has also, like, published, publicly po- published about this w- uh, but that the right thing to do is essentially, e- even though you don't, you, you understand how the cycle plays out, and you don't necessarily under what y- understand what your exit strategy is, uh, once you get out, it's better to be early, know that you need to figure out an exit strategy and figure out that exit strategy along the way, versus waiting and then being super late and, and then, and then know what the exit strategy is. And, and I think that's essentially, um, what y- that's exa- that's exactly what you see them, see them doing. They're trying to be as early to this stuff as, as possible, and I think it's a, I think it's a pretty smart play, even though we might not necessarily see, like, what, what the exit strategy is out of this cycle for them.
- LRLenny Rachitsky
So, going back to that amazing quote that you shared at the beginning of the conversation by, I think it was Alex Ram Paul?
- BBBrian Balfour
Yeah.
- LRLenny Rachitsky
Of that startups win by finding a distribution channel before the incumbent copies them, and what you're saying here is this is the opportunity for startups to disrupt an incumbent. This is the opportunity for someone to disrupt Salesforce, I don't know, ServiceNow, all these guys that have been around for a long time.
- BBBrian Balfour
Yeah. It's gonna be one of the major ones. Now, look, you've already see players that are, have been able to hit this escape velocity.... uh, you know, the, the cursors and stuff of the world. Um, and, and so, uh, there... once again, there's multiple ways to hit that escape velocity, but this is gonna be one of... this is one of the major ways to do it, is to basically hitch yourself to a new platform. Look, you did it yourself actually. You hitched yourself to Substack super early.
- LRLenny Rachitsky
I was gonna-
- BBBrian Balfour
You took a focused bet.
- LRLenny Rachitsky
... I was gonna say that.
- BBBrian Balfour
Uh, yeah, yeah. I was like... I don't know why that just hit me, but you took a focused bet and you benefited from it in a disproportional way than those that kind of came later. Uh, and I think that's actually a great meta example here (laughs) as, as I sit here and think about this.
- LRLenny Rachitsky
Yeah. That's actually the way I thought about when I was moving to Substack. Just like, I feel like there's this wave rising and I want to ride this wave even if it... maybe it's not the best place or may... you know, they take a cut, all that stuff.
- BBBrian Balfour
Yeah.
- LRLenny Rachitsky
Uh, but it worked out really well.
- BBBrian Balfour
That's right.
- LRLenny Rachitsky
Uh, and, and-
- BBBrian Balfour
I think it worked out very well (laughs) .
- LRLenny Rachitsky
It worked out really well.
- BBBrian Balfour
(laughs)
- LRLenny Rachitsky
Uh, and to be honest, it, it felt like it was too late, the- when I started six years ago.
- BBBrian Balfour
When you- when you entered, it felt too late?
- LRLenny Rachitsky
Yes. Yes.
- BBBrian Balfour
Oh, say more about that.
- LRLenny Rachitsky
Like, it's... it always feels too late, I think, to people that joined. Mm-hmm. Like Silicon Val... or sorry, Marc Andreessen has this famous quote. He's like, "I came to Silicon Valley in the '80s. I thought it was over. It was too late. I missed all the opportunities."
- BBBrian Balfour
That's fair.
- LRLenny Rachitsky
Um, yeah. So yeah, there were just a lot of newsletters that were doing really well, a million subscribers. I'm like, "Yeah."
- BBBrian Balfour
And what do you say to people now who want to join Substack?
- LRLenny Rachitsky
That's, that's... Learn from this example. Uh, a lot of times when people think that it's too late, it's, it's definitely not too late and it's always only just getting started. Especially if you're like on Twitter all day listening to podcasts like this where we're surrounded with this bubble of everyone talking about something, when in reality, like 1% of people know anything about what you're hearing about every day.
- 1:04:34 – 1:08:41
Adopting AI tools: challenges and strategies
- LRLenny Rachitsky
you guys at Reforge are now building actual SaaS products that people can buy. It's not just courses. I don't know if people know that but let's make sure people understand this. There's actually products for product teams so maybe just explain that briefly but the thing that I think is really interesting here is you work with a lot of companies now, selling them AI tools and you have noticed a very big difference between the companies that are really good at adopting AI tools and seeing gains from them from those that don't. Talk about just what you see there and because this is, in theory, gonna be really helpful to companies that are struggling with adopting AI tools and seeing gains.
- BBBrian Balfour
Yeah, just to quickly explain that tran- transition so it, uh, it makes sense for people which is, you know, I started Reforge just with the interest that there was all these incredible leaders out there growing, you know, on the front lines of some of the fastest growing companies and they have all this amazing knowledge and I wanted to encode it in useful and practful, practive, you know, practical ways for others, right? And that took the form of courses, uh, and content and product, all that kind of stuff at the beginning and along the way everybody kept asking us to essentially build the tools to implement what we taught. Um, because, you know, with anything is like you can learn as much as you want, you can listen to my podcasts, your podcasts, Lenny, like whatever as much as you want but if you don't actually put it into action and implement it then it's not really going to create value, right? And so people kept asking us to, to really close that gap and we said no for the longest time and then about a couple years ago when AI really started to inflect it really created this moment that, oh wow, now we... There's this opportunity not just to encode this knowledge into content but also into the products, the software, the tools that we use ourselves. And so we started to take a really big bet on that and, uh, and started to develop this, this new, um, platform for AI native product teams. The first product we launched was called, is called, uh, Reforge Insights which acts like your AI product researcher. Kind of aggregates all the feedback from all the sources, uses AI to analyze it, helps you explore it, um, but also, uh, will start to identify like what are the gaps, the things that you don't have in your feedback today and auto generate the research to go gather all those n- new insights so complete the full cycle. We're gonna launch two other major products as part of this platform before the end of the year but, uh, we'll, we'll save that for some, some future episode. So that's kind of been our, our journey and so we've seen inside companies that are going through this transformation from two perspectives. One is obviously selling in that tools but the other perspective is for ten years companies have been coming, uh, to us to help them drive some sort of transformation with our learning product. Uh, you know, most people, most companies are not coming to us to,... uh, just like throw a bunch of courses in front of ... They're, they're trying to solve some big business problem, some transformation. Now that used to be things like, we've got to figure out this growth thing, right? Or I'm going from sales-led to product-led, or, um, you know, I'm turning, uh, I have, uh, more project managers and I need to transition to product managers, right? Uh, like something like that. Like, or, uh, there's some business problem. They're going through some transformation and they, they saw us as part of that transformation, and we got to partake in quite a few of those types of transformation. Now, of course, the transformation that everybody's going through is, "Okay, how do I become more AI native? How, how do I adopt this stuff?" And, and so we've seen a pretty wide spectrum and from both perspectives of how companies are approaching this. And I'm sure everybody's seen the, like, AI ... oh, I call it, we've been calling them, like, the AI manifesto memos from CEOs out there that proclaim, "We are now AI native." (laughs) You know, uh, in some grandiose, you know, way, right? Uh, and, uh, but there's behind the scenes, there's actually some incredibly stark differences in, uh, the actual teeth of what backs up those memos and backs up those executive decrees that, you know, we should all be, uh, you know, AI.
- 1:08:41 – 1:14:23
The importance of hard constraints
- BBBrian Balfour
And, and so just to kind of point out, um, a few of them, which is, um, one is that, uh, they're ... I think the most impactful thing, um, that you can do is form really hard constraints. So a lot... what I... what you see... there's, there's other parts is like, okay, you wanna communicate this, you wanna establish an owner of who's going to drive this, uh, you wanna build in incentives and rewards. And you see this all playing out in things like, um, you know, building it into your, uh, you know, your career ladders. Or some people are starting to introduce this as questions into, uh, their performance reviews. Like, uh, you know, all those types of pieces. And, but the thing that is actually moving the needle are the companies that are defining incredibly hard constraints. So one company that we worked with developed this constraint that they benchmarked against other companies of their revenue size and the team sizes, uh, for their stages, and they set a benchmark that we will be one-fifth. Each of our functions will be one-fifth the size. And, and what that did is it created a constraint that you couldn't hire above that level, and it forced people to essentially find ways to adopt AI and, and do things to, to replace that. So that was one. Um, you've seen these other ones. I can't remember from what company. This might have been Shopify or another who was like, "You are not allowed new headcount until you prove to us that you are not able to accomplish this, uh, with AI." That's like another hard constraint. And but you also see these other constraints on a smaller level, which is, you know, an executive saying, "I will not do a product review, uh, or review a PRD unless it comes with three prototypes." You know something like that. And so that's, that's the hardest one. Uh, those are the biggest constraints. But I think the biggest change that I'm seeing is a- and the things that separates the, the top few percent making this change and, and everybody else is, uh, is essentially making the hardest decisions. And that hardest decision is going to come down to exiting people. So in every transformation, what we see is essentially three groups of folks. You see your, uh, we call them the catalysts, the people kind of leading the charge, the people who are experimenting, you know, doing this on their own, um, time, like all that kind of stuff. You then have, uh, your, what we call your converts. Um, these are folks that will make the transformation, they will adapt, but they need structure. They need permission. They need a clear outline. They need a clear plan, right? And I don't say this in a negative way. It's just that, you know, that's how some people operate, right? And, and so you, um ... And so that's where things like, uh, all the things that we were talking about before which was like, the decree, the permission, the clear budgets, the rewards, like all of those types of things. Um, but then inevitably you have a certain percentage that are anchors, right? And they're dragging their feet. They're kind of, uh, you know, silently creating friction in the background, uh, and like all those pieces. And there's a big difference in how I think companies are treating, uh, and, and thinking about their strategy for those folks. One group is kind of like, "Oh, we're gonna work with them very passively." Others, others have set a hard deadline. They're like either make the ... They're gonna either make the transformation by X date or we're going to exit folks. And a lot of people look at this as being really harsh. I think a lot of people would think that, especially individuals. But let me kind of explain it from a, a s- more of like a CEO perspective. Um, a lot of these companies are seeing this AI transformation. The, the ones that are taking it more seriously, as this isn't adopting new tools. This isn't a light change. This is a fundamental culture change of how we operate as a company, right? And you can't have 20, 30%, whatever meaningful number of it is, of your company trying to operate in a completely different way, in a, in a completely different culture. Cultures thrive on density, right? And that's why they're sometimes the best ones feel like cults, you know? Um, and, and so as a result from that perspective, it's like, hey, like, we ... For us to be successful, for this to be the best thing for all employees, we all need to be operating around the same cultural principles and stuff. And if that's not you anymore, then we're defining a plan to exit it. But I would say that less than 10% of companies we see are taking this hard stance. But I would say they are probably the ones that are farthest along, getting the most adoption, and are seeing the most results, uh, of the ones that are-... taking those hard stances. So, there's a bunch of other stuff I could talk about, but that's kind of the high level of, kind of what we've, w- what we've seen across a bunch of different companies.
- LRLenny Rachitsky
That is incredibly interesting. I'm glad we went there. There's a, I have a newsletter post coming out soon, probably before this episode, that touches on some, a lot of advice along these lines. Um, I, I, I'm excited for you guys to keep sh- seeing these, uh, insights into companies and sharing more of those. 'Cause this is, I think, what a lot of people are looking for. Just like, things aren't quite clicking at our company. We keep hearing everyone is getting so much more productive. All these companies are, uh-
- BBBrian Balfour
Yeah.
- LRLenny Rachitsky
... running more efficiently, and, and it's not working here. And so, I think that's the kind of advice a lot of people are looking for.
- BBBrian Balfour
Yeah.
- LRLenny Rachitsky
So, thank you for sharing all that. Ryan, is there anything else that you wanted to touch on? Anything else you wanted to leave listeners with before we get our very exciting lightning round?
- BBBrian Balfour
Well actually, just a couple more points on this topic-
- LRLenny Rachitsky
Oh, yeah.
- BBBrian Balfour
... I think we should, we should go. Is like, um, uh, is, there's probably two more
- 1:14:23 – 1:19:05
Effective AI adoption in companies
- BBBrian Balfour
things I would say about this. One is that, um, so if you're a CEO listening to this, I would say that most CEOs or most executives are incredibly disconnected from the actual AI adoption taking place in, in, in inside their companies. I think a lot, a lot of executives who have done these dec- decrees and all that kind of stuff think it's kind of happening naturally. But we talked to both groups. We talked to tons of end users and we talked to tons of executives. The story we hear from the end users, the PMs, the eng., all that kind of stuff, that we talked to kind of using all this stuff, one of the main questions we ask them is, uh, you know, if somebody, if we're talking to somebody who's picked up a prototyping tool, say, "Well, um, how many other people on the product and design team, uh, or have u- are using this?" Almost 90% of the time, it's like, "Ah, it's like me and this one other person, and everybody else hasn't, uh, like taken it up." Right? And so, the, there's a huge disconnect. And we heard one story, and I won't, I can't say the name, but the, it's a company we all know. It's a major tech company, tech forward company. CEO's been out there talking about being AI native. We talked to one of their, um, like, uh, prin- you know, principal PMs. The person was early to the prototyping tools. Uh, this person shared a prototype with the designer, the eng. manager. The designer and eng. manager escalated it to the VPs. It caused this whole conversation. A month later, kind of the, it was like kind of still stalling out. This PM happened to then, you know, attend a happy hour where this, the CEO was at, and, uh, approached the CEO and told, uh, the, the CEO about the experiment that, uh, they were running with prototyping and stuff. And the CEO was like, "This is fantastic." Like, "Why... You know, like, like where is it at right now?" And he's like, "Oh, well, X, you know, X, Y, Z happened." And the CEO had no idea. And then, and then the CEO was like, "Okay, let me take care of it." And then the next day, (laughs) like it, it happened. So there, one is that there, you have to go to the ground floor on this stuff. Um, some of the best companies, like Shopify and others, are measuring actual, uh, adoption and usage. Uh, they've gone to the extreme, uh, like, uh, uh, kind of on that, on that front to, to get a bunch of signals in close to the ground. But it's just that, it just goes to show that, uh, this is, you know... Ah, I don't think we wanna talk about, quote unquote, "founder mode," but, um, the reality is, is it's not just about getting into the weeds of your product, but with something this sizable, you gotta get into the weeds of the transformation to like really understand, um, what's going on and adopt it. So that, that's point number one. The second point I would say is, Farid, uh, um, um, we do this podcast, uh, called Unsolicited Feedback. Uh, uh, you know, Farid Mossavad had this great quote on it. He was like, "Look, the slowest... Your output is, uh, constrained by the slowest part of your system." And, uh, and I thought that was, that stuck in my head because it's absolutely true. And so if you think about AI adoption as a system, there's all parts of the system that could be slowing adoption. It might be that people don't feel permission, or they don't have the budget, or they don't have the knowledge, or like, uh, the struc- like all these types of things, right? Um, but it, in a lot of these cases, it's things like IT, legal, procurement are the slowest part of the, the friction or are kind of setting the pace of all of this output. And you can also see this in, um, in just product teams, which is, uh, you know, a lot of, there's been all this talk about, you know, product managers are becoming the new bottleneck because engineers are speeding up. Well, that's because people are speeding up one part of the product system and not the other parts. Wh- which makes sense. Like, they adopted all of this tooling for engineers 'cause they're the biggest headcount and the most expensive and like all that type of stuff. But product is an output of design, PMs, and engineering. The system is there not to produce code, it's to ship product, right? And, and shipping product is the function of those three things. So if you just accelerate one part of the system, you're just gonna move to the bottleneck to another part. And your actual product output, the output of the system doesn't accelerate either. So, uh, I think you, like, really gotta un- ex- people have to really understand those two things. It's like, what is actually happening on the ground floor? And what, and what is the slowest part? What is the thing that is causing, you know, the slowest part of the adoption? Just like attack, attack them ruthlessly, if, if you're really serious about making this transition.
Episode duration: 1:29:11
Install uListen for AI-powered chat & search across the full episode — Get Full Transcript
Transcript of episode cX4cL6B-_aU
Get more out of YouTube videos.
High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.
Add to Chrome