Why great AI products are all about the data | Shaun Clowes (CPO at Confluent)

Why great AI products are all about the data | Shaun Clowes (CPO at Confluent)

Lenny's PodcastDec 29, 20241h 21m

Lenny Rachitsky (host), Shaun Clowes (guest), Narrator, Narrator

Why most product managers underperform and what great PMs actually doUsing customer, market, and competitive insight as the core of product workAI’s impact on product management: data management vs. models and UXHow data should and shouldn’t guide product decisions (data as compass, not GPS)Building and scaling B2B product-led growth and its interplay with salesHow AI will (and won’t) disrupt enterprise SaaS and systems of recordCareer strategy for PMs: breadth, versatility, and “bingo card” experiences

In this episode of Lenny's Podcast, featuring Lenny Rachitsky and Shaun Clowes, Why great AI products are all about the data | Shaun Clowes (CPO at Confluent) explores product, Data, And AI: Why Most PMs Still Miss The Point Shaun Clowes, CPO at Confluent, argues that product management remains an underdeveloped discipline where outcomes and PM quality are highly variable, largely because most PMs focus too much inside the building and not enough on customers, markets, and data.

Product, Data, And AI: Why Most PMs Still Miss The Point

Shaun Clowes, CPO at Confluent, argues that product management remains an underdeveloped discipline where outcomes and PM quality are highly variable, largely because most PMs focus too much inside the building and not enough on customers, markets, and data.

He lays out what distinguishes great PMs: structured, outside-in thinking, rigorous use of data as a compass (not a GPS), and the ability to synthesize diverse feedback into sharp, contrarian insights that drive real business value.

Clowes explains why AI’s real leverage in product work is all about data management—getting the right, fresh, well-structured data into models—rather than clever prompts or UX tweaks, and how this will strengthen, not weaken, major SaaS incumbents.

He also shares lessons from building one of the first B2B growth teams at Atlassian, the nuanced realities of PLG in B2B, his “career as bingo card” philosophy, and candid reflections on failed products and over-indexing on data.

Key Takeaways

Great PMs start outside the building and stay there.

The highest-leverage PMs frame everything from the customer, market, and competitor perspective, rather than getting sucked into sprint management, internal politics, or delivery coordination. ...

Get the full analysis with uListen AI

Data is a compass, not a GPS—and most PMs misuse it.

Data rarely hands you the answer; it helps you falsify bad hypotheses and sanity-check intuition. ...

Get the full analysis with uListen AI

AI’s real advantage in product work comes from data management, not clever prompting.

LLMs are powerful synthesis engines but “insanely dumb” without timely, comprehensive, well-structured data. ...

Get the full analysis with uListen AI

Enterprise SaaS moats are in business rules and configuration, not just UI.

Products like Salesforce, Workday, or Jira are not easily cloned because their real lock-in is years of accumulated, company-specific workflows and rules embedded in their systems. ...

Get the full analysis with uListen AI

PLG rarely replaces sales; the winning model blends both motions.

Product-led growth is less about eliminating sales and more about having a system and incentives that prioritize end-user success early in the journey. ...

Get the full analysis with uListen AI

A “feedback river” plus LLMs can massively upgrade PM insight.

By continuously streaming in interviews, tickets, NPS, competitive intel, and product usage, and then using LLMs to cluster, summarize, and specifically look for where your strategy is wrong or mismatched, you can surface non-obvious opportunities and threats much faster than doing it all manually.

Get the full analysis with uListen AI

Design your career like a bingo card to build real leverage.

Clowes intentionally took very different roles (consumer, B2B, infra, with/without sales, different go-to-market models) to fill in “squares” of experience. ...

Get the full analysis with uListen AI

Notable Quotes

The job is not about execution; it’s about finding reliable, differentiated value you can uniquely deliver into the market.

Shaun Clowes

LLMs are limitless information eaters, but they’re also insanely dumb. They only know what you train them on or what you give them right now.

Shaun Clowes

People really underestimate where the value is created in these applications. It’s not the forms on databases; it’s the years of evolved business rules and workflows.

Shaun Clowes

Data is more like a compass than a GPS. If you expect it to give you the answer, you’ll either be wrong or slow—often both.

Shaun Clowes

People don’t care what you know until they know that you care.

Shaun Clowes

Questions Answered in This Episode

How can a PM practically restructure their week to spend 80% of their thinking time “outside the building” without dropping the ball on internal responsibilities?

Shaun Clowes, CPO at Confluent, argues that product management remains an underdeveloped discipline where outcomes and PM quality are highly variable, largely because most PMs focus too much inside the building and not enough on customers, markets, and data.

Get the full analysis with uListen AI

What concrete systems and tools are needed to build an effective “feedback river” and avoid it becoming just more unprocessed noise?

He lays out what distinguishes great PMs: structured, outside-in thinking, rigorous use of data as a compass (not a GPS), and the ability to synthesize diverse feedback into sharp, contrarian insights that drive real business value.

Get the full analysis with uListen AI

In an AI-first world, how should early-stage SaaS startups think about building proprietary data moats before they have many customers?

Clowes explains why AI’s real leverage in product work is all about data management—getting the right, fresh, well-structured data into models—rather than clever prompts or UX tweaks, and how this will strengthen, not weaken, major SaaS incumbents.

Get the full analysis with uListen AI

Where is the line between being appropriately data-informed and over-indexing on experiments and metrics that create false confidence?

He also shares lessons from building one of the first B2B growth teams at Atlassian, the nuanced realities of PLG in B2B, his “career as bingo card” philosophy, and candid reflections on failed products and over-indexing on data.

Get the full analysis with uListen AI

For PMs planning their own “career bingo card,” which experience squares (domains, company stages, GTM models) are most valuable to deliberately seek out over the next decade?

Get the full analysis with uListen AI

Transcript Preview

Lenny Rachitsky

I love that you have very strong opinion about this, which is just the state of the product management career and how it, most PMs are not that great.

Shaun Clowes

Why is it that product management is still such a relatively undeveloped discipline? Like we're like 15 to 20 years into this. And so there's something about the current state of product management that isn't getting at the truly important things, the truly value added things. If we were doctors, you'd be like, "That's totally unacceptable."

Lenny Rachitsky

What's the answer, Sean? How do we solve this problem?

Shaun Clowes

Everything. Always talk from the customer's perspective, from the market's perspective, from the competitor's perspective. A very small number of PMs do that. They get dragged into internal politics. They get dragged into Scrum management or Scrum execution or product delivery and you just can't win that way.

Lenny Rachitsky

You kind of have this hot take that the way AI will most impact product management is data management.

Shaun Clowes

Well, you've got this synthesis machine, which is this LLM thing that's gonna help you do synthesis. But if it hasn't got all that data to do synthesis on top of, it's got nothing. And so that means that LLMs can only be as good as the data they are given and how recent that data is.

Lenny Rachitsky

In the future, if you can easily clone a B2B SaaS app like Salesforce or Atlassian, what happens to these businesses long term? Do they just become... Are they all in trouble?

Shaun Clowes

People really underestimate where the value is created in these applications and they just kind of get it completely wrong.

Lenny Rachitsky

Today my guest is Sean Clauss. Sean is chief product officer at Confluent. Previously he was chief product officer at MuleSoft, which is a billion dollar business within Salesforce. Before that, he was chief product Officer of Metromile, a public auto insurance technology company. And prior to that he spent six years at Atlassian where he ran Jira Agile and also built the first ever B2B growth team. He also created two of the most popular Reforge courses, one on retention and engagement and one on data for product managers. Sean is awesome because he is both very tactical and execution oriented while also being very philosophical and insightful about the craft of product and growth. In our conversation, Sean shares why most PMs are not good, what it takes to become a good or great product manager, how he thinks about his career like a bingo card and why he indexes towards finding very different roles for every new job that he takes, why good data is the most important ingredient in AI tools and for product managers working with AI, also how to build a great B2B growth team, what he's learned about doing B2B growth, and his really interesting take on how AI will and won't disrupt SaaS tools out in the wild. If you enjoy this podcast, don't forget to subscribe and follow it in your favorite podcasting app or YouTube. It's the best way to avoid missing future episodes and it helps the podcast tremendously. With that, I bring you Sean Clauss. This episode is brought to you by Interpret. Interpret unifies all your customer interactions from Gong calls to Zendesk tickets to Twitter threads to App Store reviews and makes it available for analysis. It's trusted by leading product orgs like Canva, Notion, Loom, Linear, monday.com and Strava to bring the voice of the customer into the product development process, helping you build best in class products faster. What makes Interpret special is its ability to build and update customer specific AI models that provide the most granular and accurate insights into your business, connect customer insights to revenue and operational data in your CRM or data warehouse to map the business impact of each customer need and prioritize confidently, and empower your entire team to easily take action on use cases like win-loss analysis, critical bug detection, and identifying drivers of churn with Interpret's AI assistant Wisdom. Looking to automate your feedback loops and prioritize your roadmap with confidence like Notion, Canva, and Linear? Visit E-N-T-E-R-P-R-E-T dot com slash Lenny to connect with the team and get two free months when you sign up for an annual plan. This is a limited time offer. That's interpret.com/lenny. This episode is brought to you by BuildBetter.AI. Back in 2020 when AI was just a toy, Build Better bet that it could cut down on product teams' operational BS. Fast-forward to today, 23,000 product teams use purpose built AI in Build Better every day. First, Build Better uses custom models to turn unstructured data like product and sales calls, support tickets, internal communications and surveys into structured insights. It's like having a dedicated data science team. Second, Build Better runs those structured insights into workflows like weekly reports about customer issues, context aware PRDs and user research documents with citations. It even turns standups into action items that automatically get assigned and shared into your tools. Plus, with unlimited seat pricing on all plans, Build Better ensures everyone at your company has access to this knowledge. Truly, no data silos. In a world of AI demos overpromising and under-delivering, see why Build Better has a 93% subscription retention. Get a personalized demo and use code Lenny for a $100 credit if you sign up now at BuildBetter.AI/Lenny. Sean, thank you so much for being here and welcome to the podcast.

Install uListen to search the full transcript and get AI-powered insights

Get Full Transcript

Get more from every podcast

AI summaries, searchable transcripts, and fact-checking. Free forever.

Add to Chrome