Lenny's PodcastArchie Abrams: Why Shopify bans KPIs and optimizes for churn
Through Shopify's year-plus holdout experiments and 100-year vision; intuition and lower funnel friction beat conversion-rate KPIs that quietly gate growth.
At a glance
WHAT IT’S REALLY ABOUT
Shopify’s Growth Playbook: Ban KPIs, Embrace Churn, Trust Intuition
- Shopify’s VP of Product & Head of Growth, Archie Abrams, explains an unconventional growth philosophy built around a 100‑year vision, power‑law economics, and radical experimentation discipline. Rather than obsess over churn and retention, Shopify optimizes for lowering barriers to entrepreneurship, accepting high failure rates because a small set of power users generate the vast majority of GMV and profit. Core product teams are not driven by KPIs or OKRs and instead prioritize taste, technical architecture, and long‑term merchant value, while the growth org uses metrics but validates impact through long‑term experiment holdouts. The conversation covers team structure, experiment design, incentives, monetary friction, sales and marketing integration, and how to make a “no KPIs” model work without drifting into chaos.
IDEAS WORTH REMEMBERING
5 ideasDesign for power‑law outcomes, not perfect retention.
Shopify expects many merchants to fail; its model assumes a few successful merchants generate outsized GMV and payments revenue that more than compensate for high churn. This allows them to prioritize ease of starting a business over maximizing long‑term retention for every new shop.
Lower monetary friction to unlock hidden high‑value customers.
Experiments reducing early monetary friction (e.g., trials, credits, pricing tweaks) often bring in people who would otherwise quit before validating their idea. Long‑term data showed these cohorts sometimes contain highly valuable, previously invisible entrepreneurs who succeed given a little more runway.
Use absolute counts, not conversion rates, to align incentives.
Teams goaled on funnel conversion rates naturally game the system by adding friction upstream, improving percentages while harming total outcomes. Shopify orients teams around absolute numbers of merchants progressing through each stage, which favors removing friction and increasing total value created.
Run long‑term holdouts; short‑term wins often don’t endure.
Shopify keeps experimental cohorts “tagged” and automatically re‑analyzes results at 3, 6, 9, and 12+ months, focusing on GMV and profit. They find 30–40% of short‑term “wins” show no long‑term lift (often just pulling revenue forward), and occasionally neutral experiments turn into big long‑term positives.
Ship neutral experiments if they align with strong product intuition.
If an experiment shows no significant short‑term effect but the team has conviction it improves the product experience or merchant outcomes, Shopify often ships it anyway. They treat the experiment as confirmation that neither variant is harmful and defer to taste and long‑term intuition.
WORDS WORTH SAVING
5 quotes“We want to lower the barriers to getting started and help folks grow, and those winners make the whole system work.”
— Archie Abrams
“In a given cohort, a lot of people will start and not succeed, but the folks who do go on to be successful will make that entire cohort extremely successful for Shopify.”
— Archie Abrams
“It’s almost always easier to just make it harder to do the thing right before your step in the funnel to increase your conversion rate.”
— Archie Abrams
“About 30 to 40 percent of the time, there actually isn’t a long-term lift from a lot of things that you might think in the short term are.”
— Archie Abrams
“You either have to use metrics as accountability, or have an extremely strong founder who has extremely strong opinions on what good is and what taste is.”
— Archie Abrams
High quality AI-generated summary created from speaker-labeled transcript.
Get more out of YouTube videos.
High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.
Add to Chrome