Skip to content
Lenny's PodcastLenny's Podcast

Career frameworks, A/B testing, onboarding tips, selling to engineers | Laura Schaffer (Amplitude)

Laura Schaffer is the brand-new VP of Growth at Amplitude. Prior to this role, she spent over 10 years leading product management and growth teams at Twilio, Bandwidth, and Rapid. In today’s episode, we talk about the role of experimentation and data in growth, and Laura shares stories of big wins from her time leading growth teams. She explains how customer insights helped her uplevel her career and how she (surprisingly) thinks about qualitative versus quantitative data. We wrap up our conversation by discussing where the best ideas come from and what you need to know if you’re selling to developers. — Brought to you by Public—Invest in stocks, treasuries, crypto, and more | Eppo—Run reliable, impactful experiments | Writer—Generative AI for the enterprise Find the full transcript here: https://www.lennysnewsletter.com/p/career-frameworks-ab-testing-counterintuitive Where to find Laura Schaffer: • LinkedIn: https://www.linkedin.com/in/lauraschaffer/ Where to find Lenny: • Newsletter: https://www.lennysnewsletter.com • Twitter: https://twitter.com/lennysan • LinkedIn: https://www.linkedin.com/in/lennyrachitsky/ Referenced: • Elena Verna on Lenny’s Podcast: https://www.lennyspodcast.com/elena-verna-on-how-b2b-growth-is-changing-product-led-growth-product-led-sales-why-you-should-go-freemium-not-trial-what-features-to-make-free-and-much-more/ • Bandwidth: https://www.bandwidth.com/ • Twilio: https://ahoy.twilio.com/ • Jeff Lawson on LinkedIn: https://www.linkedin.com/in/jeffiel/ • The Surprising Power of Online Experiments: https://hbr.org/2017/09/the-surprising-power-of-online-experiments • Reforge: https://www.reforge.com/ • Online Experimentation at Microsoft: https://ai.stanford.edu/~ronnyk/ExPThinkWeek2009Public.pdf • The Simple Path to Wealth: Your Road Map to Financial Independence and a Rich, Free Life: https://www.amazon.com/Simple-Path-Wealth-financial-independence/dp/1533667926 • Atomic Habits: An Easy & Proven Way to Build Good Habits & Break Bad Ones: https://www.amazon.com/Atomic-Habits-Proven-Build-Break/dp/0735211299/ • James Clear on The Tim Ferriss Show: https://podcasts.apple.com/us/podcast/648-james-clear-atomic-habits-simple-strategies-for/id863897795?i=1000592431628 • The Great British Baking Show on PBS: https://www.pbs.org/food/shows/great-british-baking-show/ • Hotjar: https://www.hotjar.com/ • Amplitude: https://amplitude.com/ • Builder: https://www.builder.io/ • ChatGPT: https://chat.openai.com/ • Lenny Bot: https://www.lennybot.com/ • Segment: https://segment.com/ • Senior Growth PM, Monetization, at Amplitude: https://boards.greenhouse.io/amplitude/jobs/6636704002 • Lead Growth PM at Builder: https://boards.greenhouse.io/builder/jobs/4814755004?gh_src=30cfda2d4us • Growth PM at Rapid: https://jobs.lever.co/rapidapi/8d2611d1-6463-4919-9817-31f61e730831 In this episode, we cover: (00:00) Laura’s background (04:15) How to carve your own career path, and an example from Bandwidth (05:50) Laura’s career growth framework (10:18) The value of customer insights (12:25) The “voice of the customer” report (16:14) Leaning into your strengths (18:16) The experiment that shifted the way Laura thinks about friction (20:20) Questions that improved Twilio’s onboarding and conversion rate (28:53) Thinking about the psyche of your users (31:26) The hot dog analogy for burying “scary stuff” (33:58) Why it’s better to be iterative and why experiments fail (36:21) Saving money by validating fast (41:58) Where the best ideas come from (49:51) Experimentation lessons (52:54) The amount of time a growth team needs to be successful  (54:43) The big change at Twilio that led to tens of millions of dollars (58:41) The need for both PLG and enterprise, and how Amplitude plans to tap into PLG (1:05:42) What it’s like to serve developers (1:11:16) Lightning round Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email podcast@lennyrachitsky.com.

Laura SchafferguestLenny Rachitskyhost
Mar 8, 20231h 21mWatch on YouTube ↗

At a glance

WHAT IT’S REALLY ABOUT

From Twilio to Amplitude: Growth, experiments, and selling developers

  1. Lenny interviews Laura Schaffer, newly appointed Head of Growth at Amplitude and former growth/product leader at Twilio and Rapid, about career growth, experimentation, and developer-focused products.
  2. Laura shares her career framework centered on proactively surfacing customer insights, building an internal brand, and effectively carving your own path instead of waiting for managers or ladders to define it.
  3. She dives deep into experimentation strategy—why most ideas fail, how to validate cheaply, when to accept lower statistical confidence, and the importance of understanding user psychology at each step of the journey.
  4. They also explore how to build product-led growth motions (especially in traditionally sales-led companies) and what makes developers such a distinct, demanding audience to build and sell for.

IDEAS WORTH REMEMBERING

5 ideas

Own your career by surfacing customer insights, not just doing your job well.

Laura argues that simply excelling in your role ties your trajectory to your manager and org structure. By deeply understanding customers and regularly sharing structured 'voice of the customer' insights across the company, you build a broader reputation, unlock cross-functional opportunities, and can even create new roles/teams for yourself—as she did with growth at Twilio.

Get known internally as “the person who knows the customer.”

Creating recurring artifacts (e.g., a digest, a quarterly voice-of-customer session) makes you visible to senior leaders and peers. This helped Laura quickly gain influence at Twilio and secure support when she later pitched forming a growth team.

Not all friction is bad; use “good friction” to reassure and orient users.

A Twilio experiment adding four questions (language, role, product, use case) to signup unexpectedly increased conversion by ~5%. The extra steps calmed users’ fears (“Am I in the right place? Will this work for me?”), showing that psychologically aligned friction can actually boost conversion.

Design experiments around user psyche, not just UX logic.

In onboarding, forcing developers to deal with telecom concepts (phone numbers) as step one suppressed conversion, because it triggered anxiety and unfamiliarity. Moving that step later and 'hiding the scary part in the hot dog' (embedding it within a more familiar code-first flow) significantly improved outcomes.

Most ideas fail; success comes from failing cheaply and often, not from perfect bets.

Citing data from companies like Microsoft and Netflix, Laura notes 80–90% of hypotheses are wrong. She pushes teams to validate ideas via cheap methods (mocks, qualitative tests, painted doors) and reserve fully built A/B tests for concepts that have already survived earlier filters.

WORDS WORTH SAVING

5 quotes

Bad friction is bad, and good friction is good. There’s no rule that all friction is bad.

Laura Schaffer

Your executive team is smart, but they’re often the farthest from the customer. That’s your superpower.

Laura Schaffer

If it’s not embarrassing, you’ve gone too far with the first iteration.

Laura Schaffer

Failure doesn’t have to be a wall; it can be a compass.

Laura Schaffer

Developers can’t afford to take someone’s word for it. They have to prove it to themselves, because if your service fails, it’s on them.

Laura Schaffer

Proactive career growth and building an internal personal brandStaying close to customers and sharing voice-of-customer insightsExperimentation strategy: good vs. bad friction, psyche of the user, and iterating quicklyStatistical rigor vs. speed: confidence intervals, failure rates, and decision-makingBuilding product-led growth within sales-led organizationsDesigning onboarding and activation flows that reduce fear and increase confidenceSelling to developers and how they fundamentally differ from other customer segments

High quality AI-generated summary created from speaker-labeled transcript.

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.

Add to Chrome