Skip to content
Lenny's PodcastLenny's Podcast

The UX Research reckoning is here | Judd Antin (Airbnb, Meta)

Judd Antin has spent 15 years leading research and design teams at companies like Yahoo, Meta, and Airbnb. His direct reports have gone on to lead user research at Figma, Notion, Slack, Robinhood, Duolingo, AllTrails, and more. In our conversation, we unpack the transformation that the user-research field is experiencing. Specifically: • Where user research went wrong over the past decade • The three types of research—macro, middle-range, and micro—and the purpose of each • How to effectively integrate researchers into the product development process • The “user-centered performance” phenomenon and why it’s a waste of time • Common tropes about PMs, from researchers • The ideal ratio of researchers in a company • Why Judd says NPS is useless, and what to use instead — Brought to you by Teal—Your personal career growth platform: http://tealhq.com/lenny | Vanta—Automate compliance. Simplify security: https://vanta.com/lenny | Ahrefs—Improve your website’s SEO for free: https://ahrefs.com/awt Find the full transcript at: https://www.lennysnewsletter.com/p/the-ux-research-reckoning-is-here Where to find Judd Antin: • LinkedIn: https://www.linkedin.com/in/juddantin/ • Website: https://juddantin.com/ • Blog: https://medium.com/onebigthought Where to find Lenny: • Newsletter: https://www.lennysnewsletter.com • X: https://twitter.com/lennysan • LinkedIn: https://www.linkedin.com/in/lennyrachitsky/ In this episode, we cover: (00:00) Judd’s background (04:16) Critiques and responses to Judd’s post “The UX Research Reckoning Is Here” (07:33) The state of user research (08:53) Macro, middle-range, and micro research (14:05) What teams get wrong when it comes to research (15:46) The importance of integrating research from the beginning (17:30) Traits of great researchers (19:53) Advice for evaluating user researchers (21:10) Balancing business and product focus (23:55) User-centered performance (26:42) The role of intuition in product development (30:15) Checking your gut instincts (32:54) Common tropes about PMs, from researchers (41:02) A/B testing vs. user research (43:15) Hindsight bias and narrative fallacy (44:55) Making recommendations based on research (47:26) Advice for teams on how to leverage researchers (51:18) How product managers can be better partners to user researchers (56:53) The ideal ratio of researchers in a company (59:43) Empowering user researchers to drive impact (01:03:39) The limitations of NPS as a metric (01:06:48) The risks of dogfooding (01:08:51) Lightning round Referenced: • Matt Gallivan on LinkedIn: https://www.linkedin.com/in/mattgallivan/ • Janna Bray on LinkedIn: https://www.linkedin.com/in/janna-bray-a4046a25/ • Celeste Ridlen on LinkedIn: https://www.linkedin.com/in/celesteridlen/ • Rebecca Gray on LinkedIn: https://www.linkedin.com/in/rebeccagray2/ • Hannah Pileggi on LinkedIn: https://www.linkedin.com/in/hannah-pileggi-43169314/ • Louise Beryl on LinkedIn: https://www.linkedin.com/in/louise-beryl-13225833/ • The UX Research Reckoning Is Here: https://medium.com/onebigthought/the-ux-research-reckoning-is-here-c63710ea4084 • The end of the “free money” era: https://www.theguardian.com/technology/2023/apr/11/techscape-zirp-tech-boom • Cognitive biases: https://en.wikipedia.org/wiki/List_of_cognitive_biases • IDEO design thinking: https://designthinking.ideo.com/ • Everything Is Obvious: How Common Sense Fails Us: https://www.amazon.com/Everything-Obvious-Common-Sense-Fails/dp/0307951790 • Patrick Collison’s tweet: https://twitter.com/patrickc/status/1443215022029619200?lang=en • Brian Chesky on LinkedIn: https://www.linkedin.com/in/brianchesky/ • Brian Chesky on Lenny’s Podcast: https://www.lennyspodcast.com/brian-cheskys-new-playbook/ • What is CSAT and how do you measure it?: https://www.qualtrics.com/experience-management/customer/what-is-csat/ • Michael Murakami on LinkedIn: https://www.linkedin.com/in/michaelhmurakami/ • Bad Leadership: What It Is, How It Happens, Why It Matters: https://www.amazon.com/Bad-Leadership-Happens-Matters-Common/dp/1591391660 • Demon Copperhead: https://www.amazon.com/Demon-Copperhead-Novel-Barbara-Kingsolver/dp/0063251922 • All Systems Red: The Murderbot Diaries: https://www.amazon.com/All-Systems-Red-Murderbot-Diaries/dp/0765397536 • The Last of Us on HBO: https://www.hbo.com/the-last-of-us • Belay glasses: https://www.amazon.com/Belay-Glasses-Climbing-Comfortable-Sturdy/dp/B08GSBYDKQ/ • Epictetus: Control What You Can—Especially Yourself: https://www.shortform.com/blog/epictetus-control/ • The 7 Habits of Highly Effective People: Powerful Lessons in Personal Change: https://www.amazon.com/Habits-Highly-Effective-People-Powerful/dp/0743269519 Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email podcast@lennyrachitsky.com. Lenny may be an investor in the companies discussed.

Judd AntinguestLenny Rachitskyhost
Jan 3, 20241h 14mWatch on YouTube ↗

At a glance

WHAT IT’S REALLY ABOUT

UX research’s reckoning: from feel-good theater to business-critical partner

  1. Judd Antin argues that UX research is undergoing a necessary reckoning after years of misalignment, over-hiring, and limited business impact. He introduces a framework of macro, middle-range, and micro research, contending that teams over-invest in vague, "interesting but not actionable" middle-range studies. Antin believes research is more valuable than ever—if researchers become deeply business-literate, multi-method, and embedded end-to-end with product teams, and if companies stop treating research as a reactive service. He also calls out widespread “user-centered performance,” where teams perform customer obsession to justify decisions they’ve already made, rather than genuinely seeking to learn and be proven wrong.

IDEAS WORTH REMEMBERING

5 ideas

Most teams are over-investing in vague middle-range research that feels insightful but doesn’t move metrics.

Middle-range studies (e.g., broad attitude or sentiment work) often produce interesting findings that are hard to operationalize and easy for stakeholders to dismiss as obvious, yielding little concrete business impact compared to well-aimed macro or micro research.

UX research must evolve into a business-critical, multi-method discipline.

Antin argues the strongest researchers are ‘Swiss army knives’ with skills in generative and evaluative research, survey design, applied statistics, and basic data/AI tooling—and they speak the language of funnels, OKRs, and strategy as fluently as user needs.

Researchers need to be explicitly profit- and strategy-oriented, not just user-empathy oriented.

He urges researchers to deeply understand company strategy, financials, and metrics (e.g., reading shareholder letters, roadmaps, funnels) and to frame work around the overlap between user value and business value, not just “what users need.”

Embedding researchers from beginning to end of the product process is far more effective than treating them as a late-stage service.

When researchers help define questions, prioritize work, and sit in key decision meetings, they can direct effort toward high-impact problems and run fast, targeted studies—rather than being asked to ‘validate’ pre-baked decisions at the end.

“User-centered performance” is pervasive and undermines genuine learning.

Teams frequently do research, listening sessions, or focus groups to signal customer-obsession and get a ‘check-the-box’ validation, while having no real willingness to change course; Antin argues that true research aims to falsify assumptions, not reassure egos.

WORDS WORTH SAVING

5 quotes

User-centered performance is work we do to signal to each other how customer-obsessed we are, not because we want to make a different decision.

Judd Antin

We don’t validate, we falsify. We are looking to be wrong.

Judd Antin

The user research discipline of the last 15 years is dying. The reckoning is here.

Judd Antin

Good research doesn’t slow us down—it speeds us up.

Judd Antin

If they cannot have that decision-making meeting without the researcher there, that means you’ve developed influence.

Judd Antin

The current ‘reckoning’ in UX research and why layoffs exposed structural issuesMacro vs. middle-range vs. micro research and where value is truly createdThe concept of “user-centered performance” and performative customer obsessionWhat makes a great modern researcher: skills, methods, and business fluencyHow to integrate research into product development for maximum impactThe often-strained PM–researcher relationship and common anti-research tropesCritique of NPS and better ways to measure customer experience and loyalty

High quality AI-generated summary created from speaker-labeled transcript.

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.

Add to Chrome