Skip to content
Aakash GuptaAakash Gupta

Gemini Gems Masterclass with the Creator at Google: 3 Gems You Must Build

Lisa Huang (SVP Product at Xero, creator of Gemini Gems at Google) breaks down how to build personalized AI with Gemini Gems, what it takes to ship accurate agents in fintech, and how to navigate your AI PM career - from Apple to Meta to Google to Xero. Full Writeup: https://www.news.aakashg.com/p/lisa-huang-podcast Transcript: https://www.aakashg.com/gemini-gems-meta-ray-ban-ai-and-building-agents-at-scale-with-lisa-huang/ --- Timestamps: 0:00 - Intro 1:49 - Guest introduction 2:05 - What are Gemini Gems? 3:52 - The 3 must-have Gems for every PM 6:05 - Live demo: building a product strategy Gem 9:01 - The story behind building Gemini Gems 10:32 - Ads 11:39 - Gemini Gems vs ChatGPT custom GPTs 16:45 - Career lessons from Apple, Meta and Google 23:05 - Building the AI assistant for Meta RayBan glasses 27:43 - Introducing JAX - Xero's financial super agent 32:22 - How to measure an AI agent 37:39 - Will AI replace PMs? 38:40 - Ads 39:45 - Breaking into AI PM 51:15 - Outro --- 🏆 Thanks to our sponsor - Reforge Build: AI prototyping built for product teams - https://reforge.com/aakash --- Key Takeaways: 1. Stop briefing your LLM from scratch every time - Gemini Gems hold your context permanently. Your role, your company strategy, your writing style. Build it once and it already knows everything the next time you open it. 2. Every PM needs 3 Gems - A writing clone trained on your PRDs and emails. A product strategy advisor loaded with your company docs and competitor analysis. A user research synthesizer that ingests raw transcripts and surfaces key themes. 3. Vague instructions are the number one mistake - "Help me write better" gets you nothing. Write a full page of context. Your role, your audience, your format preferences. The more specific, the more personalized the output. 4. Gemini Gems vs ChatGPT custom GPTs - OpenAI framed GPTs as an app store ecosystem. Google focused on personal productivity instead. First principles beat copying a competitor's framing, and the GPT store never took off. 5. On-device AI is the future for wearables - Cloud is the default today but once a device is on your face all day, people want their data staying local. Privacy beats performance when the device is that personal. 6. Accuracy is the product in high-stakes AI - LLMs out of the box are not great at math, accounting, or tax. Winning agents combine deep domain knowledge with proprietary data that no general-purpose model can access. 7. Measure agents in three layers - Quality first (evals, human annotators, LLM judges). Product metrics second (adoption, retention, CSAT). Business impact third (revenue attribution, ARR). Skip to layer three without the foundation and you are measuring on sand. 8. AI will not replace PMs - it will replace the execution work. Writing PRDs, creating mocks, managing roadmaps. What stays is product judgment. The ability to look at ambiguous signals and say this is the right bet and here is why. 9. The PM role is becoming a hybrid - PM to engineer ratios will compress. The expectation is that PMs also build. Not just spec and hand off, but prototype, design, and code enough to show what they mean. The tools to do this exist right now. 10. Your company's permission is not required - Most companies are not fine-tuning models. They are using the same consumer tools you already have. Build Gems. Build projects. Build small AI products with your personal data. There is nothing stopping you. --- 👨‍💻 Where to find Lisa Huang: LinkedIn: https://www.linkedin.com/in/lisaxhuang/ Xero: https://www.xero.com/us/ai-in-accounting/jax/ 👨‍💻 Where to find Aakash: Twitter: https://www.x.com/aakashg0 LinkedIn: https://www.linkedin.com/in/aakashgupta/ Newsletter: https://www.news.aakashg.com #gemini #aipm --- 🧠 About Product Growth: The world's largest podcast focused solely on product + growth, with over 200K+ listeners. 🔔 Subscribe and turn on notifications to get more videos like this.

Aakash GuptahostLisa Huangguest
Mar 4, 202652mWatch on YouTube ↗

At a glance

WHAT IT’S REALLY ABOUT

Build Gemini Gems, ship AI agents, and future-proof PM careers

  1. Gemini Gems are customizable Gemini instances that retain instructions and uploaded context so users stop re-prompting and can get consistently tailored outputs.
  2. Lisa Huang recommends three must-have PM Gems—a writing clone, product strategy advisor, and user research synthesizer—mapped to core PM responsibilities of communication, strategy, and insight generation.
  3. Effective Gems require detailed instructions, the right contextual “knowledge” files, specialization by job-to-be-done, and ongoing iteration like a mini product.
  4. In high-stakes domains like finance, successful AI agents require hybrid systems (LLMs plus programmatic controls), strong domain workflows, robust evals, and human/LLM-judge quality loops.
  5. PM careers won’t be replaced by AI, but team structures and expectations will change toward “PMs as builders,” making AI tool fluency, prototyping, and technical depth increasingly mandatory.

IDEAS WORTH REMEMBERING

5 ideas

Treat a Gem like a reusable context container, not a one-off prompt.

Gems exist because LLMs lack persistent context; by storing instructions and curated documents, you reduce repetitive prompting and get more reliable, “you-shaped” outputs over time.

Every PM should start with three Gems tied to core PM work.

A writing clone speeds stakeholder communication, a product strategy advisor supports decision-making with company/market context, and a user research synthesizer turns raw feedback into actionable insights.

High-performing Gems are built with specificity, examples, and scoped jobs.

Vague prompts (“help me write better”) underperform; detailed instructions plus relevant artifacts (PRDs, emails, research transcripts) and specialized Gems per task produce better consistency.

Iteration is not optional—quality comes from a feedback loop.

Lisa frames Gems as mini products: test outputs, refine instructions, update knowledge files as reality changes, and keep tightening until the Gem reliably matches your intent.

Gems differ from custom GPT positioning: prioritize productivity over monetization.

Google saw instructions as easily copyable and focused less on an “app store” model, instead optimizing for personal/team amplification and sharing within shared-context environments.

WORDS WORTH SAVING

5 quotes

Gemini Gems are custom versions of Gemini that you can create for your specific use case.

Lisa Huang

If you aren't using Gemini Gems, you aren't getting the most out of Gemini.

Lisa Huang

Let’s call them the writing clone, the product strategy advisor, and the user research synthesizer.

Lisa Huang

Accuracy is not a nice-to-have, it’s a core part of our differentiation.

Lisa Huang

I pay them for their product judgment.

Lisa Huang

Definition and purpose of Gemini GemsThree essential Gems for product managersGem creation workflow: instructions, knowledge, iterationGems vs ChatGPT custom GPTs (ecosystem vs productivity)Building AI assistants for wearables (Ray-Ban Stories)Xero’s JAX financial super-agent and hybrid architectureMeasuring AI agents: quality, engagement, business impactAI PM hiring signals: grit, growth mindset, craftFuture of PM: compression, PM-as-builder, technical expectationsBreaking into AI PM: side projects, networking, interview practice

High quality AI-generated summary created from speaker-labeled transcript.

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.

Add to Chrome