Gemini Gems Masterclass with the Creator at Google: 3 Gems You Must Build

Lisa Huang (SVP Product at Xero, creator of Gemini Gems at Google) breaks down how to build personalized AI with Gemini Gems, what it takes to ship accurate agents in fintech, and how to navigate your AI PM career - from Apple to Meta to Google to Xero. Full Writeup: https://www.news.aakashg.com/p/lisa-huang-podcast Transcript: https://www.aakashg.com/gemini-gems-meta-ray-ban-ai-and-building-agents-at-scale-with-lisa-huang/ --- Timestamps: 0:00 - Intro 1:49 - Guest introduction 2:05 - What are Gemini Gems? 3:52 - The 3 must-have Gems for every PM 6:05 - Live demo: building a product strategy Gem 9:01 - The story behind building Gemini Gems 10:32 - Ads 11:39 - Gemini Gems vs ChatGPT custom GPTs 16:45 - Career lessons from Apple, Meta and Google 23:05 - Building the AI assistant for Meta RayBan glasses 27:43 - Introducing JAX - Xero's financial super agent 32:22 - How to measure an AI agent 37:39 - Will AI replace PMs? 38:40 - Ads 39:45 - Breaking into AI PM 51:15 - Outro --- 🏆 Thanks to our sponsor - Reforge Build: AI prototyping built for product teams - https://reforge.com/aakash --- Key Takeaways: 1. Stop briefing your LLM from scratch every time - Gemini Gems hold your context permanently. Your role, your company strategy, your writing style. Build it once and it already knows everything the next time you open it. 2. Every PM needs 3 Gems - A writing clone trained on your PRDs and emails. A product strategy advisor loaded with your company docs and competitor analysis. A user research synthesizer that ingests raw transcripts and surfaces key themes. 3. Vague instructions are the number one mistake - "Help me write better" gets you nothing. Write a full page of context. Your role, your audience, your format preferences. The more specific, the more personalized the output. 4. Gemini Gems vs ChatGPT custom GPTs - OpenAI framed GPTs as an app store ecosystem. Google focused on personal productivity instead. First principles beat copying a competitor's framing, and the GPT store never took off. 5. On-device AI is the future for wearables - Cloud is the default today but once a device is on your face all day, people want their data staying local. Privacy beats performance when the device is that personal. 6. Accuracy is the product in high-stakes AI - LLMs out of the box are not great at math, accounting, or tax. Winning agents combine deep domain knowledge with proprietary data that no general-purpose model can access. 7. Measure agents in three layers - Quality first (evals, human annotators, LLM judges). Product metrics second (adoption, retention, CSAT). Business impact third (revenue attribution, ARR). Skip to layer three without the foundation and you are measuring on sand. 8. AI will not replace PMs - it will replace the execution work. Writing PRDs, creating mocks, managing roadmaps. What stays is product judgment. The ability to look at ambiguous signals and say this is the right bet and here is why. 9. The PM role is becoming a hybrid - PM to engineer ratios will compress. The expectation is that PMs also build. Not just spec and hand off, but prototype, design, and code enough to show what they mean. The tools to do this exist right now. 10. Your company's permission is not required - Most companies are not fine-tuning models. They are using the same consumer tools you already have. Build Gems. Build projects. Build small AI products with your personal data. There is nothing stopping you. --- 👨‍💻 Where to find Lisa Huang: LinkedIn: https://www.linkedin.com/in/lisaxhuang/ Xero: https://www.xero.com/us/ai-in-accounting/jax/ 👨‍💻 Where to find Aakash: Twitter: https://www.x.com/aakashg0 LinkedIn: https://www.linkedin.com/in/aakashgupta/ Newsletter: https://www.news.aakashg.com #gemini #aipm --- 🧠 About Product Growth: The world's largest podcast focused solely on product + growth, with over 200K+ listeners. 🔔 Subscribe and turn on notifications to get more videos like this.

Aakash GuptahostLisa Huangguest

Mar 5, 202652mWatch on YouTube ↗

EPISODE INFO

Released: March 5, 2026
Duration: 52m
Channel: Aakash Gupta
Watch on YouTube: ▶ Open ↗

EPISODE DESCRIPTION

Lisa Huang (SVP Product at Xero, creator of Gemini Gems at Google) breaks down how to build personalized AI with Gemini Gems, what it takes to ship accurate agents in fintech, and how to navigate your AI PM career - from Apple to Meta to Google to Xero. Full Writeup: https://www.news.aakashg.com/p/lisa-huang-podcast Transcript: https://www.aakashg.com/gemini-gems-meta-ray-ban-ai-and-building-agents-at-scale-with-lisa-huang/ --- Timestamps: 0:00 - Intro 1:49 - Guest introduction 2:05 - What are Gemini Gems? 3:52 - The 3 must-have Gems for every PM 6:05 - Live demo: building a product strategy Gem 9:01 - The story behind building Gemini Gems 10:32 - Ads 11:39 - Gemini Gems vs ChatGPT custom GPTs 16:45 - Career lessons from Apple, Meta and Google 23:05 - Building the AI assistant for Meta RayBan glasses 27:43 - Introducing JAX - Xero's financial super agent 32:22 - How to measure an AI agent 37:39 - Will AI replace PMs? 38:40 - Ads 39:45 - Breaking into AI PM 51:15 - Outro --- 🏆 Thanks to our sponsor - Reforge Build: AI prototyping built for product teams - https://reforge.com/aakash --- Key Takeaways:
1. Stop briefing your LLM from scratch every time - Gemini Gems hold your context permanently. Your role, your company strategy, your writing style. Build it once and it already knows everything the next time you open it.
1. Every PM needs 3 Gems - A writing clone trained on your PRDs and emails. A product strategy advisor loaded with your company docs and competitor analysis. A user research synthesizer that ingests raw transcripts and surfaces key themes.
1. Vague instructions are the number one mistake - "Help me write better" gets you nothing. Write a full page of context. Your role, your audience, your format preferences. The more specific, the more personalized the output.
1. Gemini Gems vs ChatGPT custom GPTs - OpenAI framed GPTs as an app store ecosystem. Google focused on personal productivity instead. First principles beat copying a competitor's framing, and the GPT store never took off.
1. On-device AI is the future for wearables - Cloud is the default today but once a device is on your face all day, people want their data staying local. Privacy beats performance when the device is that personal.
1. Accuracy is the product in high-stakes AI - LLMs out of the box are not great at math, accounting, or tax. Winning agents combine deep domain knowledge with proprietary data that no general-purpose model can access.
1. Measure agents in three layers - Quality first (evals, human annotators, LLM judges). Product metrics second (adoption, retention, CSAT). Business impact third (revenue attribution, ARR). Skip to layer three without the foundation and you are measuring on sand.
1. AI will not replace PMs - it will replace the execution work. Writing PRDs, creating mocks, managing roadmaps. What stays is product judgment. The ability to look at ambiguous signals and say this is the right bet and here is why.
1. The PM role is becoming a hybrid - PM to engineer ratios will compress. The expectation is that PMs also build. Not just spec and hand off, but prototype, design, and code enough to show what they mean. The tools to do this exist right now.
1. Your company's permission is not required - Most companies are not fine-tuning models. They are using the same consumer tools you already have. Build Gems. Build projects. Build small AI products with your personal data. There is nothing stopping you. --- 👨‍💻 Where to find Lisa Huang: LinkedIn: https://www.linkedin.com/in/lisaxhuang/ Xero: https://www.xero.com/us/ai-in-accounting/jax/ 👨‍💻 Where to find Aakash: Twitter: https://www.x.com/aakashg0 LinkedIn: https://www.linkedin.com/in/aakashgupta/ Newsletter: https://www.news.aakashg.com #gemini #aipm --- 🧠 About Product Growth: The world's largest podcast focused solely on product + growth, with over 200K+ listeners. 🔔 Subscribe and turn on notifications to get more videos like this.

SPEAKERS

Aakash Gupta
host
Host of the Aakash Gupta channel/podcast who interviews product and AI leaders.
Lisa Huang
guest
Creator of Gemini Gems and AI product leader with experience at Apple, Meta, Google, and SVP at Xero.

EPISODE SUMMARY

In this episode of Aakash Gupta, featuring Aakash Gupta and Lisa Huang, Gemini Gems Masterclass with the Creator at Google: 3 Gems You Must Build explores build Gemini Gems, ship AI agents, and future-proof PM careers Gemini Gems are customizable Gemini instances that retain instructions and uploaded context so users stop re-prompting and can get consistently tailored outputs.

RELATED EPISODES