Skip to content

By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.

a16za16z

What It Takes to Build an AI That Actually Knows You

AI agents are getting smarter, but every new agent still has to learn who you are. What if your preferences, priorities, relationships, and digital context could move with you instead?

Ken LiuguestMartin CasadohostJoel de la Garzahost
Nov 18, 202633mWatch on YouTube

Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.

Great conversations run long. Their best ideas don't have to.

uListen is free on iPhone, iPad, Android, Chrome, and Claude.

See how

Episode Details

EPISODE INFO

Released
November 18, 2026
Duration
33m
Channel
a16z
Watch on YouTube
▶ Open ↗

EPISODE DESCRIPTION

AI agents are getting smarter, but every new agent still has to learn who you are. What if your preferences, priorities, relationships, and digital context could move with you instead? First Person Labs co-founder Ken Liu joins a16z’s Martin Casado and Joel de la Garza to introduce Second, a personal context layer designed to understand what you’re doing across your digital life and make that context available to the agents you choose. They discuss how Second can proactively connect information across conversations and applications, why protecting such personal data requires a different security architecture, and the longer-term vision of AI that doesn’t just respond to prompts, but understands enough context to know when and how to help. Timestamps: 0:00 Intro 0:50 What Is First Person Labs? 2:43 The Alfred Model: Your Agent's Butler 3:56 What Your Computer Already Knows About You 5:59 Proactive AI: Reactive vs. Reflective 8:16 Why You Only Need One Second 10:27 Can You Trust Something That Sees Everything? 15:41 Can an LLM Keep Your Secrets? 17:40 Cost, Models, and the Target User 20:20 Use Cases and the Model Mix 23:34 How You Use Second (APIs and Apps) 26:20 Toward Jarvis: AI Everywhere 30:43 Fort Knox Meets Delightful UX Resources: Try Second: https://2.computer Learn more about First Person Labs: https://fpl.company/ Follow Ken Liu: ​​​​https://www.linkedin.com/in/kenziyuliu/ Follow Martin Casado on X: https://x.com/martin_casado Follow Joel de la Garza: https://x.com/YODELAGARZA Stay Updated: If you enjoyed this episode, be sure to like, subscribe, and share with your friends! Find a16z on X: https://twitter.com/a16z Find a16z on LinkedIn: https://www.linkedin.com/company/a16z Listen to the a16z Show on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX Listen to the a16z Show on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711 Follow our host: https://x.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see http://a16z.com/disclosures.

SPEAKERS

  • Ken Liu

    guest

    Founder at First Person Labs, building the “Second” personalized AI assistant and its privacy/security architecture.

  • Martin Casado

    host

    a16z general partner focused on infrastructure/enterprise tech, interviewing Ken about First Person Labs and its product design.

  • Joel de la Garza

    host

    a16z host/co-host with a security/systems focus, asking detailed questions about confidential inference and data handling.

EPISODE SUMMARY

In this episode of a16z, featuring Ken Liu and Martin Casado, What It Takes to Build an AI That Actually Knows You explores Second: a secure, always-on personal context layer for AI agents Ken Liu introduces First Person Labs’ “Second” as a persistent model of a person—capturing memories, preferences, priorities, and intent—that other agents can consult as portable context.

RELATED EPISODES

What History Tells Us About the AI Revolution | Tyler Cowen & Alex Imas

What History Tells Us About the AI Revolution | Tyler Cowen & Alex Imas

Cyberattacks Used to Take Months. AI Can Do It in Minutes.

Cyberattacks Used to Take Months. AI Can Do It in Minutes.

How AI Could Bring Halo and Other Classic Games Back to Life

How AI Could Bring Halo and Other Classic Games Back to Life

Mike Volpi on Why AI Infrastructure Will Outlast the Hype Cycle

Mike Volpi on Why AI Infrastructure Will Outlast the Hype Cycle

Why HubSpot’s Co-Founder Is Betting Against the SaaSpocalypse

Why HubSpot’s Co-Founder Is Betting Against the SaaSpocalypse

Inside Salesforce’s Acquisition Strategy for the AI Era

Inside Salesforce’s Acquisition Strategy for the AI Era

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.