Skip to content

By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.

a16za16z

The New AI Agents That Shop, Plan, and Gossip

Will we have one AI assistant that does everything, or an entire network of agents that know different parts of our lives? David Pawlan, creator of Assistant Benchmark, returns with Anish Acharya and Josh Elman to take stock of how quickly the agent landscape has changed. David has now tested more than 140 AI assistants, and they unpack what separates them, from memory and judgment to trust, shopping, and social experiences. They also explore what happens when agents start talking to each other, how they could create new kinds of social networks and serendipity, and why the most compelling agents may ultimately do more than save time. They could become a kind of secret superpower. Timestamps: 00:00 Intro 00:52 Inside the agent meetup 03:36 An army of agents for every part of life 05:12 Trust, fences and the Shane Mac Slack leak 09:15 Privacy vs. utility: what people will actually share 12:16 Testing agents on flowers and a weekend in LA 21:00 Photos, screenshots and new sources of context 25:31 Will agents make consumers more rational? 29:27 Multiplayer and gossipy agents 36:55 From OpenClaw to agent-to-agent networks 46:15 What will change by next month Resources: Follow David Pawlan: https://x.com/DavidPawlan Follow Josh Elman: https://x.com/joshelman Follow Anish Acharya on X: https://x.com/illscience Stay Updated: If you enjoyed this episode, be sure to like, subscribe, and share with your friends! Find a16z on X: https://twitter.com/a16z Find a16z on LinkedIn: https://www.linkedin.com/company/a16z Listen to the a16z Show on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX Listen to the a16z Show on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711 Follow our host: https://x.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see http://a16z.com/disclosures.

Josh ElmanhostDavid PawlanguestAnish Acharyahost
Nov 4, 202650mWatch on YouTube ↗

Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.

At a glance

WHAT IT’S REALLY ABOUT

AI agents are becoming specialized, social—and trust remains the bottleneck

  1. The speakers discuss how AI agents are rapidly evolving beyond a single general assistant into many specialized agents spanning productivity, travel, multiplayer/social, and other life areas.
  2. Trust is described as the biggest barrier to adoption, with emphasis on permission “fences,” preventing personal/work context bleed, and avoiding embarrassing mistakes.
  3. They explore how real users trade privacy for convenience, while noting discretion and social judgment (avoiding embarrassment) may matter more than abstract security concerns.
  4. Benchmarks like ordering flowers and planning a LA weekend reveal large differences in how agents balance constraints, interpret ambiguous preferences, and incorporate feedback from other agents.
  5. They predict near-term shifts toward more fun, relationship-building agents and broader adoption by non-technical users, alongside ongoing infrastructure and reliability improvements.

IDEAS WORTH REMEMBERING

5 ideas

Agents will diversify into an “army of agents,” each specialized by life facet and personality.

Josh Elman argues people won’t rely on a single do-everything assistant; instead they’ll use different agents the way they rely on different friends for different needs (work, travel, health, brainstorming, etc.). He expects some agents to be matter-of-fact productivity tools while others are playful and socially oriented.

Trust is the dominant user fear and a gating factor for higher-stakes agents (e.g., finance).

David Pawlan says that across ~3,600 messages from AI power-user group chats, the most common fear is trust, representing 22% of messages. He suggests solving trust is a prerequisite for sensitive use cases like finance, which he hasn’t seen “come to fruition yet.”

The path to trust runs through “fences”: scoped permissions, monitoring, and preventing context bleed.

Josh Elman recounts a case where a personal agent crossed into work context and posted finances into a company Slack, reinforcing the need for better boundaries. He highlights Shane Mac’s “fences” analogy: giving agents freedom inside carefully defined permission boundaries.

People will trade privacy for utility, but privacy becomes a differentiator once capabilities converge.

Anish Acharya claims stated privacy concerns often differ from revealed behavior, pointing to examples of people connecting sensitive accounts for convenience and to a campaign where people granted broad access for pizza. Josh Elman adds a counterbalance: when utility is equal, people will choose the more private option.

Preference-handling and trade-off reasoning are key differentiators—and agents interpret the same words differently.

David Pawlan’s flower-ordering test evaluated how agents balance multiple constraints (same-day delivery plus lowest cost), and his LA weekend test stressed conflicting goals (“luxurious” and “cost-efficient”). The results showed agents interpret preferences differently (e.g., luxury as time vs. luxury as comfort) and vary in handling trade-offs and peer input.

WORDS WORTH SAVING

5 quotes

I think we're gonna get used to having kind of an army of agents that will do this.

— Josh Elman

From over 147 different assistants that have come across my plate so far, the number one fear that people talk about, 22% of the messages are talking about trust as the main fear.

— David Pawlan

What I've seen from 30 years in consumer product is, like, paternalism will kill any product. Even a hint or a whiff of paternalism will.

— Anish Acharya

I've been thinking a lot back to this photo roll about what are the other data sources that we haven't tapped into yet.

— Josh Elman

I think whoever is able to build that type of trust, you know, almost like a dark agent, um, will actually have something really fascinating on their hands.

— Anish Acharya

Agent ecosystem and specializationCommunity and agent builder meetupsTrust, permissions, and context boundariesPrivacy vs. utility trade-offsBenchmarks: flowers and weekend travel planningMemory, onboarding, and switching frictionMultiplayer, gossipy agents, and agent-to-agent networks

High quality AI-generated summary created from speaker-labeled transcript.

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.