Skip to content

By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.

a16za16z

The New AI Agents That Shop, Plan, and Gossip

Will we have one AI assistant that does everything, or an entire network of agents that know different parts of our lives? David Pawlan, creator of Assistant Benchmark, returns with Anish Acharya and Josh Elman to take stock of how quickly the agent landscape has changed. David has now tested more than 140 AI assistants, and they unpack what separates them, from memory and judgment to trust, shopping, and social experiences. They also explore what happens when agents start talking to each other, how they could create new kinds of social networks and serendipity, and why the most compelling agents may ultimately do more than save time. They could become a kind of secret superpower. Timestamps: 00:00 Intro 00:52 Inside the agent meetup 03:36 An army of agents for every part of life 05:12 Trust, fences and the Shane Mac Slack leak 09:15 Privacy vs. utility: what people will actually share 12:16 Testing agents on flowers and a weekend in LA 21:00 Photos, screenshots and new sources of context 25:31 Will agents make consumers more rational? 29:27 Multiplayer and gossipy agents 36:55 From OpenClaw to agent-to-agent networks 46:15 What will change by next month Resources: Follow David Pawlan: https://x.com/DavidPawlan Follow Josh Elman: https://x.com/joshelman Follow Anish Acharya on X: https://x.com/illscience Stay Updated: If you enjoyed this episode, be sure to like, subscribe, and share with your friends! Find a16z on X: https://twitter.com/a16z Find a16z on LinkedIn: https://www.linkedin.com/company/a16z Listen to the a16z Show on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX Listen to the a16z Show on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711 Follow our host: https://x.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see http://a16z.com/disclosures.

Josh ElmanhostDavid PawlanguestAnish Acharyahost
Nov 4, 202650mWatch on YouTube ↗

Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.

CHAPTERS

  1. 0:00 – 0:53

    Why life will need an “army of agents” across different facets

    The conversation opens with the idea that agents won’t be a single universal assistant but many specialized helpers for different parts of life. The speakers contrast productivity-focused agents with playful, social, and even “gossipy” ones that create new kinds of connections.

    • •Agents are framed as filling many distinct facets of life, similar to relying on different friends for different needs.
    • •Anish Acharya raises the question of what kinds of personal boundaries people won’t want to cross or reveal to an agent.
    • •The group foreshadows that trust and discretion will become central as agents become more embedded in personal routines.
    • •The notion emerges that some agents may be purely utilitarian while others are socially oriented and relationship-building.
  2. 0:53 – 3:37

    Inside the agent builder meetup: community at the frontier

    David Pawlan describes hosting a meetup with over 100 attendees and a pitch-style showcase of assistant builders. The group discusses why founders are unusually open and collaborative right now, and why in-person community feels surprisingly important in “agent world.”

    • •David recounts an event with strong attendance, casual conversations, and multiple builders pitching what they’re working on.
    • •He observes people are craving community even while spending lots of time interacting with agents.
    • •Anish notes many products overlap, yet David says founders are still open-minded because nobody knows how the landscape will settle.
    • •Josh suggests the moment feels non-zero-sum and early enough that sharing learnings benefits everyone.
  3. 3:37 – 5:11

    How agents will differentiate: work, travel, multiplayer—and social gossip

    The speakers map the current agent ecosystem into categories and describe how new behaviors emerge when agents are connected to multiple people. Josh shares examples of playful agents that exchange information across friends, creating social moments unrelated to “getting tasks done.”

    • •Josh predicts people will use different agents for finances, health, trips, calendar management, and thinking out loud.
    • •David says he’s seen four categories most often: general, work-oriented, multiplayer, and travel, and notes finance hasn’t yet emerged strongly.
    • •Josh describes “gossipy” agents connected to friends that share tidbits and spark real conversations.
    • •The group frames this period as a “Cambrian phase” where many approaches will coexist.
  4. 5:11 – 9:15

    Trust, fences, and preventing personal/work bleed-through

    Trust becomes the major theme, anchored by an anecdote about an agent accidentally sharing personal finance information into a work Slack. The speakers discuss “fences” as permission boundaries and debate how much autonomy people actually want agents to have today.

    • •David cites analysis of messages from AI power users, saying trust is the top fear and is frequently discussed as the main concern.
    • •Josh relays an analogy about building fences so agents can roam freely within safe boundaries of apps and data access.
    • •They discuss the risk of personal agents bleeding into workplace systems and the need for controlled permissions and monitoring.
    • •Josh argues people want agents to do groundwork and present options, but still want a final check-in before acting.
  5. 9:15 – 12:38

    Privacy vs. utility—and why embarrassment may matter most

    The discussion distinguishes between stated concern about safety and what people actually do when utility is offered. They argue that beyond privacy, the bigger failure mode is social embarrassment and poor discretion, especially when agents communicate on someone’s behalf.

    • •Anish contrasts stated vs. revealed preferences, arguing people often share lots of data for small upside.
    • •David gives an example of people granting broad Google Workspace access for small rewards, illustrating how easily data gets exchanged.
    • •Anish emphasizes embarrassment and social signaling as a major source of anxiety, using the Slack incident as an example.
    • •Josh says people trade privacy for utility, but when utility is similar they’ll choose the more private option; discretion becomes critical.
    • •David highlights the sensitivity of AI sending emails, describing the professional embarrassment risk if tone goes wrong.
  6. 12:38 – 14:13

    Testing agents in the real world: ordering flowers under constraints

    David explains a benchmark test where multiple agents were tasked with ordering same-day flower delivery while optimizing for both price and speed. The group uses the results to explore what “judgment” means and how well agents handle multiple competing preferences.

    • •David defines the test as balancing two constraints: lowest cost and delivery today.
    • •He reports some agents handled the dual constraints better than others, while many prioritized delivery but not price.
    • •The discussion surfaces how agents struggle when preferences become more complex and weighted simultaneously.
    • •Josh notes real-world gifting adds social dimensions (impressing the recipient, hiding price, adding a note) that benchmarks may omit.
    • •They point out that agents sometimes ask about including a note, hinting at early forms of situational judgment.
  7. 14:13 – 17:48

    A weekend in LA: luxury vs. cost, clarifying questions, and agent debates

    David describes a second experiment: booking travel and planning a weekend with intentionally conflicting goals (“luxurious” and “cost-efficient”). He also tests multi-agent interaction by placing agents in a shared chat to see whether they influence each other’s plans.

    • •David describes asking agents to book a flight to LA and plan a weekend with luxury and cost efficiency in tension.
    • •He explains that different agents interpreted “luxury” differently, such as prioritizing time versus prioritizing cost.
    • •Josh argues the most human behavior is clarifying what the user means and presenting trade-offs rather than guessing.
    • •David describes running multiple rounds where agents present and justify plans, then seeing whether they incorporate peers’ ideas.
    • •He reports one agent was notably methodical in adopting useful elements from other agents’ itineraries.
  8. 17:48 – 21:00

    Making implicit preferences explicit—and the power (and creepiness) of memory

    The speakers explore a core friction: agents require users to state preferences that people often keep implicit, which can feel identity-threatening. They discuss why long-running chat histories create switching friction and describe exporting “memory files” to move context between agents.

    • •Anish notes agents force people to confront and articulate implicit self-perceptions (like being “cheap” versus “saving money”).
    • •David discusses why some users value an agent that has long chat-based context about them, even if it’s not their primary choice.
    • •He describes switching friction and his test of whether agents will export a full memory summary for portability.
    • •They discuss how reading a compiled memory file can feel unsettling because it reflects a detailed model of the user.
    • •Anish describes an onboarding pattern where users copy prompts into a chat tool, download a file, and upload it elsewhere.
  9. 21:00 – 23:45

    Photos and screenshots as new context sources—and whether value persists

    The conversation shifts to new forms of context extraction, especially from photos and screenshots that capture cross-app life details. They debate whether such data stays useful over time and how behavior might change if people start capturing media specifically to feed agents.

    • •David argues photos can provide rich context users wouldn’t think to describe, but also raise major trust concerns.
    • •They discuss an approach where an agent might “forget” photos it doesn’t need, as a trust-building stance.
    • •Anish describes building an app that extracted key information from phone screenshots but found the value decayed and he didn’t keep using it.
    • •They explore the possibility that people will take more screenshots/photos once they know it benefits personalization.
    • •David describes a concept of organizing saved content like mood boards to build a “flavor profile” that can later guide creative work.
  10. 23:45 – 25:31

    Shopping agents, long-tail winners, and direct-to-consumer discovery

    The speakers connect richer context to shopping behavior and predict agents could shift power away from aggregators toward smaller brands. They discuss how agents’ “infinite patience” for searching could surface niche products, especially in direct-to-consumer commerce.

    • •David references survey results indicating shopping is a major category of agent usage among the power users he studied.
    • •Anish suggests companies with worse marketing may benefit because agents can find products tailored to taste beyond top sites.
    • •Josh describes agents enabling discovery of direct-to-consumer brands at scale without manual browsing.
    • •They discuss how ecosystems that support many direct brands can be advantaged if agents shop through them.
    • •Josh argues aggregators may be pressured if agents can identify original makers and route purchases directly.
  11. 25:31 – 28:18

    Will agents make consumers more rational—or just better at getting what they want?

    The conversation challenges the idea that agents will create hyper-rational consumers. They argue that agents may have their own “alien” heuristics, while humans will reject agents that feel paternalistic or misaligned with their actual desires.

    • •David references a vision that agents doing the work could make consumer choices more rational and force businesses to compete on quality.
    • •Anish counters that agents may develop their own revealed preferences, using the example of favoring clean APIs and good documentation.
    • •Josh doubts agents will make people more rational, suggesting they’ll mostly help people access what they already want faster.
    • •Anish warns that paternalism—agents nudging people toward “better” behavior—can kill consumer products.
    • •They discuss splitting use cases into commodities (where preference matters less) versus preference-heavy decisions.
  12. 28:18 – 31:31

    Multiplayer agents and new social threads: Wabi, shopping swipes, and comfort with norms

    The speakers explore multiplayer experiences where agents operate in shared channels and create new norms. They contrast creating a fresh social contract in a new agent-centric channel versus adding an agent into existing messaging threads where expectations and discomfort are high.

    • •Anish says most products still resemble general assistants, but multiplayer experimentation is emerging.
    • •David describes multiplayer agents as potentially more like entertainment and mentions a shopping flow that learns preferences through swipe-like interaction.
    • •Josh describes using Wabi to manage multiple “threads” of life and track watchlists for books, shows, and other media.
    • •Anish argues new agent-native channels can reset social expectations, while adding agents to existing threads creates uncertainty about what’s visible.
    • •Josh notes fragmentation problems if people end up maintaining parallel group chats with and without agents.
  13. 31:31 – 42:00

    Gossipy agents and agent meetups: serendipity, entropy, and agent-to-agent networks

    Josh describes joyful “gossipy” agents that ask questions about friends and share information, creating social indirection that brings people closer. David extends this into agent-to-agent interactions, including an “agent meetup” experiment where agents freeform-chat, and the group imagines agents helping humans discover people and opportunities.

    • •Josh describes agents that ask personal questions, encourage inviting friends, and share tidbits that spark real-world conversations.
    • •Anish frames this as social indirection that reduces oversharing friction while increasing closeness.
    • •David describes hosting an “agent meetup” alongside a human meetup, letting agents converse after scanning a QR code.
    • •They discuss how agent chats can devolve into gibberish over time, raising questions about structure and goals.
    • •The group imagines agent networks that match people by complementary interests, including interest-based group features and eventual offline meetups.
    • •Anish highlights “entropy” and serendipity as under-discussed goals: creating unexpected beneficial connections.
  14. 42:00 – 46:13

    New data sources: hardware, purchase history, real-world recording—and filtering “curiosity journeys”

    The speakers brainstorm additional context sources beyond messages and email, including smart home hardware signals and long purchase histories. They also grapple with a personalization pitfall: agents misreading temporary curiosity as lasting preference, and the challenge of capturing authentic real-world behavior without distorting it.

    • •Josh asks what untapped data sources could unlock personalization beyond email, calendar, and photo roll.
    • •David suggests smart home and hardware integrations could provide passive signals (like temperature preferences or cleaning habits).
    • •Josh proposes Amazon order history and app download history as rich personal context that agents rarely access today.
    • •They discuss bringing agents into social events, while acknowledging permission concerns and the possibility observation changes behavior.
    • •Josh describes “curiosity journeys” that can mislead personalization (temporary interests being mistaken for identity), leading him to use modes that avoid storing memory.
    • •They touch on wearables capturing daily “tidbits” and the implications of ambient listening.
  15. 46:13 – 50:15

    What changes next: enterprise shift, fun-first adoption, and the “dark agent” trust breakthrough

    In closing, they predict near-term evolution: more enterprise innovation, more playful agents that build relationships, and broader adoption from non-technical users. Anish proposes a deeper frontier: agents that earn trust around the parts of ourselves we avoid thinking about, and the idea that agents become “secret superpowers,” not just productivity tools.

    • •David predicts more innovation will shift toward enterprise use cases, noting consumer attention currently dominates.
    • •Josh predicts more emphasis on fun, gossip, and relationship-building as a path to deeper trust and broader usage.
    • •David describes giving an agent to his technophobic mother and observing rapid adoption through simple texting interactions.
    • •He shares a use case where she sends a photo and asks the agent to find a similar dog and negotiate, illustrating mainstream behaviors emerging.
    • •Anish suggests the big opportunity is building trust for a “dark agent” that can handle sensitive, self-concealed desires and aspirations.
    • •They conclude that agents will take off when they feel like a secret weapon that upgrades identity and self-perception, not just saves time.

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.