Skip to content
a16za16z

Should You Trust ChatGPT With Your Health?

More than 300 million people use ChatGPT for health and wellness questions each week. OpenAI’s Karan Singhal thinks that’s only the beginning: the longer-term goal is AI that can help people navigate their health proactively, while making trustworthy medical intelligence dramatically more accessible. Karan joins a16z Partner Jay Rughani to explain why OpenAI trains healthcare expertise directly into its general-purpose frontier models, how it works with hundreds of medical experts to evaluate safety and disagreement, and why the company sees AI as a complement to doctors rather than a replacement for medical care. They also discuss integrations with Epic, AI copilots for clinicians, and what happens as personal agents begin navigating appointments, health records, and other fragmented parts of the healthcare system. Looking further ahead, Karan makes the case that the cost of medical intelligence could continue to fall dramatically, allowing AI to act as a safety net for patients and clinicians, surface insights from years of health data, and potentially accelerate the discovery and validation of new treatments. Timestamps: 00:00 Intro 01:00 The story of Nathan Labenz's son 07:57 A doctor in your pocket 14:20 Teaching AI who it's talking to 19:44 Medical consensus and its 5–17 year lag 28:03 The mental health problem 30:59 Information vs actual care 38:21 A "move 37" for health 43:39 Driving down the cost of care 50:27 Procedural care and what's next Resources: Follow Karan Singhal on X: https://x.com/thekaransinghal Follow Jay Rughani on X: https://x.com/JayRughani Stay Updated: If you enjoyed this episode, be sure to like, subscribe, and share with your friends! Find a16z on X: https://twitter.com/a16z Find a16z on LinkedIn: https://www.linkedin.com/company/a16z Listen to the a16z Show on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX Listen to the a16z Show on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711 Follow our host: https://x.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see http://a16z.com/disclosures.

Jay RughanihostKaran Singhalguest
Oct 20, 202655mWatch on YouTube ↗

CHAPTERS

  1. 0:00 – 4:18

    Why healthcare feels scarce despite trillions in spend—and why AI health info is exploding

    The conversation opens with the paradox of massive healthcare spending alongside limited access, long waits, and short appointments. OpenAI frames health as a core “upside” area for AGI: making reliable health intelligence abundant while handling safety risks at scale.

    • •Healthcare spend is enormous, yet access to clinicians is scarce
    • •Hundreds of millions use ChatGPT weekly for health/wellness questions
    • •AI’s role is especially valuable between appointments (prep, follow-ups, navigation)
    • •OpenAI’s health investment is tied to mission: deploy capability, prevent downside, create upside
  2. 4:18 – 6:06

    A real-world patient story: AI as an early warning system for a child’s leukemia

    Karan shares Nathan Labenz’s account of using GPT to push for seriousness when symptoms were downplayed. The story illustrates how AI can help families interpret signals, seek testing, and make sense of labs before specialists weigh in.

    • •AI advised taking a child’s fatigue/irritability seriously during travel
    • •Encouraged repeat testing even when clinicians were uncertain
    • •Diagnosis: aggressive leukemia; AI helped interpret labs and process steps
    • •Illustrates AI’s potential value as a supportive “navigator,” not a replacement for doctors
  3. 6:06 – 7:57

    Why a general-purpose frontier model can be trained for medicine (without falling behind)

    They address the general vs specialized model debate. OpenAI argues for specialized healthcare training layered into a general frontier model to get both medical competence and rapid gains from scaling and reasoning improvements.

    • •Healthcare data is integrated across multiple training phases for ChatGPT models
    • •General frontier models improve faster than isolated domain-only models
    • •Approach aims for ‘best of both worlds’: scale + medical specialization
    • •Specialized smaller models risk quickly lagging the frontier
  4. 7:57 – 10:11

    The ‘doctor in your pocket’ vision: personalization, memory, and proactive nudges

    Jay outlines the aspirational experience: a perfectly knowledgeable, personalized assistant that remembers history and preferences and helps with adherence and behavior change. Karan describes a path toward a proactive health assistant while emphasizing it won’t replace real clinicians.

    • •Vision: cross-specialty knowledge + personalized context + motivation/coaching
    • •Users can connect health info with protections (no training use, no ads targeting)
    • •Distribution matters: most health users are free-tier and many are outside the US
    • •Goal is proactive assistance embedded throughout the care journey
  5. 10:11 – 12:01

    Second opinions everywhere: AI as a safety net for patients and clinicians

    They discuss examples where AI catches medication interactions and flags potential issues. Karan highlights clinician-copilot experiments (e.g., with Penda Health) where the model operates as a background safety layer that suggests checks without disrupting workflow.

    • •AI can provide cheap second/third opinions and interaction checks
    • •Clinician copilot can proactively flag “something might be off”
    • •Patient-side safety net could trigger reviews when key labs worsen (e.g., A1C)
    • •Augmentation framing: supportive, not a ‘middleman’ in every interaction
  6. 12:01 – 14:21

    Agents in healthcare: scheduling, insurance friction, and breaking fragmentation

    Jay connects agentic AI to real healthcare pain: coordination, billing, insurance disputes, and disjointed systems. Karan agrees healthcare fragmentation is a major bottleneck and anticipates agents and computer-use tools dissolving barriers even amid legacy software environments.

    • •Agents can execute multi-step tasks across apps (scheduling, billing, navigation)
    • •Healthcare has legacy tools and poor connectivity; agents may bridge gaps
    • •Fragmentation between data/workflows is a central obstacle to better care
    • •Expectation: many access barriers will erode as agentic tooling matures
  7. 14:21 – 16:13

    Trust part 1: tailoring answers to patients vs clinicians with evals and expert feedback

    They shift to trust: the same underlying model must communicate differently to laypeople and clinicians. Karan describes how OpenAI uses expert feedback and benchmarks (e.g., Health Bench) to measure and train persona-appropriate behavior and jargon levels.

    • •Health ‘moves at the speed of trust’: correctness plus communication matters
    • •Models are evaluated/trained for multiple personas (lay, expert patient, clinician)
    • •Health Bench includes scenarios testing appropriate technical depth and tone
    • •Trust-building includes transparent measurement and deployment practices
  8. 16:13 – 19:00

    Trust part 2: when users want reassurance but safety requires escalation

    Jay probes the tension between user satisfaction and medical safety. Karan explains OpenAI prioritizes safety, uses large networks of clinicians to reduce individual disagreement, and trains models to advise appropriate care-seeking even when users prefer comfort or risky alternatives.

    • •Relying on a few doctors is insufficient; physician opinions often diverge
    • •OpenAI built a global physician network across specialties/languages
    • •In conflict between comfort and correctness, safety is prioritized
    • •Evals explicitly track ‘seek care/unsafe’ moments and model performance improvements
  9. 19:00 – 28:03

    Trust part 3: disagreement with your doctor, uncertainty, and the 5–17 year guideline lag

    They explore what to do when AI and a clinician disagree (seek a second opinion). Karan then explains how medical knowledge moves from papers to guidelines to practice—and that practice lags 5–17 years—arguing AI can compress that gap and also learn to acknowledge genuine uncertainty.

    • •If doctor and AI disagree, patients can seek second opinions like any dispute
    • •Medical consensus pipeline: literature → guidelines → real-world practice
    • •Guideline adoption can lag 5–17 years; AI could bring latest evidence at point of care
    • •Models should recognize/communicate uncertainty (hedging evals) and avoid overclaiming
  10. 28:03 – 29:59

    Mental health: from safety floor to ‘raising the ceiling’ with Mental Health Bench

    Jay asks how AI interprets vague mental health goals and handles high-stakes scenarios. Karan describes baseline crisis safeguards across products (including Dots) and a benchmarking effort with licensed experts to define desired behavior and measure positive-support capabilities, not just harm avoidance.

    • •Commitment to crisis support and consistent safeguards across product surfaces
    • •Mental Health Bench aims to measure helpfulness and positive outcomes, not only safety
    • •Built with global licensed mental health experts to define tricky scenario behavior
    • •Benchmarks serve as a shared ‘measuring stick’ for the industry
  11. 29:59 – 30:59

    Information vs actual medical care: what AI will (and won’t) do

    They distinguish medical information from the bundled reality of medical care: exams, prescriptions, liability, empathy, and workflow coordination. Karan positions OpenAI as an enabler and ‘front door’ that can quarterback navigation and logistics while partners deliver licensed care.

    • •Medical care is bundled: diagnosis, empathy, exams, liability, prescriptions, follow-ups
    • •OpenAI aims to enable the ecosystem rather than become the full care provider
    • •AI can quarterback: navigation, scheduling/logistics, and care-journey support
    • •Impact depends on partnerships that make the ‘last mile’ feel like the last 100 meters
  12. 30:59 – 35:17

    Clinician and enterprise deployment: Epic integration and early health-system results

    They discuss product “activation energy” and the need for HIPAA-grade privacy/security for enterprise adoption. Karan describes Epic integrations (ChatGPT in Epic and Epic in ChatGPT) and highlights health systems like UCSF and AdventHealth, including reported administrative efficiency gains.

    • •Lowering activation energy is as important as model quality
    • •Enterprise readiness required HIPAA compliance, privacy, and workflow fit
    • •Epic integration: sidebar use in clinician workflows; connectors reduce fragmentation
    • •Examples: UCSF workflow use; AdventHealth reports large reductions in admin workflow costs
  13. 35:17 – 43:39

    What happens when both doctor and patient use AI—and the ‘move 37’ idea for health

    They consider the future visit when both sides pre-process data with AI, leaving more room for human judgment and empathy. The conversation then shifts to ‘move 37 for health’: AI discovering non-obvious, high-impact insights, with early examples like reducing antibiotic overuse and future promise via longitudinal data integration.

    • •Future visits may focus more on human aspects: empathy, uncertainty, physical exam
    • •AI can flag systemic considerations (e.g., antibiotic stewardship) beyond local patterns
    • •‘Move 37’ framing: surprising, insightful predictions/actions humans learn from
    • •Longitudinal, multi-source health data may enable predictions humans can’t integrate alone
  14. 43:39 – 50:28

    Driving down the cost of care: cheaper health intelligence, admin automation, and payer-provider arms races

    They examine how rapidly falling inference costs could commoditize health intelligence. Karan notes cost reduction alone won’t fix all spending, but administration and workflow integration can compress costs; he also argues payer-provider ‘bot wars’ are a short-term distraction solvable by shared ground-truth visit data and AI adjudication.

    • •Health intelligence cost is falling fast (example: cheaper models outperforming prior best)
    • •Commoditizing reliable intelligence could expand access globally
    • •Big savings likely in documentation and administrative workflows, not just Q&A
    • •Payer-provider AI arms race could be avoided with shared visit ground truth + AI adjudication
  15. 50:28 – 55:54

    Procedural care and what’s next: prevention, data unlocks, and AI-accelerated drug development

    They close by discussing how AI may affect procedural care first through better targeting and prevention, with robotics as longer-term. Looking ahead, Karan forecasts major 5–10 year impact via AI-accelerated science—new targets/molecules and faster trial prioritization and validation—alongside proactive assistants and better use of ‘data in boxes.’

    • •Near-term procedural impact: better triage/targeting and earlier prevention to avoid costly interventions
    • •Robotics and procedural automation are likely longer-term due to tech and reimbursement
    • •Future roadmap: raise the floor (trustworthy ubiquitous intelligence) and raise the ceiling (new capabilities)
    • •Largest 5–10 year impact may come from AI-driven drug discovery and trial acceleration

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.