EVERY SPOKEN WORD
60 min read · 12,292 words- 0:00 – 1:00
Intro
- JRJay Rughani
5.3-plus trillion we spend on healthcare. If it were its own country, it'd be the third-largest GDP, and yet we have a ton of scarcity
- KSKaran Singhal
OpenAI's mission is to ensure AGI benefits all of humanity and give people access to trustworthy, abundant, reliable health intelligence. One of the stories that I was most touched by was the story of Nathan Labenz. He basically had this kind of long saga with his son where at some point he was suffering a lot of fatigue and irritableness, and AI helped them navigate the process, and it turns out he was diagnosed with an aggressive form of leukemia
- JRJay Rughani
Some of the work that you've done around mental health, there's a lot of complexity. How do you help guide a user on that, given that could mean so many things?
- KSKaran Singhal
We've just been working with a bunch of licensed mental health experts across the world to think about the right ways to define model behavior in a bunch of tricky scenarios and ensure that we can get to a level of consensus where we can actually measure performance
- JRJay Rughani
Let's talk about trust. A person can be speaking to an LLM, really hoping to hear that everything is okay, but from a medical perspective, they need to hear perhaps something very different. How do you teach an AI to recognize the difference?
- 1:00 – 7:57
The story of Nathan Labenz's son
- JRJay Rughani
Hey, everyone. Welcome back to the podcast. I'm Jay Rughani, a partner at a16z, leading investments in healthcare and biotechnology companies. I'm joined by Karan Singhal of OpenAI. He leads health AI research at OpenAI, and we've got a lot to talk about. Thanks for being here.
- KSKaran Singhal
Thanks for having me.
- JRJay Rughani
I wanna start with the big question. Uh, there was a report earlier this year, you all have talked about it publicly. Hundreds of millions of people each week use ChatGPT for health-related questions. Uh, what are they asking? What are the kinds of questions they're asking that they're not getting from our main healthcare system?
- KSKaran Singhal
Yeah. Um, let, let me zoom out and, and talk a little bit about why we're investing in health in the first place. Um, so, you know, OpenAI's mission is to ensure AGI benefits all of humanity, and so we see that in, at a high level happening in three ways. Um, the first is building and deploying AGI, so building capable models, building products around them, deploying them, partnerships. The second is preventing downside, um, safety of various kinds. The third is making upside happen. Um, and so we view health as a really, really concrete way to make upside happen and also work on some of the safety problems that come up in healthcare along the way. And so really, we're really invested in, in making sure basically two things. One is that we can raise the, the floor of human health and give people access to trustworthy, abundant, reliable health intelligence for, for free or nearly free, and really raise the ceiling as well and make things possible that weren't possible before. And so the best way to see the kind of raising the floor is really to think about how we've been working in the consumer space. Um, and so as we've reported, there's, there's more than 300 million people weekly using ChatGPT for, for health and wellness types of questions, and we take that as, like, an incredibly important responsibility to, to get that right. Um, and that's been rapidly growing, um, over time. I think one of the things that you see is just if you, if you think about the experience of, of getting healthcare, even in the US, even in the Bay Area, you know, if you're looking to get a specialist appointment, even here in the Bay Area, sometimes it can take weeks or months. Um, you might, um, spend a lot of time figuring out how to get an appointment and scheduling and all these kinds of things, and after all that time, maybe get 15 minutes with a doctor where you don't feel adequately prepared and you maybe walk out of it thinking, "Oh, I had like six more questions that I wanted to ask." And our hope is that AI can be part of this care journey with you, and, like, health is not something that is just kind of restricted to these kind of 15-minute intervals, and it... AI can actually help you navigate your care journey. And so that actually reflects how people are using AI on the consumer side today. Like, people are coming in with questions and concerns, in-in-information that they'd like to have. Um, they want to figure out how to kind of navigate their care visits or ask questions or figure out how to follow up things that they, that the doctor told them or things like this. And we're finding that in between these visits is, is when AI can help people most on the consumer side, and, you know, we're making similar investments on the clinician side and on the enterprise side as well.
- JRJay Rughani
Yeah, it's amazing. We have an extraordinary healthcare system. Uh, if I got really sick, there's no country I'd rather be in than the US, and yet we have a ton of scarcity. We have... You know, you've seen some of these statistics. Over 100 million people don't a-access to a regular primary care doc. Even the ones who do often have to wait 40-plus days to see that doctor. Sometimes you meet the doctor, exactly as you said, and it's a quick 15-minute visit, and you have more questions. I saw a dermatologist last week about something. I wrote down all my questions beforehand in an Apple Notes, and I still forgot to ask something, and now I'm scheduling a follow-up, and it's another four months out. It happens to all of us. We've all felt that. Um, is there a specific patient story or recent case that you all have seen that kinda help us imagine where the world is going and where your work is taking us?
- KSKaran Singhal
One, one way in which the, the work of our team is gratifying is just, like, seeing the numbers and seeing how many people are using the tech and how useful it seems to be for them. Um, one other way is just hearing from people, right? So we get people coming in, sending us emails or whatever it is, reaching out in various ways multiple times a week-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
... saying like, "Here's how this has helped me." I think one of the things that I... one of the stories that I, you know, was most touched by was the story of Nathan Labenz and his, um, his son. Um, so he hosts the "Cognitive Revolution" podcast, um, and he's kind of told his story in that podcast. But he basically had this kind of long saga with his son where at some point he was kind of suffering a lot of fatigue and irritableness and, and things like this, um, his, his very young son. Um, and, um, AI helped them to kind of navigate the process of realizing that this was, like, a, a pretty serious thing while they were on vacation and, and deciding to take them for testing and repeatedly telling them like, "Hey, take this seriously," even when, when doctors were a little bit less sure and actually kind of downplaying it. And it turns out he was diagnosed with an aggressive form of leukemia. Um, and throughout his care journey, I mean, I mean, Nathan reports kind of using GPT 5 Pro q- at that time, you know, quite a bit for helping navigate the process, um, helping understand lab reports and things like this even before, you know, a specialist had time to kind of help interpret, and I think, you know, it brought them a lot of peace of mind. Um, and so Nathan actually tells that story. I don't, I don't know if I'm allowed to advertise other podcasts here, but Nathan actually tells that story in his podcast and would recommend that for folks.
- JRJay Rughani
In many ways-- So OpenAI is building health intelligence and health intelligence into your model at every step, but it's the same model that folks use to write code or plan a vacation. Can you help folks understand why you're building it that way from an architectural standpoint? Why is a general-purpose AI the right foundation for something as complicated as medicine?
- KSKaran Singhal
Yeah. I mean, people often ask us, like, you know, this kind of general versus specialized model debate.
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
And I used to work on specialized models actually in a previous role, and so, so I definitely have kind of experience on, on kind of both sides of this, um, this question. I think the, the, the kind of, the kind of most important thing here is, like, what, what we're talking about here is actually specialized training in a general model, which is, I think, actually the best of both worlds. So what we do, um, for, for ChatGPT and all the models that we ship in ChatGPT, every-- across every stage of model training for ChatGPT, we actually have specialized healthcare data added to each phase of training, um, since all of our models in the last year. As a result is now you have a model that benefits from all the scale and general improvements in intelligence and reasoning of the big, big frontier models, and also the benefits from the specialized training that we get from, for example, integrating data that we get from working with a bunch of physicians across the globe. And so I think you get the best of both worlds with this approach. If you, if you kind of forked and said like, "Hey, we're gonna train a kind of smaller specialized model that is just for healthcare"-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
...um, like I used to and like many people have, um, what you'd find is that model would just kind of fall behind the frontier relatively quickly-
- JRJay Rughani
Hmm
- KSKaran Singhal
...because the pace of the frontier and, and the general model improvements is so fast. Then if you bet on scale, what we found as OpenAI, as an industry, is that things will get better. Um, and so what we're doing is kind of hitching a ride on that kind of scale frontier, um, and, and leveraging the fact that we have the ability to kind of integrate evals and training data into the models to make the models both specialized and also benefit from the general capability.
- 7:57 – 14:20
A doctor in your pocket
- JRJay Rughani
I wanna almost start imagining what's possible with the technology that you're building. Obviously, w-where it is today is amazing, but you're not stopping, and there's a lot, lot of work to go. I think many people are allured by the idea of a personal doctor in your pocket, something that is perfectly knowledgeable, has knowledge across all medical specialties, so you don't necessarily need to go see a cardiologist and a dermatologist for different questions. Um, something that is perfectly personalized to you, has all your medical history and context, um, remembers everything that you've said, remembers your medical history, but also your preferences, um, and is also able to motivate you and nudge you so that, uh, the information that it gives you is given to you at the right time in a way that can nudge you towards better health behaviors or adhering to the protocol that your doctor, uh, gave you. Is that sort of the experience you're building at OpenAI in the fullness of time, or-- and how close are we to that?
- KSKaran Singhal
Yeah, that's something that we're, we're really excited about. We are very excited about this vision of kind of a proactive personal health assistant. I don't think that's any kind of replacement for actually having a, having a doctor or having access to a doctor, but really thinking about the ways in which we can take that experience of getting health information and making it more personal to kind of your context is a really important part of kind of our investment in health in ChatGPT, which is kind of consumer offering that we have that enables users to connect their health information for that information to be used kind of securely, not to be used for, for training data or for targeting ads or anything like this.
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
And that's a big part of how we think about how we're gonna m-move towards this world of really, like, increasingly personal access and proactive access. It's also been how we've been thinking about deployment. So we've a-actually, from the beginning, been deploying this as widely, um, as possible to our free users as well as our pro users. And so we have been of the kind of 300 million weekly active health users, the vast majority of them are free users, and we take that, and most of them are outside the US as well.
- JRJay Rughani
Hmm.
- KSKaran Singhal
And so we, we take that kind of, um, question of, like, distribution here really important-- really, um, really centrally. And so as we're thinking about this kind of next frontier of, like, a proactive personal health assistant, we're kind of bringing that to, to bear as well.
- JRJay Rughani
I think use cases help us imagine, help people imagine what's actually possible, what all this work is contributing to.
- KSKaran Singhal
Yeah.
- JRJay Rughani
The idea of a personal doctor in your pocket, I think, is exciting. When Greg Brockman came on the podcast, he spoke a little bit about this situation he had with a friend of her-- friend of his was in the hospital, and, uh, her physician was about to administer a certain medication. She double tech-- double-checked that medication in ChatGPT, realized based on her medical history that she would have some drug, uh, interaction or some, um, adverse event that may come from that. She showed that to her doctor. Her doctor agreed and said, "I didn't have enough time to look through your medical history, uh, to notice that, so thank you so much for, for raising that." Shouldn't we do that for everyone all the time? If it's cheap enough and convenient enough, can't we do a second, third, fourth opinion for, for every clinical scenario? Is that where we're going?
- KSKaran Singhal
Yeah. I, I, I love this idea of a kind of safety net for both patients and clinicians that is just kind of there in the care journey and, you know, not, not always interfering or, or, or being the middleman, but, like, really thinking about the ways in which it can augment the existing experience and build on it. Um, you know, we did this work actually kind of more directly studying this on the clinician side, um, in a kind of a series of experiments that we ran, uh, with Penda Health, where we studied this idea of, like, a clinician copilot that was deployed, and it was exactly deployed in this way, where, you know, it was a safety net for the clinician as they were doing their work. It kind of came in and proactively suggested like, "Hey, this might be off." Like, you know, this, there might be this medication interaction that you might not be, might not be tracking.
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
Can we, you know, potentially adjust that and things like this. I think we're gonna see the same thing happen on the patient side, and I'm very, very excited about this idea of, like, kind of like a proactive pers-- proactive agent in your care journey really helping you and making sure that, like, you know, if your A1C rises and you're diabetic, like, that you get, like, a review of your medications by your doctor and things like this, and making sure that that's kind of flagged for kind of appropriate review.
- JRJay Rughani
You mentioned sort of personalized proactive agents. Personal agents in general have kind of- Emerged on the scene in, from a popularity perspective over the last few months, Instinct, Muse, GrokBot, OpenAI's Dots. Uh, you can give these AI apps an objective, for folks who are not familiar, and it can execute a series of tasks. So it's not just, "Hey, do this task," and then it executes the task, uh, with a single loop. It can use your preferences. It can access all of your applications that you give it permission to. Uh, it can access your credit card information if you give that to them, and it can execute an objective on your behalf. One can't help but imagine the possibilities there in navigating our wonderful but often disjointed healthcare system, scheduling a appointment and making sure, uh, your insurance is covered, uh, for that appoint-- or covering that appointment, uh, you know, helping you and guiding you to follow a care protocol that your doctor gave you post-discharge, even negotiating with your insurance company on a medical billing error, all kinds of tasks that just create friction in our healthcare system.
- KSKaran Singhal
Yeah.
- JRJay Rughani
Is that where you're kind of going with, with, uh, with your work? Should we look forward to that from OpenAI?
- KSKaran Singhal
I'm ve-very excited about that vision. I think if you look at, from, from both a patient and clinician perspective, one of the most difficult things about the healthcare system and how it serves people is this kind of question of, like, fragmentation and kind of lack of connection of the ecosystem. And healthcare is also one of those industries where you shouldn't expect everything to have an MCP con-connector tomorrow, right? It is a, it is a place where there's legacy software. There's not, like, necessarily the best connectivity with AI or software in the first place, and many people are, you know, running their primary s-- EHR software in the healthcare ecosystem on, like, a VM, for example.
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
So, like-
- JRJay Rughani
Virtual machine that they're running in the cloud, yeah.
- KSKaran Singhal
Exactly. And so th-there's actually, like, an interesting component where, like, a virtual machine actually makes things easier-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
... in some ways for, for AI agents. But this is absolutely right for agents and computer use. Um, so, so I definitely think that this is, like, a place where a lot of the barriers that have traditionally existed between patients and getting the care they need and clinicians and delivering the care that they need and healthcare data in general, which is often kind of a bottleneck to the whole system working well for patients, I think a lot of those will dissolve in the coming months, and so we're really excited about
- 14:20 – 19:44
Teaching AI who it's talking to
- KSKaran Singhal
that.
- JRJay Rughani
Okay. So we-- we're talking about the use cases. You're helping us dream the dream. Uh, before we keep going down that, that, uh, that road, let's talk about trust. Obviously, trust is m-most important here. The same underlying model, um, can help me understand my lab results or something that I heard from a doctor, um, but it can also help a highly trained specialized physician make sense of a very complicated case. What do you change in the answer so that it's legible to each of those two personas or any other persona that might be engaging with the same underlying model?
- KSKaran Singhal
Yeah. I mean, h-as you said, health is a, is a place where, you know, it moves at the speed of trust, and so you need to be able to not only make the models better and measure them, but also kind of communicate and bring the world along. And so that's been a very important part of our thinking and our strategy for both how we work with patients and how we work with end users and how we work with clinicians. And so, um, the, the brief answer to your question is basically we, we evaluate and train the models by working with experts across the world and, and getting feedback in various ways to kind of tailor their behavior, um, to whether a, a person is a lay user or kind of an expert lay user that has been, like, navigating their care for a while, a, a complex care journey or a clinician or other kinds of user personas. And so back even for the original Health Bench evaluation that we released back in May 2025, there was actually a theme or part of the, the evaluation that was really focused on this distinction of how the model behaved and tailored its level of kind of use of technical jargon and things-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
... like this to whether a person was a lay user or a clinician. And since then, we've both gotten better at measuring whether the models are able to cater to, to different kinds of users and also training the models towards that. Um, and so a lot of our approach has really been, like, not only do-- how do we make the models better for these different users, but how do we bring them along? And part of that is how we do evaluations and communicate about them as well.
- JRJay Rughani
So there's a few components to trust. So we've talked about, um, sort of tailoring the answer to the user. Another big component is disagreement. Um, a person can s-be speaking to an LLM or speaking to chat and be sharing all of their symptoms, but really hoping to hear that everything is okay.
- KSKaran Singhal
Mm.
- JRJay Rughani
So from a consumer user NPS perspective, net promoter score perspective, they want to hear reassurance. But from a medical perspective, they need to hear perhaps something very different.
- KSKaran Singhal
Yeah.
- JRJay Rughani
How do you teach an AI to recognize the difference and manage different product objectives there, either from consumer engagement and retention versus sort of correctness and, and sort of clinical quality?
- KSKaran Singhal
Yeah. Th-this is super central to how we do both evaluation and training. And so zooming out a little bit and, and the question of, like, agreement and disagreement around how we, um, how we respond and how we evaluate. Like, one thing you could do and one thing that we c-- you could, you could kind of base your approach on here is, like, we could bring in a few clinicians into, let's say, the OpenAI health team and say, like, "Hey, you guys figure out how to navigate these kind of uncertain cases, and, you know, we'll, I'll ask you about these uncertain cases, and you'll help us build evaluations and training data and stuff like this," um, and leave it to those few physicians to figure it out. Um, this is actually not the best approach. So it turns out if you ask five physicians or something this, um, any question, you'll get, like, eight different answers.
- JRJay Rughani
Yeah.
- KSKaran Singhal
And so the, the-- one of the first things that we did when we start-- first started focusing on health at OpenAI was really build this kind of global physician network-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
... of hundreds of experts that we work with kind of across the globe, across, you know, dozens of specialties and languages and countries of practice to think about the right ways to kind of aggregate the wisdom of experts so that we weren't relying, especially in areas where there could be disagreement, we weren't relying on one or two or three physicians to kind of adjudicate. So that's, that's one part of it, um, is kind of like thinking about, um, evaluation and training data from, coming in from different experts rather than relying on one or two people. But then the second part of your question is, like, how do you balance kind of competing objectives, right?
- JRJay Rughani
Yeah.
- KSKaran Singhal
Let, let's say the physicians and the aggregate wisdom of the physicians is pointing in one direction, and then maybe the user actually wants you to say something comforting even when the situation's not comforting. There, it's basically a prioritization of safety. Um, and so-
- JRJay Rughani
Mm
- KSKaran Singhal
... it's very important to us that, like, we, we take our obligation very seriously when there's hundreds of health, uh, hundreds of millions of health conversations coming in. And so across, you know, the evaluation stack and training stack, um, we have evaluations that track these kind of difficult situations where the user should, or the model should actually go and say, like, "Hey, this is unsafe," like, "You should seek care," um, even if the user doesn't wanna hear it or, you know, wants to get some kind of alternative treatment or something like this. Um, and that's, you know, a very, a very important part of how we do evaluation, and over time, we've not only improved how we've done the evaluation w- working with physicians but also seen pretty dramatic model improvements across the board, uh, in those areas.
- JRJay Rughani
There's another example, or another instance of disagreement, which is me as the consumer, I ask a medical question of ChatGPT. I then show that response to my doctor during a visit. My doctor loves me, by the way.
- KSKaran Singhal
[chuckles]
- JRJay Rughani
Um, and, and then they disagree. They disagree with the response. How should I handle that situation?
- KSKaran Singhal
Yeah, I mean, I think you should handle it similarly, um, as if, you know, disagreement was happening in some other way as well. Like, people, people do disagree about, um, different things. And I think, like, you have a, a right as a patient to get, you know, ask for another doctor to take a look and, and get a sense and go to-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
... another doctor to get a second opinion. And yeah, that's what I would advocate for whether or not you're also using ChatGPT to get health information as well.
- JRJay Rughani
Yeah.
- 19:44 – 28:03
Medical consensus and its 5–17 year lag
- JRJay Rughani
Makes a ton of sense. There's another element of trust which is just absolute correctness, and a lot of the, a lot of the work that you all have done i- seems to be, at least from hearing from you, seems to be about grounding answers in the world's medical literature and evidence. Some parts of medicine there's not a lot of agreement or disagreement about, but there is much of medicine that's still, uh, being discovered or being studied, and there is disagreement even in the medical field. And for that, um, you know, for that, for those kinds of questions, it's difficult to ground it in truth when we don't-- we're still discovering tr- you know, truth. Science is a process, et cetera. How do you think about correctness in those kinds of instances?
- KSKaran Singhal
Yeah, it's, it's a really great question. I mean, it's important with or without AI. So if, if you kind of zoom out and look at, like, how is medical consensus distributed today, right? Like, what is the process of, of that today? You basically have, um, a bunch of people, um, writing papers, biomedical papers of various kinds, um, suggesting kind of improvements or treatments or things like this that could, that could improve the quality of care. And then you have this process, yearly process across different specialties of building clinical guidelines, which kind of describe, like, hey, in this situation, if you're a cardiologist and you see a patient with X, Y, and Z, here's what you should probably do. Um, and so these, these clinical guidelines are roughly, you can consider them kind of flowcharts that are p- put out each year by, you know, the different kinds of bodies across the different-- across the world that describe, like, roughly what you should do in different scenarios based on the latest research.
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
And then the final step is, so you have either the biomedical literature, and then you have the, um, clinical guidelines, and then you have, like, what do people actually do in practice? And so the final step, it turns out, is a, is a ma- massive bottleneck. So there are these studies on, like, how long does it take for, um, clinical guidelines to penetrate the practice of everyday doctors across the world?
- JRJay Rughani
Mm.
- KSKaran Singhal
And, um, in the past, people have found that this takes, depending on the study, like five to 17 years for that, for that penetration to actually happen.
- JRJay Rughani
Oh.
- KSKaran Singhal
Which is massive. Like, you don't wanna be practicing-
- JRJay Rughani
It's crazy
- KSKaran Singhal
... medicine five to 17 years behind. And so one of the things that we think about is how do you compress that kind of period of, of, of kind of practicing in, in the, in the past, um, down to weeks or days or even hours, right? And so this is one very important principle behind our work in ChatGPT for healthcare and ChatGPT for clinicians, which are clinician and healthcare professional-facing offerings where we're bringing in the latest biomedical literature in the moment of care-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
... and allowing people to very quickly, in the course of, like, let's say a 15-minute visit, at the point of care, get answers to their questions. So that's one way of answering question, which is like, you know, in practice, you know, while there is medical, a lack of medical consensus in many areas, in some cases, there is medical consensus, but it's not being practiced.
- JRJay Rughani
Mm.
- KSKaran Singhal
And so one thing you can do is, like, really dramatically reduce the, the amount that that's happening. This is one, one way of answering your question. A second way of answering your question is, like, how to handle the quick places where there's still, like, genuine medical uncertainty in there. I think, I mean, there's a couple things. So one is you wanna train the models to be able to recognize their own uncertainty. Like, after, after browsing and getting information and things like this, you want the models to be able to know, hey, like, there just isn't enough information, and to be upfront about that. And so, you know, that's been an important part of how we've done evaluation. That's actually, like, a public aspect of, um, Health Bench, which includes kind of evaluations on hedging, for example, when there is this kind of uncertainty. So that's one, one important thing. The second thing, and this kind of goes to this question of, like, how do you raise the ceiling of human health, is, like, really thinking about the ways that models can actually accelerate the process of doing science and actually pushing the medical frontier. And so maybe we'll, we'll chat about that later.
- JRJay Rughani
Some of these areas are gray areas and controversial, and I'm curious if you ex- if you think the models or you're designing the models in a way to take a stance on these things. Unapproved peptides, vaccines, uh, things that just get politicized oftentimes in the media. How should a product like, like Chat engage on some of those topics where there's still debate?
- KSKaran Singhal
Yeah, I mean, where, where there's debate or a lack of consensus across the board, whether that's politicized or not, we wanna make sure that we are relying on the experts to help define kind of standards for how the model should respond. And so that's kind of the approach that we take across the board.
- JRJay Rughani
Hearing you talk, it feels like you're always thinking about one of three constituents. It's either the patient, it might be the individual clinician that signed up, or it might be the enterprise, whether it's a healthcare provider enterprise or some other enterprise. How do you think about designing the product at the architectural level and at the, let's say, the harness level to meet the needs of all these different users?
- KSKaran Singhal
Yeah, I mean, I think maybe there's, there's three parts to that. One is making the models really, really good for these users. The second is building the right harness or product around it, and the third is really like the deployment or partnership motion to kind of re-reach out to the right-- reach out to the users. And like by default, I think a lot of the time the, the models are often pretty good these days. And so we talked about our approach of evaluation, working with clinicians and, and things like this. We are seeing pretty dramatic improvements in kind of performance and reliability. You know, we talked a few months ago about the improvements that we've been making on kind of the free tier and bringing free tier performance to the frontier. So, you know, of the 1.2 billion people who use ChatGPT weekly, um, giving them a model for health that is just like incredibly useful at the frontier for free. Um, so that's been a big part of our strategy, obviously for, for making healthcare health intelligence abundant. The second thing is our kind of product offerings. And so the way we think about this is you can have a model that's really good, but if the activation energy to use the model to improve health is too high, then people won't do it, right? So a lot of our product efforts are really like thinking about these constituents that you're talking about and thinking about the ways in which we can reduce the activation energy for people to use compute and intelligence to improve human health.
- JRJay Rughani
Mm.
- KSKaran Singhal
Um, and so that goes, you know, along the lines of, you know, our work in ChatGPT, uh, health and ChatGPT, um, ChatGPT for healthcare, um, on the enterprise side and ChatGPT for clinicians. A lot of the way we design these offerings is basically to think about like what are the barriers and bottlenecks and activation energies for people to be able to use the models. Um, and so for example, um, you know, what are the, um, security and compliance bottlenecks in providing an enterprise offering of ChatGPT to healthcare systems? So that was like one question that we were thinking about a lot two years ago. And so we thought, okay, we need to, we need to kind of invest in security and compliance. We need to make sure we are able to offer HIPAA compliance. We need to make sure that we're able to offer the kinds of, of, um, privacy protections that healthcare organizations need so that we're able to handle the healthcare data that they need and be able to offer services that they trust.
- JRJay Rughani
Hmm.
- KSKaran Singhal
And so that was like a very important part of the work we were doing for like roughly two years ago to like roughly a year ago. And, um, and we kind of just go after there, uh, from, from there, like based on the bottlenecks that we see to kind of adoption. The third thing is kind of partnerships and deployment. And again, it's really like, you know, a few years ago, I think OpenAI was very early to speak in the language of healthcare. Um, and when we, um, interacted with healthcare partners, I think we were, you know, early in those conversations. So I think one of the things that we've brought to bear since then is really, you know, thinking about each of those constituents that you're talking about and really thinking about how to speak their language and how to kind of bring them along this ca- this journey. Because even if the models get really smart, if nobody's [chuckles] like really trusting them or using them-
- JRJay Rughani
Right
- KSKaran Singhal
... that's not really achieving our mission.
- JRJay Rughani
And is that, uh, you're alluding to a little bit some of the work you've done with Epic to kind of integrate the product directly into Epic. Maybe s-share a little bit more about that.
- KSKaran Singhal
Yeah.
- JRJay Rughani
Uh, 'cause a lot of the folks who've spent a lot of time in healthcare, uh, were very interested to see that level of collaboration with, with Epic.
- KSKaran Singhal
Yeah, I mean, this is a very important part of our approach. You know, like, like we talked about fragmentation, um, in healthcare has been one of the issues. Um, and the fact that there is kind of data and workflows that are disconnected from each other, I think is, is a big obstacle to the, to the use of AI, uh, productively in healthcare. Um, and so, you know, our work with Epic, our work with other, um, partners, we had a recent announcement where we announced that there's now a way to use Epic in ChatGPT, um, if you're, if you're a provider or a healthcare professional, and also for ChatGPT to be useful in Epic itself.
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
And so on-- in the Epic workflow itself, you, you can have like a little, um, sidebar where you can actually use ChatGPT as well. Um, and so that's one thing. We-we've al- we're also working on like different other kinds of connectors that we've also announced recently, and we have more coming. And so there is quite a bit of work that we're doing to make sure that we are kind of breaking down these barriers to kind of the healthcare ecosystem being connected. And I think, you know, Epic is just one of many examples where we're, we're just identifying those bottlenecks and trying to fix them.
- 28:03 – 30:59
The mental health problem
- JRJay Rughani
The last thing I wanna hit on with respect to trust is, uh, some of the work that you've done around mental health. And, uh, this is ano-another area where there's a lot of complexity and there may be other objectives that you need to solve for beyond, um, the clinical complexity that, that we talked about. If I ask my OpenAI dot, "Hey, I wanna feel better over the next few weeks," how do you even interpret that question? How do you help act on that? How do you help guide a user on that, given that that could mean so many things?
- KSKaran Singhal
Yeah, I mean, and regardless of the surface, we are super committed to like helping users when they're having a difficult time or when they're in crisis. And so, for example, for Dots, we've been investing the same kinds of safeguards that we've been putting in all of our product surfaces in that product surface as well.
- JRJay Rughani
Hmm.
- KSKaran Singhal
So that's an important part of our approach is kind of like a, a baseline safety floor. And then, you know, w-with Mental Health Bench, we've really taken this approach of, of not just measuring the safety floor, but thinking about the ways in which the models can actually like proactively help kind of raise the ceiling-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
... um, and really think about the ways in which models can, you know, help provide positive mental health experiences and move from, m-move from just, um, worrying about the safety floor to measuring those, those kinds of upsides. And so again, the, the approach is, is actually very much mirroring our work on Health Bench, where we've-
- JRJay Rughani
Hmm
- KSKaran Singhal
... just been working with, um, a, a bunch of licensed meth- mental health experts across the world to think about the right ways to define model behavior in a bunch of tricky scenarios and ensure that we can get to a level of consensus. Um, people definitely disagree even more here than physical health. Get to a level of consensus in some of these tricky situations where we can actually measure performance and create this kind of like shared benchmark for the industry. And, um, so we released that, that benchmark very recently, and similar to Health Bench and Health Bench Professional, the goal has really been, can we create this benchmark that kind of raises the ceiling for everybody and kind of creates across all model developers and the healthcare industry and, and mental health experts like this really shared ruler or measuring stick that we can use to kind of make sure that we're moving in the right direction.
- JRJay Rughani
Okay, so we've spoken about intelligence and the use cases that are coming around, uh, intelligence approving. We've spoken about trust, which is critical. Let's talk about medical care, and I wanna draw the distinction between medical information and medical care. Uh, I think for medical information, I think if you have a health concern, if I have a health concern about my-myself or something that I'm dealing with- Chat and other LLMs are increasingly the better, faster, cheaper way to get an answer and a resolution to that question. But if, uh, in the scenarios where medical information alone doesn't get me to resolution, I then, uh, at least today am thrusted into the traditional medical care system. And so if I need to go get a prescription, if I n-need to go see an in-person specialist, if I need to get some follow-up blood work or some MRI or some other f-form of scan done, if I need a clinician to examine me in some way, I still need to navigate the traditional healthcare system. And
- 30:59 – 38:21
Information vs actual care
- JRJay Rughani
a lot of that work, um, uh, is sort of, uh, governed and regulated by the US medical license and sort of other infrastructure that we have in our healthcare system. Um, it's the multi-turn conversation where it's not just a single question resolution, it's, "I gotta go talk to a few people. I need to go get a few things done. We need to collect some information." In many ways, medical care is a, it's a bundled product. You know, we're getting the diagnosis and triage and the care plan. We're getting the empathy from the clinician and the assurance and the support. We're getting the legal liability associated with that and what they're taking on. Will AI provide all of that? Uh, where will it stop short? Uh, where, where do you think, where do you think this is all going?
- KSKaran Singhal
Yeah. No, I, I don't think AI can pr- can or will provide all of that. And I think you're right that there's like this distinction between health information and, and medical care. And so I think, I think the way we see our role here is really to enable the whole ecosystem, 'cause there's no future where, you know, any one company is delivering all the medical care, right?
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
And so our role here is really to think about what does the last mile of medical care really look like for, for people?
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
Can we really understand that, and can we make that easier and, um, easier for everybody so that the, the last mile of actually having impact on patients just looks like the last hundred meters for all of our partners. And so that's kind of how we think about it, is like really like making it very easy for, for our partners to use AI to support everybody in the care journey. I think there is stuff that OpenAI can do relatively uniquely here because of the front door to health that it has. And so, for example, it can help you navigate a lot of these kinds of questions or help you navigate this journey or, you know, as we get i-increasingly helpful personal agents help you with some of the scheduling and logistics and things like this and just act as a quarterback for your health.
- JRJay Rughani
Yeah.
- KSKaran Singhal
Um, that said, I don't think it'll resolve all of these challenges that we'll have, at least not in the short term. And I think to a large extent, we're looking to enable a lot of our partners that are delivering care, that are, you know, overwhelmingly using our models in various ways-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
... to like make these operations happen smoother and easier so that patients are not left in this kind of fragmented experience.
- JRJay Rughani
So should the-- As a consumer, should the experience that I look forward to, uh, from OpenAI be, um, sort of the quarterback care that you described? Will I be talking to a clinician in the interface at any point, or would you m- perhaps route me to a doctor and help me find that? 'Cause given that's a whole challenge, just scheduling and making those visits happen. What should I look forward to?
- KSKaran Singhal
I, I think, I think you'll see, like we, we will be hopefully very helpful in helping you navigate the process of finding care. I don't think we'll be in the business of doing all the things that you mentioned.
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
Um, but... And that, that's where we're really relying on all of our startup and care provider organizations-
- JRJay Rughani
Sure
- KSKaran Singhal
... and partners and things like this.
- JRJay Rughani
So it, it-- So coming back to a question I mentioned earlier, which is you are building that future, but you're building it with partners. You're building it for consumers and patients. You're building it for clinicians. You're building it for enterprises. For clinicians and enterprises, like give us some texture on, uh, on some of the tools that you're launching and, and some of the collaborations that have really worked.
- KSKaran Singhal
Yeah. Um, we, we've had a few, a few really exciting partnerships. Um, we've had some really amazing launch partners for ChatGPT for Healthcare.
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
We've had lots of users using ChatGPT for clinicians and really enjoying it. It's been, um... the retention on the, on the offering has been like a, a very pleasant surprise. People, people seem to be really enjoying it. Um, yeah, we've been working with a variety of health systems. I think one, um, a couple that stand out, you know, one is, um, we've been working with UCSF, and we've been chatting about that.
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
And they've been, you know, one of our earliest adopters for this connection between Epic and the EHR and ChatGPT, and they've been really on the front lines of thinking about, for example, clinicians using it for chart review or things like this, um, and thinking about the right ways in which like the experience of caring for a patient doesn't need to be this super fragmented. You need to switch tabs or switch experiences and, and things like this. And so they've been some of our power users on that front. Um, I think another one, um, is Advent Health, and they've actually been some of our power users in think- in thinking about deploying agents across the workspace, actually across all of OpenAI. They've been, um, they've been a leader. Um, and they've been really, um, they've, they've had amazing results. They've reported, uh, roughly eighty percent reduction in a lot of their administrative, um, c- workflow costs using AI in these kinds of ways.
- JRJay Rughani
Hmm.
- KSKaran Singhal
And I think a lo- a lot of health systems I think should look to them. I think they're, they're really impressive.
- JRJay Rughani
If I go into my doctor's office and I see ChatGPT open up on their screen, should I be upset? Should I be happy?
- KSKaran Singhal
Yeah.
- JRJay Rughani
How do you think people will, will react to that?
- KSKaran Singhal
Yeah. I, I, I hear, I hear differing things, and I think it's actually changing over time.
- JRJay Rughani
Yeah.
- KSKaran Singhal
And so I, I think it's this interesting thing whereas as the Overton window is shifting in real-time, I think, you know, there might have been some level of, of concern before.
- 38:21 – 43:39
A "move 37" for health
- JRJay Rughani
Another thing I'm curious about is in the fields of AI applied to other domains and, and situations like, let's say, games like chess and Go. Um, AI-- as AI got really good at chess and Go, they also revealed other strategies and ways of playing the game that even the best experts in those domains were not exploiting or not pursuing, and that helped us learn more about these games and, um, also helped us learn more about AI. Are there equivalents like that that you've seen in AI applied to health from the work that you've done, uh, in research? Are there already findings that are surprising you and perhaps introducing new ways of delivering care or understanding a clinical scenario, uh, that can give us some optimism?
- KSKaran Singhal
Yeah, I mean, I think we've, we've seen this at smaller scales, but let, let me, let me zoom out and say, like, you know, one thing that's been motivating our team in general recently around raising the ceiling of human health is this notion of bringing to bear a ki-kind of a move 37 for, for health.
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
And this idea of a move 37 is it comes from, from AlphaGo, um, and, uh, a game that the AlphaGo system, which plays this kind of complicated board game, uh, played with Lee Sedol-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
... where there was a s-specific move that just kind of in the moment was-- seemed like a, a really dumb move-
- JRJay Rughani
Right
- KSKaran Singhal
... and a really surprising move for all the human experts watching this game, uh, between this AI system and this world expert in Go. But in hindsight is this kind of, like, brilliant and insightful move that humans are now just, uh, beginning to understand and-
- JRJay Rughani
Yeah
- KSKaran Singhal
... learn from the patterns of and things like this.
- JRJay Rughani
Yeah.
- KSKaran Singhal
And this, this is a very interesting example. Um, I think te-- So, so there's an idea of, like, how do you get to a move 37 in health-
- JRJay Rughani
Yeah
- KSKaran Singhal
... of a, of a move or a prediction where the models predict something that a human might not have been able to predict-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
... but in hindsight seems, seems correct and brilliant and, and insightful and impactful. So I think, I think we're very early, and I, I think you're gonna see much more of this in the future than in the past. But, um, I think, you know-- I mean, one kind of example is, again, thinking about these-- the ways in which these systems have been deployed as safety nets to clinicians, where clinicians are actually delivering care, and in the moment, the AI actually flags kind of like, "Hey, something might be off here," like, like our study with Panda Health-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
... and thinking about the patterns of, of results that we saw there. As an example, you know, um, in that context, uh, the clinicians were a little bit, um, prone to overuse of antibiotics.
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
And a very common pattern that the, the models flagged is just kind of like avoiding this overuse of, of antibiotics and-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
... thinking less about the local case and more about the kind of global, um, issue of resistance to antibiotics. So that's like one, you know, specific example. But, but again, I think you're gonna see more of these examples of models taking in, like, a longitudinal history of a user over, um, ten years across all their data, across the HR data, across the chat data-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
... all the- all these things, and making predictions that seemed impossible before, because a human can't even integrate all that data in their head.
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
And making predictions about their health and their risks and things like this that seemed like they were impossible. And I, I think that would rise to the occasion of, of being called a move 37.
- JRJay Rughani
Yeah. I mean, there are-- there's so many things that consumers are curious about, uh, that, um, at least at one point in time, we weren't sure if it was healthy for you, and then the, to your point, the Overton window changed, and, uh, and there was sort of more evidence that was sort of clu-conclusive in one direction. You know, at one point, people weren't sure if smoking was, uh, bad for you. Is coffee good or bad for you? Is sugar good or bad for you? Uh, sometimes the views on some of these things have changed, and today consumers are-- they wanna know, is creatine good for you? Is melatonin good for you? Uh, you know, all these sort of new emerging phenomenons, uh, that perhaps are understudied or at least, um, uh, you know, not widely, uh, sort of agreed upon, the s-safety and, and effectiveness of certain, of certain supplements or certain medications and things like that. Can-- Do you, do you anticipate as people are sort of entering this information into ChatGPT or other LLMs that we'll have more evidence that we can generate to study some of these things that folks are curious about but we don't really know, uh, or we don't have conclusive evidence one way or the other on, on where they stand?
- KSKaran Singhal
Yeah, I mean, I think one of the most interesting things about agents is they kind of solve a lot of the bottlenecks in analyzing data that already exists, right? There, there's various places Across the healthcare ecosystem where data's being generated, EHR data, longitudinal histories, claims, whatever-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
... where data's being generated, and it is kind of just stored there, and it-- the insights from it are not fully mined or used to, to generate new knowledge.
- 43:39 – 50:27
Driving down the cost of care
- JRJay Rughani
Switching gears slightly, you, you've also shared thoughts around, um, just the cost of intelligence as an input to medical intelligence coming way down and, you know, at some point it'll be too cheap to meter. Um, I spend a lot of time, and we as a team spend a lot of time trying to understand how these technologies will make an impact on our healthcare system that, uh, is inflating well ahead of, uh, of inflation, uh, five point three plus trillion we spend on healthcare. If it were its own country, it'd be the third-largest GDP. Um, it's the biggest part of our economy. It's also the biggest employer, uh, in our economy. Twenty-three million Americans work in healthcare. There's so much, um, there's just so much we spend on healthcare. What do you, what do you sort of make of the work that you're doing and the impact that it'll have on the cost of care?
- KSKaran Singhal
I think this is, like, one of the most important ways that we can pursue our mission is to not only make our models better at the frontier, but make that widely accessible to everybody.
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
So that's, you know, obviously a big part of how we've been able to deploy health intelligence to a lot of people across the world for free. I think it's also a, a big part of how we think about, you know, um, API and how, how good our models are there for health and pricing there and stuff like this. You know, one, one recent update was we recently released, uh, GPT-6 Luna.
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
And GPT-6 Luna is, um, is our current cheapest model on the API, um, or cheapest, you know, frontier model on the API. And what we found with GPT-6 Luna was that it was actually doing better on our benchmark, Health Bench Professional, our, our current k- latest benchmark of, of kind of clinician workflows that are, like, really difficult, selected for difficulty for our current models across all the different ways in which clinicians are using our models and, and the models, um, still could be, could use some improvement.
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
Um, it performed better than 5.6 Sol, which was, uh, literally our best model like a month ago. [chuckles]
- JRJay Rughani
Hmm.
- KSKaran Singhal
And so-- and it's, it performs better despite being thirty-four times cheaper. Um, and we've had a couple of those moments even, even in the past year, and, you know, there's been many trends showing that AI, compared to other technologies that have been introduced in the past, has been reducing a cost at a given level of kind of capability or usefulness faster than many of these other technologies. And so one bet we've had at OpenAI is that the cost of health intelligence will, will plummet at a given level of health intelligence.
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
And the, the level of health intelligence where, you know, clinicians and patients feel like they can trust in the care journey is starting to get there, right?
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
So that's like a fixed level of intelligence in some sense. Hopefully, the bar after that raises over time as well. Um, my expectation is once we get close to that level of intelligence, the cost for that level of intelligence also dramatically reduces like it has been, as the hope there is that we get, like, a kind of this commoditization of health intelligence, right?
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
We don't wanna hoard that health intelligence. We want to-
- JRJay Rughani
Sure
- KSKaran Singhal
... to everybody to use it. So my hope that that contributes, but, you know, to answer your question about the whole of healthcare spending, I don't think all of that is about health intelligence.
- JRJay Rughani
Yeah.
- KSKaran Singhal
And I don't think, like, health intelligence has had yet a macro factor on the pr-- a macro effect on the problem that you're describing. If you look at, like, the whole of spend of health, there is quite a bit of areas, though, where if you look at, for example, chronic care management or documentation or administration, or a lot of kind of administrative workflows of various kinds, back office workflows, there's a lot of money spent in ways that probably don't need to be spent that way. Um, and so we are very optimistic about kind of an overall compression of spend over the, over the coming years. I don't think that's happened yet, and I don't think that just happens from making health intelligence abundant. I think that happens from integration and workflows and deployment-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
... and scaling that up and really making sure that these models are valuable in the economically valuable tasks that, that people are using them for. But I think it's a, a prerequisite to making that future happen.
- JRJay Rughani
More care, less paperwork is sort of where we're heading. At least there's a lot of the cost savings.
- KSKaran Singhal
Yeah.
- JRJay Rughani
W- I'm sure you saw some of the headlines over the last few weeks of, uh... There's a New York Times article, uh, that basically provider AIs and payer AIs are fighting, and there was some Blue Cross Blue Shield Association analysis that showed that, uh, the respective billing bots, uh, and paperwork bots effectively, uh, increased spend by a billion dollars or something like that. When you are doing cutting-edge r- research on health and trying to bring down the cost of medical intelligence to near zero, and then you see headlines like that, what do you make of that?
- KSKaran Singhal
I, I think this might be one of those areas where there might be some kind of short-term pain around this kind of provider-payer arms race, but in the long run, there's no reason this has to exist, right?
- JRJay Rughani
Yeah.
- KSKaran Singhal
And so r- really, I think, you know, you're entering a world where a lot of visits actually have some kind of ambient intelligence in the room-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
... listening, transcribing, things like this. Um, there is notes, there's clinical notes. There's AI adjudicat- A- AI details of, of, of clinical notes and things like this. And so you have a lot of the details you need to adjudicate visits, right? And so the ideal world, in my view, is a world in which providers and payers kind of have a handshake like, "Hey, here's our ground truth of what happened in this visit. Like, here's all the information we have. There's just, like, no other source of information that there is."
- 50:27 – 55:39
Procedural care and what's next
- KSKaran Singhal
well.
- JRJay Rughani
Zooming out to the overall healthcare system and now just looking at it at large, you know, we talked about this five point three trillion. A lot of that spend is paperwork between providers and payers and other stakeholders within the five Ps of healthcare. A lot of that is cognitive care that you're arguing can be augmented and, um, enhanced and sort of we can have-- bring, bring on a lot more cognitive care capacity, uh, online, which is exciting and, uh, exciting from an access perspective. And then there's a lot of spend in healthcare that is procedural, either requiring some imaging, some blood work, some follow-on examination, or it's some surgical intervention. Um, where do you see sort of the intelligence work that you're doing in the medical space impacting procedural care? And is that gonna be the ultimate-- Is that gonna be the new sort of or an en-an enhanced, uh, or perhaps an exacerbated bottleneck, or do you expect to do a lot of work there as well, robotics, et cetera?
- KSKaran Singhal
Yeah, I mean, I, I think in the short term with procedural care, I think y-you want a better targeting of when that's needed, right? And I think AI can help, you know, provide information that is helpful to-- for knowing when to seek that kind of care as well.
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
Probably the, the biggest macro factor in the next, you know, year or two will just be better kind of, um, proactive preventative stuff, right? So you don't have to actually go in later and get that procedure, right? Because if you make the right moves sooner and AI helps you navigate that kind of journey, then you can hopefully avoid a lot of the downstream costs of the most expensive procedures. So that, that might be like one macro factor to kind of look out for is my guess.
- JRJay Rughani
Mm-hmm.
- KSKaran Singhal
I think the question of kind of robotics and care, I think is a mi-- a bit of a longer term one, both from a technology perspective and kind of like a reimbursement and kind of industry, um, integration perspective. My expectation is that it's not like a next few years kind of thing.
- JRJay Rughani
Very cool. Okay, we've covered a lot of ground. We've talked about intelligence improving, we've talked about trust, we've talked about moving from medical information to medical care. Help us understand what we can look forward to as things, uh, as sort of things continue to unfold, um, as agents and personal agents and the underlying models become increasingly performant. What can we look forward to from ChatGPT Health?
- KSKaran Singhal
Yeah, I mean, I think there's like really two high-level things that we're really focused on making happen. One is, again, thinking about like the ways in which we can raise the floor of human health and make trustworthy, reliable health intelligence abundant for all clinicians and all users and patients. And so getting to the point where, you know, like we talked about, like all patients and clinicians just feel safer by having AI in the care journey. Like when you see the, the ChatGPT, you actually-- when the doctor's using ChatGPT, you actually feel safer and vice versa.
- JRJay Rughani
Yeah.
- KSKaran Singhal
Getting to that point, and again, that's, that's a question of not just, you know, the models being good and, and evals being good, but also how we deploy it and the activation energy around that and, and, um, the products and things like this. Um, I think a second thing is really thinking about, um, raising the ceiling. So what are the ways in which AI can actually do things that were not possible before? So one of them actually, I think is this kind of like, you know, proactive health-- pr-proactive personal health assistant that is part of your care journey-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
... is helping you navigate these moments, being your quarterback, you know, helping you schedule and all these things, but also flagging the places where, you know, you can intervene in your health today and prevent a lot of, you know, expensive deterioration later in the future. Um, and I think that's gonna be an important part of how we think about, you know, improving the future of, of health for, for people, as many people as possible. And I think th-the second thing is just what you mentioned before, which is like really thinking about the ways in which we can unlock the value of existing data that is sometimes stored in boxes of various kinds, and thinking about the ways in which that can be leveraged to produce new insights that benefit patients.
- JRJay Rughani
It is striking and incredible and humbling to realize that ChatGPT, I think, came out three years ago, roughly. Uh, and so it's been a lot of progress, uh, in a very, very short period of time. So to even talk on a five or a ten-year basis feels academic, but can you give us some predictions? I mean, is there a feature that we might have that feels science fiction today, uh, but we could have one day three, five, ten years from now?
- KSKaran Singhal
Yeah, I mean, it's, it is super, super hard to predict the future these days, so, um, um, this is a difficult one. But what I would say is like, I think the thing that might have the most impact on human health in the-- in that kind of timeframe, the next five to ten years, is probably gonna be newer treatments that come out of maybe two things. One is, um, AI-guided, um, generation of new targets or molecules that, that, that could be interesting-
- JRJay Rughani
Mm-hmm
- KSKaran Singhal
... or, you know, for, for new treatments. And the second is AI-guided prioritization and validation. So thinking about the right ways. We're already at a point where the number of molecules and drugs that people want to suggest to be used and in clinical trials and things like this is way more than the number of slots available in clinical trials. So thinking about the ways in which models can kind of help prioritize and run these clinical trials so that they just run smoother and faster. My guess is in, in that kind of timeframe, you're, you're talking about kind of like improved medicines, more personalized medicines for people, things like this, and that will only be possible because you invested in those two pillars.
- JRJay Rughani
That is awesome. Uh, well, we've covered a lot of ground. I'm leaving this conversation even more optimistic than I was before. Uh, so Karan, thank you so much for coming on the a16z podcast.
- KSKaran Singhal
Thank you for having me.
Episode duration: 55:54
Install uListen for AI-powered chat & search across the full episode — Get Full Transcript
Transcript of episode 9n0MI4D7TCM
