Lex Fridman PodcastDaniel Kahneman: Thinking Fast and Slow, Deep Learning, and AI | Lex Fridman Podcast #65
EVERY SPOKEN WORD
110 min read · 21,623 words- 0:00 – 15:00
The following is a…
- DKDaniel Kahneman
The following is a conversation with Daniel Kahneman, winner of the Nobel Prize in Economics for his integration of economic science with the psychology of human behavior, judgment, and decision-making. He's the author of the popular book, Thinking, Fast and Slow, that summarizes in an accessible way his research of several decades, often in collaboration with Amos Tversky...... and what, what people can do.
- LFLex Fridman
So, the effect of the in group and the out group?
- DKDaniel Kahneman
You know, the- it's clear that those were people, you know, you could- you could shoot them. You could- you know, they were not human. They were not- there was no empathy or very, very little empathy left. So occasionally, you know, they might have been- and, and very quickly, by the way, uh, the empathy disappeared if there was initially. And the fact that everybody around you was doing it, that, that completely- the group doing it and everybody shooting Jews, I think that, that, uh, makes it permissible. Now, how much, you know, whether it would- it could happen, uh, in every culture or whether the Germans were just particularly efficient and, and disciplined so they could get away with it.
- LFLex Fridman
Mm-hmm.
- DKDaniel Kahneman
That's-
- LFLex Fridman
It's a question.
- DKDaniel Kahneman
It's an interesting question.
- LFLex Fridman
Are these artifacts of history or is it human nature?
- DKDaniel Kahneman
I think that's really human nature. You know, you put some people in a position of power relative to other people and, and then they become less human. They- they become different.
- LFLex Fridman
But in general, in war, outside of concentration camps in World War II, it seems that war brings out darker sides of human nature, but also the beautiful things about human nature.
- DKDaniel Kahneman
Well, you know, I mean, what it- what it brings out is the, the loyalty among soldiers. I mean, it brings out the bonding. Male bonding, I think, is a very real thing that- and that happens. And so- and, and there is a certain thrill to friendship and there is certainly a certain thrill to friendship under risk-
- LFLex Fridman
Yeah.
- DKDaniel Kahneman
... and to shared risk. And so people have very profound emotions up to the point where it gets so traumatic that, uh, that little is left, but-
- LFLex Fridman
So, let's talk about psychology a little bit. Uh, in your book, Thinking, Fast and Slow, you describe two modes of thought system. One, the fast, instinctive and emotional one, and system two, the slower, deliberate, logical one. At the risk of asking Darwin to discuss (laughs) , uh, theory of evolution, uh, can you describe distinguishing characteristics for people who have not read your book of the two systems?
- DKDaniel Kahneman
Well, I mean, the word system is a bit misleading, but it's- at the same time it's misleading, it's also very useful.
- LFLex Fridman
Yes.
- DKDaniel Kahneman
But what I call system one, it's easier to think of it as, as a family of activities. And primarily the way I describe it is there are different ways for ideas to come to mind, and some ideas come to mind automatically. And the example- a standard example is two plus two, and then something happens to you. And, and in other cases you've got to do something, you've got to work in order to produce the idea. And my example, I always give the same pair of numbers as 27 times 14, I think.
- LFLex Fridman
You have to d- perform some algorithm in your head, some steps.
- DKDaniel Kahneman
Yes, and, and it takes time.
- LFLex Fridman
Yeah.
- DKDaniel Kahneman
It's a very different. Nothing comes to mind except something comes to mind which is the algorithm, I mean, that you've got to perform, and then it's work-
- LFLex Fridman
Right.
- DKDaniel Kahneman
... and it engages short-term memory and it engages executive function and it makes you incapable of doing other things at the same time. So, uh, the- the main characteristic of system two that there is mental effort involved and there's a limited capacity for mental effort, whereas system one is effortless essentially. That's the major distinction.
- LFLex Fridman
So, you talk about their- you know, it's really convenient to talk about two systems, but you also mentioned just now and in general that there's no distinct two systems in the brain from a neurobiological, even from psychology perspective. But why does it seem to, uh ... from the experiments you've conducted, there does seem to be kind of emergent two modes of thinking. So, at some point these kinds of systems came into a brain architecture, maybe mammals share it, but- or, or do you not think of it at all in those terms that it's all a mush and these two things just emerge?
- DKDaniel Kahneman
I mean, you know, evolutionary theorizing about this is cheap and-
- LFLex Fridman
Yeah. Fair enough.
- DKDaniel Kahneman
... and easy. So it's- the way I think about it is that it's very clear that animals, uh, have, have a perceptual system and that includes an ability to understand the world-
- LFLex Fridman
Mm-hmm.
- DKDaniel Kahneman
... at least to the extent that they can predict. They can't explain anything, but they can anticipate what's going to happen and that's a key form of understanding the world. And my crude idea is that we- what I call system two-
- LFLex Fridman
Mm-hmm.
- 15:00 – 30:00
So, along this line…
- DKDaniel Kahneman
And, and all that is in system one, so you... uh, system two verifies.
- LFLex Fridman
So, along this line of thinking, really, what we are, are machines that construct pretty effective system one. You could think of it that way. So, so we're now talking about humans, but if you think about building artificial intelligence systems, robots, do you think all the features and bugs that you have highlighted in human beings are useful for constructing AI systems? So both systems are useful for perhaps-
- DKDaniel Kahneman
Well-
- LFLex Fridman
... instilling in robots?
- DKDaniel Kahneman
What is happening these days is that actually what is happening in deep learning is, is more like a system one product than like a system two product.
- LFLex Fridman
Mm-hmm.
- DKDaniel Kahneman
I mean, deep learning matches patterns and anticipate what's going to happen, so it's highly predictive. Uh, what-
- LFLex Fridman
That's right.
- DKDaniel Kahneman
... what d- deep learning doesn't have, and, you know, many people think that this is a critical... it, it doesn't have the ability to reason, so it, it does... uh, there is no system two there. But I think very importantly, it doesn't have any causality or any way to represent meaning and to represent real interactions. So, uh, until that is solved, uh, the... you know, what can be accomplished is marvelous and very exciting but limited.
- LFLex Fridman
That's actually really nice to think of, uh, current advances in machine learning as essentially system one advances. So how far can we get with just system one?
- DKDaniel Kahneman
Well, um-
- LFLex Fridman
If we think of deep learning and artificial intelligence (laughs) systems as system one.
- DKDaniel Kahneman
I mean, you know, it's very clear that DeepMind has already gone way, way beyond what people thought was possible. I think, I think the thing that has impressed me most about the developments in AI, is the speed. It's that things, at least in the context of deep learning, and maybe this is about to slow down, but things moved a lot faster than anticipated. The transition from solving, solving chess to solving Go, uh, was... I mean, that's bewildering how quickly it went. The move from AlphaGo to AlphaZero is sort of bewildering, the speed at which they accomplished that. Now, clearly, uh, they are... there re- so there are many problem that you can solve that way, but there are some problems for which you need something else. <|agent|><|en|> Well, reasoning and also... you know, the... uh, one of the real mysteries, uh, a psychologist Gar- Gary Marcus, who is also a critic of AI, um... I mean, he... what he points out, and I think he has a point, is that, uh, humans learn quickly.... uh, children don't need a million examples, they need two or three examples. So, clearly there is a fundamental difference. And what enables, uh, what enables a machine to, to learn quickly, what you have to build into the machine, because it's clear that you have to build some expectations or something in the machine to make it ready to learn quickly, uh, that's, that at the moment seems to be unsolved. I'm pretty sure that DeepMind is working on it but, um-
- LFLex Fridman
Yeah, they're-
- DKDaniel Kahneman
... if they have solved it, I, I haven't heard yet.
- LFLex Fridman
They're trying to actually, them and OpenAI are trying to, to start to get to use neural networks to reason. So assemble knowledge-
- DKDaniel Kahneman
Yeah.
- LFLex Fridman
... uh, of course causality is, temporal causality is out of reach to most everybody. You, you mentioned wha- the benefits of system one is essentially that it's fast, it allows us to function in the world.
- DKDaniel Kahneman
Fast and skilled, yeah.
- LFLex Fridman
It's skill.
- DKDaniel Kahneman
And it has a model of the world. You know, in a sense, I mean there was the earlier phase of, of, uh, AI, uh, attempted to model reasoning, and they were moderately successful, but you know, reasoning by itself doesn't get you m- much. Uh, deep learning has been much more successful in terms of, you know, what they can do. But now, it's an interesting question, whether it's approaching its limits. What do you think?
- LFLex Fridman
I think absolutely. So I, I just talked to Yann LeCun, he mentioned, you know... (laughs)
- DKDaniel Kahneman
I know him.
- LFLex Fridman
So he thinks that, uh, the limits, we're not going to hit the limits with neural networks, that ultimately this kind of system one pattern matching will start to, start to look like system two, with, without significant transformation of the architecture. So I'm more with the, with the majority of the people who think that yes, neural networks will hit a limit in their capability.
- DKDaniel Kahneman
Well he, on the one hand I have heard him tell Demis Hassabis essentially that, you know, what they have accomplished is not a big deal, that they have-
- LFLex Fridman
Mm-hmm.
- DKDaniel Kahneman
... just touched, that basically, you know, they can't do unsupervised learning-
- LFLex Fridman
Yeah.
- DKDaniel Kahneman
... in a, in an effective way. And, but you're telling me that he thinks that the current, within the current architecture, you can do causality and reasoning?
- LFLex Fridman
So he's very much a pragmatist in a sense that's saying that we're very far away, that there's still-
- 30:00 – 45:00
Well, I think that…
- LFLex Fridman
lies, is it seems that almost every robot-human collaboration system is a lot harder than people realize. So, do you think it's possible for robots and humans to collaborate successfully?Uh, we, we talked a little bit about semi-autonomous vehicles, like in the Tesla, autopilot, but just in tasks in general... i- if you think, we talked about current neural networks being kind of system one. Do you think, uh, those same systems can borrow humans for system two type tasks and collaborate successfully?
- DKDaniel Kahneman
Well, I think that in any system where humans and, and the machine interact, uh, the human will be superfluous within a fairly short time. Uh, that is if, if the machine is advanced enough so that it can really help the human, then it may not need the human for a long time. Now, it would be very interesting if, if there are problems that for some reason the machine doesn't, cannot solve, but that people could solve, then you would have to build into the machine an ability to recognize that it is in that kind of problematic situation-
- LFLex Fridman
Mm.
- DKDaniel Kahneman
... and, and to call the human. That, that cannot be easy without understanding. That is, it's, it must be very difficult to, to program a recognition that you are in a problematic situation without understanding the problem, but...
- LFLex Fridman
That's very true. In order to understand the full scope of situations that are problematic, you almost need to be smart enough-
- DKDaniel Kahneman
To solve it.
- LFLex Fridman
... to solve all those problems.
- DKDaniel Kahneman
Yeah. It's not clear to me how much the machine will need the human. I think the example of chess is very instructive. I mean, there was a time at which Kasparov was saying that human-machine combinations will beat everybody. Uh, even Stockfish doesn't need people.
- LFLex Fridman
Yeah.
- DKDaniel Kahneman
And AlphaZero certainly doesn't need people.
- LFLex Fridman
The question is, just like you said, how many problems are like chess and how many problems are the ones where are not like chess, where-
- DKDaniel Kahneman
Let me-
- LFLex Fridman
... well, every problem probably in the end is like chess. The question is, how long is that transition period?
- DKDaniel Kahneman
I mean, you know, that's, that's a question I would ask you in terms of... I mean, autonomous vehicle, just driving, is probably a lot more complicated than Go to solve the-
- LFLex Fridman
Yes.
- DKDaniel Kahneman
... to solve the problem.
- LFLex Fridman
And, and that's surprising to people.
- DKDaniel Kahneman
Because it's open. No. I mean, I, you know, it wouldn't, that's not surprising to me because the, because the, there is a hierarchical aspect to this, which is recognizing a situation, and then within the situation, bringing, bringing up the relevant knowledge.
- LFLex Fridman
Right.
- DKDaniel Kahneman
And, uh, and for that hierarchical type of system to work, uh, you need a more complicated system than we currently have.
- LFLex Fridman
A lot of people think because as human beings, this is probably the, the cognitive biases, they think of driving as pretty simple because they think of their own experience. This is actually a, a b- big problem for AI researchers or people thinking about AI because they evaluate how hard a particular problem is based on very limited knowledge-
- DKDaniel Kahneman
Yeah.
- LFLex Fridman
... ba- basically on how hard it is for them to do the task.
- DKDaniel Kahneman
Yeah.
- LFLex Fridman
And then they take for granted... I me- maybe you can speak to that because most people tell me driving is trivial, and-
- DKDaniel Kahneman
Well-
- LFLex Fridman
... and humans, in fact, are terrible at driving is what people tell me. And I see humans, and humans are actually incredible at driving, and driving is really terribly difficult.
- DKDaniel Kahneman
Yeah.
- LFLex Fridman
Uh, so do you... (laughs) is that just another element of the effects that you've described in your work on the psychology side?
- DKDaniel Kahneman
Well...
- 45:00 – 1:00:00
I- …
- LFLex Fridman
the being in it. But there's also a modern... I don't know if you think about this or interact with it, there's a modern way to, uh, magnify the remembering self, which is by posting on Instagram, on Twitter, on social networks. A lot of people live life for the picture that you take, that you post somewhere. And now thousands of people share it and potentially- potentially millions, and then you can relive it even much more than just those minutes. Do you think about that-
- DKDaniel Kahneman
I-
- LFLex Fridman
... magnification much?
- DKDaniel Kahneman
You know, I'm too old for social networks. I, you know, I- I've never seen Instagram, so-
- LFLex Fridman
(laughs)
- DKDaniel Kahneman
... I cannot really speak intelligently about those things. I'm just too old.
- LFLex Fridman
But it's interesting to watch the exact effects you described?
- DKDaniel Kahneman
I- I think it will make a very big difference. I mean, and it will make... It will also make a difference, and that I don't know, whether, uh... It's clear that in some ways the devices that serve us, uh, supplant function. So you don't have to remember phone numbers, you don't have... You really don't have to know facts. I mean, the number of conversations I'm involved with where somebody says, "Well, let's look it up."
- LFLex Fridman
Yeah.
- DKDaniel Kahneman
Uh, so it's- it's a... In a way, it's made conversations... Well, it's- it means that it's much less important to know things. You know, it used to be very important to know things. This is changing. So the requirements of that- that we have for ourselves and for other people are changing because of all those supports and because... And I have no idea what Instagram does-
- LFLex Fridman
(laughs)
- DKDaniel Kahneman
... but it's, uh-
- LFLex Fridman
Well, I'll tell you-
- DKDaniel Kahneman
... I wish I knew.
- LFLex Fridman
I mean, I- I wish I could just have the... my remembering self could enjoy this conversation, but I'll get to enjoy it even more by having wat- by watching it and then talking to others, it'll be about 100,000 people, scary as it is to say, (laughs) "Well, listen or watch this." Right? It changes things. It changes the experience of the world, that you seek out experiences which could be shared in that way. It's in... And- and I haven't seen... It's- it's the same effects that you described, and I don't think the psychology of that magnification has been described yet, 'cause it's a new world.
- DKDaniel Kahneman
I mean, you know, the sharing... There was a per- there was a time when people read books and, uh-
- LFLex Fridman
(laughs)
- DKDaniel Kahneman
... and- and you could assume that your friends had read the same books that you read.
- LFLex Fridman
Mm-hmm.
- DKDaniel Kahneman
So there was-
- LFLex Fridman
Kind of invisible sharing that you're-
- DKDaniel Kahneman
There was a lot of sharing going on, and there was a lot of assumed common knowledge.
- LFLex Fridman
Yeah.
- DKDaniel Kahneman
And, you know, that was built in. I mean, it was obvious that you had read The New York Times, it was obvious that you had read the reviews. I mean, uh, so a lot was taken for granted that was shared, uh, and, you know, when there were... When there were three television channels, it was obvious that you'd seen one of them, probably the same as... Uh, so sharing ex- sharing-
- LFLex Fridman
Has always been there.
- DKDaniel Kahneman
Always... It was always there, it was just different.
- LFLex Fridman
At the risk of, uh, inviting mockery from you, let me say that... (laughs) that I'm also a fan of Sartre and Camus and existentialist philosophers. And, um, I'm joking, of course, about mockery. But from the perspective of the two selves, what do you think of the existentialist philosophy of life? So, trying to really emphasize the experiencing self as the proper way to... uh, or the best way to live life.
- DKDaniel Kahneman
I don't know enough philosophy to answer that, but it's not, uh... You know, the emphasis on, on experience is also the emphasis in Buddhism.
- LFLex Fridman
Yeah, right. That's right.
- DKDaniel Kahneman
So, uh, that's... You just have got to, to experience things and, and, and not to evaluate, and not to pass judgment, and not to score, not to keep score. So, uh-
- 1:00:00 – 1:15:00
Yeah, and I mean...…
- DKDaniel Kahneman
my experience, are a very personal experience. And- and I have to like the person I'm working with. Otherwise, you know, I mean, there is that kind of a collaboration which is like, uh, an exchange, a commercial exchange of, uh, "I'm giving this, you give me that," but the- the real ones are interpersonal, they're between people who like each other, and- and who like making each other think, and who like the way that the other person responds to your thoughts. Uh, you have to be lucky.
- LFLex Fridman
Yeah, and I mean... But I already noticed the pa- even just me showing up here-... you've, uh, you've quickly started to digging in a particular problem I'm working on, and already new information started to emerge. If y- is that a process y- y- just a process of curiosity-
- DKDaniel Kahneman
Yeah.
- LFLex Fridman
... of talking to people about problems and seeing?
- DKDaniel Kahneman
I'm curious about anything to do with AI and robotics and s- you know, and, uh, so, and I knew you were dealing with that, so I was curious.
- LFLex Fridman
Just follow your curiosity?
- DKDaniel Kahneman
Yeah.
- LFLex Fridman
Jumping around on, on the psychology front, the, uh, dramatic-sounding terminology of replication crisis, but really just the, at times, th- this effect that at times studies do not, are not fully generalizable. They don't-
- DKDaniel Kahneman
You're being polite. Uh, it's worse than that, but... (laughs)
- LFLex Fridman
Is it?
- DKDaniel Kahneman
Yeah.
- LFLex Fridman
So I'm actually not fully familiar-
- DKDaniel Kahneman
Well, I mean-
- LFLex Fridman
... to the degree how bad it is, right? So, what do you think is the source? Where do you think?
- DKDaniel Kahneman
I think I know what's going on, actually. I mean, I have a theory about what's going on. And what's going on is that there is, first of all, a very important distinction between two types of experiments. And one type is within-subject, so it's the same person-
- LFLex Fridman
Right.
- DKDaniel Kahneman
... as two experimental conditions. And the other type is between-subjects, where some people are this condition, other people are that condition. They're different worlds. And between-subject experiments are much harder to predict and much harder to anticipate. And the reason, uh, and they're also more expensive because you need more people, and it's, it's just... So between-subject experiments is where the problem is.
- LFLex Fridman
Okay.
- DKDaniel Kahneman
Uh, it's not so much in within-subject experiments. It's really between. And there is a very good reason why the intuitions of researchers about between-subject experiments are wrong, and that's because when you are a researcher, you are in a within-subject situation. That is, you are imagining the two conditions, and you see the causality, and you feel it.
- LFLex Fridman
Mm-hmm.
- DKDaniel Kahneman
And, but in the between-subjects condition, they don't... They, uh, they see, they live in one condition, and the other one is just nowhere. So, our intuitions are very weak about between-subject experiments. And that, I think, is something that people haven't realized. And, and in addition, because of that, we have no idea about the power of, uh, manipulations, of experimental manipulations, because the same manipulation is much more powerful when, when you are in the two conditions-
- LFLex Fridman
Mm-hmm.
- DKDaniel Kahneman
... than when you live in only one condition. And so, the experimenters have very poor intuitions about between-subject experiments. And, and there is something else, which is very important, I think, uh, which is that almost all psychological hypotheses are true. That is, in the sense that, you know, directionally, if you have a hypothesis that A really causes B, that, that it's not true that A causes the opposite of B. Maybe A just has very little effect. But hypotheses are true-
- LFLex Fridman
Yeah.
- DKDaniel Kahneman
... mostly, except, mostly, they're very weak. They're much weaker than you think when you are having images of... So, uh, the reason I'm excited about that is that I recently heard about, uh, some, uh, some friends of mine, uh, who, uh, they e- essentially funded 53 studies of behavioral change-
- LFLex Fridman
Yep.
- DKDaniel Kahneman
... by 20 different teams of people with a very precise objective of changing the number of time that people go to the gym, but-
- LFLex Fridman
Mm-hmm.
- DKDaniel Kahneman
... you know, so... And, and the success rate was zero.
- LFLex Fridman
They're not successful?
- 1:15:00 – 1:18:35
Does the possibility of…
- DKDaniel Kahneman
Uh, um, and, and humor would be more impressive than just factual conversation, which I think is, is easy. And allusions would be interesting, and metaphors would be interesting, I mean, but new metaphors, not practiced metaphors. So, there is a lot that's, you know, would be sort of impressive if... and that, uh, it's completely natural in conversation, but that you really wouldn't expect.
- LFLex Fridman
Does the possibility of creating an, a human-level intelligence or superhuman-level intelligence system excite you? Scare you?
- DKDaniel Kahneman
Well, I mean, you know, I'm, uh-
- LFLex Fridman
How does it make you feel?
- DKDaniel Kahneman
I find the whole thing fascinating, absolutely fascinating.
- LFLex Fridman
So, exciting?
- DKDaniel Kahneman
I think, and exciting. It's also terrifying, you know? But, uh, but I'm not going to be around to see it. And, uh, so I'm curious about what is happening now, but I also know that, that predictions about it are silly.
- LFLex Fridman
(laughs)
- DKDaniel Kahneman
Uh, we really have no idea what it will look like 30 years from now. No idea.
- LFLex Fridman
Speaking of silly, bordering on the profound, let me ask the question of, in your view, what is the meaning of it all?
- DKDaniel Kahneman
(laughs)
- LFLex Fridman
The meaning of life?
- DKDaniel Kahneman
Uh-
- LFLex Fridman
These, uh, descendant of great apes that we are, why... what drives us as a civilization, as a human being, as a force behind everything that you've observed and studied? Is there any answer, or is it all-
- DKDaniel Kahneman
Uh-
- LFLex Fridman
... just a beautiful mess?
- DKDaniel Kahneman
There is no answer that, that I can understand. Uh, and I'm not, and I'm not actively looking for one, um, bec-
- LFLex Fridman
Do you think an answer exists?
- DKDaniel Kahneman
No. There is no answer that we can understand. I'm not qualified to speak about what we cannot understand.
- LFLex Fridman
(laughs)
- DKDaniel Kahneman
But there is, I know, that we cannot understand reality, you know? And, I mean, there are a lot of thing that we can do. I mean, you know, m- m- gravity waves. I mean, that's, that's a big moment for humanity. And-
- LFLex Fridman
Yeah.
- DKDaniel Kahneman
... when you imagine that ape, you know, being able to, to go back to The Big Bang.
- LFLex Fridman
(laughs)
- DKDaniel Kahneman
That's, that... But, but-
- LFLex Fridman
But the why-
- DKDaniel Kahneman
Yeah, the why.
- LFLex Fridman
... is bigger than us.
- DKDaniel Kahneman
(laughs) The why is hopeless, really.
- LFLex Fridman
Danny, thank you so much. It was an honor. Thank you for speaking today.
Episode duration: 1:18:40
Install uListen for AI-powered chat & search across the full episode — Get Full Transcript
Transcript of episode UwwBG-MbniY
Get more out of YouTube videos.
High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.
Add to Chrome