Skip to content
Judea Pearl: Causal Reasoning, Counterfactuals, and the Path to AGI | Lex Fridman Podcast #56
This video isn’t embeddableWatch on YouTube →
Lex Fridman PodcastLex Fridman Podcast

Judea Pearl: Causal Reasoning, Counterfactuals, and the Path to AGI | Lex Fridman Podcast #56

Judea Pearl is a professor at UCLA and a winner of the Turing Award, that's generally recognized as the Nobel Prize of computing. He is one of the seminal figures in the field of artificial intelligence, computer science, and statistics. He has developed and championed probabilistic approaches to AI, including Bayesian Networks and profound ideas in causality in general. These ideas are important not just for AI, but to our understanding and practice of science. But in the field of AI, the idea of causality, cause and effect, to many, lies at the core of what is currently missing and what must be developed in order to build truly intelligent systems. For this reason, and many others, his work is worth returning to often. Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep56-sb See below for timestamps, and to give feedback, submit questions, contact Lex, etc. *CONTACT LEX:* *Feedback* - give feedback to Lex: https://lexfridman.com/survey *AMA* - submit questions, videos or call-in: https://lexfridman.com/ama *Hiring* - join our team: https://lexfridman.com/hiring *Other* - other ways to get in touch: https://lexfridman.com/contact *OUTLINE:* 0:00 - Introduction 3:18 - Descartes and analytic geometry 6:25 - Good way to teach math 7:10 - From math to engineering 9:14 - Does God play dice? 10:47 - Free will 11:59 - Probability 22:21 - Machine learning 23:13 - Causal Networks 27:48 - Intelligent systems that reason with causation 29:29 - Do(x) operator 36:57 - Counterfactuals 44:12 - Reasoning by Metaphor 51:15 - Machine learning and causal reasoning 53:28 - Temporal aspect of causation 56:21 - Machine learning (continued) 59:15 - Human-level artificial intelligence 1:04:08 - Consciousness 1:04:31 - Concerns about AGI 1:09:53 - Religion and robotics 1:12:07 - Daniel Pearl 1:19:09 - Advice for students 1:21:00 - Legacy *PODCAST LINKS:* - Podcast Website: https://lexfridman.com/podcast - Apple Podcasts: https://apple.co/2lwqZIr - Spotify: https://spoti.fi/2nEwCF8 - RSS: https://lexfridman.com/feed/podcast/ - Podcast Playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4 - Clips Channel: https://www.youtube.com/lexclips *SOCIAL LINKS:* - X: https://x.com/lexfridman - Instagram: https://instagram.com/lexfridman - TikTok: https://tiktok.com/@lexfridman - LinkedIn: https://linkedin.com/in/lexfridman - Facebook: https://facebook.com/lexfridman - Patreon: https://patreon.com/lexfridman - Telegram: https://t.me/lexfridman - Reddit: https://reddit.com/r/lexfridman

Lex FridmanhostJudea Pearlguest
Dec 11, 20191h 23mWatch on YouTube ↗

EVERY SPOKEN WORD

  1. 0:00 – 3:18

    Introduction

    1. LF

      The following is a conversation with Judea Pearl, professor at UCLA, and the winner of the Turing Award that's generally recognized as the Nobel Prize of computing. He's one of the seminal figures in the field of artificial intelligence, computer science, and statistics. He has developed and championed probabilistic approaches to AI, including Beijing Networks, and profound ideas in causality in general. These ideas are important not just to AI, but to our understanding and practice of science. But in the field of AI, the idea of causality, cause and effect, to many, lie at the core of what is currently missing and what must be developed in order to build truly intelligent systems. For this reason, and many others, his work is worth returning to often. I recommend his most recent book, called Book of Why, that presents key ideas from a lifetime of work in a way that is accessible to the general public. This is the Artificial Intelligence podcast. If you enjoy it, subscribe on YouTube, give it five stars on Apple Podcast, support it on Patreon, or simply connect with me on Twitter, @lexfridman, spelled F-R-I-D-M-A-N. If you leave a review on Apple Podcast especially, but also Castbox, or comment on YouTube, consider mentioning topics, people, ideas, questions, quotes in science, tech, and philosophy that you find interesting, and I'll read them on this podcast. I won't call out names, but I love comments with kindness and thoughtfulness in them, so I thought I'd share them with you. Someone on YouTube highlighted a quote from the conversation with Noam Chomsky, where he said that, "The significance of your life is something you create." I like this line as well. On most days, the existentialist approach to life is one I find liberating and fulfilling. I recently started doing ads at the end of the introduction. I'll do one or two minutes after introducing the episode, and never any ads in the middle that break the flow of the conversation. I hope that works for you and doesn't hurt the listening experience. This show is presented by Cash App, the number one finance app in the App Store. I personally use Cash App to send money to friends, but you can also use it to buy, sell, and deposit Bitcoin in just seconds. Cash App also has a new investing feature. You can buy fractions of a stock, say $1 worth, no matter what the stock price is. Brokerage services are provided by Cash App Investing, a subsidiary of Square and member SIPC. I'm excited to be working with Cash App to support one of my favorite organizations called FIRST, best known for their FIRST robotics and LEGO competitions. They educate and inspire hundreds of thousands of students in over 110 countries, and have a perfect rating on Charity Navigator, which means the donated money is used to the maximum effectiveness. When you get Cash App from the App Store or Google Play, and use code LEXPODCAST, you'll get $10, and Cash App will also donate $10 to FIRST, which again is an organization that I've personally seen inspire girls and boys to dream of engineering a better world. And now, here's my conversation with Judea Pearl.

  2. 3:18 – 6:25

    Descartes and analytic geometry

    1. LF

      You mentioned in an interview that science is not a collection of facts, but a constant human struggle with the mysteries of nature. What was the first mystery that you can recall that hooked you, that captivated your curiosity?

    2. JP

      Oh, the first mystery. That's a good one. Yeah, I remember that.

    3. LF

      What was it?

    4. JP

      I had a fever for three days, uh, when I learned about Descartes' analytic geometry, and I found out that you can do all the construction in geometry using algebra. And I couldn't get over it. I simply couldn't get out of bed. (laughs)

    5. LF

      So, what- what kind of world does analytic geometry unlock?

    6. JP

      Well, it connects algebra with geo- geometry. Okay, so Descartes had the idea that, um, (clears throat) geometrical construction and geometrical theorems and the assumptions can be articulated in the language of algebra, which means that all the proof that we did in high school in trying to prove that the three bisectors meet at one point, and that... (laughs) Okay, uh, all this can be proven by just-

    7. LF

      Through algebra.

    8. JP

      ... shuffling around notation. Uh, that was a-

    9. LF

      The connection-

    10. JP

      ... traumatic experience.

    11. LF

      (laughs) The tr- traumatic experience.

    12. JP

      For me, it was. I'm telling you, right?

    13. LF

      So, it's the connection between the different mathematical disciplines, that they all-

    14. JP

      No, in between two diff- two different languages.

    15. LF

      Just even... Languages?

    16. JP

      Yeah.

    17. LF

      So, which mathematic discipline is the most beautiful? Is geometry it for you?

    18. JP

      Both are beautiful. They have, uh, almost the same power.

    19. LF

      But there's a visual element to geometry, being a-

    20. JP

      Visually, (laughs) it's more transparent, but, uh, once you get over to algebra, then, uh, y- a linear equation is a straight line. This translation is easily absorbed, uh, and, um, the f- to pass a tangent to a circle, uh, you know, (laughs) you have the basic theorems and you can do it with algebra. So, but, uh, the transition from one to another was really ... I thought that Descartes was the greatest mathematician of all times. (laughs)

    21. LF

      So, you have been at the ... if you think of engineering and mathematics as a spectrum-

    22. JP

      Yes.

    23. LF

      ... uh, you have been ... you have walked casually along this spectrum throughout your- throughout your life. You know, you had a little bit of engineering, and then, you know, uh, you have b- done a little bit of mathematics here and there. (laughs)

    24. JP

      Well, not a little bit. I mean, we got a very solid background in mathematics because our teachers were geniuses.

    25. LF

      Yeah.

    26. JP

      Our teachers came from Germany in the 1930s, running away from Hitler. Uh, they left their careers in Heidelberg and Berlin, and came to teach high school in Israel. And we were the beneficiary of that experiment. So, I al- when they taught us math, the good way.

  3. 6:25 – 7:10

    Good way to teach math

    1. JP

    2. LF

      What's the good way to teach math?

    3. JP

      Chronologically.

    4. LF

      The people?

    5. JP

      The people behind the theorems, yeah. Their cousins, and their nieces (laughs) and their faces, and how they jumped from the bathtub when they scream, "Eureka!" (laughs) and ran naked in town. (laughs)

    6. LF

      So, you were almost educated as a historian of math.

    7. JP

      No, we just got a glimpse of that history together with the theorem. So, every, um, exercise in math was connected with a person-

    8. LF

      S-

    9. JP

      ... and the time of the person, the period.

    10. LF

      The period also mathematically speaking?

    11. JP

      Mathematically speaking, yes. Not the politics.

    12. LF

      Yeah.

    13. JP

      No.

    14. LF

      So,

  4. 7:10 – 9:14

    From math to engineering

    1. LF

      and then in, uh, in university, you have, you have gone on to do engineering.

    2. JP

      Yeah. I got a BS in engineering at Technion.

    3. LF

      Mm-hmm.

    4. JP

      Right? And then, uh, I moved here for graduate work, and I got to, I did engineering, uh, in addition to physics in Rutgers.

    5. LF

      Mm-hmm.

    6. JP

      And it would combine very nicely with my thesis, which I did in RCA Laboratories in superconductivity.

    7. LF

      And then somehow thought to switch to, uh, almost computer science software even, even the, the, uh, not switch, but long to become, uh, to get into software engineering a little bit-

    8. JP

      Yes.

    9. LF

      ... almost even programming, if you can call it that in the '70s. So, though there's all these disciplines.

    10. JP

      Yeah.

    11. LF

      If you were to pick a favorite, what, uh, in terms of engineering and mathematics, which path do you think has more beauty? Which path has more power?

    12. JP

      It's hard to choose now. I enjoy doing physics, and even have a vortex named on my name. So, I have a (laughs) investment in immortality. (laughs)

    13. LF

      Do you, uh, so what- what is a vortex?

    14. JP

      Vortex is in superconductivity.

    15. LF

      In the superconductivity, yeah.

    16. JP

      You have permanent current, uh, swirling around. One way or the other, you can have it store one or zero for computer. That was we worked on in, in the 1960 in RCA. And, uh, I discovered a few nice phenomena with the vortices.

    17. LF

      (laughs)

    18. JP

      You push current-

    19. LF

      So, there's a pearl vortex.

    20. JP

      ... and they move. Pearl vortex, right? You can Google it.

    21. LF

      (laughs)

    22. JP

      Right? I, I didn't know about it, but the physicists, they picked up on my thesis, on my, uh, PhD thesis. And, uh, they, um, it becomes popular when thin film superconductors became important for high temperature superconductors. So, they called it, uh, pearl vortex without my knowledge. (laughs) I discovered it only about 15 years ago.

  5. 9:14 – 10:47

    Does God play dice?

    1. JP

    2. LF

      You have footprints in all of the sciences. So, let's talk about the universe a little bit. Is the universe at the lowest level deterministic or stochastic, in your amateur philosophy view? Put another way, does God play dice?

    3. JP

      Well, we, we know it is stochastic, right? Because-

    4. LF

      Today. Today, we think it is stochastic.

    5. JP

      Yes. We think, because we have the Heisenberg uncertainty principle, and we have some, uh, experiments to, um, confirm that.

    6. LF

      All we have is experiments to confirm it. We don't understand why.

    7. JP

      Why is already-

    8. LF

      You wrote a book about why. (laughs)

    9. JP

      Yes. (laughs) Yeah. It- it's a puzzle. It's a puzzle that you have the, uh, dice-flipping machine or god, and the, and the, uh, result of the flipping propagate with a speed faster than the speed of light (laughs) .

    10. LF

      Right.

    11. JP

      We can't explain it, okay? So, um, but it's, it only governs microscopic phenomena.

    12. LF

      So, you don't think of quantum mechanics as useful-

    13. JP

      No.

    14. LF

      ... uh, for understanding-

    15. JP

      It's just a diversion.

    16. LF

      ... the nature of reality?

    17. JP

      No. Diversionary.

    18. LF

      So, in your thinking, the world might as well be deterministic?

    19. JP

      The world is deterministic. And as far as the neural fir- neuron firing is concerned, it, it's a deterministic to first approximation.

  6. 10:47 – 11:59

    Free will

    1. JP

    2. LF

      What about free will?

    3. JP

      Free will is also a nice e- exercise. Free will is an illusion-

    4. LF

      Illusion.

    5. JP

      ... that we AI people are going to solve.

    6. LF

      So, what do you think once we solve it, that solution will look like? Once we put it in the page.

    7. JP

      The solution will look like... First of all, it will look like a machine, a machine that act as though it had free will. It communicates with other machines as though they have free will. And you wouldn't be able to tell the difference between a machine that does and machine that doesn't have free will. Okay?

    8. LF

      So, the illusion, it propagates the illusion of free will amongst the other machines.

    9. JP

      And, and faking it is having it. Okay? That's what Turing test is all about.

    10. LF

      Yeah.

    11. JP

      Faking intelligence is intelligent, because it's not easy to fake. It's very hard to fake, and you can only fake if you have it.

    12. LF

      (laughs) Yeah, that-

    13. JP

      So-

    14. LF

      ... that's such a beautiful statement. (laughs) That's, uh, yeah, you could... Yeah.

    15. JP

      Yeah, you -

    16. LF

      You can't fake it if you don't have it. Yeah. (laughs)

  7. 11:59 – 22:21

    Probability

    1. LF

      .

    2. JP

      (laughs)

    3. LF

      So, uh, let- let's begin at the beginning with probability, uh, both philosophically and mathematically. What- what does it mean to say the probability of something happening is 50%? What is probability?

    4. JP

      It's the degree of uncertainty that an agent has about the world.

    5. LF

      You're still expressing some knowledge in that statement.

    6. JP

      Of course. If the probability is 90%, it's absolutely different kind of knowledge than if it is 10%. (clears throat)

    7. LF

      But it's still not solid knowledge. It's-

    8. JP

      It is solid knowledge, boy. If you tell me that (laughs) the 90% assurance smoking will, um, give you lung cancer in five years, versus 10%, it's a piece of useful knowledge.

    9. LF

      So, this statistical view of the universe-

    10. JP

      Yeah.

    11. LF

      ... why is it useful? So, we're swimming in complete uncertainty.

    12. JP

      Yeah.

    13. LF

      Most of everything around us is-

    14. JP

      It allows you to predict things with a certain probability, and computing those probabilities are very useful. That's, uh, the whole idea of, uh, (sighs) of prediction, and you need prediction to be able to survive. If you cannot predict the future, then you're just a ... crossing the street will be extremely, uh, fearful.

    15. LF

      And so you've done a lot of work in causation, and so let's, let's think about correlation.

    16. JP

      I started with the probability.

    17. LF

      You started with probability.

    18. JP

      Yes.

    19. LF

      You've invented the Bayesian networks.

    20. JP

      Yeah.

    21. LF

      And so, you know, we'll, we'll, we'll, we'll dance back and forth between these levels of, uh-

    22. JP

      Okay.

    23. LF

      ... uh, uncertainty. But what, what is correlation? What is it? So, probability of something happening is something, but then there's a bunch of things happening, and, uh, sometimes they happen together, sometimes not. They're independent or not. So, how do you think about correlation of things?

    24. JP

      Correlation occurs when two things vary together over a very long time, is one way of measuring it, or when you have a bunch of variables that they all vary cohesively. Um, then we call we have a correlation here. And usually, when we think about correlation, we really think causally. Things can not be correlated unless there is a reason for them to vary together. Why should they vary together if they don't see each other? Why should they vary together?

    25. LF

      So, underlying it somewhere is causation.

    26. JP

      Yes. Hidden in our intuition, there is a notion of causation, because we cannot grasp any other logic except causation.

    27. LF

      And how does conditional probability differ from causation? So, what is conditional probability?

    28. JP

      Conditional probability, how things vary when one of them, uh, stays the same. Now, staying the same means that I have chosen to look only at those incidents where the guy has the same value as previous one. It's my choice as an experimenter. So, things that are not correlated before could become correlated. Like, for instance, if I have two coins which are uncorrelated, okay, and I choose only those flippings experiments in which a bell rings, and the bell rings when at least one of them is a tail, okay, then suddenly, I see correlation between the two coins, because I only look at the cases where the bell rang. You see, it's my design with my ignorance, essentially, with my, uh, audacity to ignore certain incidents, I suddenly create a correlation where it doesn't exist physically.

    29. LF

      Right. So that's ... You just outlined one of the flaws of observing the world and, and trying to infer something fundamental about the world from looking at the correlation.

    30. JP

      I don't look at it as a flaw. The world works like that. Which mean- but the flaws comes if you try to impose-

  8. 22:21 – 23:13

    Machine learning

    1. JP

    2. LF

      Okay, let's look at machine learning. Machine learning today, if you look at deep neural networks, you can think of it as a kind of conditional probability-

    3. JP

      Conditional probability.

    4. LF

      ... estimators.

    5. JP

      Correct. Beautiful.

    6. LF

      So-

    7. JP

      Did, where did you say that?

    8. LF

      What?

    9. JP

      Conditional probability estimators. None of the machine learning people clobbered you?

    10. LF

      (laughs)

    11. JP

      Attacked you?

    12. LF

      Listen, uh, m-

    13. JP

      (laughs) .

    14. LF

      (laughs) Most people, and this is why this, today's conversation, I think, is interesting, is most people would agree with you.

    15. JP

      Yeah.

    16. LF

      Uh, there are certain aspects that are just effective today, but we're going to hit a wall, and there's a lot of ideas, uh, I think you're very right, that we're going to have to return to about causality, and that, uh, it would be ... L- l- let's try to explore it.

    17. JP

      Okay.

    18. LF

      Let's, let's, let's even take a step

  9. 23:13 – 27:48

    Causal Networks

    1. LF

      back. You invented, uh, Bayesian networks ... that look awfully a lot like they express something like causation, but they don't, not necessarily. So how do we turn Bayesian networks into expressing causation? How do we build causal networks? This A causes B, B causes C, how do we start to infer that kind of thing?

    2. JP

      We start asking ourself question, what are the factors that would determine the value of X? X could be blood pressure, uh, death, um, hungry, hunger.

    3. LF

      But these are hypotheses that we propose-

    4. JP

      Hypotheses, everything which has to do with causality comes from a theory, okay? The difference is only what kind ... how you interrogate the theory that you have in your mind.

    5. LF

      So, it still needs the human expert to propose-

    6. JP

      Right. You need the human expert to specify-

    7. LF

      Yeah.

    8. JP

      ... the initial model.... initial model could be very qualitative, just who listens to whom, by whom listen to, I mean one variable listen to the other. So, I say, "Okay, the tide is listening to the moon, and, and not to the rooster crow." Okay? And so far, this is our understanding of the world in which we live, scientific understanding of reality. We have to start there, because if we don't know how to handle cause and effect relationship when we do have a model, then we certainly do not know how to handle it when we don't have a model. So, let's start first, an AI slogan is, "Representation first, discovery second."

    9. LF

      Mm-hmm.

    10. JP

      Right? If I give you all the information that you need, can you do anything useful with it? That is the first, representation. How do you represent it? I give you all the knowledge in the world. How do you represent it? When you represent it, I ask you, "Can you infer X or Y or Z? Can you answer certain queries? Is it, uh, complex? Is it polynomial?" It... All the computer science exercises-

    11. LF

      Mm-hmm.

    12. JP

      ... we do, once you give me a representation for my knowledge, then you can ask me, "Now I understand how to represent things, how do I discover them?" It's a secondary thing.

    13. LF

      First of all, we... I- I should echo the statement that mathematics and the current m- m- much of the machine learning world has not considered causation, that A causes B.

    14. JP

      Correct.

    15. LF

      Just in anything. So that- that seems like a s- uh, that seems like a non-obvious thing that you- you'd think we would've really acknowledged it, but we haven't. So, we- we have to put that on the table. So, uh, knowledge. How hard is it to create a knowledge from which t- to work?

    16. JP

      In certain area-

    17. LF

      S-

    18. JP

      ... it's easy, because we have only four or five major variables, okay, and- and an epidemiologist or an economist can put them down, um, what, the- the minimum wage, uh, un- unemployment, p- policy, X, Y, Z, and- and start collecting data, and quantify the parameter that were left unquantified with the initial knowledge.

    19. LF

      Yeah.

    20. JP

      Okay? That's the routine work that you find in experimental psychology-

    21. LF

      Yes.

    22. JP

      ... in economics, ev- everywhere, any- any health science. That's a routine things. But I should emphasize, you should start with a research question: What do you want to estimate? Once you have that, you have to have a language of expressing what you want to estimate. You think it's easy? No.

    23. LF

      So, we can talk about two things. I think, b- one is, um, how the science of causation is, uh, very useful for a- uh, answering certain questions, and then the other

  10. 27:48 – 29:29

    Intelligent systems that reason with causation

    1. LF

      is, how do we create intelligent systems, uh, that need to reason with causation? So, if my research question is, "How do I pick up this water bottle from the table?" (laughs) Uh, the w- all the knowledge that is required to be able to do that, how do we construct that knowledge base? Does it- does it- do we return back to the problem that we didn't solve in the '80s with expert systems? Do we have to solve that problem of automated construction of knowledge?

    2. JP

      Hmm. You're talking about the, uh, task of eliciting knowledge from an expert.

    3. LF

      Task of eliciting knowledge from an expert, or just self-discovery of more knowledge, uh, more and more knowledge, so automating the building of knowledge as much as possible.

    4. JP

      It's a different game in the causal domain, because... It- it's essentially the same thing. You have to start with some knowledge, and you're trying to enrich it.

    5. LF

      Mm-hmm.

    6. JP

      But you don't enrich it-

    7. LF

      Mm-hmm.

    8. JP

      ... by asking for more rules. You enrich it by asking for the data, for them to look at the data and quantifying, and ask queries that you couldn't answer when you started. You couldn't, because it- it- it's... the- the question is quite complex, and it's not within the, um, capability of ordinary cognition, of ordinary person, or ordinary expert even, to answer.

    9. LF

      So, what kind of questions do you think we can s- start to answer? What's-

    10. JP

      Even a simple one. Suppose... uh, yeah

  11. 29:29 – 36:57

    Do(x) operator

    1. JP

      (laughs) . I start with easy one.

    2. LF

      Let's do it.

    3. JP

      Okay. What's the effect of a drug on my recovery? Uh, was it the aspirin that caused my headache to be cured, or was it the television program, or the good news I received? Um, this is already... you see, it's a difficult question, because it's find the cause from effect. The easy one is find effect from cause.

    4. LF

      That's right. So, first you construct a model saying that this is an important research question.

    5. JP

      Yeah.

    6. LF

      This is an important question. Then you- you d-

    7. JP

      No, no, I didn't construct a model yet. I just said it's important question.

    8. LF

      It's important question.

    9. JP

      And the first exercise is express it mathematically. What do you want to prove? Like, if I tell you, "What's the eff- what will be the effect of taking this drug?" Okay? You have to say that in mathematics. How do you say that?

    10. LF

      Yes.

    11. JP

      Can you write down the question? Not the answer.I want to find the effect of the drug on my headache.

    12. LF

      Right.

    13. JP

      W- write down, right? Write it down.

    14. LF

      That's where the do calculus comes in. (laughs)

    15. JP

      Yes. Do operator, what is do operator?

    16. LF

      Do operator, yeah.

    17. JP

      Yeah. You have to have a-

    18. LF

      Which is nice. It's the difference between association and intervention.

    19. JP

      Correct.

    20. LF

      Very beautifully, sort of constructed.

    21. JP

      Yeah. So, we co- we have a do operator, so the do calculus connected on the do operator itself, connects the operation of doing to something that we can see.

    22. LF

      Right. So, as opposed to the purely observing, you're making the choice to change a variable.

    23. JP

      Yeah. That's what it, it expresses.

    24. LF

      Hm. Gotcha.

    25. JP

      And then, the way that we interpret it, and the mechan- mechanism by which we take your query, and we translate it into something that we can work with, is by giving it semantics. Saying that you have a model of the world, and you cut off all the incoming arrow into X, and you're looking now in the modified, mutilated model, you ask for the probability of Y. That is interpretation of doing X, because by doing things, you've liberated them from all influences that acted upon them earlier, and you subject them to the tyranny of your muscles.

    26. LF

      So you... (laughs) You remove all the questions about causality by doing them.

    27. JP

      So, because-

    28. LF

      You're now-

    29. JP

      ... it's one level of questions.

    30. LF

      Yeah.

  12. 36:57 – 44:12

    Counterfactuals

    1. LF

      you talk about machine learning as essentially learning by s- association, or reasoning by association. And this new calculus is allowing for intervention. I like that word. Uh, but-

    2. JP

      Intervention.

    3. LF

      ... action. So, you also talk about counterfactuals.

    4. JP

      Yeah.

    5. LF

      And I'm trying to sort of understand the difference in counterfactuals and in- in- intervention. Uh, what's the... well, first of all, what is counterfactuals, and why are they useful? Wh- wh- why are they, eh, eh, especially, uh, useful as opposed to just reasoning what- what effect actions have?

    6. JP

      Well, conf- counterfactual contains what we normally call explanations.

    7. LF

      Can you give an example of a counterfactual?

    8. JP

      If I tell you that acting one way affects something else, I didn't explain anything yet. But if I, if I ask you, uh, "Was it the aspirin that cure my headache?" I'm asking for explanation. What cure my headache?

    9. LF

      Mm-hmm.

    10. JP

      And putting a finger on aspirin provide information. It was aspirin. It was responsible for your headache going away. If y- if you didn't take the aspirin, you will still have a headache.

    11. LF

      So by s- by saying, "If I didn't take aspirin, I would have a headache." You're thereby saying that aspirin is the thing that removes the headache.

    12. JP

      Yeah, but you have to have another important information. "I took the aspirin, and my headache is gone." Okay? It's very important information. Now I'm reasoning backward, and I said, "Was it the aspirin?"

    13. LF

      Yeah.

    14. JP

      Okay.

    15. LF

      By considering what would have happened if everything else is the same, but I didn't take aspirin.

    16. JP

      That's right.

    17. LF

      Counterfactual.

    18. JP

      So, in order, things took place, you know. Joe killed Schmo, okay?

    19. LF

      Yeah.

    20. JP

      And Schmo would, uh, would be alive had Joe not used his gun.

    21. LF

      Right.

    22. JP

      Okay? So, that is the counterfactual. It, it, it conf- it had a confliction, it had a conflict here or clash between observed fact that he, he did shoot, okay, and the hypothetical predicate, which says, "Had he not shot." You have a clash, a logical clash. They cannot exist together. That's a counterfactual, and that is the source of our explanation of our idea of responsibility, regret, and free will.

    23. LF

      Yeah, so it certainly seems, uh, that's the highest level of reasoning, right, is counterfactual?

    24. JP

      Yes, and physicists do it all the time.

    25. LF

      Who does it all the time?

    26. JP

      Physicists.

    27. LF

      Physicists.

    28. JP

      In every equation of physics, let's say you have a Hooke's law, and you put, uh, one kilogram on the spring, and the spring is one meter, and you say, "Had this weight been two kilogram, the spring would have been twice as long." It's no problem in, for a physicist-

    29. LF

      Hmm.

    30. JP

      ... to say that. Accept that mathematics is only i- i- is in the form of equation. Okay? Equating the weight, proportionality constant, and the length of the string. So, you don't have the asymmetry in the equation of physics, although every physicist thinks counterfactually. Ask the high school kids.

  13. 44:12 – 51:15

    Reasoning by Metaphor

    1. LF

      can we take a leap to trying to learn in this very... when it's not 20 variables, but 20 million variables, trying to learn causation in this world? Not learn, but d-

    2. JP

      No, I mean, uh, it-

    3. LF

      ... somehow construct models. I mean, it seems like you would only have, be able to learn, because constructing it manually would be too difficult. Do you have ideas of...

    4. JP

      I think it's a matter of combining simple models from many, many sources-

    5. LF

      Mm-hmm.

    6. JP

      ... from many, many disciplines, and many metaphors. Metaphors are the basics of human intelligence, basis.

    7. LF

      Yeah. So h- how do you think of, about a metaphor, in terms of its use in human intelligence?

    8. JP

      Metaphors is an expert system.

    9. LF

      Mm-hmm.

    10. JP

      An expert... it's, it's mapping problem with which you are not familiar to a problem with which you are familiar.

    11. LF

      Mm-hmm.

    12. JP

      Like, I'll give you a good example. The Greek believed that the sky is an opaque shell. It's not really outsp- in infinite space. It's an opaque shell, and the stars are holes-

    13. LF

      Yeah.

    14. JP

      ... poked in the shell through which you see the eternal light. Okay? That was a metaphor. Why? Because they u- they understand how you poke holes in shells, okay? They're not f- they were not familiar with infinite space, okay? And it's, so, a- and, and we are walking on a shell of a turtle, and if you get too close to the edge, you're going to fall down to Hades, or wherever.

    15. LF

      Yeah.

    16. JP

      Yeah? Um, that's a metaphor. It's not true. But this kind of metaphor enabled Aristarchus to measure the radius of the Earth.

    17. LF

      Hm.

    18. JP

      Because he said, "Come on. If the w- we are walking on a turtle shell, then the ray of light coming through this angle will be different, um, this place, will be a different angle that's coming to this place. I know the distance. I'll measure the two, uh, angles, and then I have the radius of the shell of the, of the turtle."

    19. LF

      Mm-hmm.

    20. JP

      Okay? And he did. And he found his measurement very close to the measurements we have today through the, uh, what, 6,000 and 700, 700 kilometers (laughs) of the Earth. That's something that would not h- occur to Babylonian astronomer, even though the Babylonian experiments were the machine learning people of the time. They fit curves, and they could predict the, um, eclipse of the moon much more accurately than the Greek, because they fit curve. Okay? Uh, so that's the difference in metaphor.

    21. LF

      Mm-hmm.

    22. JP

      Something that you're familiar with. Again, a turtle shell. Okay? What does it mean if you are familiar? Familiar means that answers to certain questions are explicit. You don't have to derive them.

    23. LF

      And they were made explicit, because somewhere in the past, you've constructed a model of that. Uh-

    24. JP

      Before, yeah, you- you're familiar with-

    25. LF

      Yeah.

    26. JP

      So the child is familiar with billiard balls.

    27. LF

      Yes.

    28. JP

      So the child could predict that if you let loose of one ball, the other one will bounce off. These are... You, you obtain that by, um, familiarity. Familiarity is answering questions, and you store the answer explicitly. You don't have to derive them. So, this is ideal for metaphor. All our life, all our intelligence is built around metaphors. Mapping from the unfamiliar to the familiar, but the, um, marriage between the two is a tough thing, which I, which we haven't yet been able to algorithmatize.

    29. LF

      So, you think of that process of cas- of using metaphor to leap from one place to another as, we can call it reasoning? Is it a kind of reasoning?

    30. JP

      It is, uh, reasoning by metaphor, metaphorical reason-

  14. 51:15 – 53:28

    Machine learning and causal reasoning

    1. JP

    2. LF

      So, there's an excitement about current machine learning methodologies, and there's really important good work you're doing in causal inference. W- where do the... where, where does the futu- uh, wh- where do these worlds collide, and what does that look like?

    3. JP

      Uh, first, they're going to work without collisions. (laughs) It's going to work in harmony.

    4. LF

      Harmony. It's not collision. That's right.

    5. JP

      Uh, the, the human is going to, uh, to, uh, jumpstart the exercise by providing qualitative, non-committing models of how the universe work, univers-... how the, in reality, the domain of discourse works. The machine is going to take over from that point of view and derive whatever the calculus says can be derived.

    6. LF

      Mm-hmm.

    7. JP

      Namely, quantitative answer to our questions.

    8. LF

      Right.

    9. JP

      These are complex question. I'll give you some example of complex question that, uh, will boggle your mind if you think about it. Y- you take result of studies in diverse population under diverse condition, and you infer the cause-effect of a new population, which doesn't even resemble any of the ones studied. And you do that by, you do calculus, you do that by generalizing from one study to another. See what's, what's common between the two? What is different? Let's ignore the differences and pull out the commonality. And you do it over maybe 100 hospitals i- around the world. From that, you can get really, uh, uh, mileage from big data. It's not only that you have many samples, you have many sources of data.

    10. LF

      So, that, that's a really powerful thing, uh, I think for, especially for medical applications, I mean, cure cancer, right? That's how, from data, you can cure cancer.

  15. 53:28 – 56:21

    Temporal aspect of causation

    1. LF

      So, we're talking about causation, which is the temporal, temporal relationships between things.

    2. JP

      Not only temporal. It's both structural and temporal. Temporal, enough, uh, uh... Temporal precedence by itself cannot replace causation.

    3. LF

      Is temporal precedence the arrow of time in physics?

    4. JP

      Yeah. It's important, necessary.

    5. LF

      It's important.

    6. JP

      But not sufficient. Yes.

    7. LF

      Is it?

    8. JP

      Yes. Uh, I never seen cause (laughs) propagate backward.

    9. LF

      But if we call... if we use the word cause-

    10. JP

      Yes.

    11. LF

      ... but there's relationships that are timeless. I suppose that's still forward in the arrow of time, but, uh, are there relationships, logical relationships, that fit into the structure?

    12. JP

      Sure. The whole, uh, do calculus is logical relationship.

    13. LF

      That doesn't r- require temporal...

    14. JP

      Mm-mm.

    15. LF

      I- it has just the condition that it, it's... you're not traveling back in time.

    16. JP

      Yes. Correct.

    17. LF

      So, it's really a generalization of... a powerful generalization, uh, of what-

    18. JP

      Of Boolean logic.

    19. LF

      Yeah, Boolean logic.

    20. JP

      Yes.

    21. LF

      That is sort of simply put and allows us to-... of, you know, reason, uh, reason about the order of events, the source, the-

    22. JP

      Not about, between, but not deriving the order of event. We are given cause-effect relationship. Okay? They ought to be obeying the, uh, time precedence relationship. We are given that. And now that we ask questions about other cause of relationship that could be derived from the initial ones, but were not given to us explicitly.

    23. LF

      Yeah.

    24. JP

      Like, um, the case of the, the firing squad I gave you-

    25. LF

      Mm-hmm.

    26. JP

      ... uh, in the first chapter. And I ask, what if, uh, rifleman A declined to shoot? Would the prisoners still be dead?

    27. LF

      Mm-hmm.

    28. JP

      To decline to shoot, it means that he disobey order. And the, the rule of the games were that he's a, a obedient and marksman, okay? That's how you start. That's the initial order. But now you ask question about breaking the rules. What if he decided not to pull the trigger? He just became a pacifist. Oh. And you can an- you and I can answer that.

    29. LF

      Mm-hmm.

    30. JP

      The other rifleman would have hi- killed him, okay? I want a machine to do that. Is it so hard to ask a machine to do that? It's such a simple task.

  16. 56:21 – 59:15

    Machine learning (continued)

    1. LF

      But the curiosity, the natural curiosity for me is, that yes, you're absolutely correct and important, and, uh, it's hard to believe that we haven't done this seriously, uh, extensively, already a long time ago. So, this, this is really important work. But I also want to know, you know, this, uh, maybe you can philosophize about how hard is it to learn?

    2. JP

      Okay, let's assume we learn it. We want to learn it, okay?

    3. LF

      We want to learn.

    4. JP

      So, what do we do here? We put a learning machine that watches execution trials, uh, in many a countries and many (laughs) locations, okay?

    5. LF

      Mm-hmm.

    6. JP

      All the machine can learn is to see shot or not shot, dead, not dead. A court issued an order or didn't. Okay? Just the facts.

    7. LF

      Mm-hmm.

    8. JP

      From the fact, you don't know who listens to whom. You don't know that the condemned person listened to the bullets, that the bullets are listening to the captain, okay?

    9. LF

      Mm-hmm.

    10. JP

      All we hear is one command, two shots, dead. Okay? A triple of variable. Yes, no, yes, no. Okay. Well, in that, you can learn who listens to whom, and you can answer the question? No.

    11. LF

      Definitively, no. But don't you think you can start proposing ideas for humans to review?

    12. JP

      You want machine to learn, right? You want a robot. So, robot is wa- watching-

    13. LF

      Yeah.

    14. JP

      ... uh, t- trials like that.

    15. LF

      Yep.

    16. JP

      200 trials. And then he has to answer the question, what if rifleman A refrained from shooting?

    17. LF

      Yeah. So how to do that?

    18. JP

      (laughs) That's exactly my point. That looking at the facts don't give you the strings-

    19. LF

      Absolutely.

    20. JP

      ... behind the facts.

    21. LF

      Absolutely. But do you think of machine learning as it's currently defined, as only something that looks at the facts, and tries to do-

    22. JP

      Right now, they only look at the facts, yes.

    23. LF

      So, is there a way to modify-

    24. JP

      Yeah.

    25. LF

      ... in, in your sense.

    26. JP

      Playful manipulation.

    27. LF

      Playful manipulation?

    28. JP

      Yes. Once in a while-

    29. LF

      Do, doing the interventionist kind of things.

    30. JP

      Yes.

  17. 59:15 – 1:04:08

    Human-level artificial intelligence

    1. LF

      I know you're not a futurist, but are you excited? Have you, when you look back at your life, longed for the idea of creating a human level intelligence system?

    2. JP

      Yeah. I'm, uh, I'm driven by that. All my life, I'm driven just by one thing (laughs) . But I go slowly. I go from what I know, to the next step, incrementally.

    3. LF

      So, without imagining what the end goal looks like, do you imagine what an-

    4. JP

      Yes, end- the end goal is going to be a machine that can answer sophisticated questions-

    5. LF

      Questions.

    6. JP

      ... counterfactuals, regret, compassion, um, responsibility, and free will.

    7. LF

      So, what is a good test? Is a Turing test a reasonable test?

    8. JP

      If there is test of free will, doesn't exist yet, uh, there's no-

    9. LF

      How would you test free will? Uh, that's a-

    10. JP

      So far, we know only one thing. I mean (laughs) , if robots can communicate with reward and punishment among themselves, and hitting each other on the wrists and say, "You shouldn't have done that."

    11. LF

      Mm-hmm.

    12. JP

      Okay? Um, playing better soccer because they can do that.

    13. LF

      What do you mean, because they can do that?

    14. JP

      Because they can communicate among themselves. It's ƒ-

    15. LF

      Because of the communication, they can do the soccer?

    16. JP

      Because they communicate like us.

    17. LF

      Yeah.

    18. JP

      Reward and punishment. Yes, you didn't pass the ball the right, the right time and so forth, therefore you're going to sit on the bench for the next two... If they start communicating like that, the question is, will they play better soccer?As opposed to what? As opposed to what they do now, without this ability to reason about, uh, uh, reward and punishment, responsibility.

    19. LF

      And a lot of factions.

    20. JP

      So far, I can only think about communication.

    21. LF

      Communication is... And, and, and not necessarily natural language, but just communication.

    22. JP

      Just communication. And that's important to have a quick and effective means of communicating knowledge. If the coach tells you, "You should have passed the ball." Ping. He conveys so much knowledge to you, as opposed to, what? Go down and change your software. Right. That's the alternative. But the coach doesn't know your software.

    23. LF

      Right.

    24. JP

      So, how can the coach tell you, "You should have passed the ball?" But that... (laughs) Our language is very effective. "You should have passed the ball." You know your software, you tweak the right module, okay? And next time, you don't do it.

    25. LF

      Now, that's for playing soccer where the rules are well defined.

    26. JP

      No, no, no. Well, they're not well defined. When you should pass the ball and when you should stop-

    27. LF

      Is not well defined.

    28. JP

      No, it's a-

    29. LF

      Yeah.

    30. JP

      It's very soft world, very noisy.

  18. 1:04:08 – 1:04:31

    Consciousness

    1. LF

      What do you think is consciousness? Uh, is it simply self-awareness, so including yourself into the model of the world?

    2. JP

      That's right. Uh, some people tell me, "No, this is only part of consciousness." And then they start telling me what they really mean by consciousness, and I lose them.

    3. LF

      Yeah.

    4. JP

      For me, consciousness is having a blueprint of your software.

  19. 1:04:31 – 1:09:53

    Concerns about AGI

    1. LF

      Do you have concerns about the future of AI, all the different trajectories of all of our research?

    2. JP

      Yes.

    3. LF

      Um, where's your hope, where the movement heads? Where are your concerns?

    4. JP

      I- I'm concerned, because I know we are building a new species that has the capability of exceeding our... Exceeding us, uh, uh, exceeding our capabilities, and can breed itself and take over the world. Absolutely. It's a new species. It's uncontrolled. We don't know the degree to which we control it. We don't even understand what it means to be able to control this new species. Uh, so, I'm concerned. I don't have anything to add to that, because it's such a gray area, an unknown. It never happened in history.

    5. LF

      Yeah.

    6. JP

      Okay? The only, the only time it happened in history was evolution with a human being.

    7. LF

      Right.

    8. JP

      And it wasn't very successful, was it? (laughs)

    9. LF

      Uh-

    10. JP

      Some people says it was a great success.

    11. LF

      For us, it was, but a few people along the way, uh, or a few creatures along the way would not agree. So, uh, so, it's just because it's such a gray area, there's nothing else to say.

    12. JP

      Uh, we have a sample of one.

    13. LF

      Sample of one.

    14. JP

      That's us.

    15. LF

      But-

    16. JP

      We dominantly

    17. NA

      (murmuring)

    18. LF

      ... some people would look at you and say, "Yeah, but we were looking to you to help us make sure that-

    19. JP

      Correct.

    20. LF

      "... sample two works out okay."

    21. JP

      Actually, we have more than a sample of one. We have theory of, theories.

    22. LF

      Yeah.

    23. JP

      And that's a good... And s- we don't need to be statisticians. So, sample of one doesn't mean any, uh, uh, poverty of knowledge.

    24. LF

      Yeah.

    25. JP

      It's not. Sample of one plus theory, conjectural theory of what could happen.

    26. LF

      Yeah.

    27. JP

      That, we do have. But I- I really feel helpless in contributing to this argument, because I know so little, and, uh, and my imagination is limited. And, uh, I know how much I don't know, and, uh-

    28. LF

      Hmm.

    29. JP

      ... I... But I'm concerned.

    30. LF

      You were born and raised in Israel.

  20. 1:09:53 – 1:12:07

    Religion and robotics

    1. JP

    2. LF

      So, it's a really tense part of the world. It's a complicated part of the world.

    3. JP

      Yes. Yes.

    4. LF

      Israel and all around.

    5. JP

      Yes.

    6. LF

      So, religion is, is, um, at the core of that complexity.

    7. JP

      Re- yes.

    8. LF

      Or one of the components.

    9. JP

      Religion is a, a strong motivating course for many, many people in the Middle East. Yes.

    10. LF

      In your view, looking back, is religion good for society?

    11. JP

      That's a good question for robotic, you know? Should we-

    12. LF

      It ... There's echoes of that question.

    13. JP

      ... equip, equip robot with a religious belief? Suppose we, we find out, or we agree, that religion is good to you, to keep you in, in line.

    14. LF

      Yeah.

    15. JP

      Okay? Should we give the robot the, the, uh, metaphor of a god?

    16. LF

      Yeah.

    17. JP

      As a matter of fact, the robot will get it without us also. Why? Because a mo-... A robot will reason by metaphor. And what is the b-... the most primitive metaphor a child grows with? Mother smile-

    18. LF

      Mm-hmm.

    19. JP

      ... father teaching, uh, father image and mother image, that's God. So-

    20. LF

      I, I d-

    21. JP

      ... whether you want it or not, the robot will... (laughs) But assum- as- assuming that the robot is going to have a mother and a father. It may only have a programmer, which doesn't supply warmth and, um, discipline.

    22. LF

      Yeah.

    23. JP

      But discipline it does, okay? So the robot will have this... a model of the trainer, okay, and everything that happens in the world, cosmology and so on, is going to be mapped into the programmer. (laughs) That's God.

    24. LF

      Man.

    25. JP

      (laughs)

    26. LF

      The, the thing that represents the origin of everything for that robot.

    27. JP

      That's the most primitive relationship.

    28. LF

      So it's going to arrive there by metaphor. And so the, the question is if overall that metaphor has served us well, as humans.

    29. JP

      I really don't know. I think it did, mm-hmm, but, but as long as you keep in mind it's only a metaphor. (laughs)

    30. LF

      So, (laughs)

  21. 1:12:07 – 1:19:09

    Daniel Pearl

    1. LF

      if you think we can, can you... can we talk about your son?

    2. JP

      Yes. Yes.

    3. LF

      Can you tell his story?

    4. JP

      His story? Well...

    5. LF

      Daniel.

    6. JP

      His story is known. He's... He was abducted in, uh, Pakistan by Al-Qaeda-driven sect, and, um, under various pretenses. I don't even pay attention to what the pretense were. Originally, they wanted to, uh, to have re- United States, mm, deliver some promised airplanes. I... (laughs) It was all made up, you know. All these demands were, uh, bogus. I, I don't know really what... Uh, eventually, he was, uh, executed in front of a camera.

    7. LF

      ... at the core of that is-

    8. JP

      Yes.

    9. LF

      ... hate and intolerance.

    10. JP

      At the core, yes, absolutely, yes.

    11. LF

      Oh.

    12. JP

      We don't really appreciate the depth of the hate at which, which, um, billions of peoples are educated. We don't understand it. I just listened recently to what they teach you in Mogadishu. (laughs) When, when the water stop in the tap-

    13. LF

      Mm-hmm.

    14. JP

      ... we knew exactly who did it, the Jews.

    15. LF

      The Jews.

    16. JP

      We didn't know how, but we knew who did it. We don't appreciate what it means to us. The depth is unbelievable, profound.

    17. LF

      Do you think all of us are capable of evil, and the education, the indoctrination is really what creates evil?

    18. JP

      Absolutely we are capable of evil. If you are indoctrinated sufficiently, uh, long, and in depth, we are capable of, uh, ISIS, we are capable of Nazism. Yes, we are (clears throat) , but the question is whether we, after we have gone through some Western education, and we learn that everything is really relative, that there's no absolute God, there's only a belief in God, right, whether we are capable now of being transformed under certain circumstances to become, uh, brutal.

    19. LF

      Yeah.

    20. JP

      That is a ques- uh, I- I'm worried about it, because some people say, "Yes," (laughs) given the right circumstances, given, uh, uh, economical, we have an economical crisis, okay, you are capable of doing it too, and that worries me. I (laughs) , I want to believe that I'm not capable.

    21. LF

      So, s- seven years after Daniel's death, you wrote an article, uh, at the Wall Street Journal, titled, Daniel Pearl and the Normalization of Evil.

    22. JP

      Yes.

    23. LF

      What was your mess- uh, message back then, and how did it change today, over, over the years?

    24. JP

      I, I lost.

    25. LF

      What was the message?

    26. JP

      The message was that, uh, we are not treating terrorism as a taboo. We are treating it as a bargaining device that is accepted, and people have grievance, and they go and sh- and, uh, bomb m- restaurants, okay? It's normal. Look, you're even not, not surprised when I tell you that. (laughs)

    27. LF

      Yeah.

    28. JP

      20 years ago, you'd say, "What? For grievance, you go and blow up a restaurant?" (laughs) Today, it's become normalized. The banalization of evil. And we have created that to ourselves by normalizing, by all- uh, by making it part of, uh, political life. It's a political, uh, debate. Every terrorist yesterday becomes a freedom fighter today, and tomorrow, he'll become a terrorist again. It is switchable, okay?

    29. LF

      Right, and so-

    30. JP

      Yeah.

  22. 1:19:09 – 1:21:00

    Advice for students

    1. LF

      Do you have advice for young minds today dreaming about creating, as you have dreamt, creating intelligent systems? What is the best way to arrive at new breakthrough ideas and carry them through the fire of criticism and, uh, and past conventional ideas?

    2. JP

      Ask your questions (laughs) freely. Your questions are never dumb.

    3. LF

      (laughs)

    4. JP

      And solve them your own way, (laughs) okay? And don't take no for an answer. Look, if they are really dumb, you will find out quickly by trying an arrow to see that they're not leading any place. But follow them and try to understand things your way. That is my, uh, advice. I don't know if it- it's going to help anyone.

    5. LF

      No, that brilliantly put.

    6. JP

      But I-- there is a lot of, uh, I would say, inertia in science, in academia. It is slowing down science.

    7. LF

      Yeah, those two words: "your way." That's a powerful thing.

    8. JP

      Um, yes.

    9. LF

      It's against inertia, potentially, against the flow.

    10. JP

      Against your professor.

    11. LF

      (laughs) Against your professor.

    12. JP

      It is, uh... I- I wrote The Book of Why-

    13. LF

      Yeah.

    14. JP

      ... in order to democratize common sense, yeah. (laughs)

    15. LF

      (laughs)

    16. JP

      In order to instill rebellious spirits in students so they wouldn't wait until the professor get things right.

    17. LF

      (laughs) Thus, you wrote the manifesto of the rebellion against the professor. (laughs)

    18. JP

      Against the professor, yes.

  23. 1:21:00 – 1:23:00

    Legacy

    1. LF

      So, looking back at your life of research, what ideas do you hope ripple through the next many decades? What, what do you hope your legacy will be?

    2. JP

      I already have a tombstone, uh, carved. (laughs)

    3. LF

      (laughs) Oh boy, yeah.

    4. JP

      The fundamen- the fundamental law of counterfactuals, that what, uh, it said. (laughs)

    5. LF

      (laughs)

    6. JP

      It's a simple equation. What a counterfactual in terms of a model surgery.

    7. LF

      Mm-hmm.

    8. JP

      That's it, because everything follows from that. If you get that, all the rest, I can die in peace, and my student can derive all my knowledge (laughs) by mathematical means.

    9. LF

      The rest follows.

    10. JP

      Yeah.

    11. LF

      Judea, thank you so much for talking today. I really appreciate it.

    12. JP

      Well, thank you for being so attentive and, uh, instigating. (laughs)

    13. LF

      (laughs) We did it.

    14. JP

      We did it.

    15. LF

      The coffee helped. Thanks for listening to this conversation with Judea Pearl. And thank you to our presenting sponsor, Cash App. Download it. Use code LEXPODCAST. You'll get $10, and $10 will go to FIRST, a STEM education nonprofit that inspires hundreds of thousands of young minds to learn and to dream of engineering our future. If you enjoy this podcast, subscribe on YouTube, give it five stars on Apple Podcasts, support it on Patreon, or simply connect with me on Twitter. And now, let me leave you with some words of wisdom from Judea Pearl. "You cannot answer a question that you cannot ask, and you cannot ask a question that you have no words for." Thank you for listening, and hope to see you next time.

Episode duration: 1:23:01

Install uListen for AI-powered chat & search across the full episode — Get Full Transcript

Transcript of episode pEBI0vF45ic

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.