Lex Fridman PodcastNoam Chomsky: Language, Cognition, and Deep Learning | Lex Fridman Podcast #53
EVERY SPOKEN WORD
55 min read · 10,564 words- 0:00 – 15:00
The following is a…
- LFLex Fridman
The following is a conversation with Noam Chomsky. He's truly one of the great minds of our time and is one of the most cited scholars in the history of our civilization. He has spent over 60 years at MIT and recently also joined the University of Arizona where we met for this conversation. But it was at MIT about four and a half years ago when I first met Noam. My first few days there I remember getting into an elevator at Stata Center, pressing the button for whatever floor, looking up and realizing it was just me and Noam Chomsky riding the elevator. Just me and one of the seminal figures of linguistics, cognitive science, philosophy and political thought in the past century, if not ever. I tell that silly story because I think life is made up of funny little defining moments that you never forget for reasons they may be too poetic to try and explain. That was one of mine. Noam has been an inspiration to me and millions of others. It was truly an honor for me to sit down with him in Arizona. I traveled there just for this conversation, and in a rare heartbreaking moment after everything was set up and tested the camera was moved and accidentally the recording button was pressed stopping the recording. So I have good audio of both of us but no video of Noam, just the video of me and my sleep-deprived but excited face that I get to keep as a reminder of my failures. Most people just listen to this audio version for the podcast as opposed to watching it on YouTube, but still it's heartbreaking for me. I hope you understand and still enjoy this conversation as much as I did. The depth of intellect that Noam showed and his willingness to truly listen to me, a silly-looking Russian in a suit, it was humbling and something I'm deeply grateful for. As some of you know, this podcast is a side project for me, where my main journey and dream is to build AI systems that do some good for the world. This latter effort takes up most of my time, but for the moment has been mostly private. But the former, the podcast, is something I put my heart and soul into and I hope you feel that even when I screw things up. I recently started doing ads at the end of the introduction. I'll do one or two minutes after introducing the episode and never any ads in the middle that break the flow of the conversation. I hope that works for you and doesn't hurt the listening experience. This is the Artificial Intelligence Podcast. If you enjoy it, subscribe on YouTube, give it five stars on Apple Podcasts, support it on Patreon, or simply connect with me on Twitter @lexfridman, spelled F-R-I-D-M-A-N. This show is presented by Cash App, the number one finance app in the App Store. I personally use Cash App to send money to friends, but you can also use it to buy, sell, and deposit bitcoin in just seconds. Cash App also has a new investing feature. You can buy fractions of a stock, say $1 worth, no matter what the stock price is. Broker services are provided by Cash App Investing, a subsidiary of Square and member SIPC. I'm excited to be working with Cash App to support one of my favorite organizations called FIRST, best known for their FIRST Robotics and Lego competitions. They educate and inspire hundreds of thousands of students in over 110 countries and have a perfect rating on Charity Navigator which means the donated money is used to maximum effectiveness. When you get Cash App from the App Store or Google Play and use code LEXPODCAST you'll get $10 and Cash App will also donate $10 to FIRST, which again is an organization that I've personally seen inspire girls and boys to dream of engineering a better world. And now here's my conversation with Noam Chomsky. I apologize for the absurd philosophical question-
- NCNoam Chomsky
(laughs) .
- LFLex Fridman
... but if an alien species were to visit Earth do you think we would be able to find a common language or protocol of communication with them?
- NCNoam Chomsky
There are arguments to the effect that we could. In fact, uh, one of them was Marv Minsky's back about 20 or 30 years ago he, uh, performed a brief experiment with a student of his, Dan Bobrow. They essentially ran the simplest possible Turing machines just free to see what would happen, and, uh, most of them crashed, either got into an infinite loop or, uh, bl- stopped. The few that, uh, persisted essentially gave, uh, something like arithmetic. Um, and his conclusion from that was that, uh, if some alien species developed, uh, higher intelligence they would at least have arithmetic. They would at least have what the, uh, simplest, uh, computer would do. And in fact the, he didn't know that at the time, but the, uh, core principles of natural language are based on operations which yield something like arithmetic in the limiting case, in the minimal case. So it's conceivable that, uh, a mode of communication could be established based on the core properties of human language and the core properties of arithmetic which maybe are universally shared. So it's conceivable.
- LFLex Fridman
What is the structure of that language, of language as an internal system inside our mind versus an external system as it's expressed?
- NCNoam Chomsky
It's not an alternative. It's two different concepts of language.
- LFLex Fridman
Different.
- NCNoam Chomsky
It's a simple fact that, uh, there's something about you, a trait of yours-... part of your, the organism, you, that, uh, determines that you're talking English and not T- Tagalog, let's say, so there is an inner system. Uh, it's, uh, determines the sound and meaning of the infinite number of expressions of your language. It's, uh, localized. It's not in your foot, obviously. It's in your brain. If you look more closely it's in specific configurations of your brain and that's essentially like the internal structure of your laptop, whatever programs it has are in there. Now one of the things you can do with language, it's a marginal thing in fact, is use it to ex- ex- to externalize what's in your head. Actually most of your use of language is thought, internal thought, but you can do what you and I are now doing. We can externalize it. Well, the set of things that we're externalizing are an external system. It- there are noises in the atmosphere and you can call that language in some other sense of the word, but it's not a, it's not a set of alternatives. These are just different concepts.
- LFLex Fridman
So how deep do the roots of language go in our brain-
- NCNoam Chomsky
Well-
- LFLex Fridman
... our mind? Is it yet another feature like vision or is it something more fundamental from which everything else springs in our, in the human mind?
- NCNoam Chomsky
Well, it's, in a way it's like vision. There's a, you know, there's something about our genetic endowment that determines that we have a mammalian rather than a insect visual system, and there's something in our genetic endowment that turn, that determines that we have a human language faculty. No other organism has anything remotely similar so in that sense it's, uh, internal. Now there is a long tradition which I think is valid, uh, going back centuries, uh, to the early scientific revolution at least that holds that, um, language is the, sort of the core of human cognitive nature. It's the source. It's the mode for constructing thoughts and expressing them and that is th- what forms thought and it's, uh, got fundamental creative capacities. It's free, independent, unbounded, and so on, and undoubtedly I think the basis for our, uh, creative capacities and the other, uh, remarkable, uh, human capacities that, uh, lead to the unique achievements and not so great (laughs) achievements of the species.
- LFLex Fridman
The capacity to think and reason, do you think that's deeply linked with language? Do you think the way we sp- the internal language system is essentially the mechanism by which we also reason internally?
- NCNoam Chomsky
It is undoubtedly the mechanism by which we reason. There may also be other fa- there are undoubted other faculties involved in reasoning. Uh, we have a kind of scientific faculty. Nobody knows what it is, but whatever it is that enables us to pursue a certain lines of endeavor and inquiry and to decide what makes sense and doesn't make sense and to achieve a certain degree of understanding of the world, that uses language but goes beyond it. Uh, just as, uh, using our capacity for arithmetic is not the same as having the capacity.
- LFLex Fridman
The idea of capacity, our biology, evolution, you've talked about it defining essentially our capacity, our limit and our scope. Can you try to define what limit and scope are? And the bigger question, do you think it's possible to find the limit of human cognition?
- NCNoam Chomsky
Well, that's an interesting question. It's, it's commonly believed, most scientists believe, that, uh, uh, human intelligence can answer any question in principle. I think that's a very strange belief. If we were biological organisms, which are not angels, uh, then we, our capacities, uh, ought to have scope and limits which are interrelated.
- LFLex Fridman
Can you define those two terms?
- NCNoam Chomsky
Well, let's take, uh, let's take a concrete example. Uh, your genetic endowment, uh, determines that you can have a mammalian visual system, uh, arms and legs and so on, but it, and th- therefore become a rich, complex organism, but if you look at that same genetic endowment, it prevents you from d- ha- developing in other directions. There's no kind of experience which would yield, uh, uh, uh, the embryo to develop a insect visual system or to develop, uh, wings instead of arms. So the very endowment that confers richness and complexity also sets bounds on what it could, um, wha- wha- what can be attained. Now I assume that, uh, our cognitive capacities are part of the organic world, uh, therefore they should have the same properties. If they had no built in capacity to develop a rich and complex structure we would have, understand nothing, uh, for, just as if, uh, your genetic endowment did not compel you to develop arms and legs. You would just be some kind of a (laughs) random amoeboid creature with no structure at all. So I think it's plausible to assume that, uh, there are limits and I think we even have some evidence as to what they are. So for example there's a classic moment in the history of science, uh...... at the time of Newton. Uh, there was a, from Galileo to Newton, modern science developed on, on a fundamental assumption which Newton also accepted, uh, namely that the world is a, the entire universe is a mechanical object and by mechanical they meant something like the kinds of artifacts that were being developed by skilled artisans all over Europe, gears, levers, and so on. And the o- the, their belief was, well, the world is just a more complex variant of this. Uh, Newton, to his astonishment and distress proved that there are no machines, that there's interaction without contact. Uh, his contemporaries like, uh, Leibniz and Huygens just dismissed this as returning to the mysticism of the neo-scholastics and Newton agreed. As you've said, it is totally absurd. No person of any scientific intelligence could ever accept this for a moment. In fact, he spent the rest of his life trying to get around it somehow as did many other scientists. That was the very criterion of intelligibility for say Galileo or Newton. Earth u- th- theory did not produce an intelligible world unless you could duplicate it in a machine. He showed you can't. There are no machines, any. Finally, after a long struggle, it took a long time, scientists just accepted this as common sense. But that's a significant moment. That means they abandoned the search for an intelligible world and, uh, the great philosophers of the time understood that very well. So for example, David Hume, uh, in his encomium to Newton, uh, wrote that, who was the greatest thinker ever and so on, he said that he unveiled the secret, many of the secrets of nature, but by showing the imperfections of the mechanical philosophy, mechanical science, he left us with... He showed that there are mysteries which ever will remain and science just changed its, uh, its goals. It abandoned the mysteries. "It can't solve it. We'll put it aside. We only look for intelligible theories." Newton's theories were intelligible. It's just what they described wasn't. Well, what a few... Locke said the same thing. Uh, I think they're basically right and if so, that should... something about the limits of human cognition. Uh, we cannot attain the goal of devel- uh, under- uh, of understanding the world, of finding an intelligible world. This, uh, mechanical
- 15:00 – 30:00
Yeah, we like physical…
- NCNoam Chomsky
philosophy, Galileo to Newton, uh... Uh, there's a good case that can be made that that's our instinctive conception of how things work. So if the infants are tested with, uh, uh, things that if this moves and then this moves, they kind of invent something that must be invisible that's in between them that's making them move and so on.
- LFLex Fridman
Yeah, we like physical contact. Something about our brain seeks-
- NCNoam Chomsky
Makes, makes us want a world like that just like it wants a world that has, uh, regular geometric figures. So for example, Descartes pointed this out, that if you have a, an infant who's never seen a triangle before and you draw a triangle, uh, the infant will, uh, see a distorted triangle, not whatever crazy figure it actually is, you know, three lines not coming quite together or one of them a little bit curved and so on. We just impose a conception of the world in terms of, uh, uh, geometric, perfect geometric objects. It's now been shown that goes way beyond that, that, uh, if you show on a tachistoscope, let's say, a couple of lights shining, you do it three or four times in a row, what people actually see is a rigid object in motion, not whatever's there. That's... We all know that from a television set basically. (laughs)
- LFLex Fridman
So that gives us hints of potential limits to our cognition.
- NCNoam Chomsky
I think it does, but it's a very contested view. If you do a poll among scientists they'll say, "Impossible. We can understand anything."
- LFLex Fridman
So let me ask and give me a chance with this. So I just spent a day at a company called Neuralink and what they do is try to design what's called the brain machine, brain computer interface. So they try to s- do thousands of readings in the brain, be able to read what the neurons are firing and then stimulate back, so two way. Do you think their dream is to expand the capacity of the brain to attain information, sort of increase the bandwidth at which we can, uh, search Google kind of thing? Do you think our cognitive capacity might be expanded, our linguistic capacity, our ability to reason might be expanded by adding a machine into the picture?
- NCNoam Chomsky
Can be expanded in a certain sense, but, uh, a sense that was known thousands of years ago. Uh, a book expands your-
- LFLex Fridman
Right.
- NCNoam Chomsky
... cognitive capacity. Okay? So this will, could, could expand it too.
- LFLex Fridman
But it's not a fundamental expansion. It's not totally new things could be understood.
- NCNoam Chomsky
Well, nothing that goes beyond our native cognitive capacities, uh, just like you can't turn the visual system into an insect system.
- LFLex Fridman
Well, I mean, the, the thought is, the thought is perhaps you can't directly but you can map sort of-
- NCNoam Chomsky
You couldn't but we already-
- LFLex Fridman
... because-
- NCNoam Chomsky
We know that without this experiment.
- LFLex Fridman
Right.
- NCNoam Chomsky
You could map what a bee sees and present it in a form so that we could follow it. In fact, every bee scientist does that.
- LFLex Fridman
Mm-hmm.But you don't think there's something greater than bees that, that we can map and then all of a sudden discover something, be able to understand a quantum world, quantum mechanics? Be able to start to be able-
- NCNoam Chomsky
You can.
- LFLex Fridman
... to make sense-
- NCNoam Chomsky
Students at MIT ex-, study and understand quantum mechanics.
- LFLex Fridman
(laughs) But they always reduce it to the infant, the physical. I mean-
- NCNoam Chomsky
Not physic-
- LFLex Fridman
... they don't really understand-
- NCNoam Chomsky
... not physic-, oh you don't... There's thing... That may be another area where there's just a limit to understanding. We understand the theories, but the world that it describes doesn't make any sense. So, you know, the experiment on Schrodinger's cat, for example, can understand the theory but as Schrodinger pointed out, it's an unintelligible world.
- LFLex Fridman
(laughs)
- NCNoam Chomsky
One of the reasons why Einstein was always very skeptical about quantum theory. He described himself as a classical realist once said, uh, in once intelligibility.
- LFLex Fridman
He has something in common with infants in that way.
- NCNoam Chomsky
(laughs)
- LFLex Fridman
So back to linguistics, if you could humor me, what are the most beautiful or fascinating aspects of language or ideas in linguistics or cognitive science that you've seen in a lifetime of studying language and studying the human mind?
- 30:00 – 35:45
Sure. Falling in love,…
- LFLex Fridman
that brought you happiness that you would love to relive again?
- NCNoam Chomsky
Sure. Falling in love, having children.
- LFLex Fridman
What about ... So y- you have put forward into the world a lot of incredible ideas in l- in linguistics, in cognitive science. In terms of ideas that just excites you when it first came to you that you would love to relive those moments.
- NCNoam Chomsky
Well, I mean when you make a discovery about something that's exciting like, say, str- the, uh, even the observation of structured dependence and a- on from that the explanation for it, but the major things just seem like common sense. So if you go back to, uh... Take your question about external and internal language. You go back to, say, the 1950s, uh, almost entirely language is regarded an external object, uh, something outside the mind. It just seemed obvious that that can't be true. Uh, like I said, there's something about you that says, determines you're talking English not, uh, Swahili or something. And, but that's not really a discovery, that's just an observation of what's transparent. Uh, you might say it's kind of like, uh, uh, the 17th century, the beginnings of modern science, 17th century. They, they came from being willing to be puzzled about things that seemed obvious. So it seems obvious that a, a heavy ball of lead will fall faster than a light ball of lead, but Galileo was not impressed by the fact that it seemed obvious, so he wanted to know if it's true. He carried out experiments, actually thought experiments, never actually carried them out, which showed that can't be true, you know. And out of, uh, you know, things like that, um, observations of that kind, uh, you know, why, why does a, a ball fall to the ground in- instead of rising, let's say? It seem, seems obvious till you start thinking about it just why, why does it? Why does steam rise, let's say? And I think, uh, the beginnings of modern linguistics roughly in the '50s are kind of like that, just being willing to be puzzled about phenomena that looked, uh, from some point of view obvious. For example, a kind of, a doctrine, almost official doctrine of, uh, structural linguistics in the '50s was that, uh, languages can differ from one another in arbitrary ways and each one has to be studied, uh, uh, on its own without any presuppositions. In fact, there were similar views among biologists about the nature of organisms, that each one is... they're so different when you look at them that almost anything, you could be almost anything. Well, in both domains it's been learned that that's very far from true. There are very narrow constraints on what could be an organism or what could be a language. But these are, you know, that's just the nature of s- of inquiry.
- LFLex Fridman
Science in general, yeah, inquiry. So o-one of the peculiar things about us human beings is our mortality. Ernest Becker explored it in general. Do you ponder the value of mortality? Do you think about your own mortality?
- NCNoam Chomsky
I used to when I was about 12 years old.
- LFLex Fridman
(laughs)
- NCNoam Chomsky
Uh, I wondered, uh, I didn't care much about my own mortality, but I was worried about the fact that if my consciousness disappeared-
- LFLex Fridman
Mm-hmm.
- NCNoam Chomsky
... would the entire universe disappear? That was frightening.
- LFLex Fridman
Did you ever find an answer to that question?
- NCNoam Chomsky
No. Nobody's ever found an answer, but I stopped being bothered by it. It's kind of like Woody Allen in one of his films. You may recall he, he starts, he goes to a shrink when he's a child and the shrink asks him, "What's your problem?" He says, "I just learned that the universe is expanding. I can't handle that." (laughs)
- LFLex Fridman
(laughs) And then another absurd question is, what do you think is the meaning of our existence here, our life on Earth, our-
- NCNoam Chomsky
That's-
- LFLex Fridman
... brief little moment in time?
- NCNoam Chomsky
That's something we answer by our own activities. There's no general answer. We determine what the meaning of it is.
- LFLex Fridman
The action determine the meaning.
- NCNoam Chomsky
Meaning in the sense of significance, not meaning in the sense that chair means this, you know, but the significance of your life is something you create.
- LFLex Fridman
Noam, thank you so much for talking today. It was a huge honor. Thank you so much. Thanks for listening to this conversation with Noam Chomsky, and thank you to our presenting sponsor, Cash App. Download it. Use code: LEXPODCAST. You'll get $10 and $10 will go to FIRST, a STEM education nonprofit that inspires hundreds of thousands of young minds to learn and to dream of engineering our future. If you enjoy this podcast, subscribe on YouTube, give us five stars on Apple Podcasts, support it on Patreon, or connect with me on Twitter. Thank you for listening, and hope to see you next time.
Episode duration: 35:45
Install uListen for AI-powered chat & search across the full episode — Get Full Transcript
Transcript of episode cMscNuSUy0I
Get more out of YouTube videos.
High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.
Add to Chrome