Essentials: Machines, Creativity & Love | Dr. Lex Fridman

(peaceful music) Welcome to Huberman Lab Essentials, where we revisit past episodes for the most potent and actionable science-based tools for mental health, physical health, and performance. And now, my conversation with Dr. Lex Fridman.

We meet again.

We meet again. I have a question that I think is on a lot of people's minds, or ought to be on a lot of people's minds: what is artificial intelligence, and how is it different from things like machine learning and robotics?

So, I think of artificial intelligence first as a big philosophical thing. It's our longing to create other intelligent systems, perhaps systems more powerful than us. At the more narrow level, I think it's also a set of tools that are computational, mathematical tools to automate different tasks. And then also, it's our attempt to understand our own mind, so build systems that exhibit some intelligent behavior in order to understand what is intelligence in our own selves. So all those things are true. Of course, what AI really means as a community, as a set of researchers and engineers, it's a set of tools, a set of, uh, computational techniques that allow you to solve various problems. There's a long history that, uh, approaches the problem from different perspectives. What's, uh, always been throughout one of the threads, one of the communities goes under the flag of machine learning, which is emphasizing in the AI space the- the task of learning. How do you make a machine that knows very little in the beginning f-follow some kind of process and learns to become better and better in- in a particular task? What's been most, uh, very effective in the recent about 15 years is a set of techniques that fall under the flag of deep learning that utilize neural networks. It's a network of these little basic computational units called neurons, artificial neurons, and they have, uh, these architectures have an input and an output. They know nothing in the beginning, and they're tasked with learning something interesting. What that something interesting is usually involves a particular task. The- there's a lot of ways to talk about this and break this down. Like, one of them is how much human supervision is required to teach this thing. So, supervised learning, this broad category, is, uh, the- the neural network knows nothing in the beginning, and then it's given a bunch of examples of, uh, in computer vision that would be examples of cats, dogs, cars, traffic signs, and then you're given the image and you're given the ground truth of what's in that image. And when you get a large database of such image examples where you know the truth, the, uh, the neural network is able to learn by example. That's called supervised learning. The quest- there's a lot of fascinating questions within that, which is, how do you provide the truth? When you're given an image of a cat, how do you provide to the computer that this image contains a cat? Do you just say the entire image is a picture of a cat? Do you do what's very commonly been done, which is a bounding box? You have a very crude box around the cat's face saying, "This is a cat." Do you do semantic segmentation? Mind you, this is a 2D image of a cat, so it's not a ... (laughs) The- the computer knows nothing about our three-dimensional world. It's just looking at a set of pixels. So, uh, semantic segmentation is drawing a nice very crisp outline around the cat and saying, "That's a cat." That's really difficult to provide that truth, and the- one of the fundamental open questions in computer vision is, is that even a good representation of the truth? Now, there's another contrasting set of ideas, their attention, their overlapping is, uh, what used to be called unsupervised learning, what's commonly now called self-supervised learning, which is trying to get less and less and less human supervision into the, into, uh, into the task. So, self-supervised learning is, uh, more, uh, it's been very successful in the domain of, uh, language model, natural language processing, and now more and more it's being successful in computer vision task. And what's the idea there is let the machine, without any ground truth annotation, just look at pictures on the internet or look at texts on the internet and try to learn something, uh, generalizable about the ideas that are at the core of language or at the core of vision. And based on that, we humans at- at its best like to call that common sense. So with this- we have this giant base of knowledge on top of which we build more sophisticated knowledge, but we have this kind of common sense knowledge. And so the idea with self-supervised learning is to build this common sense knowledge about what are the fundamental visual ideas that make up a cat and a dog and all those kinds of things without ever having human supervision. The- the dream there is the- (laughs) you just- you just let an AI system that's, uh, self-supervised run around the internet for a while, watch YouTube videos for millions and millions of hours, and without any supervision be primed and ready to actually learn with very few examples once the human is able to show up. With- we think of, uh, children in this way, human children, is your parents only give one or two examples-