Fix your AI-limited mindset in 12 mins | Caltech, Anima Anandkumar

1. 0:00 – 1:24

   Intro

   1. AAAnima Anandkumar0:00

      A lot of these AI tools are getting better, but that only means they can do a certain set of instructions which are seen in data. You still need to provide AI what to do, right? You still need to be able to describe it, and that ability to describe what are the tasks AI should do, what are the programs to be written, is still important. I think one job that will not be replaced by AI is the ability to be curious and go after hard problems. So for young people, my advice is not to be afraid of AI or worry what skills to learn that AI may replace them with, but really be in that path of curiosity. I'm Anima Anandkumar. I'm Bren Professor at Caltech. I've been a professor at Caltech for about eight years now, and during that time, I also had stints in industry. I was Principal Scientist at Amazon Web Services. So at Caltech, I lead the AI and Science Lab, which means, uh, working on some of the hardest challenges we see in science and engineering, and how we can not only use existing AI methods to solve them, but really develop new ones. I think one job that will not be replaced by AI

2. 1:24 – 3:38

   Start Where You Are Curious

   1. AAAnima Anandkumar1:24

      is the ability to be curious and go after hard problems. For a lot of students, there is a strong motivation to just conform and go ahead, right? The number one thing I would ask is to question everything. Think critically. I always begin the classes by asking questions, not writing down math equations, right? Not going into the details, but just intuitively based on everything that you've seen, you've done, what do you think? I ask them simple cases. For instance, if you were to design for a fire alarm, when should it say that there is fire or not? That's something you can change, right? You can put a threshold in what level of smoke, or when does it think it's smoky, and that's a very practical question. So if you just had fire alarms every day [laughs] , we'd be just out and it would be useless. We would not have a functional office space. But on the other hand, if we never set fire, that would be bad, too. So how to balance this and how to model how noisy this sensor could be. And sometimes I see with students who may not have the mathematical training, but they're very intuitive and practical. They may be like, "Oh, I would go and measure how noisy it is," or, "I would show different levels of smoke, have, like, candles of different sizes and go and test it." That... And, you know, many times people already may be somewhat aware of this, so they have some intuitive ideas, so that already is a good starting point. And sometimes they are maybe really wrong. They have an intuition, but that's a wrong intuition, which is still okay because intuitions are not always the only answer, right? So I think a lot of it comes by asking questions, and now you can use these AI tools to get answers very quickly and also verify them. A lot of it comes from being just, like, curious or interested, and that could be one specific topic, and if somebody's interested in music, they can delve deeper into that. If somebody's interested in art... So it just has to... The spark has to come from within, and I think giving students more the freedom to pursue where they are passionate, where they have a spark, I think is going to be the future and that's the right thing, rather than forcing everybody to learn everything. I'm always motivated by

3. 3:38 – 4:53

   How I Started Where I Was Curious

   1. AAAnima Anandkumar3:38

      the hardest challenges [laughs] . You know, I wanna know what is difficult, but also why it's difficult, right? And even though I may not be able to solve it today, how do we build up the foundations to get there? Growing up in Mysore as a kid, I loved just solving math problems, you know, going to my parents' factory. I was reading up their program manuals. I was l- you know, learning how they could be programmed. And unlike in other computer programs, here, if something was wrong [laughs] , that would lead to, like, physical failure, parts being, like, not manufactured correctly. Then I'm like, "Oh, but how does it go into the computer, and how does the computer tell the machine what to do?" So there were always gaps because as a kid you don't know everything, but to me it was like observing and then understanding what the gap is. And even if I didn't get an immediate answer, I would remember that there is a gap, and then later when I was introduced those topics, I was... In my mind, I was like, "Oh, that's what it relates to." So somehow I had built up that mental map, and I had put places of where things I knew and things I didn't know, and I kept kind of growing that in my mind as I progressed through the years. So when I was growing

4. 4:53 – 8:25

   Developing the AI That Changes the Real World

   1. AAAnima Anandkumar4:53

      up, AI was considered science fiction. Naturally, there were lots of science fiction movies where I saw and was fascinated, but that's not something people thought were practical. Uh, since I was in middle and high school, and now it's almost 30 years, right? It is a long time, but the amount of progress that has happened is also so astounding in so many ways. So since I joined Caltech in 2017, the timing just felt right to use AI as a tool and a framework to solve some of the hardest problems, which until that point was not considered practical. So w- after I joined Caltech and wanted to explore problems at the intersection of AI and science, and I was talking to everybody on campus, I was like, "Okay, do you need compute? [laughs] What do you need it for? Let me understand the problems that you're tackling." And, you know, I can't possibly go and solve each one of them problems myself, right? My question then was, are there general tools we can develop that could impact so many different areas? And that again put me back to mathematical foundations, so because a lot of these different real-world phenomena are modeled by partial differential equations. So now can we design AI that can solve this and do it much faster, do it much better than what is currently being done with traditional simulations? And to do that, we develop neural operators. We've invented an AI technology called neural operators that is trained to understand physical behaviors. Not just high-level reasoning with text. So think of a hurricane. The hurricane, if you will just eyeball it, can you tell where it's gonna go? You know, most humans cannot, [laughs] right? It's a superhuman skill to predict where hurricanes are going to go, and for to do that, we need fine-scale information and fine-scale modeling. So this cannot be just a coarse-scale image like the image of a cat where even if it's, gets blurry, you know it's a cat. The same techniques don't work for phenomena like hurricanes. Once we develop tools, and then the next natural question is what were practical use cases that involved, and the weather models was a natural one because it's widely used. It has huge implications on our lives, especially if extreme weather events like hurricanes, if we get them right, that has the potential to save human lives and also bring down economic costs. So I was motivated by how it can be helpful to people, but I was also motivated by that being considered a very hard technical challenge. In fact, just a few months before we released our model, there were a group of very well-respected weather scientists who published in the Royal Society journal thinking they're, they were under the impression that AI would take more than a decade or even longer to replace traditional ways to forecast weather, and they felt AI was just not ready. This problem is way too difficult, and we released this, and it just took everybody by surprise. It was not only accurate, it was tens of thousands of times faster. So what would take a big supercomputer for traditional weather models can now be run on a local gaming PC with just a consumer GPU. So that's the beauty of, uh, machine learning as a field. We are not always stopped by what others think as difficult. As long as we can get the data and we can design the methods, we can just go and try it. So my mission

5. 8:25 – 10:00

   Can AI Replace Scientists?

   1. AAAnima Anandkumar8:25

      is to constantly be curious and learning and not assume that any problem is easy. I can't imagine a world where scientists will be out of jobs because the definition of a scientist is somebody who tackles open problems, right? So there are harder and harder problems to tackle. You know, if you want to look at the deep secrets of our universe, go down to the smallest scale and understand at the atomic and subatomic level how matter is constructed to, of course, level of galaxy and beyond and understand how the universe is put together. There are still lots of open challenges. Many other teams such as Google DeepMind focus on what is known as an AI scientist, meaning AI that comes up with new ideas. But so much of scientific progress is not limited by the lack of new ideas, right? Lots of people have lots of ideas, but the bottleneck is going to the lab or going to the real world and testing them. That is slow. That is expensive. So my focus is how we can replace those lab experiments. Can we come up with AI that inherently understands the physics better so we can completely avoid the lab experiments or maybe only do it to do the final testing? And so with that focus and with that physical knowledge, we can come up with AI-designed answers that we can go directly to the real world and, uh, minimize this need for testing. To me, human agency is driving

6. 10:00 – 11:53

   Does AI Kill Curiosity?

   1. AAAnima Anandkumar10:00

      AI to do something that you want it to be done. You have the agency as a human to decide what tasks AI does, and then you're evaluating, and you're in charge, right? So you go and verify whether what AI is saying is true or not, and then over time, provide that feedback to AI and make it get better. AI is a tool. It can both help curiosity but also kill it depending on how it's used, right? So for young people, my advice is not to be afraid of AI or worry what skills to learn that AI may replace them with, but really be in that path of curiosity, right? Use AI as a tool to drive that curiosity. Learn new skills, new knowledge, and you can do that in a much more interactive way. Even when it comes to writing computer programs, you know, a lot of these AI tools are getting better, but that only means they can do a certain set of instructions which are seen in data. You still need to provide AI what to do, right? You still need to be able to describe it, and that ability to describe what are the tasks AI should do, what are kind of high-level understanding of what AI is doing when it writes these computer programs is still important because a bad programmer who is not better than AI will be replaced, but a great programmer who can assess what AI is doing, make fixes, ensure those programs are written well, will be in more demand than ever. [upbeat music]

Episode duration: 11:54