A CS Professor on Why Slow Learning Wins in the AI Era | CU Boulder, Tom Yeh

1. 0:00 – 0:46

   Intro

   1. TYTom Yeh0:00

      My name is Tom Yeh. I'm a professor of computer science at the University of Colorado in Boulder. I'm also a founder of AI by Hand. It's a global education initiative to make AI inside the black box accessible and approachable, writing all the math with hand, in doing so, understanding that AI is not a big mystery. It's something we all can understand. What is the purpose of learning? Having the answer doesn't mean you know it. People can buy degree, buy certificate. Do you have ownership of this particular idea? Core and foundational that doesn't change, it's evergreen. AI cannot change people, but you can change AI. [instrumental music]

2. 0:46 – 4:07

   Why I Teach AI by Hand- The Power of Learning "Slow"

   1. TYTom Yeh0:47

      [keyboard clicking] A transformer is to, meant to process individual words in a sentence, and it can start with, say, we are at a token number four in my sentence, and then just, then this is a box I draw to show that, oh, well, each token actually has multiple number. In this case, simple case, it's just three numbers. Unfortunately, while I was a student, I missed deep learning entirely. I was a bit too old, so I studied support vector machines, traditional machine learning method. So right then, I became a professor. All of a sudden, all these people are doing deep learning. I have to learn deep learning all over again. So what I'm doing today with AI by Hand is to share my learning journey, how I, as a old professor, trying to learn deep learning from scratch. [instrumental music] All the things I'm sharing has been about to show my own struggle with understanding AI model, maths, and algorithms. Only way I can get it is I get to draw or write on the paper. This is when, oh, I actually get it, so I wanna share my drawing, share my way to map out the math, and it, a lot of people resonated, and people started to comment on, “Hey, I really like your approach to breaking down by hand.” I thought that, hey, maybe I just call it AI by Hand. It, there's a reason that people resonate with this, connect with this thing that I'm doing by hand. Why do we like to calculate this by hand when AI can do this very well? When I was teaching introduction to programming, and I have a feedback that I'm going too fast, I'm going through the slides and so on, and just too fast, 'cause I really like to share a lot of my teaching and knowledge with my students. So I decided to teach the entire semester of C++ programming on the blackboard instead of doing light coding. So I decided to do that, so I have a whole semester of doing, writing the, uh, this is my notes about, I wrote it down on a piece of paper. As the semester progressed, uh, I see a few benefits. One is that I can only go at the humanly possible speed of my writing. I cannot go any faster than I write. Second, student can only learn at a humanly possible speed. They can only follow how much I write. And number three is that if I get my student to use their hand to copy my notes on a notebook, their hands are not on their keyboard, checking their Instagram messages, so help with focus as well. The by hand is really about a way to connect back to our humans. So using your hand, you can go at a human speed. It commune in the human way, and over time I learned is I started to see this value, so going back to the old school, by hand. What is the purpose of learning? Is this about that physical or digital artifact that prove they have learning, or something you feel like you actually internalize, you actually own this kind of stuff? Do you have ownership of this particular idea? Well, AI give me an answer right away. Having the answer doesn't mean you know it. People can buy degree, buy certificate. Whether you, or now you own something, you value something, it's actually proportional to how much time you spend, um, acquiring that piece of knowledge. You have to first define what learning actually means to you. [keyboard clicking]

3. 4:07 – 9:32

   The Foundation That Doesn't Burn

   1. TYTom Yeh4:07

      [instrumental music] I remember when I was a undergrad, we are learning linear algebra as part of a requirement while getting a CS degree. We have learned linear algebra, and we have learned matrix multiplication. I have no idea why it is e- even important. But then it turns out, over time, computer graphics became really popular because of Jurassic Park. They put this CGI up the front, and people talk about, "Hey, everybody need to learn CGI," and CGI uses a lot of matrix multiplication. And then after a few years, there was big data movement. Then it turns out you also need matrix multiplication to do some sort of, uh, processing. And then you move into machine learning. Again, forget about data science. We should be machine learning specialist engineer. Again, matrix multiplication. In today's AP is AI, AI. Everybody needs to be AI-native. We should raise our kids, send them to AI school. Matrix multiplication. In a few years, we all t- all we talk about is quantum computing is possible, right? And guess what? Matrix multiplication again. So you see this, a, a trend that every time there's something, that tool keep changing, but it's always something that's core and foundational that doesn't change, it's evergreen. You could revisit a year from now, two years from now, it's still relevant, people still care a lot about. Whereas the DeepSeek, it was popular at the time, but it's been a while now, so DeepSeek not as popular as before. There's a new, new thing, for instance, like this Grok, super popular. But let's see, in two, two months, is it still, uh, popular? We don't know. But I'm pretty confident transformer topic still gonna be popular. [instrumental music] Couple summers ago, I had a ch- opportunity to visit, uh, South Korea, and I got to visit where everybody else will go, the Gyeongbokgung. There's, there's a palace that's thousands of years of history, very beautiful palace, and then what just struck me when I learned about a bit more history, the entire thing was burned down in like, uh, 1500 except- For the foundation that was made in solid rock. So in 1800s, they rebuilt entire palace based off the same foundation. I'd like to talk about this story because that reminds me of how this technology has been changing over and over again. But if you had a foundation on the mainstream application, you could just apply it to AI. It doesn't really matter. Rebuild your skill based on your solid foundation. So that's why I'm focusing on foundation, because I believe there's something you can rebuild. Doesn't really matter whether the new tools is obsolete. If you keep focused on the surface features, the tools, then forget about foundation, you just have to keep rebuilding your houses. You still never have your foundation on board, can rebuild upon. So how can it apply to your own situation? Think about the way you grew up. Maybe y- your parents sent you to a soccer game, or maybe the piano, and you have something, some skill you have become good at. Is it piano? Is it chess? And think about the way you acquire this skill, and that is actually something that doesn't change. So as AI tool come every day, the fact that you could acquire very difficult skill, that is something that part of your identity that doesn't change. If you continue to focus on that, and you have ability to realize, "Hey, I could acquire this. I can learn this skill. I can become really good at it," that's when you could continue to apply that skill to a new AI tool. So I'm a good example. I was falling behind on deep learning for quite a while, but I have learned skills really trying to break down difficult topics by patiently writing everything down on paper. So that skill, I'm able to eventually catch up. I caught up on deep learning by, from the position that's way behind from people who actually been working on deep learning for a long time. So for you, your piano skill, your soccer skill is not useless. That will be a skill to help you eventually. Once we figure out all this, like, crazy stuff, and this one tool, you just skip this tool, I think it's absolutely fine. Who knows what is gonna next? But if you skip your next piano practice, you skip your next f- soccer practice, and you give up on that, that's not fine, because that is going to be eventually in long run define who you are. But not this tool, not this one tool. At this moment in my career as a educator, I've started to care more about, not that they learn this math. A lot of times when I teach, I say, "Oh, you showed up, you listened to me, you're trying to go through it." But I bet maybe a year from now, you don't remember anything. But what you can remember is more about you are able to understand this. At the moment, you are willing to come here to understand foundation. You are willing to open the black box. That willingness is what sets you apart from others. Others would never try, never attempt it, never took on the challenge. That's what differentiate. It's not really about how much you remember the equation about transformer, about attention mechanism. It's really about there was once upon a time, I try hard to memorize this. I stay in the library for hours to study it. I was successful. So next time, when there's a ch- learning challenge, I can learn this. So that is more important about what differentiate that people who know foundation, that implies the process, time the person invested in learning it. So that is what I value. Versus person who would never really learn foundation implies the lack of effort, the lack of willingness to invest in time and effort to take on a challenging learning task. [keyboard clacking]

4. 9:32 – 12:36

   The 'AI-Native' Trap - AI can't change people, but people can change AI

   1. TYTom Yeh9:32

      When I was teaching the intro to programming, would really spend a lot of effort making new assignments every semester because of Chegg places that people share solutions. And we have all these technical solutions. We're trying to check the IP addresses, see whether people are accessing this, and we even put some kind of a trap on the site. If somebody access that, we know they accessed this. But at the time, I was like, "Hey, well, I hope Chegg can get out of business, maybe shut down by the government, that that would help us educators." And my dream came true, because AI became the new cheating tool, and Chegg out of business. And then when I realized, hey, Chegg was out of business, my dream came true, but problem's still there. What's going on? So it reminds me, again, we should keep thinking, going back to the source. There was the reason why people have to cheat in the first place. That is the main cause. It's not... And Chegg and AI just the symptoms. So Chegg is gone, people still cheat. I bet when AI is gone, people can still find way to cheat. It's this AI cheating that distract us from the bigger fundamental problem of the society's incentive system. Why are student compelled to cheat? Why is this like the, the system doesn't encourage real learning that has, that you have spent time. So when you hire somebody, what do I care about is, does student have a good work ethics? What I care about, is the student a good problem solver? Is this the person a team player that can actually communicate, willing to work with others? So when you hire somebody, go and go back to those basic. That's what you actually care about. You want to keep those people as your employees. And this AI thing is just going to be a byproduct of this. Think about it. When we hire someone because there's a problem solver, in order to solve problem, that person's automatically just gonna learn AI. You don't have to tell them. The reason why you had forced your AI-native, you had to go back, maybe you didn't hire the right person. You forgot to emphasize on person being a problem solver. Again, similarly, if you are hiring this person because this person team player, because the person is team player, the person will learn how to use AI to facilitate team collaboration. So you don't even have to tell the person. The person will automatically do that as well. Trust your instinct. Continue to hire people like that, because those people would automatically adopt AI. You're not a team player, AI not gonna make you a team player. You always look out for your own interest. You do not respect others. AI not gonna fix that. How can AI fix that? AI cannot change people, only you. But you can change AI. [outro music]

Episode duration: 12:37