Nikhil KamathNikhil Kamath ft. Perplexity CEO, Aravind Srinivas | WTF Online Ep 1.
EVERY SPOKEN WORD
115 min read · 23,212 words- 0:00 – 0:45
Intro
- NKNikhil Kamath
Are you like a Chennai boy? Have you grown up there all your life?
- ASAravind Srinivas
My parents live in Chennai, so I first go there.
- NKNikhil Kamath
What were these fancy ideas?
- ASAravind Srinivas
I'm very upset to hear that, 'cause I actually thought my ideas are cool. [upbeat music]
- NKNikhil Kamath
Hi,
- 0:45 – 12:14
Meeting Aravind Srinivas | His Journey & Career Path
- NKNikhil Kamath
Aravind.
- ASAravind Srinivas
Hi, Nikhil.
- NKNikhil Kamath
Hi. This is a bit weird for me 'cause I'm doing it this way, a conversation after a bit.
- ASAravind Srinivas
Okay.
- NKNikhil Kamath
Yeah.
- ASAravind Srinivas
Yeah, I wish we could be in the same place.
- NKNikhil Kamath
Where are you now?
- ASAravind Srinivas
I'm in San Francisco.
- NKNikhil Kamath
Right.
- ASAravind Srinivas
Yeah. I was traveling to Europe last week.
- NKNikhil Kamath
Okay.
- ASAravind Srinivas
A lot more travel coming up, but, uh, hope to be in India pretty soon, um, before my May, hopefully.
- NKNikhil Kamath
Oh, that's not far. When you come to India, where do you typically go to? Is it-
- ASAravind Srinivas
My parents live in Chennai, so I first go there. And then, um, depending on the arrangement, like who I'm meeting, I spend-- Like last time I came, I went to Mumbai and Delhi. Um, and this time I probably will try to go to Bangalore, too, in addition to, um, these two cities.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
But everything's, like, in the flux right now.
- NKNikhil Kamath
Right. Super. Are you like a Chennai boy? Have you grown up there all your life?
- ASAravind Srinivas
Yeah.
- NKNikhil Kamath
So you know, like, the local stuff about Chennai kind of thing?
- ASAravind Srinivas
Um, I mean, I, I'm, I'm... Yeah, I grew up there, so I hope- [chuckles]
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
I, I don't know exactly what you mean by local, but I definitely know Chennai pretty well.
- NKNikhil Kamath
Right. How did this begin? Would you like to start by telling us, like, a little bit of-- little bit about your journey, how it was from where you began in Chennai to where you are today?
- ASAravind Srinivas
Yeah. Um, well, I was just like any other, um, student in Chennai, um, just, just studying. Uh, people in Chennai study a lot. I think that's one thing I've known.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
Um, I think I was pretty interested in, um, all, all sorts of statistical things. Um-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... mainly coming from following cricket a lot, is people generally, like, try to analyze the stats and run rate and, like-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... how many fifties or hundreds, and I, I got a s- intuitive sense for numbers pretty early on. I was pretty good at math. Um, and I also, like, early on, picked up programming towards the end of my, um, I think, eleventh standard. So that's, uh, that was how it began, and obviously, my mom wanted me to get into IITs. Uh, every time, like, we would go on a bus, um, and, and pass by the IIT Madras campus, uh, my mom would point to the campus and say: "This is where you're going to study." The-
- 12:14 – 29:06
AI’s Evolution | From Basics to Super Intelligence
- NKNikhil Kamath
talk about AI today, let me, like, set context. [clears throat] Think of me as an absolute idiot who does not understand anything, and whenever you say something, if possible, please try and explain it to me in the manner that you would speak to, like, a ten-year-old boy who's not very smart. That would help.
- ASAravind Srinivas
Sure. Absolutely.
- NKNikhil Kamath
Sure. And I think a good place to start, um, today, where I am, I work in fintech, largely in India, but I feel whenever I read the news or I watch the news, very insecure about the fact that so much is happening in AI, and I almost feel like I'm being left out of it.
- ASAravind Srinivas
Mm-hmm.
- NKNikhil Kamath
And it doesn't feel like I'm even amidst the action to learn about it. It feels like I'm talking to the commentator or reading what the commentator who has-- what he has to say, whereas the match is happening in another region altogether.
- ASAravind Srinivas
Mm-hmm.
- NKNikhil Kamath
So maybe we can preface this conversation with, like, maybe a brief history of compute leading up to AI-
- ASAravind Srinivas
Sure
- NKNikhil Kamath
... in the manner, in the manner that you would speak to a ten-year-old boy, and we can take, take it from there.
- ASAravind Srinivas
Sure. Uh, I mean, AI has been going on, uh, since a long time. Uh, if, if you like, in-- I think there was a project at MIT which declared you can solve AI in a summer project, like, like, uh, literally in, in three months. And then obviously-
- NKNikhil Kamath
Would you want to first define what is AI?
- ASAravind Srinivas
So AI, obviously, uh, artificial intelligence is a field of computer science that's, uh, trying to design computers to behave intelligently.
- NKNikhil Kamath
I was wondering what their definition of intelligence is.
- ASAravind Srinivas
Yep, yep. Program computers to do, uh, tasks that require, uh, some level of intelligence to accomplish them, uh, in a manner similar to a human does it. And what is the scope of tasks, uh, that, uh, require intelligence, that, that, that you want the computer could do, is where the generality comes in. So, um-
- NKNikhil Kamath
So are you saying that intelligence is when a computer is able to behave like a human? 'Cause that itself-
- ASAravind Srinivas
General intelligence is.
- NKNikhil Kamath
Yes.
- ASAravind Srinivas
General intelligence is.
- NKNikhil Kamath
Right.
- ASAravind Srinivas
Um...
- NKNikhil Kamath
Right.
- ASAravind Srinivas
So an AI that you write in a, in a, for a chess game that you're building. Let's say you're building a chess game, uh, as, a software project.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
And, um, obviously, the, uh, when, when the user picks White and the Black's playing with an AI-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... um, there is an AI you write for the game. That is not really a generally intelligent AI. It, it, it can only do what you hard-coded it to do, okay? It can assign points for each piece. A bishop is this much, a knight is this much, and it can just run a tree search to optimize for that. Uh, by that I mean it can search for moves, roll out-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... few steps, and then try to pick the one that gives you the maximum score. That is-- people used to call that AI, but that is not general AI. The reason is, whatever software you write for that cannot do another game even, leave alone another task.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
It is a very constrained, specific setting. Now, that is interesting by itself. There are a lot of things you could do in the world that are useful, where you break down a problem and you write a specific solution for that. It's pretty useful. But, uh, what was really on the frontier of science at, at that time, when I, when I was doing PhD, was like: How can we figure out general intelligence, uh-
- 29:06 – 35:54
Understanding the Process Behind AI
- NKNikhil Kamath
but I'm going to ask it. Uh, how a calculator worked? I'm using the most basic of examples. How a calculator worked back in the day.
- ASAravind Srinivas
Mm-hmm.
- NKNikhil Kamath
When I hit on a computer, multiply twenty-five into twenty-five or twenty into twenty, what happened on the back end that I couldn't see? How did it throw the output? We'll start there, and we'll try to extrapolate all the way to what's happening today.
- ASAravind Srinivas
Sure. I mean, there were circuits for adders, multipliers, uh, and, and these are the circuits that are running on the back. Depending on your input that you, uh, enter, it's getting parsed, and then that input is getting fed into the circuits, and then you're getting the output.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
And you can build me-- even mechanical circuits. That's a beautiful thing. Like, once you, once it works, all the... You know, there are, like, nice visualizations of how adders just work in a completely mechanical way. So, uh, you don't actually need that much power to, uh, make this work. I think I saw somebody say a beautiful thing. It's like, a calculator is such an amazing p-- uh, artifact that, uh, if you took it, uh, let's say from twenty twenty-five, and let's say you time travel back to eighteen hundred, [chuckles] it would still work the same way.... uh, it, it w- it, like solar, let's say it's solar powered, um, it would just work the exact same way. Um, and, and that's fantastic because you cannot say that about, uh, let's say, your MacBook. You, you're not gonna be able to power it, right?
- NKNikhil Kamath
That's actually useful. The way you described it helps me visualize. When you say it's mechanical, I can imagine a IC doing what I can picturize mechanically in my head. Like I can see that-
- ASAravind Srinivas
Yeah, yeah.
- NKNikhil Kamath
There are five lights and you add them.
- ASAravind Srinivas
Yeah. There, there are some-- You can go to y- YouTube and watch some, [clears throat] how, like, you can have, um, a binary counter-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... three-digit binary counter that's completely mechanical, and, and-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... um, it's pretty beautiful. So-
- NKNikhil Kamath
Okay.
- ASAravind Srinivas
Uh-
- NKNikhil Kamath
And then, what hap- what changed in computing after that?
- ASAravind Srinivas
Well, a lot, a lot of things, obviously.
- NKNikhil Kamath
Mm-hmm. Mm-hmm
- ASAravind Srinivas
... um, you know, we gotta go very deep into, like, what people built with calculators, like other, other devices and so on. But, um, I think the biggest change, I would say, was the personal computer revolution. We, we had mainframe computers, right? Uh, but then the biggest change that kind of truly made computing, uh, very democratized and ubiquitous is, uh, people being able to have a personal computer at home. Uh, that was the whole, you know, Apple I, Apple II, IBM.
- NKNikhil Kamath
Yeah. So sticking to the IC example, Moore's Law, ICs got smaller and smaller, so you could have enough compute at home to do these same calculations that before you needed a mainframe for.
- ASAravind Srinivas
Correct. Correct. Not... Yeah, definitely, Moore's Law is, um, one of the critical reasons it happened, but, um, also, like, a lot of artistry in the beginning to package, uh, a lot of computations in a very compact way into, like, one board that could be put into a portable computer, was pretty amazing. Uh, a lot of people actually, in the beginning, were skeptical. They thought that: "It's not gonna matter. Like, why would people need a computer at home, right? It's just, like, stuff you do for work." And, uh, uh, that's where the beauty was, "Hey, people might wanna actually work at home, too." Of course, games was a big deal, but ev- the real reason computers took off, personal computers took off, is this software called VisiCalc-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... uh, which is essentially a spreadsheet and calculator.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
And, and, and, uh, so that led, like, people who were doing accounting, uh, do their work at home, and, um, slowly, it spread. Like, more software started being written for personal computers. Um, and, and, uh, and, and so, like, that be- that made, like, personal computing fun. Now, after that, there's the network effects, where if you had a personal computer at home and I had one, and we could figure out a way to talk to each other, which is the Internet, and then, uh, the World Wide Web-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... and then, like, mobile, uh-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... cloud, and now AI. So [chuckles] it's a very, like, simplistic way to describe it.
- 35:54 – 45:25
WTF is a Neural Network?
- NKNikhil Kamath
you again, but can you explain what a neural network actually is? I have a little bit of history with this because I work in the stock investor world, and we've had neural networks for a long time, and I remember seeing this over much of the last decade.
- ASAravind Srinivas
Yeah.
- NKNikhil Kamath
Where you would put in a lot of, maybe a bunch of different data factors that we have, like maybe time, price, volume, and put all this data into neu- into a neural network, try to get it to predict what will happen next.... and start maybe a robo-advisory kind of service or, you know, try to figure out how a computer might be able to predict. But none of this played out in the manner that we perceived it when it came to the stock market. But maybe you can define for me, it, it didn't play out then. I'm talking over the last decade. Can you define what is a neural network in very simple words?
- ASAravind Srinivas
So a neural network is a network of artificial neurons, uh, connected to each other layer by layer. Um, and what is a ne-- artificial neuron is just like a computational unit that takes an input number and gives you an output number. Uh, and so it's, it's, it's called a neural network because it's inspired from the biological ne- neural network, which is the human brain. Um, but it's not exactly meant to be working the same way either. In fact, that's actually why in practice it works, 'cause a lot of people tried to make it work the exact same way and failed at it. But think about it as like a massive circuit that you're feeding numbers to, and it, it spits out new numbers. Um, and it's doing-
- NKNikhil Kamath
Does it spit out new numbers based on the numbers that I have put in and the-
- ASAravind Srinivas
Correct
- NKNikhil Kamath
... patterns it recognizes in those?
- ASAravind Srinivas
Yeah. Correct. Yeah, exactly.
- NKNikhil Kamath
In the stock market example, if we were to just stick to it, when you put so much data into a neural network and it predicts what might happen tomorrow based on what has happened yesterday-
- ASAravind Srinivas
Mm-hmm
- NKNikhil Kamath
... stock markets often tend to be random.
- ASAravind Srinivas
Mm-hmm.
- NKNikhil Kamath
And there is a school of thought, they call it technical analysis, where people believe that patterns exist, and they try and map out what patterns happened in the past and how they will repeat themselves specifically. But what if... This is a bit selfish because I'm, I'm sticking to the stock market example, but what if the past patterns do not recur in the future? Then what does the neural network predict?
- ASAravind Srinivas
That's a good question. So are neural networks... Uh, look, neural networks can be trained to predict anything, right?
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
And, uh, uh, standalone, without the prediction function, the loss function, just the neural network alone is simply a mathematical function.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
Very nonlinear. Think about it as like some extremely high-order polynomial function, right?
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
Um, it's just gonna-
- NKNikhil Kamath
What was the last word you said, order?
- ASAravind Srinivas
Extremely high-order polynomial function.
- NKNikhil Kamath
Right.
- ASAravind Srinivas
Um, by, by that all I mean is, like, very nonlinear.
- NKNikhil Kamath
Correct.
- ASAravind Srinivas
Um, a lot of higher-order interactions and multiplicator- multiplications.
- NKNikhil Kamath
Can you help me picture a neural network? You said it was meant to mimic brain chemistry, but it doesn't.
- ASAravind Srinivas
Yeah. Think about it as like... Okay, let's say you're, you're feeding in, like, three or four numbers at the input layer. Uh, the first layer will take that and, like, transform that. Imagine it applies some, some sinusoids or, like-
- NKNikhil Kamath
Do you mean when you say transform, are you talking about transformers in Google and their development and stuff like that, or?
- ASAravind Srinivas
No, I, I don't mean specifically a transformer, but I just mean, like-
- 45:25 – 53:59
Large Language Models (LLMs) & it’s Evolution
- NKNikhil Kamath
language model sit amidst all this? What is it?
- ASAravind Srinivas
So a large language model, uh, is essentially a giant neural network that's trained on this one task of predicting the next word from the previous word, except it's training on the whole internet. So it's training on terabytes of text, trillions of tokens.
- NKNikhil Kamath
Mm-hmm. Mm-hmm.
- ASAravind Srinivas
And it's doing-- it's, it's training on books, code, and, um, uh, textbooks, and, like, general web pages, news articles, all these things. So, um-
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
By doing-
- NKNikhil Kamath
But the distinction being just text, it's not training on videos and pictures and stuff like that?
- ASAravind Srinivas
Uh, I think, I think, like, uh, it can, uh, but, but since you're calling it large language model, I'm, I'm-
- NKNikhil Kamath
Mm
- ASAravind Srinivas
... I'm, I'm keeping that in most people.
- NKNikhil Kamath
Let's, let's take ChatGPT, for example.
- ASAravind Srinivas
Yeah, if ChatGPT-
- NKNikhil Kamath
If we're talking about-
- ASAravind Srinivas
Yeah, so the image part, uh, like, like taking in an image and captioning it, and all that stuff, comes only, uh, in a different phase of training called the post-training. Uh, but most of the, most of the compute is thrown at just predicting the next word from the previous word. That's called the pre-training. Um, and so, so e-essentially, think about the data set. It's the same thing. Think about the data set as being the whole internet dump, like all of Wikipedia, all of Reddit, uh, everything like that. You, you, you, you, you download it from the web, you, you tokenize it. That is, you, you know, c-c-con-convert every sentence into a bunch of tokens, and then you store it somewhere in, in your S3 dump, and then, um, feed, like, you know, hun- four thousand words, and ask it to-- for each of those four thousand words, you ask it to predict the next word, given the previous word, right? And there's one-
- NKNikhil Kamath
This is where the transformer comes in.
- ASAravind Srinivas
Correct. Exactly.
- NKNikhil Kamath
Yeah.
- ASAravind Srinivas
This is where the transformer comes in, which is a particular neural network architecture, uh, that's pretty efficient. And, um, you, you shard the model, which is the neural network model, on, like, thousands of GPUs and, and, and, and learn on, like, trillions of tokens, on, like, train this model for, like, three or four months. And it's pretty amazing artifact emerges out, which is... it'll, it'll be great at, like, predicting the next word, but it's still not conditioned enough to be practically useful. And so that's where the post-training process comes in, where you, uh, train this, or fine-tune it mo- fine-tune this model to be a good chatbot, uh, which is training it to produce good responses to human inputs. Uh, and, and, and, um, that requires a separate data collection phase, where you're collecting data for practically useful tasks, like software programming, compressing emails, summarizing documents, uploading PDFs, and, like, having it summarize things or answer questions about it. Uh, and, and, and then, and then also, like, just generic conversational outputs, where you're training the model to be, like, conversationally good, keep references of the past and stuff. And once you do that, like, you end up with a system like ChatGPT.
- NKNikhil Kamath
Right.... when I was speaking to Yann, I mean, I asked him things like, you know, explain tokenized to me a dozen times and all of that, but he seemed to think that the current path of evolution of where la- large language models are going is not the path to AGI. He had a counter opinion on it. Can you elaborate on that a bit?
- ASAravind Srinivas
Well, again, like, he, he has his opinions, and I think, you know, um, he, he's generally been right, so it's worth listening to him. Um, I would say that, um, what Yann wants is, like, physical common sense to—like, he, he counts that as a prerequisite for something to be deemed as AGI. Uh, by that I mean, like, just basic stuff that we all take for granted, that we c-- we do on a daily basis, which is how to pour water into a cup, how to-- like, let's say you're a waiter in a restaurant, and you have to pick up, like, three glasses and two coffee cups-
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
-with two hands.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
How do you do it, right? Like, you're pretty clever. You ta-- you, you, um, tilt them in a way and make sure they don't break, um-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... and so on. Or like, or you have a new, uh, bottle of wine, how to even use the, uh, an opener that you've never used before. You figure all these-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... things out pretty quickly. Uh, the tool use that comes on a daily basis. You know, like, it's not good to mix two ingredients that are not supposed to be mixed. I think these are the things that, like, he thinks a generally intelligent AI should do. Like, stuff a cat figures out to just get from one place-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... to another when they're like-
- 53:59 – 57:03
The Latest AI Shifts
- NKNikhil Kamath
to ask you, what changed? Like, what changed in the last couple of years that this has taken over everything, like this conversation?
- ASAravind Srinivas
I would say it's, um, a lot of compute thrown at the problem-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... unprecedented scale.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
Um, the key realization that it's not just compute also, uh, it's-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... it's high-quality data and, and RLHF, you're learning from human feedback-... and actually like, um, t- training it on tasks useful to human labor, like coding-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... and like summarization and stuff like that-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... all came together simultaneously. And, um-
- NKNikhil Kamath
But do you think the one main thing is throwing immense amounts of compute at the problem without-
- ASAravind Srinivas
Definitely, that is-
- NKNikhil Kamath
worrying
- ASAravind Srinivas
... i- i- if there's, like, a highest order bit-
- NKNikhil Kamath
Yeah
- ASAravind Srinivas
... I think it's about-
- NKNikhil Kamath
Without worrying if the outcome is going to make up for the revenue spent towards the compute?
- ASAravind Srinivas
Yeah. Yeah, I think so. Um-
- NKNikhil Kamath
Is that the distinction?
- ASAravind Srinivas
Definitely. Because, like, um, the compute and, and, and by the way, compute alone is useless. Like, people have tried to-
- NKNikhil Kamath
Mm
- ASAravind Srinivas
... reproduce these things with doing the same thing, and it doesn't work. You gotta throw high-quality da- data tokens at the problem too. So that taste on, like, w- curating datasets of, like, what will really matter. Like, for example, if you want reasoning to emerge in a model, it's good for you to, like-
- NKNikhil Kamath
Mm
- ASAravind Srinivas
... make sure you have YouTube transcripts of video, uh, like, like, like, uh, lectures, uh, MIT lectures-
- NKNikhil Kamath
Right
- ASAravind Srinivas
... Stanford lectures, um, and, and textbooks, like, where you actually have problems, where-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... it's not just the problem, but the solution is explained step by step. So when the models-
- 57:03 – 1:05:13
Aravind’s Hustle | Work, Education & Family
- NKNikhil Kamath
said Bangalore. How long were you there for, and what were you doing? That's where I'm from.
- ASAravind Srinivas
You mean for my internship?
- NKNikhil Kamath
Yeah.
- ASAravind Srinivas
Um-
- NKNikhil Kamath
You said you finished the problem in three weeks.
- ASAravind Srinivas
[chuckles] Yeah, probably. Uh, I l- I think I was in this place called Koramangala. Um, and, um, I didn't actually explore, so I, I, I just worked all the time, which is, you know... Now that I look back, I probably think I should have explored. But, um-
- NKNikhil Kamath
No, now when I look at you, I think you did a good thing by not exploring Koramangala and working all the time.
- ASAravind Srinivas
No, not, not, not-- I don't, I don't mean to explore Koramangala-
- NKNikhil Kamath
Mm
- ASAravind Srinivas
... but I, I just mean explore Bangalore in general.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
That, that I wish I did. But, um, I do remember the traffic being bad, and I'm being told it's even worse now. So, [chuckles] so probably not-- probably good that I stayed in the room and just worked. But otherwise, like, uh, I do remember the weather was awesome compared to, uh, Chennai. I think-
- NKNikhil Kamath
Mm
- ASAravind Srinivas
... weather was much better. Um, [inhales] what did I do?
- NKNikhil Kamath
Do you still follow cricket?
- ASAravind Srinivas
Uh, yeah, I do. Yeah, I followed the match on Sunday.
- NKNikhil Kamath
Yeah.
- ASAravind Srinivas
And, uh-
- NKNikhil Kamath
I'm actually in Dubai 'cause I came to watch the match.
- ASAravind Srinivas
How was it?
- NKNikhil Kamath
This is my hotel room in Dubai.
- ASAravind Srinivas
Oh, cool.
- NKNikhil Kamath
It was good. It was good. I feel like the stadium had maybe ninety-nine point nine nine percent Indian support and point zero one percent New Zealand. They had, like, a tiny box with thirty people in there.
- ASAravind Srinivas
Wow!
- NKNikhil Kamath
So everybody walked away happy.
- ASAravind Srinivas
Okay.
- NKNikhil Kamath
Most people walked away happy.
- ASAravind Srinivas
Yeah.
- NKNikhil Kamath
Yeah.
- ASAravind Srinivas
Yeah, I mean, like I, I was pretty disappointed in the last three or four, um, times we lost in the semifinal or the final.
- 1:05:13 – 1:22:00
What are Big Players of AI Doing? | Perplexity, Google, Meta, Open AI, Anthropic, and more
- NKNikhil Kamath
particular thing, uh, we speak to wannabe entrepreneurs from India, largely, who are under the age of twenty-five.
- ASAravind Srinivas
Mm-hmm.
- NKNikhil Kamath
But for a second, I'm gonna put on my investor cap and ask you what the big players are doing. How do you distinguish one from another?
- ASAravind Srinivas
Mm-hmm.
- NKNikhil Kamath
And maybe you can give us a bit of nuance of how is one different from another?
- ASAravind Srinivas
Okay.
- NKNikhil Kamath
Like, you take a Grok, you take what, uh, Meta is doing.
- ASAravind Srinivas
Yeah.
- NKNikhil Kamath
You talk about what Microsoft is doing.
- ASAravind Srinivas
Yeah.
- NKNikhil Kamath
Maybe like, just like, you know, like, really low-level stuff that I can understand.
- ASAravind Srinivas
Yeah. Honest answer right now is, all of them are doing similar things. Okay, like, uh, I'll just say it as blunt as it can be, uh, is there's not really a genuine differentiation between, uh, ChatGPT, or Anthropic, or Gemini, or Grok, or Meta AI right now. And, um, of course, for Perplexity, you can argue similarly, which is, you know, in the beginning, the differentiation was we were the only ones to make sure you always had sources for everything and, like, you know, highly accurate sources, fast answers, uh, and, and so on, but everybody else is also, like-... realizing that the real value is in search, uh, even more than freeform chat, and they're trying to put sources for almost any, any response. So I think right now, we're, we're in this weird phase where, like, all AI chatbots seem similar, and, like, some people prefer one over the other. And, like, you know, if you rank response accuracy, like, I'm sure different benchmarks will have different people ranking one, number one or two. But, but consistently, Perplexity is, is deemed as, like, one of the most accurate, fastest chatbots. Um, and, and I'm very happy because that's the work we've put in the last two years. But I feel the-- this year in 2025 and '6, the differentiation is gonna come from more agentic behavior, uh, where, like, the, the, the question answering, like, answering questions will be seen as a commodity. Uh, some people will have preferences for some products, some u- user interfaces are gonna be better. Uh, those who not just respond with text, but also give you charts, and, like, images, and inline product cards or hotels, uh, you know, shopping is easier.
- NKNikhil Kamath
Would you call that agentic? Like, if somebody picks off a language answer, like a text answer from a certain large language model and converts it into images and makes it more-
- ASAravind Srinivas
No, that's not agentic. I'm just saying-
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
... question answering itself, you can say-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... just responding in text is, like, not gonna cut it. You're, you-
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
Like, let's say I'm gonna ask for the best shoes, you wanna actually see the shoes. Uh, you wanna see an actual shoe card, and, like, reviews, and, like, compactly summarized-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... to you with, like, options to buy. Uh, same thing with hotels, same thing with, like, restaurants. You can just wanna book it right there. I think these kind of experiences will differentiate one or two chatbots from the rest, and we are doing our part-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... to be ahead of the curve there.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
But I, I feel like the real magic is gonna come from AIs doing things.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
Where you can go to the AI and ask it to play a song, or, like, play a video, or, or book a restaurant reservation, book an Uber, book a flight, uh, send an email, move your calendar. Like, say, I'm communicating to Nikhil's team, I'm just gonna ask my assistant to, like, um: "Hey, can, can you ask them, can we start at eight thirty instead of eight?" Uh-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... and then it's, it's just gonna do this emailing for me, and it's gonna do the back and forth with your team, and it's just gonna, like, figure it out. I'm not-- I'm, I'm just, like, in my bed sleeping, and the AI is working for me. I think those kind of things-
- 1:22:00 – 1:34:44
Where the Real AI Opportunities Are
- NKNikhil Kamath
uh, with all the talk about tariffs and who imports how much and who exports so much, and the deficit that the US is running versus India or China or many of these other countries. Almost every new company here in India-
- ASAravind Srinivas
Mm-hmm
- NKNikhil Kamath
... spends all of their marketing money, their distribution money. Like, if I were to even start a T-shirt company, a coffee brand, a, I don't know, a SaaS company, gone are the days of putting a ad on a newspaper or a TV channel or a cricketing team or, you know, like the traditional way of spending money to get distribution. Uh, don't hold me to the numbers, but pragmatically, I see that declining, and more and more money in discovering clients in India goes to either Facebook or Google, and Meta-
- ASAravind Srinivas
Yeah
- NKNikhil Kamath
... or Google. And that money, that revenue might be registered in Facebook India or Meta India or Google India, but essentially, I-- the way I look at it, it's trickling back to the parent company because the, the market cap of these companies are going up by virtue of the revenue they register here in India. Since we are at the very core of it, talking to entrepreneurs who want to start something in India, do you think there's a play there to disrupt this market? Do you think that's even remotely possible for an Indian p- for someone in the Indian youth to build something, to take away some of this pie?
- ASAravind Srinivas
Well, uh, if an Indian company started an Instagram or WhatsApp rival, I would very, be very impressed by the bravery of it. Not that like-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... I'm trying to do anything similar.
- NKNikhil Kamath
Is bravery a euphemism for stupidity?
- ASAravind Srinivas
No, uh, well, I, I, I would say, like, what I'm doing is similar, uh, where-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... even now people think it's a stupid idea to compete with Google. Uh, but I think it, I think there's some angle, uh, that can work. Um, and, um, if, if-- okay, here, here's how I would see it. If you can build way better targeting, [sniffs] uh-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... than, than Instagram does, at least for consumers in India, that you're trying to target-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... for your business. Um, and, and sure, like, people would be at least... All they gotta do is, like, if, if they're spending a million dollars in ads a year, instead of spending the entire million on Instagram, if they spend seven hundred K on Instagram and three hundred K on your thing, like, that's already a big disruption.
- NKNikhil Kamath
That's step two after I first garner the distribution for my-
- ASAravind Srinivas
Correct. Yeah
- NKNikhil Kamath
... platform, where people come to me.
- ASAravind Srinivas
Yeah.
- NKNikhil Kamath
Now, how do I do that?
- ASAravind Srinivas
You need to have one core-- you need to have one core-
- NKNikhil Kamath
Yeah
- ASAravind Srinivas
... uh, reason why people even-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... post on your platform.
- NKNikhil Kamath
Yeah.
- ASAravind Srinivas
... and, and, um, when you have zero users, uh-
- NKNikhil Kamath
Yeah
- ASAravind Srinivas
-or you're just, like, getting users, the creators are like, you know, the ones who are posting stuff, uh, they, they, they want, they want traction, they want, like, likes and stuff, they want shares. And so that, that's the problem, that's a cold start problem. And, and network effects, that-that's kind of why I said Meta has a bigger moat than Google. Uh-
- 1:34:44 – 1:39:15
AI Features & Tools | Text-Videos, Chatbots, Translations
- NKNikhil Kamath
if text moved to pictures, moved to short-form video, could it be long-form video? No, YouTube has-
- ASAravind Srinivas
YouTube is there.
- NKNikhil Kamath
Yeah.
- ASAravind Srinivas
Right.
- NKNikhil Kamath
Yeah.
- ASAravind Srinivas
By the way, YouTube is actually, uh-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... one of the biggest rivals to Instagram, I would say.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
Um, mainly because-
- NKNikhil Kamath
That was Instagram's market to take, right?
- ASAravind Srinivas
The Reels? Yeah.
- NKNikhil Kamath
The long-form video. The long-form video as well.
- ASAravind Srinivas
Long-form video? Yeah, yeah, a little bit, yeah. Um, what I was told is YouTube's ad revenue now, uh, comes more from TVs than even, like, the actual YouTube app. Um, so, so you can kind of see where people are actually beginning to spend more time on their TVs now-
- NKNikhil Kamath
Yeah
- ASAravind Srinivas
... um, than, than even their mobile apps, so there's probably something there. Uh, podcasts is growing a lot. A lot of people-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... of course, you are making one of the most listened to podcasts, but-
- NKNikhil Kamath
Mm
- ASAravind Srinivas
... it's, uh, it's, it's, it's a thing that Instagram is not really getting. Um-
- NKNikhil Kamath
Yeah
- ASAravind Srinivas
... and it's m- going more towards the Apple Podcasts, Spotify. So there's always, like, people figuring out new forms of content that's not necessarily going to Instagram, so-
- NKNikhil Kamath
Mm
- ASAravind Srinivas
... there's something there.
- NKNikhil Kamath
Do you think that's an opportunity? If I'm able to aggregate every Indian podcaster-
- ASAravind Srinivas
Yeah
- NKNikhil Kamath
... and improve the quality of their video by, I don't know, if I include a chat function where they can talk to the podcaster and the guest, like, have some angle like that, do you think if I were to be able to aggregate that, is, is it a possibility?
- ASAravind Srinivas
Definitely. Um, another thing that people haven't really tried is, like, live stream the podcast. Like, let's say we're talking now, um, and, and, and, like, so the way a podcast works is we record it, you edit it, you post it, and then people are listening to it, but there's no communication between us and them, right? Um, and, and, like, X tried that with, with live stream-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... and, and, and, you know, like, so that's something-
- 1:39:15 – 1:49:42
Why Data Centers Are the Next Big Thing
- NKNikhil Kamath
[clears throat] I have a private equity fund. We are reviewing a data center business. Fairly large, something that does maybe $100 million of EBITDA right now. So data center has become such a thing in India, Aravind, that, uh, every real estate person that you speak to or I speak to today, everyone's talking about data centers. It's like-
- ASAravind Srinivas
Interesting
- NKNikhil Kamath
... it's like the real estate almost in, in the 2025 version, the big f- big thing for them is not this new building, but it's building a data center. Uh, if you're able to buy data center businesses at a 20 multiple of EBITDA or a 25 multiple of EBITDA, would you do it today? Is there something I'm missing? Is there something changing in terms of how data is being compressed, quantum computing, or compute moving out of the data center-
- ASAravind Srinivas
Yeah
- NKNikhil Kamath
... that one should not do it?
- ASAravind Srinivas
I wouldn't really worry about quantum computing right now. Uh, I, I think it's still in pretty early stages. Um, I certainly think India should have its own data centers, like, like, there's no, um, reason not to. Um, and, um, definitely calls for good real estate expertise. Um, infrastructure, uh, build-out is not easy. Uh, buying the chips, uh, connecting them, the... making sure you use the right technology for the interconnects between these different GPUs, building these server racks. I mean, uh, compute c- centers in, in, in different IITs have done this. Like, like, you know, we had our class compute cluster that we had access to in IIT, and it would live in the computer center. So definitely doable. Um, and, um, it, it, it really depends on, like-- Okay, so there is this company called, uh, CoreWeave in, in the US. I think it's gonna IPO pretty soon. It's the first, like, pure data center play that, that I've seen. Like, it's not a, it's not a big tech data center. Uh, NVIDIA owns a big chunk of this company. Um, and, and I, I think, like, the, the way they compete against the rest is they do the build-outs faster. Uh, and, and, uh, OpenAI is using them, and a bunch of others are using them. So if you can provide training GPUs to people in India, uh, much faster and, and, and, like, cheaper prices, potentially cheaper, because the data center build-out costs might be lower, because labor costs are lower, uh, there, there's probably something there. I hope at least for inference, it makes a lot of sense because data sovereignty might be a thing. So let's say, even for companies like us in future, if the government of India wants, like, the data of, uh, people using Perplexity AI to stay in India, then it makes sense to have, like, you know, even American companies or for other, other companies outside India to be using the data centers built out in India, so that the data is stored in India.
- NKNikhil Kamath
I, I think it'll happen eventually, invariably.
- ASAravind Srinivas
Yeah.
- NKNikhil Kamath
Uh, now the financial data sits out of India.
- ASAravind Srinivas
Yeah.
- NKNikhil Kamath
And India creates something like, I don't know, 20% of all the data because of the number of people with smartphones. So the assumption is it will happen, and hence everybody's talking about the data center business. But structurally, there is nothing that is changing in the data center business?
- ASAravind Srinivas
I don't expect it to be a pretty high-margin business of its own unless you combine it with good software.
- NKNikhil Kamath
... And what would software look like for a data center? Is it like the API-
- ASAravind Srinivas
Spin up, spin up jobs, um, easily host models, um, have the Kubernetes support for, like, scaling instances.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
Uh, that's kind of what the cloud companies have shown, right?
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
Um, maybe in the short term, if you're the only one who can provide a data center in India-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... you're gonna enjoy good margins. But long run, you should expect more people playing the game.
- NKNikhil Kamath
Yeah. No-
- ASAravind Srinivas
Yeah
- NKNikhil Kamath
... there, there are many providers already. There is maybe a gigawatt worth of data centers. I mean, I'm not sure of the exact number, but it has scaled significantly. The question is: does it continue to grow in this manner, where... At the end of the day, it's a very commoditized business. It's almost like a real estate company starting a warehouse.
- ASAravind Srinivas
Yeah.
- NKNikhil Kamath
I'm, I'm not able to distinguish if one has IP over another. And the other big worry-
- ASAravind Srinivas
Not really, until you have, like, some vertical integration done pretty well.
- NKNikhil Kamath
And the other big worry is, does this become such a big business that the hyperscalers build their own and do not go to a third-party vendor?
- ASAravind Srinivas
Possible. I mean-
- NKNikhil Kamath
Yeah
- ASAravind Srinivas
... hyperscalers actually build their own data centers everywhere-
- 1:49:42 – 2:02:47
India’s Role & Scope in this Industry
- NKNikhil Kamath
w-what is India's role in all this? Like, say, like I said earlier, like, this is genuinely how I feel. You know, Gen Z uses a particular word. They say FOMO all the time, like fear of missing out. I face that on a daily basis 'cause I keep reading about AI, but it does feel to me like, you know, the match is happening in another geography, and I'm, I'm talking to the commentator's friend about what is happening or reading what he's saying on Twitter or X. What, what can India do? Or what should it do? And you can be, like, honest about this, like, because there's something we want to incorporate, and we want young people to go out and try at least.
- ASAravind Srinivas
Uh, I've, I've said this before, I, I think India should definitely train its own models, um, and not-
- NKNikhil Kamath
But wouldn't we arrive at the same answers that the incumbent models are arriving at if the data is largely democratized and our data is also part of the training pool?
- ASAravind Srinivas
It doesn't matter. I, I, I think we should still build our own models because there's so much more work to do on the models to make them reason and think and, and, and be good at things they're not good at today, and, and, and be more agentic and do tasks and stuff like that. Um, and India should have its own, like, DeepSeek-like company-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... uh, that, that, um, trains models and, like, competes not just on Indian languages, but on global benchmarks. And that will inspire the next generation of, like, engineers to come and work in those companies and, and, and build out the future.
- NKNikhil Kamath
Outside of fundamental models, I'm, I'm guessing this requires serious hardware and a reasonable amount of money.
- ASAravind Srinivas
Yeah, data centers, chips-
- NKNikhil Kamath
Yeah
- ASAravind Srinivas
... models.
- NKNikhil Kamath
What does somebody young do? Like, say, a twentyfi- five-year-old boy or girl sitting out of Bangalore or Chennai or Mumbai or Delhi, what do they do specifically, like today, with no resources?
- ASAravind Srinivas
I would hope, like, they can raise some venture funding and try to do something ambitious.
- NKNikhil Kamath
Yeah. Let's assume they're able to raise a million dollars 'cause AI is hot right now. Then?
- ASAravind Srinivas
Well, uh, it's pretty hard to do something meaningful with a million dollars, but-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... certainly doable. Um, the way I would do it is I would build a product that's pretty interesting and new, uh, get users, raise more money, um, get more users, and raise one-- little more money, and then start to build your own models. Uh, start with post-training on top of open source models, then start to, like, look into pre-training, too. And, um, then get into data centers. Like, it's a multi-stage process. That's what I would do if I could start small. But if you're already established, if you're not, like, this twenty-five-year-old young person, if you're already somewhat established, you have a presence, you have a name in the field, or, or, or are able to attract investments of higher magnitude, then I think you can go for the more ambitious targets right away.
- NKNikhil Kamath
Is there any, like, nuanced, low-hanging fruit that Indians are not taking advantage of? Who want to start off? I don't know, maybe language, maybe we have access to.
- ASAravind Srinivas
I think voice. Uh, most of the AIs are pretty bad at Indian voices. Uh, the, the speech recognition and speech synthesis are not necessarily good.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
That's a place where you can make a clear difference, 'cause-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... it's not a high priority for the Western labs to make it work. And there are, like, so many dialects and languages, and, like, I think Indians are also more, um, mobile app users, and so voice is a more natural form factor of interaction.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
So really having that amazing real-time AI voice synthesis, but, um, broadly, like, support for all the Indian languages, nailing the dialects and accents and grammar would be a big deal. Um, it's, it's easier said than done. It's not a-- It's not as easy as just collecting data. You have to do a lot of evals and training and, like, iterations.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
But it's definitely something that will matter a lot for the Indian market, more than anybody else.
- NKNikhil Kamath
Because you're an investor as well, would you buy NVIDIA stock today?
- ASAravind Srinivas
I have exposure to it. [chuckles]
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
So, uh, I'm, I'm not selling, I'm holding, and I think I believe in... Like, basically, everybody's gonna try to build superintelligence and general intelligence, and, uh-
- 2:02:47 – 2:05:26
Aravind’s AI Platform Recommendations
- NKNikhil Kamath
as somebody who doesn't understand technology too much, such as me, that I have to use to get better? Uh, better at business, better at more efficient as a person.
- ASAravind Srinivas
I mean, I, I, [chuckles] I'd love to say Perplexity, but, uh-
- NKNikhil Kamath
I use Perplexity already.
- ASAravind Srinivas
Okay. Um, I think you should definitely give, um, a shot at, um, Cursor. It's like a coding assistant.
- NKNikhil Kamath
What does Cursor do?
- ASAravind Srinivas
Cursor is a coding assistant. Like, you, you, you can-
- NKNikhil Kamath
Okay.
- ASAravind Srinivas
It helps you write code with an AI.
- NKNikhil Kamath
Even if I know nothing about writing code?
- ASAravind Srinivas
Right. You can just go and ask it to say, "Hey, I wanna build a website with so and so. Generate the code for me." But if you're like: I don't even wanna, I don't even wanna, like, be in charge of deploying it, I think there are some-- there's this thing called Replit or Bolt, where you can just go and describe an app you want to build, and the agent will build and deploy it for you. And I think that's where things are heading to.
- NKNikhil Kamath
Bolt.
- ASAravind Srinivas
Um, Bolt, B-O-L-T, or Replit, R-E-P-L-I-T.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
And, uh, sure, it's not gonna work perfectly, um, but I, I, I feel like this is where things are headed, where I can just... You don't have to be a software engineer anymore to build an app.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
And that's really-
- NKNikhil Kamath
But do you need to know a little bit of coding or a little bit of maths, maybe?
- ASAravind Srinivas
No.
- NKNikhil Kamath
No? But will I be able to produce an app via this method, which is as good as somebody who is a software engineer?
- ASAravind Srinivas
Not today.
- NKNikhil Kamath
Right.
- ASAravind Srinivas
Um, as good as maybe like, um, lower level or, like, lower-tier software engineer, yes.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
Uh, not as good as, like, the, the, the, the good ones or the be- best ones.
- NKNikhil Kamath
So if I were to have a kid, I shouldn't send him to a engineering college to study coding?
- ASAravind Srinivas
I think it still helps to be very good at infrastructure, back-end-
- NKNikhil Kamath
Mm-hmm
- ASAravind Srinivas
... uh, data centers, like, uh, floa- flo- floating point arithmetic, storage. All the core fundamentals are not going away. In fact, like, I would say they're [chuckles] very essential in a world where AIs are taking care of the front end and the UI and, um, all that stuff, because you have to know where the data lives, you have to know, like, how it is stored, you have to know how it's deployed, and you have to know if a system goes down, how to fix it, debug it. Those things are still useful.
- NKNikhil Kamath
Mm-hmm. And last one or two questions:
- 2:05:26 – 2:08:43
Where AI is Headed Next
- NKNikhil Kamath
What is the future? If you were to, like, predict the next five years, do you have-- You must have thought of this.
- ASAravind Srinivas
Yeah. I think we'll all have, like, a personal assistant. It, it's gonna feel really amazing. Um, it's not gonna be a luxury thing anymore. Um, it's not just a thing billionaires had access to. Uh, uh, it's gonna feel like an iPhone, where the same phone, uh, that, that the president of the US uses, you're gonna be able to use, too, if you... It's, uh... And, and by that, I mean it's gonna be pretty affordable. And, uh, that's gonna make life a lot easier. Um, and, and, um, people are gonna be able to build personalized things for them. Um, and, uh, there's be a lot more creative expression. Like, what- whatever you want to exist in the world, you can make it happen. Not, not everyone in the world earlier used to be able to make something happen when they wanted to. They would use other people's creations. I think that's gonna change, and that's, that's gonna feel very utopian. That's the nice part of it. [chuckles] The dystopian part of it is, um, unfortunately, in the short term, there's gonna be s- a lot of labor displacement. Uh, not as many people are needed to get a work done anymore. Uh, and so how people upskill themselves and adapt, uh, those w- who are using AIs are definitely gonna be well positioned. Um, so all that stuff's gonna take place, and how people react to it is already like, you know, not-- you don't need, um, to build ten thousand people companies to be a trillion-dollar company anymore. So definitely, where, where are the next generation of graduates getting jobs? Existing big techs are laying off people or, like, not hiring more. So all this stuff's definitely gonna impact, like-... the market. And, uh, it's very interesting that simultaneously we're creating new value and making software creation easier, and, uh, we're also, like, displacing existing labor and value. So how people deal with all this is gonna be interesting to watch, and, and, uh, I don't think anyone really knows how it'll all play out.
- NKNikhil Kamath
Will the world be more complicated if a lot of this power, access, and determining the path forward is-- the decision-making lies upon one or two geographies, like it's playing out today?
- ASAravind Srinivas
I think, um, the-- I think the technologies will be broadly accessible, uh, and, and, uh, secrets are not gonna be lying in one or two places. And open source will ensure there's sufficient distillation to the rest of the world. I think what won't be democratized is access to compute, mainly because it takes a lot of money.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
Uh, a-and, um, that really depends on which countries choose to invest early on and later on in the process.
- NKNikhil Kamath
Right. I don't, I don't know what to ask you. Uh,
- 2:08:43 – 2:16:17
AI Regulations | Tackling Complications
- NKNikhil Kamath
I have in my notes that I should ask you about regulation and the future of that. I don't know how to... I've read a fair amount about this, and how a lot of people think that the incumbent AI players are, are trying to use it as a moat almost, and capture the regulatory thing. Like, do you have any view on this? Like, how should regulation-- Let's say the government of India is listening or watching this show, what would be the right way for them to regulate AI? And then, B, what is the right way for America to regulate AI?
- ASAravind Srinivas
Um, I mean, I, I, I think, like, regulating models is not necessarily a great idea, uh, and it's not gonna work in practice either. Uh, people are still gonna be able to download a model and use it. Uh, I, I think the best way is to regulate applications. Like, uh, personally, what I feel is pretty, um, concerning at this point is probably people using chatbots when they're kids, and developing, like, relationships with them, um, a-and, like, feeling suicidal when, when they don't get to, like, enjoy the chatbots anymore, or they don't respond in the way they want to. [inhaling] And, um, f-- kinda like taking your lonely-loneliness out on, like, an AI chatbot. All that stuff is pretty... I, I, I find it concerning, like, maybe some people don't, and they don't care, and they just think this is not any different from how the internet used to be.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
But I think it is different. So thinking about that application and, like, how do we make sure AI usage by kids is done on apps that, you know, are productive, and useful, and knowledge-enhancing, rather than feeling too companionship-like, i-is worth thinking about. Um, I don't think, like, other stuff is worth regulating as much today.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
Um, [inhaling] and, uh, we're, we're kind of still, like, very early in AI, that moving slows is gonna cost us a lot long term. And lot means, like, hundreds of billions or trillions of dollars. So it's best to keep accelerating right now, and be mindful of, like, use cases, like what I described, that are clearly, like, dangerous, but more-- o-otherwise, like, be pretty open-minded and build stuff, and see how things play out. And I don't have a different answer to America or India. I think it's the same answer here.
- NKNikhil Kamath
Will the world get to a point, as it gets more complicated, that we all try and own our data a bit more? Where-- like, let's assume a, a model today is scraping data from across the internet. Will the world go in a direction where Indians own Indian data, um, maybe like another country owns their data, and every model has to pay a fee to use that data as an input to train their models? In the sense, will things move behind a paywall, or even if they don't want to move behind a paywall, will there be a fee?
- ASAravind Srinivas
It's possible. Um, I, I, I think, like, in general, the internet has been global and fair use so far. I don't expect it to change. Um, I think if there are some tokens that are pretty valuable, a-a-a-and then people might want some kind of, like, token payment for it, uh, it probably won't be on the internet. That's my guess.
- NKNikhil Kamath
Don't you find, like, that's happening already, more of it? Like, right now, I find so much on the internet, which appears interesting, but it's behind a paywall. But the question also will be that, me, as an individual, if I consume behind a paywall, a model which is then in turn going to distribute what is behind a paywall, should they pay the same fee or should they pay different fees?
- ASAravind Srinivas
I genuinely don't know, because, like, the models are definitely, like, training on the content, so they're... Those who are training foundation models, they're, they're not just, like, consuming the content once, they're actually, like, distilling it, so they never have to consume it again.... so it's a different kind of consumption to a human just reading an article?
- NKNikhil Kamath
Right. But even when I read an article, I consume it once and distribute-
- ASAravind Srinivas
Yeah, but like, your, your memory and the model's memory are not comparable.
- NKNikhil Kamath
Right. But I'm not distributing it. But the model is-
- ASAravind Srinivas
Kind of, like you, you might, you might share the article with someone else, like say, "Hey, did you read this news?" So you're attributing to it or you're, you're gonna use the wisdom you learned from it in some manner. Um, I mean, in Perplexity, that's why we source-- we attribute it to a source. Like, we, we, we don't like say it's our content, and that way we give credit to the source, and we're not actually training on the data. But ChatGPT is different. They, they actually train on all the data.
- NKNikhil Kamath
Right. Okay, last question, Aravind. [clears throat] Because I'm feeling so left out in all of this, do you think it might be possible for me to come be an intern, work for maybe three months at Perplexity, free of charge?
- ASAravind Srinivas
Well, you're, uh, way more accomplished for doing that, but, uh-
- NKNikhil Kamath
No, but I'd love to. Like, this is genuine. Like, I feel like I'd love to come live there for a couple of months, learn some stuff, and come back, 'cause I do feel like I'm not learning enough right now.
- ASAravind Srinivas
I mean, we'd be very honored to have you, and, um, I think, um-
- NKNikhil Kamath
I'm not joking, huh? I'm just gonna, like, be there in the next thirty days, maybe.
- ASAravind Srinivas
[chuckles] Sure, we'd love to host you.
- NKNikhil Kamath
Testing you every day.
- ASAravind Srinivas
Would love to host you. Uh, I guess I'd just say I, I, I love the spirit of how you are like, uh, having this learner's mindset. I, I think it's very inspiring and refreshing, so I don't think there's a lot you're missing out on. The internet has pretty much everything out there. Um, and the world is, like, running super fast that, like, physical access matters way less anymore.
- NKNikhil Kamath
Mm-hmm.
- ASAravind Srinivas
I think it's more the amount of time you get to spend yourself with an AI model-
- NKNikhil Kamath
Mm
- ASAravind Srinivas
... using these apps, understanding where they fail, and, um, talking to the best people. But in- interestingly, like, X has all of them literally talking all the time, real time.
- NKNikhil Kamath
Mm.
- ASAravind Srinivas
It's, uh, pretty nuts, so, um-
- NKNikhil Kamath
So it's not so much as learning from the model, but being around people who, who know what they're learning or who-
- ASAravind Srinivas
Yeah
- 2:16:17 – 2:16:30
Outro
- NKNikhil Kamath
this, and-
- ASAravind Srinivas
Thank you, Nikhil.
- NKNikhil Kamath
Uh, you're gonna be in India soon.
- ASAravind Srinivas
Yeah.
- NKNikhil Kamath
So if I'm not there, I'm gonna host you when you're here in India.
- ASAravind Srinivas
Yep.
- NKNikhil Kamath
[chuckles] Done. [upbeat music]
Episode duration: 2:16:30
Install uListen for AI-powered chat & search across the full episode — Get Full Transcript
Transcript of episode y5Ewu8wYgqM
Get more out of YouTube videos.
High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.
Add to Chrome