Uncapped with Jack AltmanMike Volpi on Why AI Breaks Traditional Venture Capital | Ep. 52
EVERY SPOKEN WORD
60 min read · 11,706 words- 0:00 – 0:39
Intro
- MVMike Volpi
The kind of classical marketing efforts that have been done for brand building, particularly in venture, s-sound off-key-
- JAJack Altman
Mm.
- MVMike Volpi
-to your average twenty-two-year-old entrepreneur. I think what does resonate is inside knowledge, tips, connections, network, all those things which are kind of indirect but organic ways of building brand. Yes, brand is important, but I think you wanna build it organically. [upbeat music]
- JAJack Altman
All right. I am really excited to be here today with Mike Volpi, who is probably one of the most successful venture capitalists of the last couple decades, and now building your own new firm, and I'm really looking forward to learning from you, so thanks for doing this with me.
- MVMike Volpi
Are you kidding? It's a pleasure, and I've already fooled you. [laughs]
- JAJack Altman
[laughs] Well, that's one.
- 0:39 – 4:02
Building a venture firm for AI
- JAJack Altman
One of the things I wanna start with talking to you about, which I thought would be kind of interesting just 'cause, you know, I also, um, gave, gave my shot at it, um, is just, like, building a new venture firm. You obviously have had this incredible run at, you know, a great firm at Index for a long time, and now you're building your own firm, which you've been doing for the last, I don't know, year?
- MVMike Volpi
Year and a half.
- JAJack Altman
Year and a half. Obviously, you've been really thoughtful about how you wanna do it and, you know, what the trade-offs you wanna make are and what the firm design's gonna be and what's the strategy. So I guess I wanted to start, when you were thinking about creating a new firm, what did you sort of start by thinking about? What were, like, the key considerations as you got going?
- MVMike Volpi
The first is somewhat obvious but very important, which is it's very hard to disrupt a market, to break into a market, unless there's something macro that's happening that's an enormous change. Obviously, AI is that. So, uh, the first thing is to take a firm that's new and deadly focus it on whatever gigantic wave is hitting the industry right now. 'Cause if you tend to do the, you know, spread the peanut butter thing, it's just never gonna work. So first, A, identify that there is a massive trend. Two, absolutely focus on it. The third thing I would say is gather people who are not only fluent but just have grown up and live whatever this new trend is. I do think that there is a big generational shift right now between sort of classic entrepreneurship, classic venture, and this new generation of AI venture, and some people are more predisposed to it than others. The last thing I would say is you have to be very careful about your past success. This is, I would say, very true for individuals, for yourself, and it's also very true for firms. And the more success a firm has had, the more, to use an AI term, reinforcement learning there is of how things were done, and if the world shifts to a place where things are done a little bit differently-
- JAJack Altman
Yep.
- MVMike Volpi
-that reinforcement could be applied very incorrectly.
- JAJack Altman
I actually think this, like, past success reinforcement loop thing explains why a lot of, for example, like, execs from pre-AI SaaS are, like... That-- It's really difficult to adapt-
- MVMike Volpi
Yeah.
- JAJack Altman
-because you learned a whole set of things that don't make sense anymore.
- MVMike Volpi
Yeah. The whole concept of software is changing. Basically, most venture capital firms are focused on making money on software companies, and that foundation is based on the idea that software is complicated, expensive, and takes a long time to build. And it makes... It costs very little to make lots of it, but it costs a lot to make the first edition of it. And so then you're in this world of, "I have a high fixed cost thing which I need to sell to as many people as possible." Every business model starts looking like that. Then you move into an AI era, which takes the cost of making software way down. You're completely shifting the core assumptions on how a business is built, and that then extends into everything from go-to-market, engineering, fundraising, h-which customers you target first. How do you target your customers? Should it be a product-centric company or a service-centric? All these assumptions kinda blow up. So if you've had sort of a, a f- a firm as an investor that's been structured to invest in a certain type of company with a certain type of people and that base assumption changes, the cost of making software is now super low, you blow up everything. And so if you get stuck with the old way of doing it, you're probably gonna invest in
- 4:02 – 5:52
Designing Hanabi
- MVMike Volpi
the wrong companies.
- JAJack Altman
You obviously invested in a certain way over the last, you know, years at Index, and you had a certain, I don't know, ownership model, stage you like to do, all the rest of it. When you came in with Hanabi and you're like, "I've got a blank cl- blank canvas now, and I need to not train on what I did wrong. I wanna learn from the good stuff. I wanna not, like, you know, bring the bad stuff," what did you think about from a firm design perspective when it comes to, like, let's say, the types of deals you were gonna do, the stage, like, the ownership, the size checks, the dispersion of all that stuff?
- MVMike Volpi
Well, let's start with the people. Um, first of all, I thought, you know, AI is a, uh, relatively complex and deeply technical field, and therefore, the people that I have at the firm should be native speakers of that new dialect. The number of people that were focused on AI and machine learning pre-two thousand and eighteen, nineteen is incredibly tiny. So essentially, the volume of people that are, I'll call it, a-a native human beings have a professional depth of five to six years max.
- JAJack Altman
How big of an, of an advantage is it if you got into AI in twenty eighteen versus twenty twenty-four, let's say?
- MVMike Volpi
Uh, reasonably substantial, but not massive, I would say.
- JAJack Altman
Like, you can catch up?
- MVMike Volpi
You can catch up.
- JAJack Altman
Yeah.
- MVMike Volpi
You can catch up, but, you know, you gotta have a foundation, like how does it work? Why does it work? What are the flaws? How quickly does it evolve? Do you understand compute? Can you talk semiconductors? What's a GPU versus CPU? Why? Memory, high bandwidth, like, all this stuff. Like, unless you sort of are genuinely fluent in tech, these are not conversations that you're gonna easily have with your counterpart, the entrepreneur. So you gotta look for people that are pretty damn techy and are pretty damn young.
- JAJack Altman
Mm-hmm.
- MVMike Volpi
You know, when you build from scratch, the complexity is finding such people in this industry that wanna be VCs. It's not the easiest thing in the world.
- JAJack Altman
Yep.
- MVMike Volpi
But A, you, you look
- 5:52 – 9:38
Why stage matters less
- MVMike Volpi
for that. The second kind of idea that's very important is in venture capital, we've talked a lot about stage centricity. We are an early stage firm. We are a mid stage firm. We do growth. We do pre-public.
- JAJack Altman
Yeah.
- MVMike Volpi
We're crossover. Everything is defined by stage. I don't think that idea applies in this point in time because I could invest in a company At 10 billion in valuation, and three years later, it could be worth 380 billion. In essence, what you have is a suite of companies that we would now consider growth stage-
- JAJack Altman
Yeah
- MVMike Volpi
... but that represent venture-like return characteristics.
- JAJack Altman
It's also probably the flip side of that is, you know, there was probably a point in time when investing in something that was worth 10 billion, the downside risk was also probably very different than it is today.
- MVMike Volpi
Yeah. But honestly, like you can't sit around VC and worry about downside risk. I mean, if you're gonna lose your money, you're gonna lose your money.
- JAJack Altman
No, I'm just thinking about, you know, there were growth investors who at one point in time-
- MVMike Volpi
Oh, yeah
- JAJack Altman
... could, you know, they could... I'm gonna get my three Xs when it works, and I'm gonna get my money back when it doesn't, and now it seems like there's still venture outcomes from much later stages-
- MVMike Volpi
Absolutely
- JAJack Altman
... in the business.
- MVMike Volpi
I mean, when I, when I got started in this industry, growth investors would be like, "Oh, I'd like a three X lick pref, and I might triple my money and whatever." And now I think you can genuinely go into a company at, you know, you would g-get into Anthropic at 60 billion, and you're gonna get like 10X plus return on it. So I think you have to be ignore stage, observe the size of the opportunity, the magnitude of it, and so forth, and in some cases, you're finding two people in a garage and you're helping them build the business, and in some cases, you're piling in Anthropic at 380 billion.
- JAJack Altman
Mm-hmm.
- MVMike Volpi
And they, they have... Literally all of those have 10X plus possible outcomes, so I think you, you just don't pay attention to that.
- JAJack Altman
I wanna stick with that topic for a second. I think it is an idea that is maybe still not the mainstream idea, but definitely more people are s- operating in this way where, you know, you can, you can sort of choose what boundaries you create. The stage one has gone away in favor of other things. Do you think that you're able to do that as a result of experience, or do you think a early career investor is also equipped to both traffic and pre-seed first money investments and also make assessments at the growth stages?
- MVMike Volpi
Let me phrase it this way. On the assessment side, so being able to, uh, effectively value very different stage companies can be done by the same person. It's not that hard. Like, you know, looking at a spreadsheet is not rocket science for the average engineer. What is trickier, one of the things that I still think in this era and in prior eras is important, is the proximity or, or affinity you have with the founders. If you're investing in two kids coming out of OpenAI right now, and they're 22 years old, and you're a young new investor, you can definitely do that. It's not likely that you'll be able to establish that relationship with Dario. So I think the advantage I have is that I can play that, you know, relationship game with some pretty senior folks because of my experience, but also appreciate that I need to build that relationship with a 25-year-old. Now, some of the younger people on my team don't quite have the ability to go up to Dario or Sam and establish a relationship with them, which is understandable. My job is to start to open up that pathway for them so they can. But I do think the assessment of the fact that, you know, Cerebras is an interesting investment at the pr- at the price that it was done, or that, you know, uh, uh, OpenAI might still be interes- th-that any-anybody can do is just look at the math and see what it looks like and expect some level of multiples. It's not that hard to make the decision. I do think it's hard to get in at a growth stage if you don't quite have the reputation.
- JAJack Altman
When you thought about, you know, building this, not just as, you know, creating great funds, but also, you know, sort of building a firm, what are the other things that you've thought about? Like have you thought about... You know, and we've talked a little bit about team, the stage and focus and
- 9:38 – 13:58
Building a venture brand
- JAJack Altman
things like that. Have you thought about things like brand, infrastructure, you know, sizing of the funds over time? Like what, what are some of the other attributes when you think about building like a new real venture capital firm?
- MVMike Volpi
I still believe brand is super important. Brand is probably even more important when your purchaser, the i.e. the entrepreneur, is not incredibly well-informed. It's like, you know, what is brand? Brand is basically a way of summarizing the value proposition that a product has to the prospective buyer, because the prospective buyer is an expert. You know, you buy a Mercedes-Benz. Why? I don't know anything about the engine or the reliability or whatever.
- JAJack Altman
You just know it's good.
- MVMike Volpi
But you just know it's good.
- JAJack Altman
Yeah.
- MVMike Volpi
Right? That's what brand is. And if you think about entrepreneurs being younger and having less network in the world of capital, brand is very important. So I do think you have to be super conscious of brand. However, the creation of that brand has to be done very differently, which is to say, in the old world of brand, you know, you, you could use marketing good stuff. Like, you know, you put out super professional content and banners, and you sponsor this conference and so forth. I think in this modern era, there's an enormous amount of transparency, and so brand gets conveyed in a much more organic way, person by person, reference by reference. So it's less about, did I sponsor this conference or is my banner over here?
- JAJack Altman
Yep.
- MVMike Volpi
And it's much more about what impression do you convey to a person that you interact with, which spreads, and then people get to know you.
- JAJack Altman
Yes.
- MVMike Volpi
Right? So I think the kinda classical marketing efforts that have been done for brand building, particularly in venture, s-sound off-key-
- JAJack Altman
Mm
- MVMike Volpi
... to your average 22-year-old entrepreneur. They're just... It's doesn't resonate.
- JAJack Altman
Yeah.
- MVMike Volpi
I, I think what does resonate is k- inside knowledge, tips, connections, network, all those things which are kind of indirect but organic ways of building brand. So yes, brand is important, but I think you wanna build organically.
- JAJack Altman
Billboards aren't the right thing. I heard somebody did like a survey of college students and what VC firms, and interesting on this point, Thrive was ranked really highly, and they don't do a lot of, you know-
- MVMike Volpi
Exactly
- JAJack Altman
... they're not, it's not loud, there's not tons of blog posts, there's not all the other stuff, and-
- MVMike Volpi
Yeah, I think, look-
- JAJack Altman
... but the brand
- MVMike Volpi
... Jo-Josh and his team over there are probably the prototypical built a brand on the down low versus the You know?
- JAJack Altman
Totally. There's also when you feel like you're in on a secret. You know, when you've, when you know about it and if you know, you know brand, that's worth a lot more to people.
- MVMike Volpi
100%.
- JAJack Altman
But how does that get cultivated, I guess, is one of the que- you know, like, um-
- MVMike Volpi
Well, it's, you know, over time, succe- you know, Hermes doesn't exactly do big brand ads.
- JAJack Altman
Yeah.
- MVMike Volpi
You just know it.
- JAJack Altman
I also think, um, I'm sure you've probably felt this just over the course of your career, but probably over the long term, making good investments is probably the number one thing and, you know, being able to sit with the founder and say, "I've invested in these companies," and then-
- MVMike Volpi
I think that helps. I, I... look, I, I think, at least from my own experience, what I find is, like, having made some good investments, i.e., I know what I'm doing, is a good one, but also just, uh, people saying, "Look, so and so was very, very helpful in these particular moments in my company's evolution. When this happened, they were helpful in this way. When this happened, they were helpful..." You know, you're on the board of somebody-
- JAJack Altman
Yeah
- MVMike Volpi
... and they say, "Who's your best board member?" And if, if you're that person-
- 13:58 – 17:06
The role of board seats
- JAJack Altman
How do you think about leading in board seats than in contrast to participating and, you know, maybe having, like, a slightly less engaged relationship? Do you do both?
- MVMike Volpi
Hanabi is a small fund, uh, and you know, we op- we manage $175 million. So leading a Series A in this day and age, which probably ranges between 15 on the low end to 25, 30, not broadly generalizing, very hard to do with my size fund. So for now, we generally lead seeds, co-lead a few Series A's, deploy some capital against big companies that we think are gonna be even more successful. I do think that at some point in the future, maybe with a little more capital, we'll try to lead some things. But I also think that the idea of classic lead may not be as relevant in the future, meaning, you know, again, this is classic VC role. I wanna own 15% of the company or 20% of the company at Series A. Okay, that's, that's nice. First, it's probably incongruent with what the entrepreneur wants. But then again, would you own 20% of some schmo company or 1% of Anthropic? So I think there, too, you sort of need to relinquish this need to, like, lead, not lead, whatever, and deploy capital into good companies. If you can deploy it as a, you know, 4% owner or an 8% owner, just deploy the capital. And then these companies create such disproportionate value over time, just pour more money in, more money, more money, more money. Even at higher valuations, just put more of it in because they're great companies.
- JAJack Altman
Yeah.
- MVMike Volpi
And so I think that's one of the kind of historical VC rules that we have to let go a little bit of, like, I must own this much in the beginning. Own a reasonable amount.
- JAJack Altman
Then buy more over time.
- MVMike Volpi
And then buy more over time. Now, what does that mean in terms of board membership, not board membership? It's a badge of honor for a VC to say, "I'm on the board of that company." In my case, you know, I've done this for a while. That's not... I don't need that badge of honor anymore. But I will commit to spending a lot of time. And so basically, almost every investment that I've made as part of Hanabi, I will do weekly, biweekly, or at least monthly check-ins with founders, go on a walk with them, spend an hour with them. Uh, in some cases, for the younger companies, it's literally, like, weekly. A, I find that a lot higher bandwidth in board meetings. Like, I, I, I've done enough board meetings to last a few lifetimes at this point, and I don't find them as productive for knowledge extraction.
- JAJack Altman
Mm.
- MVMike Volpi
And I think it helps the entrepreneur more with what matters to them in the moment.
- JAJack Altman
A lot of it is, like, managing their execs and things like that a lot of the times.
- MVMike Volpi
Yeah. There's, there's so much stuff.
- JAJack Altman
There's all sorts of stuff that's not-
- MVMike Volpi
Everybody's got, like, you know-
- JAJack Altman
Yes
- MVMike Volpi
... when you're a founder, like, okay, this week I got this issue. Next week I got a different issue. Next week I got a-
- JAJack Altman
Yeah
- MVMike Volpi
... so yeah, once a quarter you prepare a deck, and you sit around and read the deck, and, you know, all, all the three guys that are observers wanna say something useless.
- JAJack Altman
I agree.
- MVMike Volpi
Like, you know, companies-
- JAJack Altman
Once they're big, they're useless, I think.
- MVMike Volpi
Yeah.
- JAJack Altman
A small board meeting is a good forcing function to get everybody together, but once they're big, I-
- MVMike Volpi
I completely agree
- JAJack Altman
... it becomes a different thing.
- MVMike Volpi
I have done some board seats. I don't make it in any way mandatory, but I do make it mandatory to invest the regular time one-on-one-
- JAJack Altman
Yeah
- MVMike Volpi
... or one-on-two, depending on how many founders they
- 17:06 – 20:44
Attributes of enduring firms
- MVMike Volpi
have.
- JAJack Altman
When you think about going from, you know, a good early fund, couple funds, what do you think will allow for a new firm to break through into the sort of like multi-decade, this is now a truly established firm? You know, like, do you think that'll be a function of the brand asce- ascending to a certain place? Is it a function of getting to a certain size? Like, what do you think is the thing that leads to, all right, this is now one of, you know, the institutional firms?
- MVMike Volpi
When you take this job of a venture capitalist and really distill it down to its, its barest bones, uh, attributes, I think there's four things that matter. You need to find opportunities, so discovery sourcing is important. You need to have good judgment to decide whether something is good or not. You need to convince the entrepreneur to take your money, so you gotta be a salesman. And then lastly, you've gotta help them develop their business so there'll be a reference so that the other things work. Those four things matter. I think a lot of the other decorations that VC has become, where you have, like, 600 people at a firm to do spreadsheets... And by the way, nobody's gonna do any spreadsheets anymore. [chuckles]
- JAJack Altman
That's true, too. [chuckles] That's over.
- MVMike Volpi
I think you can have actually very compact organizations Of people that do those things very well. Doing those things very well take actually a fairly diverse skill set. So once you start trying to overspecialize, like, you know, this VC is a good sourcer, but they have bad judgment.
- JAJack Altman
Should never do that.
- MVMike Volpi
This one's a great salesperson-
- JAJack Altman
Yeah
- MVMike Volpi
... but they can't source. You know, this one's a great operating partner, but they-
- JAJack Altman
Now you're trying to stitch together like five people to do one deal.
- MVMike Volpi
No. So I would say the firms of the future are probably leaner and more concentrated to groups of people that are well-rounded at that suite of four skill sets.
- JAJack Altman
On that point, the way you described it, you know, was the loop of the strong reference from being a great board member loops back. You can't then transfer it to somebody else doing the next deal. Like, it almost has to be one person.
- MVMike Volpi
No, I agree. Venture capital has gone from this sort of, uh, boutique business to the scale business of, like, I administer $20 billion.
- JAJack Altman
And-
- MVMike Volpi
So if you wanna call that venture-
- JAJack Altman
Administer is a funny way to say it. [chuckles]
- MVMike Volpi
If you wanna call that venture, okay, then you have all sorts. But in terms of actually happen- helping companies grow and develop in, in, in true startup mode, then I think it's smaller firms with, um, that set of skills demonstrated by as many people in the firm as possible.
- JAJack Altman
I suppose also there's gonna have to be something around the sort of like the generational transition ability of the firm has gotta be like the thing that makes it last beyond the founders and-
- MVMike Volpi
Yeah, but I mean, you know, that's the trickiest thing at every single venture firm.
- JAJack Altman
Yeah.
- MVMike Volpi
This fact doesn't change, which is the, the loop in VC is very long, right? So you're a brilliant investor at Benchmark. You're making investments today. Benchmark will raise a fund, the next fund you do, not because of the work you did, but the, your predecessors. So is the credit due to them or is the credit due to you?
- JAJack Altman
Them.
- MVMike Volpi
And this is, well, I don't know, because you're gonna generate value for the capital that you're raising now. So I think when legacy investors get greedy on the economics in a firm, things go poorly.
- JAJack Altman
Yeah.
- MVMike Volpi
That, that is the quintessential failure mode of every venture firm, which is legacy partners who no longer do useful investments-
- JAJack Altman
Yeah
- MVMike Volpi
... take the disproportionate portion-
- JAJack Altman
It, yeah
- MVMike Volpi
... of the promote.
- JAJack Altman
It seems to me it's almost like it was clearly the last generation's work that earned the next fund, but you have to give it all away anyway if you want the thing to-
- 20:44 – 23:14
The future of AI labs
- JAJack Altman
kind of thing.
- MVMike Volpi
Yeah.
- JAJack Altman
I wanna talk about AI now. Obviously, you know, I know you're, you're fully AI pilled. The whole firm's around AI. So I wanna talk about, you know, a few of the ideas here. What I wanna start with is just sort of level setting on your overall, I guess, assessment of the state of play of AI. And maybe let's start with kind of like what you think is happening at the labs, at the sort of like core intelligence and, you know, I wanna talk about sort of where you think the, you know, advantages and edges are, what you think around sort of like compute and capital and scale of these things. Like, what's your read of sort of like, you know, the state of AI at the sort of central lab level first?
- MVMike Volpi
The first thing I would say is my mental model of AI is a stack of things that start at the bottom with, uh, foundries and then semiconductors and then core models and the infrastructure that's associated with building those. And then there's sort of, uh, you know, middleware and application layer software that sit all stacked on top of each other. I think you were referring to the big labs themselves-
- JAJack Altman
Right
- MVMike Volpi
... which sort of sit right in the middle of that pie.
- JAJack Altman
Mm-hmm.
- MVMike Volpi
My perspective right now is that the winners are the winners, and we already know. Um, I think, uh, you know, clearly OpenAI, Anthropic, Google, uh, I would throw Meta in the mix right now, and if Elon can get his act together at X.
- JAJack Altman
Yeah. Yeah. Those are the five.
- MVMike Volpi
Those are the five.
- JAJack Altman
Yeah.
- MVMike Volpi
Why those five? And that's because if you think about what are the vectors, what are the forces that make one model company better than the other one? Right now, compute and access- availability of, of compute and chips dominates. Compute is very highly correlated with capital, and you are talking about a group of companies that spend fifty to a hundred billion conservatively a year on compute. Now, you show up and you're a new company X, and you're like, "Hey, you know, I raised two billion." And it's like-
- JAJack Altman
Yeah
- MVMike Volpi
... nicely done. You're about an order of magnitude, if not more, at a disadvantage than your competitor. So I don't see a scenario. Until model architectures change, and they may change, it's the bitter lesson to me right now, even if you came up with a far better model, and you could argue that the way OpenAI and Anthropic do their things are le- are a little more clunky, they can just throw compute at it and blow you away. I don't see that landscape changing. They are the dominant force in LLMs. Now, there are other kinds of models-
- JAJack Altman
Yeah
- MVMike Volpi
... that could be kind of interesting, but-
- JAJack Altman
Yeah
- MVMike Volpi
... at least in that world, game over.
- JAJack Altman
Okay, so two follow-ups
- 23:14 – 32:49
Open-source and neolabs
- JAJack Altman
on that. The first is, um, what do you think about then open source? And so, like, obviously in the wake behind the frontier, you have open source, you know, let's call it six, whatever, nine months behind. Obviously smaller models, cheaper, you know, served by, you know, inference companies. And there's obviously a lot of utility there. Is that going to be an important part in your view of the next few years? Do you think that that's gonna sort of be at the edges no matter what?
- MVMike Volpi
Open source is a, is a relevant phenomenon, but not a business in AI. If you look at the overwhelming amount of prompting that's happening, it's against the most advanced models, and that's the most monetizable, right? So advanced models being queried over and over again is where the dollars are, and that will sustain. Open source can exist, in my view, in the context of, you know, somewhat far behind and somewhat reliant On various forms of distillations and techniques that the big guys have already done. So what that tends to do is if you think about the monetization curve, it, it, it commoditizes the tail end of the curve, but not the front end of the curve, and the big dollars are still in the front end of the curve. So I think there, there will be. The asterisk there is that as-- if you're creating an open-source model that's very close to the front end, you're by definition using a lot of compute, and you need to have capital, you need to have money to get that compute. And you're seeing even the most staunch open-sourcey firms not be so open-source anymore. The latest Qwen model is closed. Muse Spark is closed. That's not a coincidence. They're spending a lot of money training those models. They're not just gonna, like, open them up.
- JAJack Altman
Do you think the frontier labs will stop allowing third party to use their frontier quite as much because of the compute crunch stuff?
- MVMike Volpi
It is likely that that will be the case.
- JAJack Altman
Let's say that that happens, then what, what are the impacts of that? If, you know, the, if the big labs start to say, "Hey, you can sort of, you know, you can access our old models, but the new stuff is only first party."
- MVMike Volpi
Well, I mean, what it'll do is it'll cause the open-source stuff to be even further behind. And by the way, the- temporally, you can have blips. So, like, you know, Jensen can get the idea that he really wants an open-source model, so he can go to Reflection or whatever and give them ten billion dollars. One generations, they can catch up, and then-
- JAJack Altman
Right
- MVMike Volpi
... they, they'll fall behind again.
- JAJack Altman
But it's a one-time thing.
- MVMike Volpi
It's a one-time thing, yeah. You c-- I don't think it's continuous. I do think that you'll, you'll have-- I mean, open source will be relevant. It's relevant in one more context, which is, at least in today's world, and I don't know if this will sustain, but in today's world, if you post-train a lesser model enough, it will perform a small number of tasks just as well as the big models can, right? Essentially, open source can exist as the underlying layer of companies that are post-training them for specific personalized or business or corporate use. That exists, and there may be a business model somewhere out there if these post-training kinds of companies are quite successful, that they can provide financing for open source to be closer in to the big models. But open source out of the kindness of your heart-
- JAJack Altman
Mm-hmm
- MVMike Volpi
... which was the Qwen, the, the DeepSeek, Kimi, Llama.
- JAJack Altman
Doesn't make sense.
- MVMike Volpi
No. I mean, who's gonna go spend fifty billion dollars to give it away? I mean, it just doesn't make sense.
- JAJack Altman
It made sense for a minute, or what do you think was the argument for it at the time?
- MVMike Volpi
I don't think people forecasted how much money it would take to train these bigger models.
- JAJack Altman
Yeah.
- MVMike Volpi
I don't think people expected it. I think, you know, decisions like why was Llama free, my guess is the folks at, at Meta looked at all these people and said, "We can't exactly monetize this, but we'll try to commoditize their market by putting out something that's free." And I think that that's passed.
- JAJack Altman
Yep.
- MVMike Volpi
That's passed, clearly.
- JAJack Altman
Yeah. I mean, it seems like once we saw that it was tapping into labor budgets for real instead of, like, software spend, at that point, it's not really about price. It's about value.
- MVMike Volpi
Yeah, exactly.
- JAJack Altman
That's the open-source side. And then what about the neolab side? 'Cause that's, like, obviously the other potential vector here, and I would argue that's probably, like, one of, if not the hottest venture segments right now that is getting backed at, you know, huge dollar amounts, huge prices. Like, what's your read on why that's happening?
- MVMike Volpi
Yeah. Well, we largely have not invested in neolabs because of my thesis that the big labs are gonna win. It is difficult to imagine that there will be an algorithmic improvement, uh, that will allow a new lab to be competitive with the capital that the big labs are throwing at it. Not to mention the fact that the big labs, they're not sitting there clueless, like thinking like, "Oh, yeah, there's no other algorithms here." They're, they're doing their own research of what the next generation will be. I don't see a scenario where there's a more clever architecture to a model that outperforms dramatically the big guys. Now, there are a couple of areas that I find somewhat interesting, and they-- those usually sit in pockets where there is a set of proprietary data that the model can be trained on-
- JAJack Altman
Hmm
- MVMike Volpi
... that is not available to the big labs. So if you think about, uh, uh, the core of the training that happens for the large models, it's the Internet. The Internet, and the Internet is largely available to everybody. If there's pockets of the Internet that are not available, you can pay for it and open it up and get that stuff. Any model that sort of bases its training on Internet-available data is likely to not be as competitive with the big labs. However, there are pockets where you need, you need or have proprietary data. Uh, we're investors in Periodic Labs. Uh, why is that interesting to us? They create their own data through their own labs, and they do training and reinforcement based off of that. We are interested in robotics. Why? Well, robotics data is not broadly available on the Internet. However, you can either teleop it or have remote workers, uh, uh, create data, but you have to basically generate the data that your model trains on. So long as that data universe is reasonably private and not available to everybody else, then the people who have the right data strategy can actually stand out. So there are pockets where I think different kinds of models can be used for different kinds of orthogonal directions than the classic core models. But the neolab that comes along and says, "You know what? I'm really good at RL."
- JAJack Altman
Right.
- MVMike Volpi
"And, you know, because we do RL better, we're gonna beat the other guys." And I'm like, "You know-
- JAJack Altman
Day late and RL too
- MVMike Volpi
... OpenAI got the memo on RL. They didn't miss that memo." [chuckles]
- 32:49 – 36:51
The compute race
- JAJack Altman
What's your read on the overall compute situation? So like one framing of this is that basically like the demand for AI is just going absolutely vertical much faster than can, compute can get online. What do you think is, like, the likely ways this plays out? You know, if like the labs, you know, Anthropic adds ten billion of ARR, you know, a few more mon-- It's just like, how, how do you think this ends up shaping, you know, maybe down through the stack? You know, we were talking about the labs, but like what, what will the ripple effects be, and like, how do you think about this dynamic if demand really is surging at this rate?
- MVMike Volpi
It used to be that the demand for GPU compute was largely on training. Now, with this explosion in inference, you have the twin effect of bigger models being trained and tons and tons of inference running on the same systems. So that means that the load or the demand for compute is kind of skyrocketing, and it's likely that it will continue for some time. The supply side of that is basically TSMC wafer starts.
- JAJack Altman
Yeah.
- MVMike Volpi
There's only so many of those. So anybody that bought compute historically probably got it cheaper than anybody that will buy it in the future. And I think one of the very smart things that OpenAI did is they bought a lot, a lot, a lot of compute ahead of time. As a result, I think, Google aside, 'cause we can talk about TPUs in a second, but Google aside, they probably have the lowest cost of compute of any player in the market right now.
- JAJack Altman
Yeah, there's the price of it, and then there's also just the availability of it.
- MVMike Volpi
The availability of it.
- JAJack Altman
It's just like, you, you know, money doesn't get you more wafers kind of thing. You just gotta wait.
- MVMike Volpi
Yeah, exactly. On the other hand, the value, particularly on the inference side, that the value that people are seeing from the, the inferencing of these models is very high. Like, you know, you sit there and you do a spreadsheet, and you ask Claude to do the spreadsheet for you, and you go, "Wait a minute, I'll pay triple the amount of money that I'm paying for." So in some sense, we're getting into the fact that you'll be able to sell that, the output of that compute at a much higher price point in the future, given how productive and useful it is. Today, we live in a world where NVIDIA is the gatekeeper to all compute. Again, TPUs aside, 'cause that's a whole interesting side conversation of what Google decides to do with TPUs. I don't see that sustaining, and I do see more specialization in the kind of compute.
- JAJack Altman
You don't think NVIDIA's dominance will sustain?
- MVMike Volpi
No.
- JAJack Altman
What do you think will happen?
- MVMike Volpi
I think you're gonna have compute that is oriented towards specialized tasks that are not necessarily dependent on NVIDIA. So, for example, I'm a big fan of Cerebras.
- JAJack Altman
Totally.
- MVMike Volpi
Um, why do I like that one? It's not a particularly good training chip, although Andrew will argue with me that that's not true, that's not true. But, you know, let's leave that as where it is. In inference, it's a godsend. It's super fast, and it's made certain compromises that make it very, very good for that. I think that's one. I think we're gonna see more of that style of architecture that's very good for inference, for example. I think you're gonna see more of these. There's even Further evolutions of, you know, back in the old days, we used to call them ASICs, but if you look at Etched or Talys, these are companies that are fundamentally baking in some parts of the neural network weights into the chip itself, which will make it even faster than Cerebras, even less flexible than Cerebras. So I think that you're seeing this evolution towards mission-specific silicon rather than general purpose silicon, and that will happen and will take the load off of, uh, be- everything being Nvidia. But I do think that we're gonna do a lot of work in that bottom layer of the infrastructure to limit ours- liberate ourselves as an industry from a stranglehold of chips.
- JAJack Altman
Yeah. Feel like, um, the US probably can't invest enough, fast enough in this.
- MVMike Volpi
Already some, a bunch of the GPUs are being built in Arizona. Like, I think, uh, s-some of the Cerebras chips are ma- are made in Arizona. I know Intel is trying to come online with their fabs to do, uh, independent silicon. I don't know that that's still worked yet. But I do think we're gonna see a, a huge amount of capacity, and then obviously there's the geopolitical issue of Taiwan and, you know, I-
- JAJack Altman
Yeah
- MVMike Volpi
... can't imagine that that same situation will be true in five, six years.
- JAJack Altman
That would be great.
- MVMike Volpi
Yeah.
- 36:51 – 45:49
The future of software
- JAJack Altman
What about, you know, flipping to the other side, you know, we've been at the bottom of the stack, like the application layer. Obviously, over the last few years, there have been a bunch of amazing application companies built. Do you feel like there's durability there, and if so, what do you think the source of it is? Or, you know, what are the places that you think are risky? Not talking about pre-AI SaaS. I'm talking about like an AI native, you know, seeming application. I guess let's start there.
- MVMike Volpi
In a given business, there are two things that are fundamentally proprietary. One is we talked about data. Every business has a bunch of data, and it's their most relevant data. And the second one is business workflows, so how you do and conduct business. I think companies that can capture the data and the workflows that exist inside of a business or in a, in a given industry vertical that the big labs are unconcerned about or don't have access to those things can survive as application companies.
- JAJack Altman
Mm-hmm.
- MVMike Volpi
If your basic concept though is, you know, I take a document, I send it over to, to, uh, to OpenAI API or, or, or Anthropic API, it comes back and I show it to you this way-
- JAJack Altman
It's not enough
- MVMike Volpi
... that's not enough. What will also happen is over time, the, the OpenAI's, Anthropic's, and Google's of the world will l-look at the most interesting TAMs and saying, "Wait a minute, I'm gonna do that."
- JAJack Altman
Yes.
- MVMike Volpi
So, you know, there's Anthropic for legal-
- JAJack Altman
Yeah
- MVMike Volpi
... or Anthropic for finance or whatever.
- JAJack Altman
Yeah.
- MVMike Volpi
This is not their core business, so they're gonna have varying degrees of success.
- JAJack Altman
But it'll do eighty percent of the job.
- MVMike Volpi
But it'll do the damage. Business verticals, like if you're in construction, there's a bunch of workflows in construction that it's not likely that OpenAI or, or Anthropic or Google will care about.
- JAJack Altman
Also, I personally, I don't know, may-maybe this is something I need to let go of, but it would be surprising to me if people no longer wanted UIs, but we'll see. If everything just became chatting.
- MVMike Volpi
Uh, no, I, I'm, I'm in that camp. You know, it, it was interesting when you were talking to Brett, he was talking about like systems of record and how systems of record are important. I actually think one of the reasons why s-Salesforce sustains is because every salesperson knows how to use Salesforce.
- JAJack Altman
Yeah.
- MVMike Volpi
So actually, the human interaction [chuckles] with the system is the single highest-
- JAJack Altman
It's the best
- MVMike Volpi
... moat-
- JAJack Altman
Yes
- MVMike Volpi
... that, that, that anybody has from, from breaking in. That might change over when agents do the work-
- JAJack Altman
It may
- MVMike Volpi
... for us as humans. But as AI pilled as I am, I think that takes a while.
- JAJack Altman
Yeah.
- MVMike Volpi
And so that, that retains some l- the UI does retain some level of sustainability for some period of time.
- JAJack Altman
What do you think about AI like service as a software, fully do the work type of things where, you know, instead of selling you, you know, accounting software to an accounting firm, we're just gonna sell you completed accounting work kinda thing. Like do you think that's where stuff ends up? Are you more excited about that, or are you more excited about the, you know, software looking companies?
- MVMike Volpi
Well, I answer the question two ways. One, I think it's a high bar today, for AI systems today to actually offer accounting as a service. You still... You, you, you may not need the entry level, lower level white collar work, but you still, in today's world, need a lot of contextual and other forms of knowledge that accountants have about their clients, about the systems, about how all things work. So I think we're still in an era where purely delivering a, a, uh, uh, sort of service from AI with no humans involved, I think we're a little early for that.
- JAJack Altman
Particularly 'cause in some of these you need the verification of a human stamping. It is actually part of the value.
- MVMike Volpi
Yeah. You know, I think customers obviously will want some human to have supervision over it, and then humans, we have some very interesting sporadic contextual knowledge about things that's actually surprisingly helpful. To the point earlier about VCs and what makes us different than introducing you to customers and, and employees, there's just like random little bits of knowledge here and there that we collect over time-
- 45:49 – 47:50
Investing in defense
- JAJack Altman
And then how about outside of AI? Is there anything that you're investing in that's not AI?
- MVMike Volpi
Right now it's, like, ninety percent plus AI, but I would say defense tech is an interesting area. In defense tech too, there's a lot of AI mixed into it.
- JAJack Altman
Yeah, sure.
- MVMike Volpi
Um, but I do think that we're seeing geopolitical shifts, uh, that, uh, are reasonably permanent for some time. Uh, take for example, um, the dynamic between the US and Europe and defense spending. I don't see European defense spending being reduced. It's probably gonna be dramatically increased, and so there's opportunities there. It's the right tailwinds. I do think that with companies like Anduril and to a degree Palantir being successful at breaking into the market of selling into the US defense infrastructure will be an inspirations for both sides, for, for the-
- JAJack Altman
I was gonna say, it does both things. It, it both, it unlocks capital and talent, but then it also sort of warms up the DoD to believing that, you know, these companies can work with them and take their understanding seriously and all that.
- MVMike Volpi
Absolutely. And I don't think that's going back. You know, the sl- sort of like the, you know, Pandora's box has been opened on that front. So I do think that that's an interesting sector. You know, it's interesting 'cause there's always these philosophies like, oh, do you, do you invest in weapons and not invest in weapons? And when I was at Index, uh, we didn't do defense investing at the time, and I remember looking at Anduril and thinking, "This is gonna be a winner." And I had a conversation with Trey Stevens, and I was like, "Hey, I don't think we can do this because we don't do weapons." And he was like, "I don't think you get the mix here. Weapons are a system that, uh, deters violence because the more weapons one side has, the other side have it, the less likely as they are to go to war." Now, this president has disproven that, but leaving that [chuckles] aside, I think the logic was pretty strong. And, uh, so now I'm more of the belief that, uh, I, I think the right kind of defense investing is the right thing to do.
- JAJack Altman
Yeah, I
- 47:50 – 50:35
From operator to investor
- JAJack Altman
think so too. Before you joined Index, you were, like, an, a founder, you were an operator. Do you feel like that mattered looking back? Like, was it valuable to you to have done that? Do you think... Would you have been an even greater investor had you just been an investor the whole time, or do you think that if you sort of, like, think back and reflect on those chapters, that it, like, the net effect was that it made you a better investor than just more experience would have?
- MVMike Volpi
First of all, I really enjoyed being an operator It was super fun to be at a fast growth company, to see things explode and grow. You know, I joined Cisco, we were a few hundred people. I left, we were fifty-five thousand.
- JAJack Altman
Oh my God.
- MVMike Volpi
You know, you know, like-
- JAJack Altman
In how long?
- MVMike Volpi
I was there for thirteen years.
- JAJack Altman
Wow, that's crazy.
- MVMike Volpi
But it, it, it grew to that size in about ten.
- JAJack Altman
Wow.
- MVMike Volpi
And by the way, you feel somewhat like you participated in something that's reasonably momentous. Like-
- JAJack Altman
Yeah
- MVMike Volpi
... [chuckles] you know, I, I got there when nobody had the internet, and because of the products that we made, everybody got the internet.
- JAJack Altman
Wow.
- MVMike Volpi
I mean, that's-
- JAJack Altman
I mean, that's only a, you know... You could count the companies on one hand that have had that headcount growth.
- MVMike Volpi
Yeah. Yeah, yeah.
- JAJack Altman
Yeah.
- MVMike Volpi
Not just the headcount growth, but the-
- JAJack Altman
No, of course. Everything that's, that's implied with that
- MVMike Volpi
... the, the, the societal impact-
- JAJack Altman
Yeah, of course
- MVMike Volpi
... of what was created.
- JAJack Altman
Yeah.
- MVMike Volpi
Just because of the pure enjoyment of having been there, I'm happy I did it. How does that, how is that relevant in the context? I, I do th- of, of the rest of my life, I do think that the old Steve Jobs things applies, which is you gotta connect the dots looking back. Now that I understand VC better, and by the way, I still get... I still learn every day, but I understand it a little bit better. I didn't actually realize how important having that card of b- having been an operator was. Because there's a lot of VCs, everyone's smart, everyone's got a degree from a good school, everyone's got a big fund. You gotta differentiate yourself, right? Like when an entrepreneur is selecting a VC, I am the product. What makes this product different than any other product in the market? And in my case, having had that experience of growth, recruiting, customers, relationships, all that was enormously useful for me. I'm not of the camp that you have to have been an operator-
- JAJack Altman
Oh, yeah
- MVMike Volpi
... because, you know, you look at Peter Fenton, the biggest thing he's operated was a lemonade stand. But [laughs] he is-
- JAJack Altman
Well, shout out Peter. Yeah, this is for you.
- MVMike Volpi
But, but he is a, he is one of the greatest VCs of all time.
- JAJack Altman
He is.
- MVMike Volpi
And so y- we all, as a venture capitalist-
- 50:35 – 56:21
Thriving founders today
- JAJack Altman
it.
- MVMike Volpi
Yeah, absolutely.
- JAJack Altman
When you think about what types of founders are thriving today, has it changed versus before this AI thing? Is it, are there different mindsets, different types of educational backgrounds, different work experience, different age? Like have there been updates that are material to you that change what kind of founders you're interested in?
- MVMike Volpi
I think the biggest difference is the level of maturity that some of the younger founders have relative to even fifteen years ago. There is so much content available, so much peer community available, that you take the average twenty-year-old, twenty-one-year-old, and they're showing up with so much knowledge-
- JAJack Altman
I know
- MVMike Volpi
... compared to a generation ago.
- JAJack Altman
I know. I was twenty-one fifteen years ago, and when I meet a twenty-one-year-old today who's like a founder of... I'm just like, "Oh my God." Like I wasn't there when I was twenty-seven.
- MVMike Volpi
Dude, I was twenty-one in the Stone Ages, so. [laughs]
- JAJack Altman
Yeah. There you go. [laughs] Two, two, two fifties ago. But I'm just like, it's crazy what people know now, and I think it's going... I think it's accelerating.
- MVMike Volpi
Yeah.
- JAJack Altman
'Cause I think, you know, now a twelve-year-old today is gonna be using AI tools. By the time they're twenty, they're gonna be eight years into this.
- MVMike Volpi
And it's not just like book knowledge or AI knowledge. There's also a lot of just commercial knowledge.
- JAJack Altman
Yeah. What do you think that's about?
- MVMike Volpi
Uh-
- JAJack Altman
Is that from the online content? Where is that from?
- MVMike Volpi
Yeah. I mean, it's all of the above. You know, we're absorbing content from all sorts of sources. It's peer groups, it's online, it's stories that we tell, podcasts that we listen to.
- JAJack Altman
Here we are.
- MVMike Volpi
Especially yours.
- JAJack Altman
That's right.
- MVMike Volpi
But I think people accumulate knowledge from all these sources at a very young age and-
- JAJack Altman
It's incredible
- MVMike Volpi
... it's extraordinary.
- JAJack Altman
Okay.
- MVMike Volpi
I mean, it's absolutely extraordinary.
- JAJack Altman
Can I ask you an offensive question?
- MVMike Volpi
Yeah.
- JAJack Altman
So you got all these young founders. You're not old, but you're not, you're not a young VC exactly.
- MVMike Volpi
Yeah.
- JAJack Altman
Um, and so, and you're doing it very successfully. What is the mindset? Like what do you have to do to be not a twenty-five-year-old VC?
- MVMike Volpi
First of all, thank you for calling me old.
Episode duration: 56:21
Install uListen for AI-powered chat & search across the full episode — Get Full Transcript
Transcript of episode 2-TDqn-8i-c