a16zHow Jev Turns AI Into Software That Gets Things Done
EVERY SPOKEN WORD
45 min read · 9,165 words- 0:00 – 0:50
Intro
- DADiogo Almeida
Where the fuck is all the automation?
- MCMartin Casado
Yeah.
- DADiogo Almeida
AI is so unbelievably smart, and yet it's so useless at all other stuff.
- MCMartin Casado
It doesn't matter how much AI coding agents you use, the software actually isn't getting better. [laughs]
- DADiogo Almeida
[laughs]
- MCMartin Casado
Maybe you're writing it faster. It's like-
- DADiogo Almeida
Yes
- MCMartin Casado
... arguably getting worse.
- DADiogo Almeida
OpenAI has been trying to automate customer service since 2020. What I want instead is smart software. I want to expand what software itself can do, such that things that should be automatable can then be automatable.
- BHBen Horowitz
My favorite thing that you guys say is, "We build prod, not God."
- MCMartin Casado
[laughs] So good.
- BHBen Horowitz
Because if we had any other kind of, like, big lab leader, even if they had joy, they would cover it up. [laughs]
- MCMartin Casado
[laughs]
- BHBen Horowitz
And then your view is so different. You're like, "No, we're gonna create a way better world."
- DADiogo Almeida
For nuanced reasons, I don't think we are on the path of RSI. In the SaaSpocalypse story, um-
- 0:50 – 4:07
Meet Diogo and Type Safe
- BHBen Horowitz
Today-
- DADiogo Almeida
[laughs]
- BHBen Horowitz
... we have the founder and leader of TypeSafe, Diogo, with us, um, who, uh, is a bit of a hero to both Martin and me.
- MCMartin Casado
Yes.
- BHBen Horowitz
Um-
- MCMartin Casado
Yes
- BHBen Horowitz
... he is not only building, like, a really interesting product, uh, but creating what we think is a very important movement. So we're super excited about today. Welcome, Diogo.
- MCMartin Casado
Thanks for coming. Yeah.
- DADiogo Almeida
Thank you.
- BHBen Horowitz
Yeah. And, uh, maybe you can give us kind of a, a brief on, um, just, you know, what is Jev? What is TypeSafe? Why is it important?
- DADiogo Almeida
Is this, uh, curse-friendly or no?
- BHBen Horowitz
Yeah. Yeah, yeah.
- MCMartin Casado
Oh.
- DADiogo Almeida
Oh, okay. Cool.
- BHBen Horowitz
What the fuck are you talking about? [laughs]
- DADiogo Almeida
Oh, okay, okay, okay, cool. So I was actually asked-
- MCMartin Casado
Anything else, and yeah, yeah
- DADiogo Almeida
... uh, for, like, a elevator pitch, which I tend to ramble on, and I don't do well. But, like, I realized my favorite e- elevator pitch for Jev is-
- MCMartin Casado
Oh, yeah
- DADiogo Almeida
... where the fuck is all the automation?
- MCMartin Casado
[laughs]
- DADiogo Almeida
Like, this is, like, so-
- MCMartin Casado
Oh
- DADiogo Almeida
... unbelievably tragic.
- MCMartin Casado
Yes.
- DADiogo Almeida
You know? So much intelligence.
- MCMartin Casado
Yeah.
- DADiogo Almeida
AI is so unbelievably smart, and yet so... I, I... Not that I hate on chatbots or coding agents. I love them myself, but it's like th- it's so useless at all other stuff, and it's, it's tragic. It's tragic-
- MCMartin Casado
Yes
- DADiogo Almeida
... so that, you know, we have so much, like, diamond in the rough, but not polished for work. That's, that's... But TypeSafe is making AI for software. You know-
- 4:07 – 15:46
Smart software, not just faster code
- BHBen Horowitz
uh, somewhat replaces a software engineer with a faster, maybe not even as good software engineer, what you're saying is, "No, no, no, we're gonna super empower the software engineers we have to write way, way better, more interesting things."
- MCMartin Casado
Yeah. I, I actually-
- BHBen Horowitz
Yeah.
- MCMartin Casado
I mean, yeah, yeah. So this is s- by the way, I, I just think so many people miss this point, and it's such-
- BHBen Horowitz
Yeah
- MCMartin Casado
... a subtle point, and it's so important to actually tease it out, which is, um, if you use something like Cloud Code or Codex, which is great, or Cursor, which is great-
- DADiogo Almeida
[laughs]
- BHBen Horowitz
Yeah
- MCMartin Casado
... they write code, but that code is the same thing a human being would have write. Maybe it's better, maybe it's worse, but it's basically still code, just like code looked 10 years ago.
- DADiogo Almeida
Yeah.
- BHBen Horowitz
Yeah.
- MCMartin Casado
A- and the thing with Jev is whether or not you're Cloud Code or a human, you have this new primitive, this new thing that you stick in your code that actually expands, like, the power of software. So instead of, like, writing code, it is something that you include in your code.
- DADiogo Almeida
Hmm.
- MCMartin Casado
Which-
- DADiogo Almeida
Go ahead. No, no, you go ahead. Go ahead
- MCMartin Casado
... no, no, you go ahead. Well, one, two, which by the way is interesting because it's this very powerful primitive, which would be great if you explain, but it's also a little bit different than, like, you know, how programmers think. For example, like, it has this notion of, like, you know, probabilities or, you know... And, like, so, you know, so maybe-
- BHBen Horowitz
Oh, so an intelligent layer inside the software.
- MCMartin Casado
Yeah, think of, like, like a libr- yeah, like a library that you can, like, use natural language to describe what you want, and then you give it kind of a state machine, and then it will, will choose what to do with some confidence levels, which we kind of haven't really had before-
- DADiogo Almeida
Yeah. Yeah
- MCMartin Casado
... like, so ubiquitous. So maybe...
- DADiogo Almeida
Ooh, there's a lot of tricks there. I will-
- MCMartin Casado
[laughs]
- DADiogo Almeida
... jump into one thing first, which is-
- MCMartin Casado
Yeah
- DADiogo Almeida
... I love the first thing you said. Like, you know, in the direction of where the fuck is all the automation.
- MCMartin Casado
Yeah.
- DADiogo Almeida
I love software so much.
- MCMartin Casado
It's the best.
- DADiogo Almeida
I wish I could be writing it all day.
- MCMartin Casado
Yes. [laughs]
- 15:46 – 22:00
Where's all the automation?
- BHBen Horowitz
But y-
- DADiogo Almeida
Yeah
- BHBen Horowitz
... you know, it, it's a kind of a, it's a very tip of the iceberg of the things that are horrible things to do that, that we need to automate.
- DADiogo Almeida
I think that if we were going to be really intellectually honest, and we are really aiming for the North Star of automation, we cannot fall into the same anti-patterns that AI has fallen into, which is really, um, focusing on outliers and demos.
- BHBen Horowitz
Hmm.
- DADiogo Almeida
Right? Like, a lot of people ask me, like, "What are your favorite use cases?" And I'm like, "I'm not sure if they work." I want them to work in the background-
- BHBen Horowitz
[laughs]
- DADiogo Almeida
... such that, like-
- BHBen Horowitz
Yeah
- DADiogo Almeida
... someone would trust that to run and not page them, and, like, people can build on top of that too. And, like-
- BHBen Horowitz
Uh, composable. Composable AI.
- DADiogo Almeida
Composable, but, like, other things, like-
- BHBen Horowitz
Yeah
- DADiogo Almeida
... safe, right?
- BHBen Horowitz
Mm-hmm.
- DADiogo Almeida
Like, it's a different type of safety where, like, i- if you want it to actually, like, run with resources associated with it, with access-
- BHBen Horowitz
Mm-hmm
- DADiogo Almeida
... to things, you need guarantees for that, or, like, at least statistical guarantees.
- BHBen Horowitz
[laughs]
- DADiogo Almeida
And, um, like-
- BHBen Horowitz
So it doesn't go rogue, break and enter-
- DADiogo Almeida
[laughs]
- BHBen Horowitz
... face, that type of thing.
- DADiogo Almeida
Well, I, I, I don't think our models will be doing that-
- BHBen Horowitz
Yes
- DADiogo Almeida
... anytime soon-
- BHBen Horowitz
Yes
- DADiogo Almeida
... unless someone, like, does the software to do that, which would be g-
- BHBen Horowitz
Their fault, yeah
- DADiogo Almeida
... a very cool flex. Very cool flex.
- 22:00 – 30:21
Is it just a data problem?
- MCMartin Casado
the, the, the real, the distribution of the real world is, is, is different than the digital world, right? It's heavy tailed. There's a lot of exceptions. We don't have all the data. And I mean, it, couldn't it be the case that the reason we're not doing productive stuff in the real world is just like we're not, we don't have the data for that distribution. We're not training on that distribution, and this is why it's just been basically relegated to like these lower dimensional manifolds, like whatever math or code or...
- DADiogo Almeida
Um, I don't entirely buy the data argument, in my opinion. Um, I do believe that there's a, a long tail, for sure, like that would be kind of crazy-
- MCMartin Casado
Yeah
- DADiogo Almeida
... to deny. And I don't think that in my like canary in the coal mine situation, we need to automate that long tail. Like I think that-
- MCMartin Casado
I see. Okay
- DADiogo Almeida
... I think we need to be incredibly pragmatic on everything, and like building reliable software is always an investment.
- MCMartin Casado
Yeah.
- DADiogo Almeida
Right? Like it, like, you know, what are the three great virtues of a programmer? Laziness to not to do it again, hubris, and [inhales] there was a third one.
- MCMartin Casado
Oh, yeah. No, yeah, no, I remember. This is from the Pearl days.
- DADiogo Almeida
Yeah.
- MCMartin Casado
Yeah, yeah.
- DADiogo Almeida
Yeah. There, there was a third one.
- MCMartin Casado
Larry Wall, yeah.
- DADiogo Almeida
I, I wish, I wish I could remember it.
- MCMartin Casado
Yeah, yeah.
- DADiogo Almeida
But like it's about like the laziness to like spend [chuckles] you know, like ten hours to do like the five-minute task instantly and to never have to do it again. Like, it only make, like it should be an ROI decision for people who like automate stuff. Like, I would just like it to be automatable.
- MCMartin Casado
Yeah.
- DADiogo Almeida
And I think that people will just make n-like new kinds of work, he-hence the Jev in Jevens.
- MCMartin Casado
Yeah.
- DADiogo Almeida
New kinds of work once that stuff is doable. But, uh, like, as like a, a benchmark, I feel like it's useful to see can we actually automate the stuff that it really, really looks like AI should be able to automate.
- MCMartin Casado
I see.
- DADiogo Almeida
OpenAI has been trying to automate customer service since 2020.
- MCMartin Casado
Yeah.
- DADiogo Almeida
You know, like, and it, it, it's, you know, like it's not. [laughs]
- MCMartin Casado
Which is pretty amazing.
- DADiogo Almeida
[laughs] It, it's, it's wild, you know? It's wild.
- MCMartin Casado
Well, and then inside, I mean, inside companies, um, there's very little that's automated right now.
- DADiogo Almeida
Yeah.
- MCMartin Casado
Like, a-a-and the projects haven't worked. Um-
- DADiogo Almeida
Yeah
- 30:21 – 34:58
SaaS apocalypse, reversed
- DADiogo Almeida
I, I don't know what else to say, right?
- BHBen Horowitz
Yeah.
- DADiogo Almeida
Like, I, I think it's, like, quite natural.
- BHBen Horowitz
Mm-hmm.
- DADiogo Almeida
Like, in the SaaSpocalypse story-
- BHBen Horowitz
Mm
- DADiogo Almeida
... um, the, the story that I feel like has panned out really poorly is that software is very cheap and perhaps easy to replicate, which-
- BHBen Horowitz
Mm-hmm
- DADiogo Almeida
... I think I could, I could believe the former, I could not believe the latter because a lot of the stuff happens beneath the hood.
- BHBen Horowitz
Totally.
- DADiogo Almeida
Um, I'm maybe overly a software fanboy here. Um-
- BHBen Horowitz
Yeah, all of us. [laughs]
- DADiogo Almeida
Yeah. Okay, okay, okay. Um, I didn't know where you-
- BHBen Horowitz
Yeah
- DADiogo Almeida
... might be in the coding agent fanboy-
- BHBen Horowitz
We, we have a lot of legacy around that.
- DADiogo Almeida
Yeah.
- BHBen Horowitz
100%, yeah.
- DADiogo Almeida
Yeah. So it, I don't think that really panned out, so SaaS seems like maybe the markets don't agree.
- BHBen Horowitz
Mm.
- DADiogo Almeida
But, like, I think SaaS is providing the same value it used to. Maybe the markets are just scared.
- BHBen Horowitz
Mm.
- DADiogo Almeida
Um, but I think that SaaS will be one of the largest winners of, like, the whole AI game.
- BHBen Horowitz
Mm-hmm.
- DADiogo Almeida
And I want to, like, work really, really well with, like, all the biggest, most boring, most, like, in the know of user problem-
- BHBen Horowitz
Mm-hmm
- DADiogo Almeida
... SaaS companies because I think that they are the best positioned to know what workflows to automate, what do people need. Like, that's what-
- BHBen Horowitz
Mm
- DADiogo Almeida
... what their bread and butter is, and to spend the big... Like, you know, software is always a CapEx investment.
- BHBen Horowitz
Mm.
- 34:58 – 38:27
New capabilities, not more code
- DADiogo Almeida
If people take that as a takeaway, that would be, like, the greatest compliment ever to what we are doing.
- BHBen Horowitz
Yeah.
- DADiogo Almeida
Like, I actually feel like it's almost too grand of a vision to expand beyond the three logic gates that we have-
- BHBen Horowitz
Yeah, yeah
- DADiogo Almeida
... into, like... You know, it, our types are kind of like one s- of the same logic gate, but, like, one that's, like, a little brain in there.
- BHBen Horowitz
Yeah.
- DADiogo Almeida
Like, that would be the greatest compliment-
- BHBen Horowitz
Yeah
- DADiogo Almeida
... to, like, the, the, the type safe legacy, 'cause, like, that is t- that's a very-
- BHBen Horowitz
Huge
- DADiogo Almeida
... non-trivial, huge thing for the world. Um, I'm not gonna, like, overpromise, underdeliver that, but I will fight for that.
- MCMartin Casado
Yeah, I mean, listen, I mean, there's, I think pretty open questions to what, like how deep can this get as far as, like, like, really serious stuff, like state consistency or durability or, like, real systems level stuff where you actually need to, like, provide strong guarantees. And so 100% this will change-
- DADiogo Almeida
Mm-hmm
- MCMartin Casado
... things like whatever, analyzing logs, analyzing emails, providing a UI, talking to the human. Like, that for sure, but, like, you know, you could argue that over time this becomes, like, a smart database.
- DADiogo Almeida
Yep, yep.
- MCMartin Casado
Like, you know, and so-
- DADiogo Almeida
And, and also-
- BHBen Horowitz
Air traffic control system.
- MCMartin Casado
Uh, anything, right?
- BHBen Horowitz
Which we really need. [laughs]
- MCMartin Casado
True, true.
- DADiogo Almeida
A little scary.
- BHBen Horowitz
Yeah.
- DADiogo Almeida
Like, I think automate the easy work before the hard work is always my philosophy.
- MCMartin Casado
Yeah, yeah.
- BHBen Horowitz
Yes.
- DADiogo Almeida
But I also think there's going to be, like, an entire era of probabilistic programming that's opened up. Like, my-
- MCMartin Casado
By the way, you know there's a huge history of probabilistic programming-
- DADiogo Almeida
Oh, I do
- MCMartin Casado
... that basically died in, like, the '70s, right? [laughs]
- 38:27 – 41:08
Apps vs the guts of systems
- MCMartin Casado
more in terms of like systems, foundations, or all the above?
- DADiogo Almeida
For what I would think of or how-
- MCMartin Casado
Yeah, just general application for this. When you think about like, like you're working on Jev and like, and you kind of envision the people are adapting it, like how, how, you know, like do, do, or maybe do you even have an opinion?
- DADiogo Almeida
I have a little bit, and it's... So the way I think of it is a little like, uh, like deep into like the TCP guts. You know, like UDP, TCP, you know, like it's unreliable, it's unreliable.
- MCMartin Casado
You're speaking, speaking my language. [laughs]
- DADiogo Almeida
Exactly. And, and like I, I, so like when I think of AI-
- MCMartin Casado
Feel comfortable
- DADiogo Almeida
... no, no, I mean, like when I think of AI, and this is why I care about intelligence per dollar, to be clear.
- MCMartin Casado
Yeah.
- DADiogo Almeida
When I think... And, and how I got to this conclusion is I work backwards from AI-based economic revolution, AI everywhere, you know, sci-fi and everything, like all the software has AI all over the place. And I ask myself the question, what percentage of the calls to AI, imagine it's like a function-
- MCMartin Casado
Mm-hmm
- DADiogo Almeida
... which, uh, what percentage are like for human consumption, where you need like style and everything?
- MCMartin Casado
Versus understanding.
- DADiogo Almeida
And, and, yeah.
- MCMartin Casado
Mm-hmm.
- DADiogo Almeida
And it's gonna be like many nines, and actually from that same question, how many will be at the first layer-
- MCMartin Casado
Yeah
- DADiogo Almeida
... versus like deep in the guts?
- MCMartin Casado
Yeah.
- DADiogo Almeida
Right? And I think that it's going to be many nines in the guts, but it will start at the first layer. But like we need to, if you don't aim for the guts... [chuckles] Wait, that sounds weird.
- MCMartin Casado
[laughs]
- DADiogo Almeida
If you don't aim for the guts, you, you, it's, it's, it's going to take you a while to get there.
- MCMartin Casado
Yeah.
- DADiogo Almeida
Right?
- MCMartin Casado
I, I think people don't understand to what extent like AI was kind of ships in the night with software. Like even if you try to embed AI in software, it kind of like didn't behave, right? Because software doesn't really take natural languages, and you like do all this weird stuff. Like you stick in the prompt like, "Here's the JSON output that you want, and here's a schema," and it would never listen to it.
- DADiogo Almeida
Yeah.
- MCMartin Casado
And so, and so what you ended up doing is just taking the output and giving it to a human. You're like, "To hell with it," right? It's like-
- DADiogo Almeida
Yes, or another LLM. That is what a while loop is, like the-
- MCMartin Casado
Yeah, ex-
- DADiogo Almeida
... agent while loop, right?
- 41:08 – 42:13
Reliability and "do what I mean"
- DADiogo Almeida
really, really care about reliability. We could have released so much sooner. I don't think people realize that, and I don't think that, honestly, I don't think that they will. I, uh, based on what I see of the Twitter discussion-
- MCMartin Casado
Yeah. [laughs]
- DADiogo Almeida
... I think people will never get it, but like it'll just have like that good vibe of like, "Oh, I can trust this."
- MCMartin Casado
Yeah.
- DADiogo Almeida
So-
- MCMartin Casado
Well, it's the anti-frustration machine, yeah.
- DADiogo Almeida
[laughs]
- MCMartin Casado
Yeah.
- DADiogo Almeida
It's, it's a... I hope so. I hope, do what I mean, right?
- MCMartin Casado
Yes.
- DADiogo Almeida
Like to me, that is about like smoothness in the world, like having everything like just move more smoothly together and interlink like gears.
- MCMartin Casado
Yeah.
- DADiogo Almeida
I actually have my whole like AI utopia on like different axes that I really, really want, and like do what I mean is a huge part of this.
- MCMartin Casado
Yeah.
- DADiogo Almeida
You know, like imagine if all technology just did what you mean.
- MCMartin Casado
Yeah.
- DADiogo Almeida
That is, like that's not sci-fi. Look how smart AI is, right?
- MCMartin Casado
Yeah. No, it's, uh, it's amazing. And, and maybe that's the thought to close on.
- DADiogo Almeida
Oh.
- MCMartin Casado
Do what I mean.
- DADiogo Almeida
[laughs] Yeah, love it.
- MCMartin Casado
Thank you, Diogo. This has been a great conversation.
- DADiogo Almeida
Hell yeah.
- MCMartin Casado
Really enjoyed it.
- DADiogo Almeida
So fun.
Episode duration: 42:24
Install uListen for AI-powered chat & search across the full episode — Get Full Transcript
Transcript of episode Ut3LOjKNJaE