Y CombinatorHow to Build Superintelligence Inside Your Company
EVERY SPOKEN WORD
45 min read · 9,188 words- 0:00 – 0:39
Intro
- GTGarry Tan
How do you build super intelligence inside a company?
- DHDiana Hu
Part of the key thing is not to just use AI as a copilot. This is the, the thing where you use it as the building layer for everything, and you need to start recording all the artifacts.
- JFJared Friedman
It's like a shared organizational brain. It's like the closest thing to us being able to, like, connect our brains.
- PKPete Koomen
If you frame this as a way for everyone in an organization to get better at what they do using the, like, collective skill and instinct of the people they work with, it's incredibly powerful.
- GTGarry Tan
[upbeat music]
- 0:39 – 2:15
YC's AI Stack
- GTGarry Tan
Today we have a real treat. Uh, we have a special guest, general partner at YC, our partner, Pete Koomen. He created Optimizely, which was one of the first and one of the best ways to do A/B testing for apps and websites. And since then, he has gone on to create all of our agent infrastructure at YC, so literally all of our harnesses and how we use AI internal to YC. Pete, welcome to the Lightcone.
- PKPete Koomen
Thanks, Garry.
- JFJared Friedman
For the last few years since ChatGPT, YC has been funding mainly AI companies, and we've been... we've gone through, like, many different, like, versions of advice for them about how to build AI-native companies that build, like, mainly AI products. And we've gone on a crazy journey with them learning all of this. I think a lot of people don't realize that internally YC is actually building and using a lot of the same stuff that we're helping our startups build and use themselves. And it's been, I think, a very powerful symbiotic relationship for us to actually be adopting these tools and, like, transforming our own organization, which was started way, way pre-AI into a super AI-native organization ourselves, and Pete has really been leading the charge for that. And so I'm really excited about this episode because I've actually been wanting to talk publicly about all the stuff that we've built internally, and this is the first time that we're doing it. So Pete, perhaps to start off, can you sort of go back to the beginning and, like, talk about, like, there was a pr- a particular, like, moment when we really started adopting these AI tools internally. It was really you who got us
- 2:15 – 5:07
The Finance Team Problem That Started It All
- JFJared Friedman
started down that path.
- PKPete Koomen
Sure. Uh, happy to, happy to tell the story here. And it's... I, I like framing it that way because it was a project that I and, and a few engineers got started about a year ago, maybe a little more, but that has since snowballed into just a whole infrastructure layer that's made it possible for us to use AI internally at YC in lots of different ways. And, and that's actually been one of the neatest parts about this, is watching the whole engineering team and, and many partners also just dive in and contribute to this, this infrastructure layer. We started building our own harness inside of YC for kind of YC-specific agents a- about a year ago. And, uh, the original impetus for the project was some of the work that I and a, and a few of the software engineers at YC were doing with our finance team. Just for a bit, a bit of backstory, so YC has, for as long as it's existed, as far as I'm aware, run mostly on our own software, in this era just given us a huge advantage, right? And so with that context, back to this, this moment maybe a year ago, we were sitting down with the finance team talking through a set of tools that we were going to build for them, uh, just to help them run through some of their finance workflows, booking journal entries, uh, logging priced rounds, like all the sorts of things that, that make YC run really. I was seeing kind of two things at once. Like o- on one hand, uh, we, you know, we had this sorta loop going internally, right, where we'd sit down with the finance team. The finance team would describe to our software engineers how, you know, this complicated financial workflow worked, and then software engineers would go and build some purpose-built software where there was a deterministic workflow encapsulating everything that they had been told, and then hand it back to the finance team and so on. And it felt really inefficient. And then at the same time, this was right around the time when agentic tools were really... agentic coding tools were really catching hold, right? And so you had, uh, kind of the first generation, uh, Windsurf and Cursor that were well-established by this point. I think this was right around when Claude Code was, was introduced. And it felt like this was giving me superpowers, right? Um, and then kind of watching this sort of old classical way of building software in YC and then watching how I was doing things on my own machine, this... it just felt like a bigger and bigger divide between those things. And so the original impetus was, "Why don't we try to build some tools at YC that we could use to run agents that would give the finance team control over their own software?" Right? Like, remove the software engineers from this crazy loop where they have to sort of understand these complicated workflows, and give the finance team the tools that they could use to encode their own workflows, not, not as, you know, not as Ruby, uh, but as, as English with prompts, right?
- GTGarry Tan
I mean, what's interesting is, like, uh, we all funded companies
- 5:07 – 7:20
SQL Access Changes Everything
- GTGarry Tan
may- maybe even, like, two or three years ago when LLMs were out, but, like, agentic coding wasn't a thing yet. And so the first thing actually was not agentic coding. It was LLMs for writing SQL queries.
- PKPete Koomen
Yes.
- GTGarry Tan
So that's what I remember from, like, the first versions of what you built, was, uh, how, like, good it was and how basically it rhymed with, like, these other failed startups that we had funded. Like, each of us probably funded one-
- PKPete Koomen
[chuckles]
- GTGarry Tan
... at some point. You know, here it was. It was working, and it worked so well that non-technical people, uh, granted very smart people from finance but with no engineering background, could use these tools to ask real questions.
- PKPete Koomen
I was really surprised too, to be honest. And, and so that... We started with this kind of purpose-built thing for finance and then rewrote it to be more of a general agent loop.Right? And it, and it's, this is now, you see these all over the place now. But, um, I- the first kind of magical moment that I had was we had this l- agent loop, and we had a tool registry, a shared tool registry for kind of YC-specific tools. And the first tool that really was an unlock for me was, I think, a tool, looking back, that you actually built, Jared. It gave these agents the ability to run read-only SQL queries-
- JFJared Friedman
Oh, yes
- PKPete Koomen
... against our database.
- JFJared Friedman
Yes.
- PKPete Koomen
Right? Um, it was two tools, actually. One was, was running queries against our database, and the other one was the ability to read our model files.
- JFJared Friedman
I remember I built those tools, and I felt a little bit like I was breaking the rules. 'Cause initially, we started with very limited tools that had very z- n- narrowly scoped domains. And I kept getting frustrated because they weren't powerful enough to do the things that I wanted. And so I was like, "What if we just gave the thing, like, access, complete access to the production database where it could just, like, trample on anything?" [laughs] And I sort of, like, surreptitiously pushed it out maybe late at night.
- PKPete Koomen
And it worked.
- JFJared Friedman
[laughs] And it worked, yeah.
- PKPete Koomen
It worked extremely well.
- JFJared Friedman
Yeah.
- PKPete Koomen
Right?
- JFJared Friedman
Yeah. Perhaps foreshadowing, you know, subsequent things like OpenClaw, where it turns out that, like, the thing that was hampering the world was being worried about security and privacy and all the things that could go wrong. And when you, like, worry a bit less, you're like, "Oh my God, these things are unbelievably powerful."
- PKPete Koomen
It's, it's another really good example of this weird split between
- 7:20 – 9:14
One Database to Rule Them All
- PKPete Koomen
I'm at work and I'm kind of operating in this really-
- JFJared Friedman
Yeah
- PKPete Koomen
... narrow box, and I'm at home using Claude Code or, or, or whatever, like OpenClaw or Hermes, and I can do anything.
- JFJared Friedman
Yeah.
- PKPete Koomen
Right? Um, and, and, and trying to, trying to narrow that gap. So why was this so useful, this ability to run SQL queries against our database? Sounds really simple. Well, I think this is where it's important to talk about one of the big advantages that I think YC had coming into this experiment, uh, which is that we run on our own software, and all of that software sits on one Postgres database that has everything that's important to YC's world in it. You know, every company that we funded, there's a companies table. There's a, there's a founders table, right? There's tables for our financial transactions. There's tables for the notes that I leave in our little internal CRM, right? All of these functions that I think a lot of other companies farm out to third-party SaaS tools, we've built our own. And as a result, we have this database with every important piece of context that I can now ask questions like, "Hey, show me all of the investors who invested in a space-related company in the last four batches," right? It just turns out when, when all of that context is in one place, with a little bit of additional, uh, information about how the schema is laid out, an agent can go and ask any, or answer arbitrary questions about, about our business.
- GTGarry Tan
That was a magic moment for sure when I first saw that.
- PKPete Koomen
Yeah.
- JFJared Friedman
And the cool thing for me is that it didn't just make it easier to answer questions. It dramatically increased the number of questions that we would ask, and dramatically increased the, the scale and complexity of the questions that we would dare to ask, where, like, you know, in the, in the old days, back when we were using, like, BI tools, to ask, to ask a question like that, you know, like what investors have invested, like, in space-related companies, that would be, like, several hours of writing SQL. And so, like, unless it was really important, you just wouldn't bother.
- PKPete Koomen
It's just another example of the, you know, the, this
- 9:14 – 10:07
Jevons Paradox
- PKPete Koomen
instance of Jevons Paradox that you get-
- JFJared Friedman
Yeah
- PKPete Koomen
... when you remove the amount of back and forth, uh, between different teams in order to get a thing done, right? If, if in order to ans- ask some kind of complex question about YC, I have to go and knock on s- on, you know, the data science team's door and wait for them to get it through, you know, their backlog, uh, I'm just gonna ask far fewer questions.
- GTGarry Tan
I mean, there are people out there watching this who work in places that still use it. The majority of people live in that world still, and it's 2026, which is a little unfathomable actually.
- PKPete Koomen
There's a long way to go-
- GTGarry Tan
Mm-hmm
- PKPete Koomen
... I think, which is, which is really exciting.
- DHDiana Hu
I guess one question is how do companies that live in that old world could get sort of wings to move so quickly? Because our, the magic for us was, as you said, everything was, the context was in one place. That made it easy.
- GTGarry Tan
You know, if you think about, um, data science, uh, historically,
- 10:07 – 12:15
Denormalizing for Agents (GBrain)
- GTGarry Tan
one of the first things that the Googlers had to figure out was, uh, Bigtable, right? And Bigtable was, you know, instead of schema, you, and joins, you have one big table that, um, can be map reduced.
- PKPete Koomen
Yes.
- GTGarry Tan
And so I think that that's happening again, and I would argue that that's happening now with, um, Karpathy-style knowledge LLM wikis, uh, with GBrain. [laughs]
- PKPete Koomen
[laughs]
- GTGarry Tan
I mean, that's what I'm seeing anyway. Like, you know, obviously I have, I have an OpenClaw. It has-
- DHDiana Hu
Mm-hmm
- GTGarry Tan
... uh, access to lots of, lots of systems, and then I'm normalizing it to my own schema that's relevant to me and the things that I care about, and it is like denormalization. It's you're taking data and you're putting it into a format that, uh, is more or less optimized for OpenClaw or Hermes Agent, like that particular type of harness to be able to ask questions.
- DHDiana Hu
Mm-hmm.
- GTGarry Tan
And it needs retrieval, it needs RAG, it needs Graph RAG, it needs, uh, you know, hybrid RRF, like there's re-ranking in there. Like, you know, all the things that everyone has learned about retrieval, uh, is now inside GBrain. And then when you give the agents a soul, and it, and you give it, uh, the data, and it knows you and what you care about, like suddenly these things have insane wings. Like I just kind of can't believe how it sees around corners, and you might ask a question, and it'll even, you know, sort of interpret what your question was about and, like, give you a thing that, uh, frankly, like, it would take a human who really knows you well-
- PKPete Koomen
Mm-hmm
- GTGarry Tan
... to answer.Um, all that's possible now. And so, you know, your question is like all the data is everywhere. My answer from like the OpenClaw Hermes experience with GBrain is like, yeah, you basically have to take that you're gonna denormalize it and you're gonna put it in a format that is optimized for agent retrieval and understanding. You could wrap it in an MCP, but for whatever reason, I just like intuitively I'd be worried. Like it's still sort of, you know, these things are really good at working with MCP and CL- like they're a little even better with CLI. It seems like you have to denormalize and do the Bigtable thing, but, you know, specifically for the agent.
- PKPete Koomen
Looking back over the, the last year and a half, uh, it
- 12:15 – 14:16
The Single-Player Era of Agents
- PKPete Koomen
feels like we're still kind of in the single-player era of agents, where the harnesses that have gotten really popular, right, uh, Claude Code, Codex, Pi, OpenClaw, Hermes, they're all designed to be used by a single human running on a single machine. And it makes a lot of sense, right? Because in that environment, these, these agents can do just about anything, right? And they, they make you incredibly powerful. It's, it's, they're a lot of fun to use. I think one of the big problems, uh, that I don't think has been solved well yet by anybody is the multiplayer-
- GTGarry Tan
Mm-hmm
- PKPete Koomen
... harness, right? It's, it's enabling that kind of superpower, but on a team or an organizational-
- GTGarry Tan
Yeah
- PKPete Koomen
... level, right? And, and, and that's, I think, been the interesting thing to explore with the infrastructure that we've built at YC, is watching which primitives that we've created that have enabled individuals and teams to use agents. You asked the question about if you're working inside of a kind of a legacy organization, which is like anyone who's more than two years old-
- GTGarry Tan
[laughs]
- PKPete Koomen
[laughs] Uh, what are the things that you can focus on, uh, in order to, to help enable everybody at your org to use AI to, to do more? Uh, and it- we talked about kind of this common context layer, right? And so a data warehouse where just as much of your internal important context lives, it just turns out is extremely useful. There are many tools for connecting individual agent harnesses to, uh, you know, other MCP tools, uh, other, other sources of truth. But l- just like a coding agent inside a monorepo just tends to be much more efficient, watching our agents operating on our single database that has everything in one schema tells me that there's a lot of value at least in getting all of the context into one place. Having an internal tool registry, this is I think the other really important thing that we've built. So in the beginning, like we were talking about, it was just the whole system was really simple. It was like an agent loop and a simple tool
- 14:16 – 16:24
350 Tools and a Shared Registry
- PKPete Koomen
registry and, you know, a few other pieces, right? Like a model router underneath. The tool registry is where most of the like YC specific stuff lives, right? The tool registry is what turns these agents into something that's useful at work, and we had like 20 tools at the beginning, including this magical ability to query our, our SQL database. But over time, teams have added more and more tools. Every time we kind of come upon some piece of work at YC, uh, that we think could be improved with an agent, we can just add tools, and there's more than 350 today. I just checked, right? Every team is adding their own tools. You know, I can do things like manage my office hours. Our finance team can, uh, you know, can book journal entries, right? We can help manage the events that we run. Uh, there's tools for all of the important work that we do at YC. And now once these all exist in, in, in, in one place, you can make them available to these internal agents that we've built, but you can also make them available to Claude Code, you know, running, running on, on, on, on our individual machines. So those things above all, I think were the important pieces that we built that if I were working in any other organization, I would focus on building.
- GTGarry Tan
I mean, honestly inspired by what you guys would- did with tools, like this idea of Skillify in OpenClaw, and then actually the most import- the last part of Skillify. Skillify is like this meta skill that I made in OpenClaw where it's like you just do anything in, uh, OpenClaw and Hermes. Hermes actually already has Skillify. They call it something else. Like it makes skills automatically. But the most important thing I, I think is actually like plugging it into the resolver, which is like your agents.md with like the list of things that the agents can do, and then like it links to the markdown entry point that like lets you use a tool basically.
- PKPete Koomen
Mm-hmm. Mm-hmm.
- GTGarry Tan
And so like this thing keeps coming up in all these different contexts, like Claude Code has a skill. The skill registry in Claude Code is actually a resolver. Our tool registry is actually a resolver.
- PKPete Koomen
Mm-hmm.
- GTGarry Tan
And then the weird thing that you have to do on top of that is actually, um, I have a meta skill called Check Resolvable that I call all the time. So I'm always like, I do something that's new or different
- 16:24 – 18:23
Skillify, DRY, and MECE Resolvers
- GTGarry Tan
in, uh, in my agent.
- PKPete Koomen
Mm-hmm.
- GTGarry Tan
And then after it does it and I like it, I say Skillify it, and then it becomes basically like a tool call or method call. And then I run Check Resolvable, which is like, you know, look at all of the other skills and, uh, tools that exist and is it, you know, DRY, don't re- don't repeat yourself, and is it, uh, MECE, which is, you know, I'm embarrassed to say a McKinsey term for, um, the consultants use it for, uh, making really good slide decks, uh, mutually exclusive, collectively ex- exhaustive.
- PKPete Koomen
Mm.
- GTGarry Tan
That's like how you're supposed to do slides if you're a McKinsey consultant. But it's useful because it's like an additional layer on top of don't repeat yourself DRY.
- PKPete Koomen
Hmm. Hmm.
- GTGarry Tan
And like the models just seem to know what those things are. And so if you have a DRY and MECE resolver table anywhere, it's actually like the optimal resolver. Like it's bad to have 10 skills that do all the same thing.
- PKPete Koomen
Mm-hmm.
- GTGarry Tan
It's good to have one skill or one tool that has parameters that then let you call them.So I don't know. I think it's like this is like the wildest time to be alive as like an applied computer scientist because it's like simultaneous like discovery of the same useful applied concepts over and over again. And I wonder if like when people were, you know, developing the first versions of Unix or something, it's like discovering a stack and a heap.
- PKPete Koomen
[laughs]
- GTGarry Tan
It feels like we're right at that moment-
- PKPete Koomen
Yes
- GTGarry Tan
... today. Like we're just coming up with the new primitives for what an agentic system actually is, and you can see it in the parallel sort of development of like we're just trying to do a thing, and it might be in Claude Code, or it might be in our own internal harness, or it might be in OpenClau, it might be in Hermes. Like these things just keep coming back over and over again.
- SPSpeaker
YC Startup School is back. We're hand-selecting the most promising builders in the world and flying them out to San Francisco for July 25th and 26th to discuss the cutting edge of tech and startups. Apply now for your spot.
- PKPete Koomen
Yeah, it's really interesting to look at how
- 18:23 – 20:26
The Self-Improving Dream Cycle
- PKPete Koomen
some of the other companies that are building this stuff, uh, have built their infrastructure because you see a lot of these same primitives in, in each of them, right? Like there's the agent loops, there's tool registries, there's skill registries. Looking at, at, at the way that we're using skills now at YC, so if you, you think of s- skill as a simple abstraction layer over tools, we have a handful of sort of shared skills, uh, that, that we all have access to, uh, through this, through this agent system. And it's been interesting to watch. I think you've talked about this, where this progression of like in the beginning, you were kind of writing your own system prompts, and then skills emerged, and so you started writing your own skills, and then you would start, uh, meta-prompting, where you'd, uh, where, you know, you'd have-
- GTGarry Tan
Do it again
- PKPete Koomen
... the agent write a skill. Exactly.
- GTGarry Tan
Improve the prompt-
- PKPete Koomen
Yes
- GTGarry Tan
... automatically.
- PKPete Koomen
Yes.
- GTGarry Tan
Yeah.
- PKPete Koomen
Seeing us kind of do the same progression internally, where we have a couple skills, and now we've gotten to the point where we have these sort of autonomous self-improving loops-
- GTGarry Tan
Yeah
- PKPete Koomen
... right? Uh, you know, and so, um-
- GTGarry Tan
Auto research from Karpathy again.
- PKPete Koomen
Yes.
- GTGarry Tan
You know? Yeah.
- PKPete Koomen
Yeah.
- GTGarry Tan
Or/goal now in Codex. Like they've, they've incorporated it too.
- PKPete Koomen
We have this general agent that every night will go and read through all of the agent conversations that employees have had and look for, uh, things it could have done better-
- GTGarry Tan
Amazing
- PKPete Koomen
... and pieces of context that if it had up front, it would have done more efficiently.
- GTGarry Tan
This is OpenClau's dream cycle.
- PKPete Koomen
Yeah.
- GTGarry Tan
And GBrain also has a dream cycle. This is a, um, um, a skill improvement dream cycle, but it could also potentially, um, read all the transcripts and then write them back into the internal, uh, DB, into the internal CRM on like what we know about people and companies.
- PKPete Koomen
Indeed. A- and w- we, we... There are cool examples of using transcripts actually to make these skills more effective as well. One of the shared skills that we have, uh, is a skill that, that partners at YC use to help our companies, uh, write what we call two-sentence descriptions, right? Everybody here has written hundreds of these.
- GTGarry Tan
We should probably explain what a two, two-sentence description actually
- 20:26 – 23:06
The Two-Sentence Pitch Skill
- GTGarry Tan
is.
- PKPete Koomen
Sure.
- GTGarry Tan
Yeah.
- PKPete Koomen
So a two-sentence description is a concise way of explaining what your company does in natural language that anyone will understand and why it's interesting.
- GTGarry Tan
Sounds easy, but it's surprisingly hard for founders to actually do this.
- PKPete Koomen
Yes.
- GTGarry Tan
Yes.
- PKPete Koomen
And also no one does it, weirdly. Weirdly, like even the most experienced founders like forget because they have perfect context. Act- interestingly, uh, I now realize YC itself is a, a context engineering, uh, sort of process in that like f- people... We're frequently teaching people, "You have perfect context about what's going on in your brain, but great communication is replicating that same context in someone else's brain," and that's what a two-sentence pitch is. Like, what is it? Like, I don't even know what the heck this is. And then second part is like, is it interesting or valuable? What... You know, is it worth my time? And so that, you know... When I, when I teach two-sentence pitches, that's my favorite way to do it, is like, do I even know what the heck this is?
- GTGarry Tan
Yes.
- PKPete Koomen
Because if you don't know what it is, you can't even ask a question about it.
- GTGarry Tan
Yes.
- PKPete Koomen
It's like something about computers, I guess, whatever. What, what time is lunch again? And then the second part is equally important, which is like, if I've heard that, you know, there are like 20 companies, like there are five other companies in this room that do X. Like, and then I don't understand like why this is noteworthy.
- GTGarry Tan
Yes.
- PKPete Koomen
Like again, I'm like thinking about my pastrami sandwich again, right?
- GTGarry Tan
[laughs]
- PKPete Koomen
So, so the two-sentence pitch like viscerally is important for founders.
- GTGarry Tan
And it's, it's a, it's a simple kind of atomic thing that every partner at YC has practiced over and over and over again. I think Tom, uh, one of the, one of the partners here, wrote a skill that teaches an agent how to, uh, take some context about a company and con- and condense that into a two-sentence description. And so that was his h- sort of handwritten prompt or skill, a- about how that was done. And one of the cool things that happened in the last month or two was that a couple of the other partners took a meeting that they had with a, a group office hours they had with a bunch of the companies in the spring batch and just went through and had every founder try, uh, their hand at, at a two-sentence description and kinda gave them feedback and input. And so kind of the knowledge that lives in a partner's head about how to do this effectively was exchanged back and forth, right, and, and, and now lived in the context of, of that meeting transcript, and handing that back to the agent and saying, "Given, you know, what you've learned by reading through this context, improve the two-sentence description skill." And they got noticeably better-
- PKPete Koomen
Wow
- GTGarry Tan
... after that. Like this thing is now better than I am, I would, I would argue, at writing those.
- PKPete Koomen
This is how super intelligence happens inside organizations.
- GTGarry Tan
[laughs]
- 23:06 – 25:10
How Super Intelligence Compounds
- PKPete Koomen
I mean, this two-sentence pitch thing sounds like something kind of small, but, uh, embedded in it is actually something very powerful. I'm sure you guys have heard, um, Jack Dorsey talk about what he's doing with Block. He basically is trying to turn Block into a mini AGI around helping people in the world make payments to one another, right? Uh, and then this is actually-
- GTGarry Tan
the micro mechanism by which he's going to do that, right? Like, you can look at the operation of any organization as, uh, the aggregate of, you know... I mean, the two-sentence pitch at YC is, that's sort of one of, like, thousands of things that I would argue we do for founders. But, you know, we just walked through a very concrete way where someone wrote a prompt, used it, used a bunch more, other people used it, uh, a bunch of artifacts came off of that around literally, like, the transcript of using it becomes a thing that can be used to meta-prompt and improve, in an automated fashion on a daily basis, the operation of that one skill.
- PKPete Koomen
Yes.
- GTGarry Tan
And then suddenly, that one skill, you just said it, that skill is now better than any of us individually than bef- you know, when before we actually had access to that. And so this is, like, a particular, like, n- needle pin prick in the fabric of, like, how any organization does things. And then how do you build super intelligence inside a company? You do that on everything you do, and it's not more complicated than that. Like, you literally just compose everything that you do, and any given thing that any given person can do, you combine that in aggregate and in this particular process, and, like, you have a super organization.
- PKPete Koomen
Right.
- GTGarry Tan
It's possible now. Like, every single person watching this can do this at any company, at their own company. They can do it at their job. I mean, the interesting thing is that's why you should start a startup, 'cause people are gonna be trapped in organizations with people running organizations that are very powerful and have all these resources and all this capital that do not believe what we just said.
- DHDiana Hu
Because they keep all the context locked down.
- GTGarry Tan
Right.
- 25:10 – 27:10
Recording Everything as a Building Layer
- GTGarry Tan
Because it's unsafe.
- DHDiana Hu
It's unsafe. This is one of those things that we talk about, um, how do you build that AI-native organization, right? Part of the key thing is not to ju- just use AI as a copilot. I think that's very 2023, '4, right? This is the, the thing where you use it as a really, the, the building layer for everything, and you need to start recording all the artifacts. Like, people wouldn't have thought of, uh, meeting recordings, and it is one of those reasons why all these, uh, meeting recorders have been taking off. People have been finding them with coaching them on the meetings, but it's not just that. You could take that and improve all the output for you that you do, like writing emails, communication, planning. You have the whole context of everything.
- PKPete Koomen
It's funny you say that. I remember the Dario essay where it's like there's some of the blockers and just the rate of progression of AI are not technical. They're just sort of like social, cultural things. I think it's kind of like a really interesting example. Two years ago, it would've seemed... I just remember it, like, felt odd to just, like, record a meeting or-
- DHDiana Hu
Yeah
- PKPete Koomen
... like, there was just, like, people trying to figure out what the, like, social etiquette around it was and, like, how intrusive it was. And today, I just feel like it's almost, like, default assumed that, like-
- GTGarry Tan
Yeah
- PKPete Koomen
... most meetings are being rec- especially if they're on Zoom, but just in general, like, everyone's started recording things now.
- PKPete Koomen
It's a little scary, but I think if you frame this as a way for everyone in an organization to get better at what they do using the, like, collective skill-
- GTGarry Tan
Mm-hmm
- PKPete Koomen
... and instinct of, of the people they work with, it's incredibly powerful. Having a canonical two-sentence description skill is not just a way to, like, generate a s- a snippet of text for a founder. It's a way to help me get better at understanding what makes for effective founder communication, right? Because now I can tap into everything that Diana and Harj and you two have learned over the many years you've done this job, which are now kind of baked into this skill through the conversations that you've had.
- GTGarry Tan
It's like a shared organizational brain.
- PKPete Koomen
Yes.
- DHDiana Hu
It is very empowering.
- GTGarry Tan
It's like, it's like the
- 27:10 – 29:18
The Shared Organizational Brain
- GTGarry Tan
closest thing to us being able to, like, connect our brains.
- PKPete Koomen
Yes.
- GTGarry Tan
Right? Yeah.
- PKPete Koomen
It, it, it totally is, right? And I, I can have an agent now come, and I can do practice sessions with it, right? And I can have it critique my... Like, there, there are so many possibilities once you get all of this knowledge into a place where an agent can, can work with it. Uh, it's a, it's a, it's a very empowering thing for every human in the organization.
- GTGarry Tan
There's some subtle interesting things around here that, like, you know, other people might get wrong that, like, I feel like we've gotten right. I mean, one of them-
- PKPete Koomen
Mm-hmm
- GTGarry Tan
... is by default, the agent conversation is actually g- um, globally vi- viewable-
- PKPete Koomen
Yes
- GTGarry Tan
... by any full-time employee at YC. You know, we sort of weren't sure about-
- PKPete Koomen
Mm-hmm
- GTGarry Tan
... that decision. I mean, it felt right, and it felt like living in the future, but it did not come easily.
- PKPete Koomen
Yes.
- GTGarry Tan
I feel like we had a lot of conversations about, like, "Well, then everyone sees everything. Is that okay?" And like, you know, "What is not okay?" And then I'm glad we made the choice to keep it open, actually, 'cause-
- PKPete Koomen
I agree
- GTGarry Tan
... people learned how to use it from watching how other people used it.
- PKPete Koomen
Yes. We used that transparency to solve several problems at the same time. One, every agent conversation, as you mentioned, was broadcast internally to a Slack channel, and anybody could join that Slack channel and look and learn, right? And I remember, uh, this is another kind of big unlock moment, was when you started using it really heavily. You were, like, super creative with, with the things you were doing with it, and a lot of us watched that and was like, "Oh, wow, I didn't even occur to me-
- GTGarry Tan
You can do that now. Yeah
- PKPete Koomen
... to, to, to use it that way," right? It allows you to be a little more lenient on internal security, right? One of the things we talked about earlier was this trade-off where these agents are at their most powerful when they are given unrestricted access to lots of context, which runs counter to the way mor- most organizations work. It turns out that by defaulting to public broadcast for these conversations, you kind of institute a bit of a social control on what people can do with it, uh, that as we learned, I think has been, like, reasonably effective, uh, inside of this high-trust environment at keeping private information private.
- GTGarry Tan
Yeah, what's interesting is, um, it, it betrays two
- 29:18 – 30:44
Trust-Default Culture as a Requirement
- GTGarry Tan
traits of, uh, truly agentic, like, 1000x super intelligent organizations-
- PKPete Koomen
Yeah
- GTGarry Tan
... that I would not have necessarily guessed would exist but are now, like, must exist. If you want to create this type of organization, you have to be relatively egalitarian, and you also have to be trust by default.And then neither of those things, uh, actually are most organizations in the world. If you're the founder of an organization, you actually have to have those at the core of what you're doing.
- PKPete Koomen
And I think, like, that kind of environment honestly works best at startups, right? When it's a small group of people that are a- all aligned and, and, and, and operating in a high-trust environment.
- GTGarry Tan
The other thing you have to do is be willing to spend, like, 10 to $100,000 a year-
- PKPete Koomen
[laughs]
- GTGarry Tan
... on tokens. But if you're willing to do it, and you invest in the skills, and you, like, actually do everything in an open way with your team that way, like, basically what I realized is it allows you to live in 2028, right? Like, what you spend 100,000 or a million dollars a year on now, it will be commonplace, like, in, in two years, right? It'll... It won't cost 100,000 in a year. It'll cost 10,000, and the year after that, it'll be, like, a couple hundred bucks, right? And everyone will do it. And we'll call it, like, "This is how companies are now." So basically, there's a one-time time warp where you can leapfrog every incumbent, all Fortune 500s, all startups that exist by doing this.
- JFJared Friedman
Like, I'm imagining in the '90s, I wonder if it felt similarly
- 30:44 – 32:35
Raising the Floor for New Employees
- JFJared Friedman
when companies started buying computers for their employees.
- GTGarry Tan
Yeah.
- JFJared Friedman
They were probably very expensive, and probably only certain companies really invested in buying these, like, expensive, flaky computer systems for their employees. But, like, what a superpower-
- GTGarry Tan
Yeah
- JFJared Friedman
... to have a computer when your competitors, like, don't have computers.
- DHDiana Hu
I think more tactically how I've seen this affect, uh, YC has been raising the-
- JFJared Friedman
Raising the bar
- DHDiana Hu
... the floor.
- JFJared Friedman
Bar.
- DHDiana Hu
The floor, in a sense. What I mean by that is that you could have a new employee joining, and maybe it would've taken them six months to ramp up, but with this, it's sort of like they automatically get a lot of the context from the company working, and they know how the best people and the star players in the or- organization do things by apprenticeship automatically with AI instead of, uh, because partner time is expensive or sometimes the best people in a org, they're very busy, right? And you get to kinda run the simulation of what it's like to be like Pete when he does, like, an awesome job coaching founders on sales or like Garry when he's, like, talking to founders and giving very specific advice. I think it helps all the new, new entrants in the or- organization just be a mini version of you a lot faster.
- PKPete Koomen
One of the first things that I appreciated about being able to use a coding agent was that all of the dumb questions I was too embarrassed to ask, I had no trouble asking, asking the agent. And it... This is kind of that same thing, but at an organizational level, right? You're a brand-new employee. You're embarrassed to ask. You don't wanna bug Harj with a, with a question. And now you don't have to, right? You... And, and which on net means a lot more questions get asked and answered, and people ramp up much more quickly.
- JFJared Friedman
After you had built all of this agent infrastructure at YC, it inspired you to write this essay, Horseless Carriages, that went, like, pretty viral on the internet. Maybe you can, like, explain the ideas behind Horseless Carriages. I think they're still very relevant now.
- PKPete Koomen
It was a critique of a lot of the, the
- 32:35 – 34:24
Horseless Carriages
- PKPete Koomen
AI software that I saw being built at the time. And to be totally honest, I think a lot of it still falls into this category.
- GTGarry Tan
It's still like that.
- PKPete Koomen
Yes.
- GTGarry Tan
Yeah, it didn't change.
- PKPete Koomen
Yes. I just saw a lot of examples of, uh, companies building software and adding AI features by sort of slotting a little bit of AI inside of a lot of software, right? And, and the example that I used at the time was the, the kind of email writer that, uh, the, the Gmail, uh, team had, had shipped. But the, the real idea underneath was just kind of that, the, the, the potential for AI is to shift control of software from the developer to the user, right? And, and the, the simple example I started with was basically that all of these kind of like AI as a little feature kept a bunch of prompt context about how the AI should do a job locked away and hidden from the user, which was just this classic example of like, well, it's the developer's job to figure out how all of this stuff should work. So the developer should write that, and we should protect the user from that kind of complexity.
- GTGarry Tan
Safetyism, I hate it.
- PKPete Koomen
Right. And, and, you know, and it, and it's just, again, going back to this contrast between watching the way that some of these tools work and what it was like to use a coding agent on my computer that could do anything, right? And feeling, feeling like I, I had superpowers. I think the conclusion that this essay points to is that as we get better at building AI-native software, it's going to look a lot more like the agent wrapping software-deterministic tools rather than deterministic software wrapping an AI, right? And we've done our best to expose that to internal employees with some of these primitives that we've built. Um, but we have a lot, we have a long way to go.
- PKPete Koomen
The chat as the interface, I just feel something... There's, like,
- 34:24 – 38:50
Why Chat Is the Best Interface for Agents
- PKPete Koomen
uh, things going around right now about how there's a need to build a new interface for, like, AI, and what does that look like? And I think that just comes from people who haven't, like, touched and felt it yet.
- DHDiana Hu
[laughs]
- PKPete Koomen
Chat is actually pretty good because, like, you trust the agent, and you increasingly trust the agent to do more of the work, and you trust its decisions, and you don't actually need to, like, have too much of a UI to go in and, like, review the things it's, it's doing. I find it-
- GTGarry Tan
It's time for just-in-time software.
- PKPete Koomen
Yeah, basically, right? Like, yes, occasionally you want it to present you, like, maybe, like, a specific view of something, but for-
- GTGarry Tan
And it could make the software and build it as a single-page JavaScript just purposely-
- PKPete Koomen
Yeah
- GTGarry Tan
... built for you-
- PKPete Koomen
Yeah
- GTGarry Tan
... at that moment.
- PKPete Koomen
Yeah.
- GTGarry Tan
And it could be a skill file that could be, like, called any time you want.
- DHDiana Hu
I was thinking a lot about this because I used to be in the camp that, oh, perhap- when ChatGPT came out and it was 2023, that perhaps chat was not gonna be the UI for all these AI applications.
- GTGarry Tan
Mm.
- DHDiana Hu
And I've definitely changed my mind. Part of it is, like, after experiencing all these tools, and I think the more I reflect upon it, why chat is probably the better interface is because it's the closest thing to human language, and human language and writing is basically the closest thing to expression of thinking.
- GTGarry Tan
Mm-hmm.
- DHDiana Hu
So chat is the closest stepping stone to clear intelligence.
- GTGarry Tan
Yeah.
- DHDiana Hu
So you can't justput it in a box. I think it just constrain us too much to have a very specific box. So that's why I thought, I was like, "Okay, all in with chat interfaces." I used to be in the other camp, and it's like-
- PKPete Koomen
And it's multimodal. I know we've talked about, like-
- DHDiana Hu
Yeah
- PKPete Koomen
... Telegram is not ideal, but I actually really-
- GTGarry Tan
It's pretty good.
- PKPete Koomen
Yeah, it's pretty good. Like-
- GTGarry Tan
I mean, the voice memos, sometimes when I don't want to type, you just do the voice memo, and it's, it feels like I'm talking to you, you know?
- PKPete Koomen
Like, I can give my OpenClaw, like, I can give it text-
- GTGarry Tan
Yeah
- PKPete Koomen
... I can give it voice, I can give it pictures of things, like-
- GTGarry Tan
It's great
- PKPete Koomen
... I can give it files. Like, it's, like, pretty good.
- 38:50 – 40:49
Just-in-Time Software
- PKPete Koomen
YC or, or tools that others have built, tend to be very small and just add kind of the smallest amount of code ahead of time that you need in order to let the model shine.
- GTGarry Tan
Mm-hmm.
- PKPete Koomen
And you can build an awful lot with that, right? I can write tens of thousands of lines of code, uh, like, like you're saying. But the ability to start at this, like, extremely simple thing that I need to, to understand very little in order to use is incredibly powerful, and I think that's... I think most software in the future is going to look like that.
- GTGarry Tan
We were talking about this earlier, but I think that is what OpenCall did really well. Like, there were, like, a few things that you want. You wanted, like, some ability to give it a bit of personality. You wanted it to, like, persist and last for a long time and have some concept of memory. And it's not, like, perfect, but that's, like, actually, like, good enough as, like, for that use case.
- PKPete Koomen
Mm-hmm.
- GTGarry Tan
Now, Claude Code 2, every time Boris comes and speaks at YC, he spoke with Diana ear- earlier this week. One of, one of the things that really stands out is how obsessed he is with simplicity and with just, like, making the product as small as possible.
- PKPete Koomen
My favorite example of this is, is, uh, the, this open source harness called Py, which is a-
- GTGarry Tan
Yep. That's what, that's what OpenCall uses-
- PKPete Koomen
Yes
- GTGarry Tan
... as its out of the box, uh-
- PKPete Koomen
Exactly
- GTGarry Tan
... coding agent.
- PKPete Koomen
It's this beautiful piece of software which is just, like, the smallest possible coding agent. You can use Py to ex- modify and extend Py, right? And it's this kind of idea of, like, self-extending and self-referential software. It's really fascinating. Uh, and you're right, OpenClaw was built on top of that. One of the things I'm very curious to see is how many other sort of pieces of classic software emerge in this form as this kind of minimal thing that you start with, uh, and then use an agent to extend over time. I think more and more s- I mean, looking at, honestly, the benefits that we've gotten from having our own customizable software, I suspect that a lot of-
- GTGarry Tan
Yeah
- PKPete Koomen
... commercial software, uh, will come with this capability-
- GTGarry Tan
Yeah
- PKPete Koomen
... uh, out of the box in the future.
- GTGarry Tan
There's a really interesting subtle thing that I wanted to talk about around,
- 40:49 – 43:32
Centralizing vs. Decentralizing AI
- GTGarry Tan
like, what I learned from your essay, uh, which is, like, AI can either be centralizing or decentralizing. And, um, the Google Gmail, like, I can't change the prompt thing is, like, the perfect example of that. We basically have a choice to be made over the next... I don't think it's even that long. I think it's, like, 18 to 24 months. It might take five years. But, um, there are sort of two scenarios, and, uh, what comes to mind is literally, like, the, uh, 1984 Macintosh commercial by Apple-
- PKPete Koomen
[laughs]
- GTGarry Tan
... where it's like, is 2034 going to be like 1984? And, you know, the 1984 case would be we have centralized control, like, there are five kings. There's only, you know, one of them maybe wins. They have the most advanced AI. They have, uh, end-run around all compute and power. They have all the space data centers 'cause they c- you can't build any terrestrial data centers in America anyway. There's this, like, centralization of control, and not only that, they don't let you run your own prompts.Like, they literally do the Gmail thing, but, like, for your whole computing existence, right? And this would be as if, like, personal computers never existed and there were only mainframes and mini computers. Like, this is sort of lost to the sands of time, but, you know, in the 1960s and '70s when computers first came out, like, you couldn't go to the store like you can today. You couldn't go to an Apple store and just buy an iPhone, let alone, uh, a Mac. You had to get access to, like, this thing that was worth, like, hundreds of thousands of dollars to millions of dollars, and it was only-
- JFJared Friedman
And it was like, and it was, like, tightly locked down-
- GTGarry Tan
Yeah
- JFJared Friedman
... by corporate policies. You're right.
- GTGarry Tan
Yeah.
- JFJared Friedman
And the, and the thing that really spurred the computing revolution was when people started having personal computers that, that they could experiment on.
- GTGarry Tan
Yeah, and it was just like the priesthood, right? There was a small priesthood and an institutional base that controlled capital, literally the means of production. And so, you know, this is, like, a coherent future that we could live in that I don't want to live in, and the alternative to that is actually, uh, embedded in the Homebrew Computer Club. It's embedded in the revolution that Steve Jobs and Steve Wozniak gave us when they were in the garage in Mountain View-
- JFJared Friedman
Mm-hmm
- GTGarry Tan
... literally soldering together breadboards, and they, like, sold 500 of these Apple 1s. And I think we're at the Apple 1 moment right now. We are coming up with the primitives. We are learning how do these things work and how do we sell it and how do we package it? Uh, but then there's, like, a lot of choices right now, right? Like, most people, the mass- you know, a billion users use ChatGPT, and ChatGPT, like, gives you a little access, but MCP is really locked down. You actually, you know, can't hook things up
- 43:32 – 46:28
The Personal AI Revolution
- GTGarry Tan
to your own databases that easily, um, and, you know, for what? Safety? Like, I would argue Claude is, like, a little bit more open, but not really. Perplexity Computer is probably the best version of it, but it's still, like, you know, d- pretty limited compared to what you could do with OpenClaw and Hermes Agent. And so what does the, uh, revolution look like that is, like, the true personal AI moment? And that's what I hope that we are building with things like GBrain and, you know, H- Hermes Agent and OpenClaw, like the ability to run your own software, to change your own prompts, to test all of it, to have your own private repo that, like, you know is only yours, um, to be able to choose which model to use, and maybe it's an open weight model. Like, to me, that's sort of the white pill for AI is, uh, we could have corporate control, no control of your own prompts, and, like, literally the AI happens to you. [laughs] You know, you're under the API line. Or, like, there's this other alternative where I want, like, a billion people to actually control and program for themselves what are these things. This should be an extension of yourself and what you care about, not what, you know, Meta or Alphabet or even OpenAI or Anthropic care about.
- PKPete Koomen
I always really bristle when I see AI framed as a way to replace people because it just doesn't match the way that I have experienced it and the way that so many of the people around me have experienced it, not as a replacement for humans, but as a thing that empowers. If you look at, at, at kind of how tech has developed since the era of, of mainframes to PCs to the internet, which gave everyone, like, a publishing platform to w- like, it's, it's a story overall, above all, of individual empowerment, and I think AI, uh, is going to play out the same way. I think it is going to enable us to do more, uh, than we could before. I think it's going to eliminate kind of the drudgery style work that, like, made a lot of my job painful in the past.
- GTGarry Tan
To me, it's like we have to make choices to do so.
- JFJared Friedman
Mm-hmm.
- GTGarry Tan
By default, like, a company is not open. By default, a company is, uh, command and control. By default, maybe the leadership gets access to these tools, but, like, the, you know, line level people, the staff people don't, right? And, like, y- we need, like, a radically different type of organization, and we need to actually offer computing in a different way, and, um, these are all choices, and the people who are watching are gonna be the people who build all these things in society. So we better choose well. Well, that's all the time we have for today. I mean, I think we covered some pretty heavy stuff, but Pete, thanks for joining us.
- PKPete Koomen
Thanks.
- SPSpeaker
Thank you.
- PKPete Koomen
Thank you.
- GTGarry Tan
Thanks for watching, guys. We'll see you guys on the next one. [upbeat music]
Episode duration: 46:29
Install uListen for AI-powered chat & search across the full episode — Get Full Transcript
Transcript of episode B246K_G7mHU