How I AIThe enterprise AI stack behind Stripe’s company brain “Kai”
EVERY SPOKEN WORD
50 min read · 9,709 words- 0:00 – 2:46
Introducing Sharadh
- SKSharadh Krishnamurthy
Agents are very creative at bringing your infra down. It turns out that agents just, like, dial up all your failure modes. It just multiplies the amplitude of problems you can get. There are agents that went rogue. There are agents that may have almost taken down core systems. One of the cool things about projects that can be very concrete for people is the idea of tool policies. Let's say you are a person on the HR team who's dealing with a bunch of sensitive information. You really don't want the agent to sort of, like, go rogue and put that sensitive data into some public Google document that all Stripes can access. But you also don't want to tell them, "Oh, you can't use any tools because your workloads are too sensitive."
- CVClaire Vo
I love this idea of this, like, three-layer triage that a data agent can go through, and that's really smart. Find existing reports, then use the analytics layer to find the right query. Then if, like, you really have to, you fall down to the data catalog and write your own query. Your data warehouse has to be very resilient to high volume queries because when in doubt, an agent will just brute force it.
- SKSharadh Krishnamurthy
We could test this out, and it's going to kick off what is a human-in-the-loop workflow. Create a calendar invite for me and Huang tomorrow at 11:00 AM Pacific. This isn't the fun part. The fun part is what I showed before. Agents are really good. They're very creative. So we gotta put some restrictions on them so they don't go rogue.
- CVClaire Vo
Welcome back to How I AI. I'm Claire Vo, Product Leader and AI obsessive, here on a mission to help you build better with these new tools. Today we have Sharadh, an engineering manager at Stripe and part of the team who built Kai, their internal company brain and company agent. He's gonna show us why you might wanna build your own custom agent for your company, what are the governance and control mechanisms of Kai that make it super special, and how to build not just a skill-building skill, but a skill-building platform for your team to share their automations and workflows with the rest of the company. Let's get to it. This episode is brought to you by DX. In a recent study across more than 500 engineering organizations, DX found that spend on AI tools has grown 28X over the last year. The share of AI-authored code is climbing, but overall innovation has remained flat. As teams generate code faster, new friction in code review and validation is offsetting those early velocity gains. DX tracks speed, quality, and cost together across the software development life cycle, giving engineering leaders clear visibility into how AI impacts delivery and whether those investments are translating into real value. Download the full report at getdx.com/howiai. That's G-E-T D-X.com/howiai.
- 2:46 – 5:18
Why Stripe built an AI agent (Kai) instead of buying tools
- CVClaire Vo
Sharadh, it's so nice to have you here, and I had to reach out to the Stripe team because I wanted to learn not just about how Kai, the company brain, the company agent, works at this big company, but I really wanted to understand why in the world you built it yourself. And so I'm wondering if you could just start us there. Why build Kai? What was the problem you all were trying to solve?
- SKSharadh Krishnamurthy
We wondered about this a lot before we built it because we have all this, like, the, this avalanche of AI tools. This was, like, early 2026. Huge number of tools coming out. Cloud code had just, like, taken the world by, by storm. Like, a lot of, like, really cool things were happening. And the problem that me and my, um, and my colleague Anupam were dealing with is how do we get AI to everyone, right? And we quickly realized it's not just an engineering or a technical problem. The harder problems are in trying to replicate the way a company works at scale. And Stripe is an incredibly complex business. Like, all around the world, like, multitude of products, so many, so many processes that keep, uh, keep us in a shape so that we can help our users. And so we quickly realized that it's not about providing AI, it's about providing the correct governance structures so that everyone can just go use AI and know it'll do the right thing for them. So some of the things that, uh, we really thought about and why we built Kai is, uh, governance is a, is a big thing for us, like I just said. The second thing is Kai is, like, really interesting. It's context-aware. It knows who you are and what you do with the company, and it knows what are the things that your colleagues are, uh, mostly interested in, and it has access to the org chart and your projects and all the things that are going on, which means that it has a lot more, uh, mechanisms to do the right thing for you and understand what you're trying to do. Um, and the other thing that, that I really like and our security team really likes is that Kai is all hosted on the cloud. It's always on. It's behind our standard security boundaries. And, uh, it's very Stripey in that everything that we use to build Kai actually ends up being standard infrastructure that helps us build great agents for our users. And ultimately, uh, while it's great for me that, like, we're really helping Stripe be more effective and enabling everyone, I really am happy that what we're doing here is helping build the rails that make our Stripe users, uh, get better products, uh, out of this using,
- 5:18 – 6:51
What Kai knows about you (and what you can turn off)
- SKSharadh Krishnamurthy
you know, great agents that are coming out.
- CVClaire Vo
So just to kind of repeat back what I heard and some of the unique things that you built into Kai is, one, this sort of bounded context engine. So, you know, I'm Claire. I work at Stripe. Kai knows about me. It knows about my place in the org chart. It knows... Does it know kind of like strategic projects that I'm working on? Does it know, like, conversations I'm having? Like, how, how do you, how do you ingest that knowledge? What does it know about an individual?
- SKSharadh Krishnamurthy
We allow people to select how much they, uh, they, they give Kai access to. But out of the box, they... Kai knows, like, who you are. And where do you sit in the org chart, right? And, um, it also knows some helpful other things like, like what day is it and what time is it, and so on. But relevant to you, personalized context is like who you are and where do you sit in the org chart. From there on, the standard tools that we have connected to Kai let you talk to our, uh, um, our project management system that figures out, like, all the OKRs and all the recent shipped emails and all the projects you're part of, right? And it, uh, lets you connect, if you choose to let it, to your Google Drive, to, uh, to your Slack, right, to private messages. Things that are, like, pretty sensitive, uh, and, uh, we really like keeping, uh, keeping, um, a tight boundary around. You can choose to let Kai know as much of that as you want to. Um, some people choose not to, and I'm, I'm actually one of those. I, I, I turn off and, uh, turn on and turn off my access every, uh, every session or every day. Uh, but many people are like, "Let the AI
- 6:51 – 10:04
Projects as a governance layer
- SKSharadh Krishnamurthy
figure it out," and more context is better.
- CVClaire Vo
Great. So you have this context engine, but controlled by the end user to, to some extent, so you can decide as an employee how much you want to automatically ingest into the system. Um, you have these... You're also building it on some fundamental agent building blocks. And, you know, this is one of the... You know, there are lots of reasons you might build one of these things, um, at a company. One is just to teach your team how to build great agents. It's like the perfect dogfooding agent experience, which is if you're gonna build a great agent for your customers, you should learn to build a great agent for yourself. And then it sounds like you're reusing some of that infrastructure, which is nice 'cause then you can pressure test it against Stripe employees or, or external customers. What else is unique about Kai? What are the places where you're like, "This-- We, we, we went a little extra on building this"? So as folks that are listening thinking about building this internally, they can decide where they wanna differentiate their own kinda internal agents.
- SKSharadh Krishnamurthy
The two things that I'm, uh, we were very intentional about is the idea of projects, and projects are primarily a governance mechanism, but they also let you... You, you have this context engine, as you said, right? But projects are almost like intentionally the user is telling you what they are trying to do, and that's a very strong signal of intent, and that lets the, uh, AI perform a lot better. But projects, uh, you can... If you, if you see my screen in a second, um, there's the How I AI demo project that I have right here. Projects are some things that Stripes can create. Um, it, it's, it's all open, right? And what they can do is, uh, we have projects that have 500 people in them. We have projects that have five people in them. The idea is that you create something where someone decides what's the appropriate set of things that you should need for the AI to function well, and what are the appropriate safety controls. Like, uh, token spend is top of mind for a lot of companies. A project can kind of say like, "Hey, here's the default model we want people to use. We don't even wanna let them use these, like, super expensive models," right? Because the, the job that you're trying to do here doesn't need, you know, uh, one of these super models to, uh, to look at them. So projects as a governance mechanism, and really, um, I think we did a lot there because, again, Stripe is a very complex business. Enterprise scale AI requires these sort of mechanisms to make sense of things. Uh, and I like the fact that we can have a few people who are, uh, very, you know, knowledgeable, knowledgeable about the AI and the trade-offs between cost, performance, and, uh, latency, and they can sort of set the stage for everyone to just go use, right? We should try to minimize the number of people who have to actively make these choices every day, and just it should do the right thing for them, and projects are one way that, uh, we can do that. Um, the other one, which is kind of related, you'll see that as well, are skills. The way that we build skills and our skill routing, uh, there's a lot there in how we think about skill quality, skill governance. A lot of good stuff there that, uh, that we can get into, uh, that we've invested a lot in. Uh, the thing I'm... I think the team has shipped. It's gonna be interesting. It's gonna be a live demo, but I think they shipped a feature where automatically people, uh, everyone who authors a skill gets suggestions on how to make their skill better, how to help client,
- 10:04 – 12:18
Live demo: Kai builds a dashboard
- SKSharadh Krishnamurthy
uh, built into the platform.
- CVClaire Vo
I, I like this because I've seen, you know, we've seen projects for holding context or just simply as an organization structure to AI work, right? Like, "Here are the files you need. Just put all my chats in this group." What I haven't seen anybody talk about, which I actually think is really interesting, is using projects as a configuration layer on... and a governance layer on how your team actually uses AI to get a specific job done. And so I like that idea of project-based model routing pro- um, project-based, I'm sure, connectors or approvals or, you know, all those sorts of things, and I'm sure there's more and more and more you could do in the future. Um, which is really interesting. So let's... I mean, show us. What's Kai good at?
- SKSharadh Krishnamurthy
Yeah.
- CVClaire Vo
And why don't you just walk us through a, a, a common Kai task and how it, how it, how this customization benefits the end user, in particular maybe, like, someone who's a little less technical.
- SKSharadh Krishnamurthy
Yeah. Uh, absolutely. Happy to do it. So, uh, I have a few trusty prompts here. What we're gonna be doing today is we're actually going to be creating a dashboard, because Stripes, we love our data, and something that literally everyone at Stripe, uh, does with Kai is create a bunch of dashboards, right? So we're gonna do this live, and we're gonna ask Kai to create a dashboard for us. And, uh, you know, in the interest of vanity metrics or [chuckles] things that I can speak to, uh, easily, I'm gonna ask it to go create, um, something related to Kai itself, right? So, uh, Hubble is our internal sort of like data querying layer, and I'm gonna tell it, "Hey, go find these queries that I usually use to track Kai adoption, and I want you to, like, create a dashboard for me." And this is really interesting. I really like this because some things that pe- I've found, uh, most people really use AI for... When I talk about most people, I'm like, so I'm an engineer, I've been an engineer all my working life, uh, but I'm super passionate about how we scale AI to like everyone. And not everyone is necessarily an engineer, even if they're super technical, uh, at Stripe. So something that people really have been using the AI for is creating dashboards that communicate a point, and that's what I wanna, I, I wanna show, uh, how we would be doing that using Kai today. And there's a lot of stuff we could get
- 12:18 – 17:22
Tools, skills, and the secure sandbox
- SKSharadh Krishnamurthy
into, uh, along the way.
- CVClaire Vo
And I see it, it polling for tools and skills. So is this like part of the harness, which is it's kind of like tuned to go find what it can use to solve this problem?
- SKSharadh Krishnamurthy
Absolutely. So, uh, there are two things. Um, we have, of course, we all have, we all know what tools are and we all know what skills are. Um, tools basically being the things you can do, and skills are like essentially a way to package up relevant tools so that we can find them easier. So the thing that you see Kai doing immediately is that it's gonna find the skill that says Ask Data, and that's a skill that's going to go figure out how to answer any Stripe data and, uh, SQL related question using our standard tools. Using that skill, which it's loaded up, it's got access to a bunch of like internal, uh, tools, and it's gonna use those tools and go ahead and, and do more things, right? Um, so the tools are a combination of a bunch of different things. There are tools that we set up in the harness. Example, discovering a skill is itself a kind of tool that we give the harness, right? But we also give it things like there's a sandbox that's secure for your session where you can do grip and stuff, because again, uh, unlike our typical agent, this isn't running on your laptop, it's running in the cloud. And so how do we make sure that your session, Claire, and my session don't like e- eat each other? So we set up the secure sandbox and give the harness tools to interact with the sandbox. Uh, tools that can securely send data to it, tools that the sandbox can u- the agent can use to search things and do things in the sandbox, and tools that can like get data out of the sandbox, right? So that's a bunch of tools, bunch of tools all over the place. Um, but the, this one is pretty cool because again, we have a sandbox. You don't even need to know that the sandbox exists, but the agent is gonna be writing, uh, some sort of script on your behalf. I don't even know what it does half the time. Uh, I know it's secure, but it's gonna go and it's, it's found the data.
- CVClaire Vo
Looks right.
- SKSharadh Krishnamurthy
And it's only... Yeah, it, it looks right. I, I told it not to make any mistakes. [chuckles] So, um, so that's what these tools and skills are doing.
- CVClaire Vo
Yeah, I, I, I have a kind of separate question while this is running, specifically about making great data agents, because I talk, talk to a lot of companies, and almost universally the first internal agent they build is specifically for this use case. It is like data querying, dashboard visualization agent. And so I'm curious in Hubble, which I think you said is like kind of your data store query engine, were there any things that high level you had to do to make Hubble agent ready? Um-
- SKSharadh Krishnamurthy
Oh, yeah
- CVClaire Vo
... because I see like query metadata and, you know, Ask Data and these skills. I'm just curious, like if you were building an agent and you needed to ready the data warehouse and the query lay- layer, what are a couple key things that you think are super important for folks to think about?
- SKSharadh Krishnamurthy
100%. Uh, that is such a great question. So, uh, like I said, luckily at Stripe we care about our data so much that, uh, we've invested a lot into both the, the data querying layer. Uh, we use, we use Trino as our, uh, data sort of querying layer in our warehouse in that perspective. Um, we've invested a lot into making that super resilient, right? And those investments have helped agents like slam it like crazy and not bring it down, right? Uh, we've invested a lot our, uh, data, um, the data platform side of things. We've invested a lot in a catalog of data and tiering of data, so we have access to schema, uh, that can quickly tell us, oh, these are the relevant data sets that you might wanna find and use, and how would you use it, right? But even there are higher level investments as well. There is a blessed analytics layer where like the really key metrics go in, right? And like there's a tiering system where you, you... There's an analytics layer. If you fail that, you go look at all the standard data, uh, dashboards that we have, and you use the queries from that. And if you fail that, then you use the data catalog and search through for the high quality data sets and figure out how to use it. Agents are incredibly good at figuring this out. However, the key part, and you asked about the Ask Data skill, the key part is we have, uh, some really smart data scientists as well who sort of said, "Hey, this is the, this is probably the right way that most data query should be handled." And what that skill does, if we dig into the Ask Data skill itself, what it's gonna t- be s- saying here is route to direct artifacts first. Use the, uh, use the analytics layer first, and if that fails, then fall back and fall back and fall back, and until you like hit, you actually hit the data catalog directly, right? So these investments were made for humans, but have held up really well for agents because turns out the reasoning through it, you, agents have the same problem. They can f- they can answer the question, but they have no idea if it was the right query or the right table. Uh, and these investments have paid off in helping, helping guard that.
- 17:22 – 19:20
Why Stripe has benefited so much from AI
- CVClaire Vo
I want people that are listening to hear a couple things, and, uh, you know, I'm gonna make the Stripe team blush. I say this specifically about Stripe a lot, which is I think one of the reasons why Stripe has been able to benefit so much from AI is prior to AI, there's been a commitment to developer experience, developer platform, data platform, analytics layers. Like all these things that made humans really efficient at the company pre-AI are foundational investments that now give you extreme leverage when you throw agents at it. And so, you know, when people ask me like, "Claire, what can I do to ship more product?" With AI. They think I'm gonna say something about product development, and I say, "Double the size of your DevX team. Double the size of your data team." Like, work on platform investments, good for humans, good for agents, um, and that's what we'll, we'll let you run. The other thing I-- you said, and I don't want people to miss, because I love this idea of this, like, three-layer, um, triage that a data agent can go through, and that's really smart. Like, find existing reports, please. Then use the analytics layer to find the right query. Then if, like, you really have to, fall down to the data catalog and write your own query. The thing that I also heard you say is, your data warehouse has to be very resilient to high volume queries, because when in doubt, an agent will just brute force it. And so, um, again, this is like infrastructure hardening investment, performance investment, not sexy, not what people are thinking about when you're building these data agents, but actually allow agents to do a really effective job because you don't worry about, like, you know, turning over your, your data warehouse because a agent is hammering it.
- SKSharadh Krishnamurthy
100%. And like everything that you said makes so... It's, it, it's resonates so much with, uh, with all of that. My, my, uh, personal history at Stripe has actually been on each of the kind of teams that you've referenced.
- CVClaire Vo
[chuckles]
- SKSharadh Krishnamurthy
So I'm like, "Yes, someone gets
- 19:20 – 20:41
Agentic identity, load shedding, and rogue agents
- SKSharadh Krishnamurthy
it."
- CVClaire Vo
[laughs]
- SKSharadh Krishnamurthy
Uh, so this is great. Um, the, the thing about resilience, uh, um, agents are very creative at bringing your infra down. Uh, what can I say?
- CVClaire Vo
Definitely.
- SKSharadh Krishnamurthy
They're like, it's almost like all these scripts that they were trained on just teach them to be script kidd- uh, kiddies or something.
- CVClaire Vo
Mm-hmm.
- SKSharadh Krishnamurthy
Right? The, the, the thing that, um, we really did well is thinking about agentic identity, like we haven't solved this yet, right? But thinking about how do we say that, you know, this is the... This is an agent, and this is what it's trying to do. Like, what is the use case it's trying to use to, to, uh, as it goes around doing its thing in our infrastructure, and using that as a way to think about priorities and load shedding and all of that good stuff. Again, not super sexy, very, like, deep infra stuff.
- CVClaire Vo
Yeah.
- SKSharadh Krishnamurthy
But the same principles apply. It turns out that agents just, like, dial up all your failure modes. Like, it just-
- CVClaire Vo
Yeah.
- SKSharadh Krishnamurthy
It's, it's just ex... Uh, it just multiplies the amplitude of problems you can get, right? And, uh, the investments, I, I wouldn't claim that we did not have any issues. We-
- CVClaire Vo
Yeah
- SKSharadh Krishnamurthy
... definitely had a bunch of issues where when we started doing this, like, there were agents that went rogue. Um, there were agents that, you know, uh, may have almost taken down core systems.
- CVClaire Vo
[laughs]
- SKSharadh Krishnamurthy
Uh, but we caught the, caught it in time and, uh, and now we've hardened those systems as well.
- 20:41 – 25:01
Iterating on the dashboard
- CVClaire Vo
I, I love it. Okay. So we've, uh, yapped while Kai ran.
- SKSharadh Krishnamurthy
[chuckles]
- CVClaire Vo
Let's show what Kai actually generated using these skills and tools in sandbox.
- SKSharadh Krishnamurthy
Yeah, of course. Um, so here's what you see. You see that, uh, you know, Kai adoption is looking good and, uh, this is something I'm personally super happy about. Like, pretty much everyone at Stripe uses Kai. Um, like 86-plus percent of the company now, so really AI for everyone, uh, which is how we started out, uh, this process. And you see this ramp that's gone from a, uh, ve- fairly low number. I, I think if we had done this a couple of weeks ago, it would've been in the hundreds, up to a very high number. So happy to talk more if you're interested, if, uh, viewers are interested into how we, uh, manage that. But okay, we have a dashboard. Dashboard looks good. It also looks, like, vaguely stripey. Uh, so I need to go back and see how the agent figured out that it needs to make things blurple. So, uh, I gotta go figure that out. But... And it has a bunch of things here. It's an interactive dashboard and has links to a bunch of things, right? That's fine. This is great. We can already see how this can be useful for, like, I now generate a dashboard every meeting I go to because it's so easy, and it helps me drive, uh, drive the meeting a lot better. But the real power here starts to come in when you talk about multi-turn conversations, right? So great, we have a dashboard. Awesome. But let's do something more. Let's sort of like get Kai to, uh, iterate on this for us, right? So, hey, I love this dashboard, but let's do some more here and, uh, use this query, get a breakdown, yada, yada, yada, and it's gonna do some interesting things here. So I'm gonna kick this off, but I'm gonna talk through what I'm doing, right? A, the dashboard isn't like... Is the artifact isn't, like, created and, like, it's not fire and forget, right? We give a chance for people to do deep work by iterating on their artifacts, and that's really powerful. Uh, it's better for token efficiency. [chuckles] You don't wanna be throwing away a HTML dashboard every, every turn. But it's also really moving into this idea where the agent and you are collaborating on a task, right? And, uh, a l- we have turns that are, like, super deep, like hundreds of turns, uh, over multiple weeks. So the idea here is you have sort of like a somewhat, like a pretty smart collaborator who has some artifacts, and you can iterate with them on it. I'm gonna add this query, and I'm gonna do some really interesting things, and this is something that I, I think it's worth getting into. I'm telling it, okay, it's not just pulling the data. It's not about pulling the data and displaying it. I want you to do things with the data. I want you to, like, munge the data in some way or form so I get what I want. And the reason why I'm touching upon this is a lot of the data sort of things that people wanna do end up being last mile data. You think about people's workflows, it's so different. It's so hard to build a dashboard for everyone to do every part of their job, and then, then you have, like, a gazillion dashboards, and how do you manage them? You can't keep the right dashboards at the right level of quality. Using an AI like Kai to do this means that you can create, like, light apps, almost like the whole, like, the lovable style, uh, thing, where people are creating apps to just hyper optimized for their workflow. And the fact that they have a sandbox that anybody, regardless of whether they're an engineer or not, can get the agent to write code for them and do whatever the heck they want with the data, it's really powerful. And I'm pretty sure that, again, as expected, it's gone in, it's sort of like said, "Okay, here's the actual data, and I want you to go do some summation somewhere to do the other tab," and, um, out it came. So, uh, super interesting, and if I open up the updated dashboard, it's the exact same dashboard, and you should now see this really cool little, uh, segment below that. So I, I could, I could keep yapping about this dashboard. [laughs] I love the fact that our marketing team is, like, 100% all in, [laughs] right? So-
- CVClaire Vo
They need it, right? I don't know a single marketing person that doesn't either want some sort of app built or some sort of dashboard. So I think you have product
- 25:01 – 29:07
How they rolled out Kai across the team
- CVClaire Vo
market fit. That leads me to my next question, which is how do you roll out... I'm just curious, kind of, you know, inside, inside the doors of Stripe, how do you roll something like this out? Is it really organic adoption? How did it get built? How did it get shared to the team? Was this, like, 20 engineers, team-- Like, h- how did this come to be?
- SKSharadh Krishnamurthy
Definitely not 20 [laughs] engineers. Uh, Stripe, uh, we, we run, uh, fairly lean and very nimble and very fast. Uh, we built this super quick. It, it, it's a very interesting case because, um, uh... So we had, like, say, me and my colleague, we had the idea. Um, um, I was moonlighting as an, uh, as an engineer ring, uh, individually, individual contributor, again, trying to get this out the door. And so it took us, like, one and a half people over two weeks to get V0 out the door. And something we realized was a lot of the questions became-- uh, the answers became apparent once we could show people something. It was very hard to tell people why something like this is, is required in a world where you had the coding agents around, and they could be, like, super powerful. But the moment we got that V0 out, super inexpensive, one and a half engineers for, like, two weeks, right? V0 out. And then we moved into a pilot stage where we started seeing a lot of, um, um, interest from... Primarily, we have a great collaborator, uh, earlier on the GTM team, um, who builds, like, AI for GTM, right? And they were, like, super interested in this because, um, like marketers, our go-to-market, uh, uh, function at Stripe, like, they are extremely... Like, they're looking for whatever they can do to, uh, to reach more people, to reach them more, uh, i-in the right manner, and so on. So they-- we saw a lot of adoption from them. And, um, that's how it kicked off. It went into this pilot stage. We still had about 200 to 300 users. At this point, we had, like, two and a half, three people working on it. Um, and this was the next, like, month or so. Things really ramped, uh, once we did, like, a company-wide demo saying that, "Hey, we built this thing. Uh, we invite you to use it." And it just clicked for everyone. And people started, uh... That's when you see the really steep ramp up somewhere here. And everyone started using it. Even then, the team itself, I wouldn't say is humongous. Like, yeah, 10,000 plus people use it every week, but the core team that manages the experience is still, like, less than 10 people. It's, uh... And we have a lot of other things we have going on, uh, with those 10 people as well. Um, and the things that let us build it, of course, coding agents and the, and the productivity that they've given us, and our DevPro team are incredible. Uh, we've spoken about Minions on the show before. We have incredible tools at Stripe to get more from, uh, from who we have. Uh, and we have all this infrastructure that you referenced. And all that has helped us. So I w- I would say it's less than 10 people, but I also wanna give credit where it's due. Like, there are a lot of people helping those 10 people do what they can do.
- CVClaire Vo
I love it. This episode is brought to you by Hyperagent, the platform for deploying always-on agents that actually run your business. With Hyperagent, you build agents in the cloud and deploy them where your work already happens, like Slack, Telegram, or email. An agent will scan your inbox and draft replies to vendor follow-ups. Another monitors competitors and spins up rich ad kits and landing pages. A third notices a deal going cold in Salesforce and writes the save email with full account context. These aren't chatbots waiting for a perfect prompt. They're proactive, learning your preferences, retaining your playbooks, and getting better with every run. One user built four agents to run an outbound sales pipeline, prospecting, outreach, follow-ups, CRM updates, all in a single afternoon. No local setup, no VPS bills, no fragile permissions on your laptop. Just powerful agents with full control over skills, tools, and guardrails. How I AI listeners get $100 in free inference to start building. Claim yours at hyperagent.com/howiai.
- 29:07 – 34:18
How projects work
- CVClaire Vo
What else, maybe one or two other things that you think are worth pointing out in Kai, um, that you think make it pretty unique or at least, you know, fun and easy to work with?
- SKSharadh Krishnamurthy
I'm gonna do two things. I'm gonna show skills, and I'm going to show projects, right? So when I come to, say, skills, we have this thing. It's great. Everyone loves the dashboard, but I don't wanna be creating this dashboard and paying a bunch of tokens and, uh, time every time. So the thing that I, uh, think I did really well, and one reason for its product market fit, was I can create a skill that basically takes what I've done this session and packages it up so that it can become a load-bearing, repeatable workflow, right? And that's when the AI goes from, "Here's something I'm just, like, iterating with on the side," like a chat interface, to, "Here's something I can trust to run my... to sort of, like, run my business or run my workflows or help me, um, help me do that." And a, a little bit after You're gonna see this kick off this, like, skill creator skill. It's a skill that the harness has that's gonna go in and create... Like, take all the things it's learned from the session, from its interaction with me, and package that up nicely into something that I can just, like, um, uh, pull up at any time. And we'll, we'll talk a little bit more about, um, how we do the skill, um, uh, retrieval. I think that's a really cool part of the system as well. But, but while that's cooking, right, uh, let's actually look at this other thing I, I love about how we built Kai, which is this notion of projects, right? So the thing about projects is there's so much stuff happening at Stripe. We have, like, 2,000 skills, right? Projects are this really nice packaging mechanism where we can draw a boundary around those skills and say, "These are what most people who are doing this workflow must be using." We have projects that are created for, uh, projects, like short-lived things. We have projects created for teams, like the people team has a super secure version of Kai in a different project that's backed by a totally secure backend and stuff. The thing about this is, again, it lets one person or a few people who are DRIs of the space to, uh, figure out how to, um, get the agent to perform well for everyone. The really interesting thing I have on projects, there's this thing called settings that, like I said, you can use it, uh... You can use a custom agent to power your project. It doesn't have to be our Kai, which, uh, which is pretty good and general purpose. But let's say you have something really bespoke, you can use all the same features we have, but just backed by a different API in the backend and a different harness, right? So really, again, when you talk about, uh, AI at the enterprise, there's going to be heterogeneity. There's-- It's gonna be a lot of different cases, and building this in layers so we can give maximum leverage and customizability. One of the cool things about projects that can be very concrete for people is the idea of tool policies. Now, I mentioned the people team. Let's say you're a person on the HR team who's dealing with a bunch of sensitive information, right? You really don't want the agent to somehow go rogue and put that sensitive data into some public Google document that all Stripes can access. That seems like a accident waiting to happen. We don't like that. But you also don't want to tell them, "Oh, you can't use any tools because your workloads are too sensitive," right? So what projects let us do is to say, "For this workflow, I'm gonna set up a tool policy that says," in this case, I set the RunHub, uh, tool so that I don't inadvertently, uh, put some, uh, confidential information into the demo, right?
- CVClaire Vo
[chuckles]
- SKSharadh Krishnamurthy
But, uh, we could test this out with some other tool, and it's going to, uh, kick off what is a, um, is a human-in-the-loop workflow. So create a calendar invite for me and Huang tomorrow at 11:00 AM Pacific, right? And I set this up ahead of time just to show what a human-in-the-loop flow would look like. Uh, but you can, you can see it extends to, uh, any other kind of tool. What this is gonna do is going to tell me, "Hey-"
- CVClaire Vo
Mm. Uh-huh.
- SKSharadh Krishnamurthy
Should be familiar to most people, uh, who've used, like, Cursor or, uh, or the other, uh, lar... you know, uh, big products out there. But I wanna do this, right? The interesting part and why... This isn't the fun part. The fun part is what I showed before, which is that someone who is the DRI of a space can decide that certain tools are kind of sensitive for the workloads that these people are gonna be using. So we need a human in the loop to confirm if that action can be taken by the agent. Agents are really good. They're very creative, so we've got to put some restrictions on them so they don't go rogue, right? And projects help us decide. I'd also don't want this to be happening for every person at Stripe. That would be kind of friction-ful. So projects are, again, drawing a boundary around it.
- CVClaire Vo
Yeah. I, I love this because I think a lot of the existing tools let you maybe configure some of this at the individual level, but then it applies to every session. It's not contexted to what you're working on, and you can't share that permission set across different users. And so what I think is interesting about Kai is the, like, permission and context boundaries are very purpose-built for how your company works on things. Um-
- 34:18 – 35:58
Bespoke agents for bespoke use cases
- SKSharadh Krishnamurthy
Sure.
- CVClaire Vo
... and I think, you know, when people are asking themselves either, "Should I build something myself, and does that make a lot of sense?" Or, "Do I need to pluck something off the shelf for my enterprise use case?" Again, you need to ask yourself, how much appropriate or inappropriate friction will this put in everybody's day-to-day work? Because at the end of the day, what you wanna do is make everybody's life easier without causing chaos or trouble, and you want the management requirements to go down really low, right? You don't want everybody to have to think every task like, "Do I need to turn on this connector, off this connector, connect to this data?" Um, and so I, I do think one of the benefits right now of, of teams building their own thing is they can really think about bespoke agents for bespoke use cases, but kind of hide all that complexity from the end employee, the end teammate, um, and just let them get to, get to work.
- SKSharadh Krishnamurthy
That, that's super insightful because as you were speaking about bespoke agents, and I showed a little bit of this earlier, Kai looks like a single product. It really isn't. It's like the icing on top of a multi-layer cake, and each of those layers can be, like, customized to work at the enterprise, right? So, uh, 100% agree that the notion of both customization but lowering the cost of management, the cost of ownership, and just the friction. If you put too much friction in front of people, they're just gonna do unsafe things because that's how humans are, right? [chuckles] Uh, we, we, we don't... If we, if I showed you this every single session for every single tool, eventually you're gonna press the wrong button, right? Uh, so really thinking through that is a big part of what we're trying to do here. So
- 35:58 – 40:40
The skill builder workflow
- SKSharadh Krishnamurthy
that's projects and why I love projects as a unit of governance. Let's hop back really quickly to the skill builder flow that I spoke about. Again- We made that dashboard. We wanna make this something that I can, uh, that I can reuse, right? And it's not just me. It could be my entire team. Why do we have to, like, keep things, uh, close to ourselves, right? And so I can now go... Kai has created a skill for me. It's like a standard open spec skill that you can use on any of your, uh, harnesses, right? But for the purpose of this, I'm gonna go click this button, and Kai is gonna say, "Okay, what do you want me to do?" Uh, I'm gonna go ahead. I could choose to put it, push it to an area, and we've talked a little bit about area skills, but for now I wanna keep it private to myself, right? And of course, this is, like, nothing special about me here. Any user of Kai can do this, and that's why we have a lot of skills, uh, now that are making people more, uh, effective. So it's filled in the description for me. It's filled in, like, when Kai could use it, so this is important. We'll come back to this in, like, a second, right? And I'm just gonna go ahead and export draft. Oh, man. I already created one.
- CVClaire Vo
[laughs]
- SKSharadh Krishnamurthy
Um, again, uh, this is what happens if you prepare too well for demos. Uh-
- CVClaire Vo
This is when you, when you do it live. I mean, we, we believe you. I think what, what you're showing here, great. You have kind of a skill creator, skill or tool. You have a specific spec that you're using to ensure that it's both written well generally for agents, but also written well very specifically for the Kai harness.
- SKSharadh Krishnamurthy
Mm-hmm.
- CVClaire Vo
Um, and then I love this idea of a draft kind of-
- SKSharadh Krishnamurthy
Yeah
- CVClaire Vo
... skill editor, um, that you can test and edit and optimize and manage. It's quite nice. Um-
- SKSharadh Krishnamurthy
Yeah.
- CVClaire Vo
I know people just love fussing around in markdown and, you know, Python files, but just a little quality of life UI here can go a long way.
- SKSharadh Krishnamurthy
100%. Um, we really invested a lot in making this feel like, uh, a little bit like an IDE so that everyone-
- CVClaire Vo
Mm-hmm
- SKSharadh Krishnamurthy
... can get access to that quality of life improvement. Um, going back here for just a second. Now that I did this, I can go and I... This is the magical part. This is the part that I'm really excited about.
- CVClaire Vo
[laughs]
- SKSharadh Krishnamurthy
Um, and the, the team has, like, really kicked ass here. So give me the latest Kai adoption dashboard, right? That's all I'm gonna say. And this is the part where the magic of Kai really shines. Now, when you're in a coding agent, you can see what it's picked up. It's picked up the skill that we just, like, literally just created, right? And the reason why this is interesting is when I said all the way at the top of this that you can just go in and start using Kai, and it knows what to do. This is how it knows. Looks like my, uh, my, uh, my, my tool policies are too, uh, are too secure, right?
- CVClaire Vo
[laughs]
- SKSharadh Krishnamurthy
So, um, now the thing that we have done is in a, when you're a coding agent, right, you're in a w- re- repository, you're in a folder, you have this natural structure to what you're trying to do, right? And so you can pick up the, uh, the, the, the skills in the hierarchy of where you're working, and you get the right set of skills required to do your job. When you're in an enterprise and you're starting to work, you don't know, like, there is no hierarchy of what you're meant to do. You're frequently trying to hit, like, five different systems. And so a large part of the investments we've done and what we've, um, what we've managed to give, uh, to Stripe is the ability to package skills and retrieve them. And we do this, like, really rigorous flow of knowing when the right skills are being invoked so that Kai can perform at a high level, right? And the number of skills that we have, we've gotta do some pretty, uh, interesting things to ensure that we keep those skills in tip-top shape. We've also built out this interesting thing where it's not enough to enable people to build a bunch of skills. How do you make sure that they actually know what it's doing, and how you keep them in, uh, in top shape? And that's the other thing that we're really investing in, this automatic platform-driven, like, suggestions for how to improve your skills so that, especially since we let anybody publish a shared skill, right, that anybody else can pick up, it's become really important to ensure that we can give people the tools to keep those in tip-top shape. Again, something that you probably don't worry too much about if you're just using AI for yourself, but the moment you introduce, like, sharing and the enterprise, uh, quality, governance, policies all become something really important. And they're usually something pretty specific to the company you're working at, and, and Stripe is no different.
- CVClaire Vo
You know, the only other
- 40:40 – 43:01
Skill quality, evals, and telemetry
- CVClaire Vo
thing that I've seen here that I'm curious maybe you have but you haven't shown is we see a lot of folks, um, that are building these internal harnesses do skill and tool telemetry and observability and see where, like, tool calls are failing a lot, so they can auto-eval that. And then they also have a deprecation policy for skills.
- SKSharadh Krishnamurthy
Mm-hmm.
- CVClaire Vo
So if skills have not been invoked for, like, 30 days, you get a little notice, and it's like, "Hey, you haven't used a skill. If it's dead, maybe we archive it."
- SKSharadh Krishnamurthy
Yeah.
- CVClaire Vo
And if they don't get a response, it goes into, like, um, deprecation status, and then they delete it two weeks later just to, like, prune all this stuff that's happening.
- SKSharadh Krishnamurthy
Yeah.
- CVClaire Vo
And so, uh, uh, I think this enterprise-level maintenance of the skill library is really important, not just from a quality perspective, which is what we see here with the evals, but honestly from a quantity perspective. Like, just is any of this useful anymore?
- SKSharadh Krishnamurthy
100%. And, uh, it's n- I almost think you can't separate quality and quantity when it comes to, uh, these systems because, you know, context is everything. The more unrelated context you throw into the AI, the less good your, uh, results become. So quantity is almost a, uh, facet of quality. Uh, we've, uh, we started out with, like, a bunch of different, uh, skills, and we do have telemetry, um, on We have, let's say, 50 skills that are used, like hammered every day across the company. We have this long tail of 100 to 150 other skills that are used by subcategories, uh, you know, parts of the org chain. And we have a bunch of tools that are used by two or three people, right? We need to respect that all of these exist. There are teams that are three-member squads doing some really bespoke thing, and they wanna share between themselves. But then again, what is the telemetry we have? And part of the process I'm showing here is we-- this is the user-facing part of it, but part of the process is telling us as harness owners, these are the kind of skills you probably wanna promote up into like a general workflow, and these are the skills that you wanna, like, delegate out and move out of the general workflow because it's just taking up context, right? So, uh, definitely, uh, unfortunately, don't have something cool I can show a-around that, but it's, it is something that there's an ETL pipeline happening somewhere
- 43:01 – 45:13
Recap
- SKSharadh Krishnamurthy
that's doing this.
- CVClaire Vo
Amazing. Well, I just wanna recap for folks because this has been awesome. Just high-level things about Kai, personalized context, um, for people, org chart awareness, um, you know, tune tools, a sandbox that you can put data in, a sandbox you can pull data out, shared artifacts.
- SKSharadh Krishnamurthy
Okay.
- CVClaire Vo
Projects, which I feel like if you missed that part, rewind, go back to it, 'cause projects are not just how you organize chats across a team, but how you give a specific space, whether that's a team under an initiative, access to tools, access to data, permissions and controls, including what requires a human in the loop. Um, a skill builder skill, but not just a skill builder skill, a skills platform for the company that allows you to build skills, edit skills, eval skills, share skills. Um, and then, you know, AI that just, just works for the things that matter, including data analysis, which benefits not just from this tuned harness and skills around it, but investment from infrastructure all the way up the stack on a great agent-ready data layer. And it took one and a half agents, or one and a half humans, sorry, probably a million agents.
- SKSharadh Krishnamurthy
Ma-many more agents.
- CVClaire Vo
A, a couple weeks to get V1 going, and now is serving 10,000 Stripes with less than 10 people, plus a bunch of great infrastructure that you've been investing pre- and post-AI. That's it. That's all.
- SKSharadh Krishnamurthy
That, that, that's all.
- CVClaire Vo
[laughs]
- SKSharadh Krishnamurthy
There. Not, not much, not much to it. Um, but yeah, it's, it's, uh, I think that was a fantastic summary. A lot of good stuff. Um, I think it's important also, I would be remiss if I didn't say, it sounds like we figured this all out. We absolutely haven't. Like, we are, we are very cognizant that we are in the earliest parts of this journey, and, um, we're hoping that, like you said, the strong foundations we have help us iterate and move forward with the, uh, with the times. Um, but yeah, it's been a fantastic journey so far, and, uh, maybe we'll be back in a year showing you something completely different because that's how quickly this space moves.
- CVClaire Vo
I, I really ho- I hope, I hope sooner than a
- 45:13 – 50:22
Lightning round
- CVClaire Vo
year. Well, before we get out of here, let's do two lightning round questions. Um, my first one is, let's just put Kai aside for a minute. Let's put a- put aside Stripe Blurple. What are personal AI things that are fun that you're doing or that you're excited about as an engineer? Um, you know, when you shut... You know, as you say, we, like, shut the work laptop and open the fun laptop on the weekends. Um, what are you excited about? What's cool?
- SKSharadh Krishnamurthy
I, I'm super boring, but so I'm gonna, like, say something less boring first, which is, uh, it's helped me, like, not sound super dumb to my-
- CVClaire Vo
[laughs]
- SKSharadh Krishnamurthy
... to my six-year-old, who's right at the stage where he's asking me all these complex questions about, like, exoplanets and, um, and, like, galaxies far away, and I'm like this, on the side, uh, you know, Gemini on my phone, like, "Hey, like, can you tell me what's happening?" Uh, and then I act like I know the answer. So it's helped me, you know, keep up to his model of Dad knows everything. So that, that's, that's good. Uh-
- CVClaire Vo
That's perfect.
- SKSharadh Krishnamurthy
Um, but on the work front, honestly, like, the stuff that I'm not doing when I'm building Kai, it's like my... I have this whole workflow now which is around using the AI to make sure that I don't miss things. It's so boring, but it's so good. Uh, we didn't get to show you Kai schedules, but I, I basically use Kai as, like, my personal assistant. It just tells me things that I'm supposed to be doing, and so, it's so basic, I, I almost... I'm almost embarrassed to say it out loud, uh, but it's, it's been the biggest life hack. Um, just not having to keep it all in the, in, in the brain has been awesome.
- CVClaire Vo
Mm-hmm. Yeah. I... What I tell people is, we think a lot about how to put agents to work. I want the agents to put me to work. I want them to say, "Claire, please fill out this form. Claire, please do this thing you said you were going to do." And so I think it's a, it's a give-and-get relationship, and I love that, and I also have many children who ask me really existential questions about the universe and about dinosaurs and about history, and I agree, intelligence on demand helps us keep our superiority in that par-parental-child relationship. [laughs]
- SKSharadh Krishnamurthy
Yes. Yes. For a few more years at least, until they figure out what we're all doing.
- CVClaire Vo
So last question. When Kai-- Well, maybe not Kai. Maybe you're very sweet to Kai. But when AI is not listening, what do you do? How do you prompt? Are you a yeller?
- SKSharadh Krishnamurthy
I, I don't know. I feel like I'm... Maybe I'm just subconsciously afraid of, uh, what it's gonna do to me when it figures out, you know, knows where I live or something. But I'm very nice to the AI.
- CVClaire Vo
Yeah.
- SKSharadh Krishnamurthy
I just say, "Hey, that's not what I wanted. Here, I'm gonna say it again," and then maybe I, like, all-caps it. But I, I don't know. I, I don't like shouting at the AI. It feels, uh, it feels wrong.
- CVClaire Vo
Yeah.
- SKSharadh Krishnamurthy
It's almost like I'm shouting at the people who built the AI.
- CVClaire Vo
[laughs]
- SKSharadh Krishnamurthy
So, um, maybe. But I, I just insist. I just, uh, I say, "Yell harder," to my, uh, team, but I actually end up just, like, saying a lot of, "Please," if you will, "Read the thing I said better."
- CVClaire Vo
Yeah.
- SKSharadh Krishnamurthy
Uh, but it's, it does mess up, and it's very frustrating.
- CVClaire Vo
Like, like many of our guests, you gentle parent the AI, which is-
- SKSharadh Krishnamurthy
This is true
- CVClaire Vo
... I n- I know, I, I know you can do better. I believe in you. I'm n- I'm not mad, I'm disappointed. [laughs]
- SKSharadh Krishnamurthy
I'm disappointed. I'm just disappointed, Kai. Like, he should've done better. [laughs]
- CVClaire Vo
I love this. Well, this has been super helpful and interesting for me. It's given me so many ideas about just my own use of AI, and how I talk to people in enterprises about their use of AI. Where can we find you, and how can we be helpful to you and the Stripe team?
- SKSharadh Krishnamurthy
Well, uh, I'm on, um, I'm on LinkedIn, and, uh, I'm happy to connect with anyone who's, like, super interested, um, in learning more about what we've built here, and how we think about, you know, uh, scaling AI for the enterprise. Um, and Stripe is always hiring. We are always on the lookout for people who want to, you know, join this, uh, crazy band of people trying to, uh, build amazing things for, for the world. So, um, please look out on the Stripe Careers page. Um, but otherwise, um, my email is, um, um, sharadh@stripe.com, and I'm happy to, um, happy to engage with anybody who has questions about anything we covered today. Um, but yeah, uh, keep those questions coming.
- CVClaire Vo
Awesome. Well, thank you to you, and thank you to the Stripe team for being so generous with all the things that you've shared with the audience. We really appreciate it, and thanks for joining How I AI.
- SKSharadh Krishnamurthy
Uh, thank you for having me, and this was, uh, this was, uh, fun. Uh, I don't know if I mentioned, but you're a minor celebrity, uh, on the team.
- CVClaire Vo
[laughs]
- SKSharadh Krishnamurthy
So, uh, I now have some reflected glory, and, uh-
- CVClaire Vo
Perfect
- SKSharadh Krishnamurthy
... yeah, it has been a amazing time. Thank you so much.
Episode duration: 50:24
Install uListen for AI-powered chat & search across the full episode — Get Full Transcript
Transcript of episode AbZODZ_4VaM