A Model For Everyone: How Ronak From Trajectory Is Building Products For Continual Learning

1. 0:00 – 0:45

   Introduction

   1. RMRonak Malde0:00

      A lot of our philosophy in product actually comes from Apple. In, like, the early 2000s, you had a computer that had access to the internet, and you had a phone that you could make phone calls. And I think no one really thought to put the two together until Apple said, "Okay, what if you actually put the internet on a handheld device and combine the two?" And I think by doing this of, of basically putting training, eval, and deployment in one place, making that just dead simple for every single person to do, and then you can close the loop and basically now upload that model back to production, gather new traces. It suddenly is this magical paradigm that I think every single company is going to adopt very soon.

   2. LRLauren Reeder0:36

      [upbeat music]

2. 0:45 – 2:48

   Pseudo continual learning: paper maps vs Google Maps

   1. LRLauren Reeder0:54

      Ronak, thank you for joining us. It's a pleasure to have you. We would love to dig into a bunch of what you're building, how you see the world of research, and where you think the future is going. Um, maybe to start, you guys spend a lot of time thinking about continual learning. Can you define it for us? I think you've also said this field is in a state of pseudo continual learning. What is real, and how will we know when we get to the real thing?

   2. RMRonak Malde1:14

      That's a great question. So, uh, when I think about continual learning, I actually think the human brain is a really good model, uh, for where we should aspire to get to. Like, in, in some sense, we are true continual learners. We learn online. We are constantly updating, iterating. And I think the world we're in right now with agents and AI, uh, is kind of, like you said, pseudo continual learning. When I was growing up, I, uh, my family used to do a bunch of road trips, right? And, uh, I don't know how you guys did, did things, but we would go to AAA, uh, back in the day, and, like, they would give us a bunch of these maps. They would, like, highlight everything, uh, and then we'd go on our road trip. Uh, and, like, if there's any point where we wanted to change our route, we'd have to either call AAA or, like, go to a physical location, and I feel like that's the world we're in right now, where we have these amazing, amazing agents. They're very intelligent. We have these mapping algorithms, but you can only consult offline a couple of places. Uh, and anytime you want to update your course, you have to just do an entire mass batch update. Uh, what the first goal and what we're building at Trajectory is first the ability to just democratize that access, right? To even just training these models and customizing them for what people want. I think of that as kind of like MapQuest, uh, where suddenly it's still offline, but we at least got the ability for everyone to not need to go to AAA, but, um, get the ability to map these algorithms. But the final stage of continual learning is something more like Google Maps, where every single time you're driving, every route that you make, uh, it is updating. It's learning aggregate what the fastest route is and where the traffic is. Uh, that's the world I want to get to.

3. 2:48 – 4:33

   Do we need new architectures? Rich Sutton, David Silver, and the missing layer

   1. PGPat Grady2:48

      That's a really good analogy. So, um, [lip smack] we had, recently we had Rich Sutton and David Silver on the show, and both of them kind of made the comment that continual learning isn't really possible with today's architectures. I'm curious in your point of view, what's doable? What's not doable? What's the state of play? Do we need major architectural leaps to kind of bring this to fruition? Where, where are we today?

   2. RMRonak Malde3:11

      Yeah, so it's funny because when you think about a transformer in LLMs, uh, I feel like a lot of people have seen maybe Karpathy's tiny GPT video or, or something where you basically have this stack of, of attention blocks and transformers that are built on top of each other. Uh, and a lot of LLM scaling has just been stacking these, these transformers on top of each other. Um, but when you look at, like, any paper, like DeepSeek V 4.1 Flash that just came out recently, uh, their architecture is, is actually kind of lobotomized or changed a lot of that base architecture, where you have things like fast and slow memory within the weights. You have skip connections that are going between layer two and layer 50. And so I think these architectural changes are actually already happening within the base models. Uh, and it will be a key component, I, I do agree, for continual learning. Uh, where I want to sit is basically leverage all of that technology and research that's happening at the architectural level, but then actually connect the dots to the real world. Because, uh, at the end of the day, the real value of any AI progress, but certainly continual learning, is how are people actually using models in the real world? Um, and I think companies have this idea of basically what good looks like in their mind, and the hardest part of this entire loop is then translating that to actual improvements for the model. Uh, I think that's where that missing layer

4. 4:33 – 7:36

   From a $100M consulting model to a product: lessons from SWE-1 at Windsurf

   1. RMRonak Malde4:33

      is.

   2. PGPat Grady4:33

      Yeah. So how do you connect the dots to the real world, and how much of that is product or productizable, and how much of that is just handholding and helping people through the process?

   3. RMRonak Malde4:44

      Yeah. So up until now, it's been really hard to, to just go from this fact of, like, data to intelligence. Up until now, that's only been in the labs, uh, and you need a massive research team. Uh, when, uh, so in the last couple of years, we, we started to have vertical companies going into this space as well and, and building out massive research teams. So, uh, I was previously at Windsurf where we embarked on this journey and trained a model, SWE-1. Um, so did Cursor as well with Cursor Composer. But the problem was you needed hundreds of millions of dollars of R&D and compute. Uh, you needed a really massive research team to invest in, and then you also needed a lot of time. So it took us six to nine months to actually get to that point where we could train a frontier model. Uh, and that is with a kind of handholding sort of consulting model. That's still sort of the world that we live in. Uh, I think any good product exists when you have every single company in the world trying to do the same thing over and over and over again. And if you can package that into a really beautiful interface that just says, "Here are the knobs and levers that you care about to translate the, what good looks like," uh, and then everything else is packaged away, I think that's, that's a beautiful interface to do that.

   4. LRLauren Reeder5:56

      What did you and your co-founders see when you were at Windsurf and when they were working on models as well to help you realize, "Hey, this is repeatable, that there is a product to build"? When did you have that aha moment and that realization?

   5. RMRonak Malde6:07

      Yeah. So part of it was, you know, we were training these models, uh, on production. Uh, like basically it's saying, "What are all these edits, the retries that are happening in the product?" And learning from that, uh, at Windsurf. Um, and then combined with that, so my co-founder's, uh, Michael was at DeepMind as well. He was working on Gemini Robotics, and they're starting to see the same thing where you could actually deploy these robots in the real world, build continual learning infrastructure to basically allow these robots to update every single day. Uh, and then Arjun was at Apple working on the Vision Pro. Um, and the same thing was he was basically saying, "How can we take artist feedback and use that for multimodal foundation models?" So in one way or another, all of us were, were basically figuring out this grand alignment problem, uh, of how do you actually take this feedback from the real world and improve the models? The problem is we were all at these big research labs, right? Um, and so I started to realize, okay, continual learning is going to be the next learning paradigm. Uh, is there a way that I can actually do this within the labs? And the thing I very quickly realized is at DeepMind, we, our, our entire focus was training one massive model and then distributing that one model to everyone in the world. And, and that's been a winning business model, obviously, across the board. But if you want to basically take one model, customize that for a single person, and then distribute that one model, like just for that customer, um, like for example, what our platform does with Harvey, that is a immense amount of infrastructure for a massive lab to build just for

5. 7:36 – 8:55

   Harvey: 6x cheaper than frontier, 4% to 18% on its own benchmark

   1. RMRonak Malde7:36

      one customer.

   2. PGPat Grady7:36

      Yeah. Ta-talk about what you guys have done with Harvey, maybe as an example.

   3. RMRonak Malde7:39

      So with Harvey, basically they were up until now riding on top of the frontier closed source models, right? Um, and they've been able to build incredible interfaces and products on top of that that help tons of law firms in the world. Um, but what they realized is they have an immense amount of knowledge, of data, uh, of all of this nuance built up that they are actually able to see, uh, what the law firms actually care about and the built-up experience of just 30 years, uh, of working in this domain. And with using frontier models, they're unable to actually take that data and use that to their advantage. Um, and so what they realized is, "Hey, okay, they're able to construct, uh, for example, a legal agent benchmark," uh, and what they released, and, uh, using all of the expert information that they have. And then if they get the power to basically use that data to train a model, uh, then they get to shape their own destiny. So with Trajectory, what they were able to do is train a model that is six times cheaper, a-and it goes from around 4% accuracy for an open source model, uh, to around 18%. Uh, and this is, there's still so much room to grow, obviously, what they're able to do. But now suddenly they get the power of a research lab. And on top of that, the nice part is these models end up being six times cheaper, uh, than the frontier, and so you're able to expend so many more tokens to achieve these

6. 8:55 – 10:13

   Why "Trajectory": the unit of work is a task, not a token

   1. RMRonak Malde8:55

      tasks.

   2. LRLauren Reeder8:56

      So you picked the name Trajectory. Is this related to this continual learning concept? How did you pick the name, and tell us how it fits into what you guys are doing.

   3. RMRonak Malde9:02

      Yeah. So it's funny because the world right now is very focused on tokens. Uh, and I think a lot of people view tokens as a unit of work. Uh, but if you think about the way that we interact with other humans, I'm not counting the amount of words that you're actually talking about, right? And with coworkers, we, a lot of the time are thinking about a task or a trajectory, and that's the unit of work that I really want to get to. In RL, it's, it basically is synonymous what they roll out or what you would actually do in a training stack. Um, and with continual learning, you have an RL training stack that's like a rollout engine and a trainer. A rollout engine is just like any simulation, basically like doing a bunch of rollouts and doing these trajectories. In the real world for continual learning, your rollout engine becomes just the inference in the tokens in the real world, and now suddenly your trajectories are the tasks of economic value that are happening. Um, and so I want this basically paradigm to propagate, where the unit of work that we think about is a trajectory. Um, beyond that, I think for also people that don't understand RL, uh, it is also super nice that we are basically letting companies just own that path and, and really grow on their own. So I think it has this nice double entendre.

7. 10:13 – 12:56

   The primitives of continual learning: traces, replayable environments, reward

   1. PGPat Grady10:13

      And can I say, I like the, I like this idea of a trajectory as like a unit of economically valuable work. Um, you've also a couple times talked about what does good look like, which kind of sounds like an eval or a benchmark. What are the core primitives for continual learning, or what are the key ingredients that kind of go into this?

   2. RMRonak Malde10:30

      Yeah. So our goal at Trajectory is to actually limit these ingredients so that it is literally just, you know what good looks like. Uh, however, right now there are a lot of components that companies need, and then we as our product as well try to bridge that gap and make that as easy as possible. So right now, as a company, you need a couple things. One, you need to be able to trace, uh, all of your trajectories that are happening in production. Uh, and there's lots of AI native companies that have gone through this transformation where they're logging not just the main agent call, but also all the sub-agents, what's happening in the product as well, any feedback that the user is giving. The ideal world is you get this kind of perfect timeline of all of those things so that you can track them. So that's the first step.

   3. PGPat Grady11:16

      And just on that, what are people doing that in today? Like, where do those traces live?

   4. RMRonak Malde11:20

      Yeah. In my view, I think the entire ecosystem of continual learning, uh, needs to be a lot of players that basically build up all this infrastructure. So, uh, some companies are doing this in-house, but there's also a lot of great products out there like LangChain, like Braintrust, Raindrop, where you can basically plug into your infrastructure or your production agents, uh, and then basically trace all of these things. So what we're finding is a lot of AI native companies will use a lot of these products in order to get that first step out of the way.

   5. PGPat Grady11:49

      Okay, so we got traces, and then what?

   6. RMRonak Malde11:50

      Yeah. So that's traces. The second part is then making these replayable. You need some sort of infrastructure to say, "Hey, okay, given a trace that I've seen in production, how can I actually then replay that for an eval to see what good looks like?" Uh, or right now for training as well. Uh, and so that's where companies also need to invest some sort of time. Uh, what we make really easy in our product as well is to bridge that gap. Uh, and so if you bring your traces and you say, "Okay, here's just the concept of an environment that I might want," uh, in more technical terms it's a Docker file or some sort of system requirements, then you can basically replay that entire trace. So that's the, that's the second part. And then the third part, uh, is then the actual modification of the algorithm. Um, and I think that's where, uh, it's really difficult to do this in-house as a company, is basically the entire training stack. Uh, the entire loss function, the reward function, all of these sort of components that need to be built up to, to translate these tasks into actual improvements for the model. Um, and so that's the main part that we want to abstract away, uh, off the

8. 12:56 – 16:16

   Group Size 1 and the meta-grader: training without an environment or a labeled reward

   1. RMRonak Malde12:56

      bat.

   2. PGPat Grady12:56

      To your point on abstracting away some of that, uh, what has been abstracted thus far? What's next? You know, what's kind of further out? Like h- how does this product come together over time?

   3. RMRonak Malde13:08

      Right now, uh, it's mainly you bring traces and reward, uh, and some notion of environment. The two parts here that, uh, require a bunch of manual work is the environment, actually constructing this thing that matches the real production. Uh, and a lot of the time it's actually impossible to create a perfect environment, right? And then the second part is reward. Uh, a lot of the times a legal workflow or investment banking workflow doesn't have some perfect verifiable reward that you can train off of, right? And so these are the two areas that we're really pushing on the research side. So for the environment, uh, there's an algorithm called GRPO. That's the main kind of post-training algorithm that exists right now. What you need to do there is you basically, like imagine you have a player that's in a video game. Uh, and it's basically going around and hopping around a bunch of platforms, and then at the end of the day you get some reward. What's needed here in GRPO is basically comparing like the same task, the same level of the video game, and you need to play that out 8 times or 16 times, and we call that a group. Now, the thing is with humans, a lot of the time we don't need to replay the exact same environment over and over again. We're just in the world experiencing and doing one rollout. And so the goal is could we modify GRPO as an algorithm to get to a world where it is what we call Group Size-1 instead of needing a group of 16? And so we've made a lot of strides here where now if you can take 10,000 trajectories and basically, uh, they're all from different tasks, we can actually learn from just that one behavior or that one rollout. Uh, and so that's one algorithm that we actually released a blog post about is going into this Group Size-1 paradigm. And so that actually eliminates the need for an environment and all of this infrastructure that needs to be built out. The second part, uh, is for reward. Uh, and so this is another factor where, let's say I have, again, 10,000 traces. Uh, the default is that I need to go and label every single one of those traces to say, "Here's verifiable reward," or, "Here's what good looks like." Uh, and this is tractable, it's just a lot of work. And so now our goal is how can we actually reduce that amount of time needed to take this notion of what good looks like and, and do that in much, uh, less amount of work? So what we've realized is, let's say I have 10,000 traces. If I can smartly select 100 of them, uh, that are basically representative of all of these broader 10,000, and then have the customer or the user basically densely say, "Okay, here's what good looks like. Here's a rubric or verifiable criteria for just those 100 traces." And then what we can do is basically train a meta-grader that learns from those behaviors of the 100 to the broader 10,000. Uh, and with that you get a really clean interface that allows you to just propagate this reward across the board. So I think obviously it's not the perfect solution in that direction. Uh, the ideal goal actually is that you have some sort of observability interface where you're like, "Here's the five things my agent's good at. Here's the five things it's bad at," and I just circle those five things and hit train. Uh, that's the world I want to get to, and that's where we're pushing that research direction in.

9. 16:16 – 18:58

   The platform: train, eval and deploy in one click, and who it's for

   1. PGPat Grady16:16

      Very cool.

   2. LRLauren Reeder16:16

      So you have a product that you just released to do some of this. Tell us about it. What have you-- what are you releasing in the product and who is it for?

   3. RMRonak Malde16:22

      Yeah. Up until now it's taken a massive research team a ton of time, uh, and a ton of compute in order to train these models. What we wanted to do is just make the easiest and most intuitive interface to train models and customize them for what you care about. Uh, and so Trajectory, the platform that we released, uh, is basically a very simple system where you can take your agent traces, uh, and what good looks like. It's a one-click train interface that just takes a couple agent prompts, uh, and then you can eval the model and then deploy it all in one place. Uh, and I think the really magical part about this, uh, a, a lot of our philosophy in product actually comes from Apple. Uh, and when, uh, in, in like the early 2000s, you had a computer that had access to the internet, uh, and you had a phone that you could make phone calls. And I think no one really thought to put the two together until Apple said, "Okay, what if you actually put the internet on a handheld device and combine the two?" And I think by doing this of, of basically putting training, eval and deployment in one place, making that just dead simple for every single person to do, and then you can close the loop and basically now upload that model back to production, gather new traces. It suddenly is this magical paradigm that I think every single company is going to adopt very soon.

   4. PGPat Grady17:37

      Very cool. Who is the product targeted at? Like, who is the ideal customer for you guys today?

   5. RMRonak Malde17:41

      Yeah. So what we want to do is make this very simple for companies that have already their agent harness in order. They've spent a lot of time there. But that next step of basically modifying the most valuable part, which is the model, uh, making that super, super easy. So right now what the product is meant for is mainly AI native companies, uh, like Harvey and Rogo, and some larger companies as well, like Nvidia, are already using the platform. But the next step after this is I want to also move beyond just the model. So, uh, another important piece is the harness as well. Uh, because I think the model gets you efficiency. It gets you, uh, a model that is seen at a task 100 times or 1,000 times over and, and making that faster, cheaper and more reliable. What a harness gets you also is new capabilities. It's just something that was not possible before. And I think a lot of larger companies that are adopting AI, uh, they also haven't done their work to optimize the harness for sub-agents or, uh, for basically squeezing out that last mile, even out of the frontier tokens. And so the eventual world is maybe you use a frontier model like Fable for 10% of tasks, uh, and then for 90% of the time you can smartly route to a model that you've trained that is far more efficient, uh, and also gets you better margins.

10. 18:58 – 20:14

    Rogo and intelligence density

    1. LRLauren Reeder18:58

       Tell us some stories about some of the customers you've worked with so far. You gave us a little hint at Harvey, but maybe a couple more examples.

    2. RMRonak Malde19:04

       Yeah. So one really interesting one here is Rogo. Uh, and I think Rogo is taking a very interesting paradigm to agents that I think will become the future. Um, so right now, the way people use agents are, are very much like synchronous, right? You prompt the agent, uh, it goes and does its thing, uh, and then it comes back. What Rogo is very interested in, uh, is not just, like, this kind of verbose model that will go and, and basically, like, spit out a bunch of garbage, right? What they want is just, like, a very concise and clear, uh, finance agent, uh, that basically, like, does the work that you care about. It can autonomously do things on the side, but then it comes back and is very efficient. Um, and so what the goal of Trajectory is, is to basically say, okay, Rogo, what good looks like for them is they also want the idea of intelligence density. Uh, they want the idea that a model can do the same task, but do that far more efficiently than the frontier models. They have the data to do that. Uh, and so with Trajectory, what they were able to do is train a model that is several times more efficient in terms of its tokens and also happens to be cheaper and faster, uh, but then is also able to gain and climb on the things that they care about.

11. 20:14 – 24:19

    What's next: curiosity, and why continual learning beats RSI on alignment

    1. PGPat Grady20:14

       Very cool. Okay, so we talked a little bit about, like, Group Size-1 with GRPO. What's next? Like, where is continual learning headed?

    2. RMRonak Malde20:22

       Yeah. So a lot of what we've been talking about right now is mainly just helping these companies, uh, like, translate over what good looks like for them into improvements for the model. Um, I think to get to this true world where humans, we are extremely efficient about learning from the real world, uh, and we're able to have, I think, inbuilt curiosity as well, uh, about the world. And I would say that's kind of one of the missing pieces to get us, uh, to agents actually learning on a, a kind of autonomously on their own via continual learning. The models right now, they do a task, uh, but they don't actually accumulate any experience or learn anything about the real world. Uh, whereas if you think about, like, l- let's say I'm throwing a football, right? Uh, I feel like as a human, uh, maybe if I've never seen a football before, I actually have no idea what's gonna happen.

    3. LRLauren Reeder21:12

       [laughs]

    4. RMRonak Malde21:13

       Uh, and but I do that 100 times over, and now I suddenly build this heuristic, right?

    5. PGPat Grady21:17

       Yeah.

    6. RMRonak Malde21:18

       Uh, and the important part is, I think, with humans, like, as kids, we are constantly exploring the world. We see a soccer ball, we see a football, and we kinda just try out things to build this mental model, and that makes us incredibly intelligent. Whereas with agents, that doesn't exist right now. And so we've done a lot of thinking in, in how do you actually quantify curiosity? Uh, and I think one interesting way to think about this is, um, so there, there's this idea in RL, uh, called a Markov decision process. Uh, and it's basically you can, you can characterize the world as a bunch of state action pairs. So a state is like I'm holding the ball in my hand, uh, and then an action is I throw it, and then the, the following state is where does the ball end up. What LLMs right now are really good at is basically going straight from state zero to state one. Uh, they're next token predictors, right? But what's missing is that intermediate part of what, what is that transition function when you actually, like, go from S, uh, one or S0 to S1, what is that transition function that happens? And LLMs don't really have a way of encoding that right now. So I think the interesting thing here is with humans, we are very aware of when we don't know what a transition function is the world, and we say, "I'm basically going g- going to try to figure out what this transition function is." And I think this is where curiosity comes in. And so if there's a way to basically quantify, here's all of the world that I don't know about right now, and my goal as an agent is to figure out if I do this task, what happens? And I build this mental heuristic, uh, then I think we are starting to solve this curiosity problem and get to a world where you can autonomously kind of, uh, learn and continually learn from the world.

    7. PGPat Grady23:01

       How do you make sure that an agent's curiosity is aligned with a user's objectives? [chuckles]

    8. RMRonak Malde23:07

       So I think that's, uh, actually one of the reasons why I'm very passionate about working on continual learning. So there's, there's two kind of directions that it seems like research is going right now. Uh, there's RSI, recursive self-improvement, uh, and there's continual learning. And, and both of these are, are very, very tightly tied together, right? Are very similar concepts. Uh, they're essentially just how does an agent actually learn from experience? Uh, the thing is, RSI is all about taking a model, putting it in a black box, and basically making it the best AI researcher itself so that it can improve itself, right? Uh, but this is kind of a scary world, right? Because it, it exactly begs the question of are these models and agents actually going to be aligned and have the best interests of humans in mind? Where I think continual learning takes a very different approach is it says, "I want to learn from experience, but learn from the experience of actually interacting with humans, uh, and then getting better at the tasks that they set out, uh, and that they want to do." And I think that's where the key difference is, is you need to allow these models and build the algorithm so that it keeps humans in the loop. Uh, I don't want to end up in a world where these agents are going rogue, and I think the way to do that is to, to keep on this alignment

12. 24:19 – 27:26

    Research and product under one roof, and the product builder as gardener

    1. RMRonak Malde24:19

       path.

    2. LRLauren Reeder24:19

       You guys have done a bunch of unique things across product and research at Trajectory to bring these two halves of the whole together. Tell us more about what makes building at Trajectory unique, and who are some of the people you bring together to make it happen?

    3. RMRonak Malde24:31

       Yeah, so the cool part that we are sitting in is the intersection of frontier research and product, uh, where we have to modify the, the core RL algorithms in order to get to a place where you can actually learn from the world, but also package that into a really beautiful and clean interface for people to train these models. Um, and so some of the research team that we've built that contributed to, like, for example, the co-founders to Gemini 3 and Gemini Robotics, other folks to GPT-4o at OpenAI, uh, and building Muse infrastructure at MSL. But then on the product side as well, uh, having people that have built scalable infrastructure at Stripe for payment SDKs. Also, we have the youngest design engineer at Netflix. Uh, these sort of people, and I think the intersection between them, is where the magic starts to happen. So the way we've actually structured the team, uh, normally you have, like, a research stack that's the spaghetti code base in, in one corner of the company, and then you have the product that's kinda well built out. What we've done is actually productionized the code base for training as well. Um, so this means microservices, Kubernetes scaling, auto-scaling of every single part of the trainer, the rollout engine. Uh, and then on the design side as well, our design engineers are kicking off training runs all of the time and understanding deeply what the research experience is. I think this is a, a really interesting and cool place to be in. Uh, a lot of this is also only possible because of frontier coding agents. Uh, actually, most of the time now we are spending our time whiteboarding, uh, and we'll spend a lot of time just arguing about system design. Uh, and then the actual implementation is just a software factory of agents that will go and, and actually implement it.

    4. PGPat Grady26:07

       Hmm.

    5. LRLauren Reeder26:08

       So building a product here is not easy. What is the role of a product builder in a world of continual learning?

    6. RMRonak Malde26:13

       I think as a product builder, you should be thinking about how you actually take these traces and experience in the real world, uh, and start to shape and improve the product autonomously. Um, so we're starting with the model, right, for Trajectory, and I think there's some interesting work to do there. Eventually, that will be the model and the harness, and basically self-improving both of those. And I think once you have the harness, a- and products are kind of becoming more AI native, and so the harness is kind of becoming most of the product for a lot of these companies, right? Well, and if you have the right to kind of self-improve the harness and then the product, uh, then you have the right to kind of improve and, and self, uh, kind of self-improve the entire company. And I think there then products and product builders start to become almost like a, a gardener. Like, you have your plant, and it's, it's going to grow autonomously on its own, and your goal as a product builder is to basically just set these trellises in the ground of here's where I want to shape my product. And I think this is gonna be a very exciting world where you can just put a, a product out to a couple hundred users. Uh, it's gonna grow on its own, and now we're gonna have basically you just imbue your taste, uh, into where the company grows. So I think that's gonna be a very exciting world, and companies should kind of start building towards that.

13. 27:26 – 31:58

    Why work at Trajectory, and the optimistic case: from 1% to 99%

    1. LRLauren Reeder27:26

       Yeah.

    2. PGPat Grady27:26

       For somebody listening who's thinking, "Boy, Trajectory sounds like a cool place to work," what's the pitch? Like, why, [chuckles] why might somebody wanna work at Trajectory?

    3. RMRonak Malde27:35

       So I think there's a couple things. The, the first thing is continual learning as a paradigm, uh, is, is the next learning paradigm. Any massive company that you can think of, of the previous age, so l- let's take Google or Amazon or Facebook, uh, they were all doing continual learning basically. Uh, if you think about, like, recommender systems or ads, the idea is taking all of these preferences from the real world and then creating online systems that can learn and get smarter the more they're used. Uh, and I think for agents, that hasn't existed yet, and that's exactly the place at Trajectory I want to be in. We're starting with just V1 of the product, which is a very easy way to train models, but in aggregate, I want it to be a massive recommender system of every single agent should be attuned to what companies want, uh, and what every single user eventually wants. And I think that's gonna be a fundamentally exciting world to get to. Uh, there's a lot of work that needs to happen, and I also think Trajectory is not the only company in the ecosystem that needs to work really well to make this happen as well. You need, uh, like two blocks down from us is Modal, uh, at our office that, that works on sandboxes, and that powers a lot of the infrastructure that we have. And two blocks down from that is Thinking Machines also, uh, in SF. And I think there's, like, all these sort of companies that need to be built to basically power all the infrastructure to make continual learning work. But I think the, the product interface is where a lot of the exciting work can happen.

    4. PGPat Grady29:02

       Yeah. One of the things you said when we were first getting to know you, uh, many, many months ago, uh, was this idea that the world right now has plentiful intelligence thanks to the foundation model labs and, and plentiful experience thanks to all the people who do hard work in lots of different domains every day, but there's this big gap between the two. And in some ways, continual learning is kind of the thing that bridges that gap, and it's kind of the thing that honors all of this earned experience that people have and, like, makes it legible to the intelligence coming out of the foundation models. And I thought that was, like, a very kind of elegant and beautiful way to think about what it is you guys are doing. And then the question that that leads to is what i- what is your most optimistic view of the future in terms of where continual learning can take us?

    5. RMRonak Malde29:55

       I love that question. A good example of this is Adam Smith's Wealth of Nations, uh, where we started out in the 1700s in this world where everyone was kind of doing the same thing, right? You would do this end-to-end workflow, you could call it, of an artisan. Uh, and what he theorized basically is a world of abundance needs specialization, uh, where you want someone to basically not be context switching all of the time and work on the thing that they've built up experience about. Uh, and it seems like in AI right now, we're in this pre-Industrial Revolution society, uh, or even a hunter-gatherer sort of society where everyone is just doing the same work over and over again. We're consulting one oracle of technology. Uh, I think what needs to happen is basically get to a world where it's no longer just one, one manufacturer of a car, one manufacturer of, like, every single unit, uh, but we get to a world of specialization where, uh, everyone can basically customize every single part of the harness, the model, uh, and that's where we get to a world of abundance. And there, there's a reason why only 1% of enterprises actually have been adopted by AI, and there's so many workflows out there that are super manual and could be automated, uh, and actually increase intelligence, uh, based on all of these agents that could be in production. And so my goal is to basically take that 1% and turn that into 99% so that, uh, we are actually learning from all of this built-up experience that, that lives in the world right now.

    6. PGPat Grady31:25

       Love it. Ronak, thanks for being here.

    7. RMRonak Malde31:28

       Yeah, thanks so much for having me. [outro music]

Episode duration: 32:00