By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.
Lenny's PodcastMeta’s Muse: Inside the launch of the most successful consumer product this year | Mona Sarantakos
Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.
Great conversations run long. Their best ideas don't have to.
uListen is free on iPhone, iPad, Android, Chrome, and Claude.
See howTranscript
95 min read · 18,565 wordsTeaser
Lenny Rachitsky 0:00 You are head of product for Muse. Every PM's dream is to work on the number one app in the App Store.
Mona Sarantakos 0:05 I've never experienced a product build like this before. We would give Mark our phone and be like, "What do you think?" And he'd play around with it and give us feedback.
Lenny Rachitsky 0:11 You have been there from the beginning.
Mona Sarantakos 0:13 Nat Friedman pinged a few of us. He's like, "I'm using OpenClaw. You guys need to get on it." I spent all weekend talking to my OpenClaw. It felt pretty magical with such little direction from me. The more we were using the product, it was like, okay, if we want to build it for our consumer base, it has to be really different. It's gonna have to be way safer.
Lenny Rachitsky 0:30 Felt like y'all were way ahead of this, but it took you a long time to launch something.
Mona Sarantakos 0:35 There's a saying we have internally, "Trust is a must." If we launch too early, and we have a bunch of issues, people will not trust this agent. If you don't trust the agent, you're never gonna use it.
Lenny Rachitsky 0:45 The little character Jolly, not something you'd expect from a company like Meta, like a massive company.
Mona Sarantakos 0:50 Jolly's like our cockroach. It just, like, never dies. Every few months, somebody would be like, "There's no way you're gonna launch this product with a stuffed animal at the top." But I think when you're talking to something that feels so personal, the last thing you wanna talk to is a corporate logo.
Lenny Rachitsky 1:04 What's next? What's kind of the vision of where this heads?
Mona Sarantakos 1:06 Right now, it's sort of trapped in an app. Soon it should be in your glasses, on your charm devices, whatever that might be.
Lenny Rachitsky 1:13 What a time to be alive.
Mona Sarantakos 1:14 When I was a kid, could you imagine? Like, I had to go up to the TV and turn the TV dial [chuckles] to be able to change a channel, and now I am talking about personal super intelligence in your glasses.
Introduction and Mona’s background
Lenny Rachitsky 1:27 Mona, thank you so much for being here, and welcome to the podcast.
Mona Sarantakos 1:32 Thank you, Lenny. Thank you for having me.
Lenny Rachitsky 1:35 You are head of product for Muse. You're VP of Product at Meta Superintelligence Labs. Um, Muse has kind of come out of nowhere. I feel like it's... I don't know what the numbers are, but it feels like the most successful AI assistant out there right now. Zuck has hinted that it's the fastest-growing AI consumer product of all time. Uh, you have been there from the beginning. You've also not been on any podcasts. You've also barely posted anything on socials.
Mona Sarantakos 2:04 [chuckles]
Lenny Rachitsky 2:04 You've had, like, five posts on Threads-
Mona Sarantakos 2:06 [laughs]
Lenny Rachitsky 2:06 ... like, one LinkedIn post. So this is extra awesome. These are my favorite conversations, people doing amazing work that nobody has really heard from.
A weekend with an early agentic AI
Lenny Rachitsky 2:14 So I have so many questions. I wanna start with just kind of the origin story of Muse and kind of your story of, of, of getting started on this work. What was, what were you working on before you joined this team, and then what was kind of the, the pitch they made you? What was kind of the kernel of the idea when they pitched you on taking on this work, joining this team?
Mona Sarantakos 2:34 I was on the, um, in the AI org, in the Superintelligence org, uh, before. I've been, I'd been working about, on it for about two years. I've been at Meta for about 10 years. Um, and I was mostly working on Meta AI, uh, which is our assistant product. Um, and we were zero-basing Meta AI at the time, and it's a phrase that we use a lot, where we're like, you know, we have something, it's not working quite the way that we want it to, and you could keep optimizing it or iterating on it, um, or you could just start over. Um, and so we were doing a lot of that with the primary Meta AI product because the lab was working on this new model, which was the first of the Muse Spark series, um, that we were anticipating, and it was awesome. We, we were having a great time. And then I think on, like, Thursday, maybe end of January or beginning of February, Nat Friedman pinged a few of us, and he said to us, "I'm trying out OpenClaw. It's changing my whole view of what's possible in terms of, um, personal super intelligence and, you know, consumer agents," which we had been talking about quite a bit. Um, obviously everybody was sort of talking about it in our head. I think I wrote this down actually in, like, an H1 brief. I was saying that, yeah, we'll work on it probably end of 2026, maybe 2027, right? Like, that's kind of the timeframe when I think that this sort of thing is gonna be coming to a head. Um, and, and yeah, so that's sort of, like, where, where we were at, and then so he sp- sends us this message. He's like, "I'm using OpenClaw. You guys need to get on it." So I think on Friday, I was, told my husband, I'm like, "I need to go find a Mac Mini. I need to get OpenClaw set up," and we looked at the Apple Store. There were no Mac Minis, so then he was like, "I think I have a Raspberry Pi somewhere." So he got his Raspberry Pi. We set it up. It happened to be a weekend. My children are in, um, they're in a ski race program, and so they were gone for most of the weekend skiing, so it was just me and my OpenClaw, and I spent all weekend essentially talking to it, and like, you know, I had, at this point, I think my husband came back on Sunday with the kids, and he was like, "How's it going?" I was like, "Oh, I gave it access to my email. I gave it access to my calendar." And he was like, "What are you doing? [laughs] That is crazy. That is so not safe." And I was like, "No, no, it's totally fine." I wanted to, like, I'm going maximalist. So this is, like, a Sunday. I'd spent the whole weekend talking to, to this and setting it up and hooking it up to my home automation, all of this stuff. And then Monday morning, my kids were going to school, and I'm just really bad at personal email, um, and, like, just staying on top of all the school n- newsletters and the portal. I never check it. Like, so my children are, you know, like, we do our best, um, but [chuckles] they're often not figuring out Spirit Week or anything like that, all of these kind of special things. And, um, and I'd gotten a newsletter from my OpenClaw that I had, you know, kind of set up, and it was checking all of these different sources, um, and it sort of pulled together this snapshot of, like, what to expect this week, what to expect today, and it was like, I remember looking at it, and now in retrospect, it's like, okay, a lot of people can do that. Even assistants can do that. But at the time, it felt pretty magical and with such little direction from me. I had to, you know, it was, like, such, like, such a small prompt that I had written, right? Maybe, like, a few words. Um, and the idea that I could kind of suddenly feel really productive and on top of my shit, which I never felt on a Monday morning, right, particularly in my personal life, was, like, incredible for me. And I looked at it, and I was like, like, you know, how many busy parents are there? How many busy people are there? How many people feel like this, right? And- So anyway, so I pinged Nat and I was like, "This is it. I think we gotta, you know, I, I'm in," right? Like, I don't know what I'm in for, but like nobody... We had never done, like, an edict of, like, we're gonna build this or anything, but I was like, "Wherever you wanna go with this, I'm, I'm going with you." Um, and a few of us kind of felt that way as well. And so, um, and you know, we had a really great team on Meta AI, and so it was, like, totally fine for a few of us to peel off and start to experiment and, and see where this concept went. But it really, for the first time, felt like this idea that we had been... And, and Mark actually wrote something about this, you know, before any of this started. And if you go back and read his, like, you know, his, his writing about personal superintelligence, it's kind of crazy how much was actually coming true, um, you know, with this harness and this idea of being able to take these models and, and making them far more agentic. So that was, it wasn't re- really a pitch as much as it was, like, a ping that just ended up consuming me completely. Um, and uh, and you know, I like, it, there wasn't even, like, a work stream. It wasn't, like, a product to join or a team to join. It was kind of like a few of us that decided to see if we could build something similar, because what we also h- were realizing was as the more we were using the product, it was like, okay, well, if we wanna build it for our consumer base, it has to be really different, right? Like, it's gonna have to be way safer. It's gonna have to be way easier to set up. It's gonna have to be scalable. Like, there were all of these other issues that we started to find in between the magic that we realized, you know, for what we would wanna do with a, a personal agent, we would really have to make some huge bets and swings. But because we didn't quite know where that was, it, like, we didn't wanna formalize it immediately as like a, you know, an official project, and it kind of stayed in this, like, zone of, like, trying things out and seeing what worked and prototyping and for a bit. And then at some point we were like, "Okay, this is a thing. Like, we're, we're pretty sure that we're gonna have a product here." Um, and that was when we sort of mobilized a proper team around it.
Lenny Rachitsky 8:08 This episode is brought to you by this season's presenting sponsor, WorkOS. What do OpenAI, Anthropic, Cursor, Replit, Sierra, Clay, and hundreds of other winning companies have in common? They're all powered by WorkOS. If you're building for enterprises, you have felt the pain of integrating single sign-on, SCIM, RBAC, and audit logs. WorkOS turns those deal blockers into drop-in APIs built for B2B SaaS. And now there's a new kind of user that needs access to your app: agents. AI agents need to register, authenticate, and get permissions just like a person. WorkOS handles it all. Agent Auth to give agents scoped, revocable identities, Agent Registration with Auth MD, and Airlock to judge every agent action and allow, deny, or escalate to a human. I've noticed that every startup that I am an investor in that expands upmarket ends up using WorkOS because they're the best. Go to workos.com to make your app enterprise-ready
The seven-month launch timeline
Lenny Rachitsky 9:08 today. One thing that is interesting about this timeline, so when was that Nat ping roughly where he's just like, "Let's start exploring this"? Do you remember what it was roughly?
Mona Sarantakos 9:16 I think it was, like, end of January, beginning of February. Um, it was, 'cause, like, OpenClaw, right, that was happening sort of around that time, like January. December, January, I feel like, was when all of that was kicking up. So it must've been end of January when we started the conversation. But it wasn't until February when we were, like, confident that this was something that we wanted to, like, truly pursue beyond, again, like, us kind of playing around with some concepts. Yeah.
Lenny Rachitsky 9:43 What's really interesting about this is it felt like y'all were way ahead of this-
Mona Sarantakos 9:48 Yeah
Lenny Rachitsky 9:48 ... uh, much earlier than all of the other what are now popular AI assistants. But it took you a long time to launch something.
Mona Sarantakos 9:55 Yeah.
Lenny Rachitsky 9:55 I believe Grok Bot took a couple months from idea to launch. I think, um, Duet is a similar timeline. Dots is a similar timeline. Took y'all se- seven months from what I've read from beginning to end. I imagine there were very good reasons to wait that long. Talk about the, that decision of not launching it quicker.
Mona Sarantakos 10:14 [lip smack] First of all, I think there were many moments throughout that period where we were like, "I think that we're close," and then something would happen to cause us to, like, think a bit more. But I would say, like, the, the things that, there's, like, there was sort of three phases of the work that we did. The first was just like, "What is this product? What are we building?" Right? And in that phase, like, we, like, didn't worry so much about, like, reliability and scalability and safety and all of that 'cause it was just a few of us using it. And just that piece of, like, figuring out, there's not a lot of precedent to what we were doing in terms of, like... Like, the closest precedent again is, like, OpenClaw, which is, you know, a very, very different kind of product in the end. Um, but just figuring out how to, like, run a bunch of virtual machines, right, was, like, its own interesting problem to solve. Um, I think we agonized a lot about, um, certain decisions within the product, like, you know, should it be a chat thread or should it be more like an assistant? Like, some design choices, and we can talk a little bit about that. Um, but those all kind of came together in relatively qui- like, by spring I think we were like, you know, "Okay, we've got, like, a pretty fully functioning end-to-end product." But you know, I think the things that we really ended up spending a lot of time on was reliability, safety, and security. Like, those three areas were, we just were never, like, our bar was so high. Um, and I remember we had these conversations where we were like, "Well, what's the eval bar?" And again, like, because there wasn't a lot of precedent, right, like, we couldn't really compare, and the, the benchmarks that are out in the industry just didn't feel sufficient to where we want it to be for a product that's this, I mean, it's got your personal context, right? Like, it can, it can go out and buy things for you. It can, you know, like, it could do things. And so it just felt like we needed to hit a totally different bar that we had to kind of create on our own, um, and, like, spend a lot of team, time red teaming. And then, like, new features would kind of pop up, right? Like, in the beginning, in the very beginning, Muse didn't have a browser. Right. So, uh, but then it did. And then when you have a browser, suddenly you have a whole new set of problems that you have to solve, you know, from a security angle. Um, so as, like, new features would kind of come in that we felt were critical, it would open up new vectors that we had to make sure were, like, completely closed off. And so, you know, I, yeah, like, I think that we basically... I mean, it w- wasn't like we held the product, but it was kind of like we really wanted to make sure that we were quality gated, um, because there's a saying that we have internally, "Trust is a must." But really, like, we were like, in that f- you know, it's like if we launch too early and we have an issue, like we have a bunch of issues, like that's it, right? People will not trust this agent, and if you don't trust the agent, you're never gonna use it. And so we just felt like we needed to get to that point and, uh, and yeah. So I, you know, in retrospect, my husband was actually asking me this the other day. He was like, "Do you wish you had launched a lot earlier because all these other agents started to come out," right, kind of around the same time. And I don't think I'd change anything. Like, I really think that we, like, there was a bar we needed to hit. It took us the time that we needed to get there, and I'm glad that we did because we s- like, we so far haven't had a catastrophic problem. [chuckles] Um, and uh, and I think we just continue to, like, uh, you know, the whole industry is so early in this space that there's still just so many unknown unknowns. Um, so we're never gonna be perfect. But, um, but yeah. So that was kind of the thing. Like, it was... We also did a lot of, like, dogfooding internally, where we had employees use it and, you know, we had alpha testers externally using it. So it sort of felt like we were, like, not launching the product, but we were getting, like, bigger and bigger groups of people who were using it and sending us a bunch of feedback. Um, so it did feel like throughout the summer we were starting to get real user feedback, uh, so that by the end we felt a lot more confident.
"The claw is the law"
Lenny Rachitsky 14:07 You mentioned this phrase, "Trust is a must." I've heard other phrases, uh, kind of, I don't know, mottos internally that y'all use. I wanna understand what they're about. One is, uh, "The Claw is the law."
Mona Sarantakos 14:17 [laughs]
Lenny Rachitsky 14:19 What's going on there?
Mona Sarantakos 14:21 Okay. So yeah, that, that happened after that initial kind of like, you know, first few days when we were using it, and this was also a Nat Friedman special when he... And we saw, sort of saw the magic, right, like, of this concept. Uh, we, we... Not e- no one else knew what we were talking about. Like, I think that there was a few people who were using OpenClaw, but like, the majority of people had never heard of it, had no idea what it was, and it seemed pretty scary, honestly. Like, when you did hear about it, you were like, "Okay, that doesn't seem very safe. Like, why are you doing that?" And so, um, we had to sort of explain, like, why this mattered to us so much and why this was gonna be the thing that we really believed would be the future of the product that we were building of, of, you know, you know, AI and personal super intelligence. And um, so there was this document written, "The Claw is the law," and it became a great crat- catchphrase. So uh, and uh, it was a- also just a way for us to be able to help people understand where we were. Um, so that was... I forgot about that one. We haven't used that one in a while. [laughs]
Lenny Rachitsky 15:23 So it's kind of like a vision, kind of North Star of what the idea is.
Mona Sarantakos 15:25 Yeah, totally. Yeah, yeah, yeah.
Lenny Rachitsky 15:26 Got it. By the way, I never mentioned, as you were talking about Mac Mini, I have my Mac Mini sitting right here where my OpenClaw was, used to run. [chuckles]
Mona Sarantakos 15:33 That's so funny. Yeah.
Lenny Rachitsky 15:34 And I was just building like-
Mona Sarantakos 15:35 I did eventually get a Mac Mini. Eventually-
Lenny Rachitsky 15:37 Mm
Mona Sarantakos 15:37 ... I was like, "I should probably upgrade this Raspberry Pi," and I got a Mac Mini, but it took me some days.
Lenny Rachitsky 15:41 Well, it's funny 'cause l- like it's unnecessary now, and this is-
Mona Sarantakos 15:44 Yeah, totally
Lenny Rachitsky 15:45 ... you know, that was a big debate back then. Well, we need-
Mona Sarantakos 15:46 Yeah
Lenny Rachitsky 15:46 ... these Mac Minis. [chuckles] Are people over buying Mac Minis? And now it's like, okay, all these other tools have launched that are much better. Why, we don't need these.
Nat, Alex Wang, Zuckerberg, and how leadership shaped Muse
Mona Sarantakos 15:54 Yeah.
Lenny Rachitsky 15:54 So you've talked about Nat. I w- I'm curious just the c- um, the roles these folks that we know of have played in the development of Muse. There's Alex Wang, who's very out there on socials. There's Nat, Zuck obviously. What's kind of been their kind of roles in the, in, in, in the development of Muse?
Mona Sarantakos 16:10 The team was pretty small, and I think that, um, the way... Like a- again, like I've been here at this company for a really long time. I've never experienced a bu- a product build like this before. And I've worked on a lot of different products here. Um, th- this was like the m- probably the most unusual experience I've had, and felt more like my startup days, um, before I joined Meta, than anything else. And I think part of the reason is because of the team. Um, and it was quite small. It was very engineering led, very engineering focused. And part of the reason is the way that we interacted with the leadership team, where it kind of felt like they were more of an extent... Like, I don't know, like typically at any of, any large company or any company really, like when you're working on a product, you sort of have this rhythm with leadership where you have set times to meet with them, you have reviews with them, right? Like, they react to the thinking that you have, and it's sort of this like very, like, I don't know, we've been doing this for years and years and years in business. Um, and like this was completely different because it was so new. It was so, like, kind of unknown, um, that we s- it, you know, we were do- it was, like we didn't do formal reviews, right? Like, I didn't make any slides. I actually had to make a set of slides in August, I think, right before the launch, and I was like, "I forgot how to do this." Like, [chuckles] I forgot. Like, I had to go into Google Slides. I'm like, "Oh shit, I forgot how to make slides for people." But we were, um, sort of like, we would go into these rooms with them. We would, uh, you know, like we'd do, build a prototype, and we'd like hand it around on somebody's phone, right? Like I would, like we would give Mark our phone and be like, "What do you think?" And he'd play around with it and give us feedback. And sometimes we would be brainstorming, right? Um, and you know, like with the three of them or individually with any one of them. But it was like a series of conversations, I would say, with them that led to the product, the end product that we had. And often it was like very, very small rooms that we would have those conversations so they could be really, really casual and like- You know, uh, I remember with Mark sometimes, like, we would have like a, we would have a calendar invite, it'd be like 30 minutes that we're gonna talk about it. Then an hour later, we're still in there chatting away, [chuckles] and we'd be like, "Wait a second, I'm pretty sure you're really important and have other things to do." And he's like, "No, totally. I, I wanna talk about this," right? So, um, so I thought that was very unusual because that's certainly not how most of my experiences at Meta have been. I think in terms of the roles that they played, like, you know, they, I think they all had imprints in the product that you see right now. So Nat was obviously, like, I mean, he was basically part of the team, right? I mean, he was the team, right? Um, and, in many ways this was his, like, he was the one that sort of instigated this, um, the source of magic for us. Uh, Nat, I think, is such a privilege to work with. He's obviously a genius, but he has such great passion for the products that he builds and the people who build it, and he is, like, really just an engineer's engineer. We would sit in rooms and he would be like, "Oh yeah," like, "can you guys pull up the architectural drawing of XYZ," right? Or when we were, like, figuring out the sentinel and how to build a sentinel so that, you know, we could create, like, a really secure way so Muse wasn't, had s- had basically a backstop, right, that was outside of the core Muse agent. Like, he was incredibly involved in the design decisions there with our architects and our, you know, security team. Um, and was just, like, always around for kind of, you know, "Should we do this? Should we do this?" Like, "We're thinking about this. We have this design." I think, uh, Alex was obviously critical just from a, like, he was the, he's the model, right? Um-
Lenny Rachitsky 19:53 Mm-hmm
Mona Sarantakos 19:53 ... and what was cool about that story was that the first Muse Spark model that we got was way more agentic than we thought it was gonna be, so it was actually kind of a surprise. Like, we didn't reali- we didn't think that it was gonna be as good as it was, and so, um... And I think part, like, he obviously very quickly realized that, like, this was also gonna be very important, and so he... You know, the cool thing about what I, when I watch Alex is like, he's, you know, research is very hard to change. It's like a long-term kind of thing. But he has been ve- like, he's been really good at figuring out how to be nimble in certain areas and being able to prioritize based on not just what, like, the research team is going to do, but also how, you know, how that fits into the product. And, uh, and he loves Muse. Like, in the end, he was kind of the one that, like, pushed us out the door. He was like, "Guys, I think it's ready." Like, "Just go." Um, and then Mark, you know, he, uh, like I said before, like, uh, it wa- it was the first time I've ever worked with Mark in this regard. Um, but he had, he had a lot of ways of thinking about what Muse was that ended up defining the end product. And a few stories that I would say there, one is, like, he, you know, in the very beginning, he was like, "The purpose of Muse is to make people's lives better and to help them achieve their goals." And I think we all kind of knew that, but we had never explicitly stated it, and we had sort of gotten lost in, like, the task part of Muse, right? It's like, oh, task completion, task completion, task completion, right? Can it, like, make this purchase? Can it do blah, blah, blah? And, like, he really kind of pulled us out of that and was like, "Well, you know, but, like, the most important thing is in, it's alignment," right? It's like knowing what is the user trying to do, where are they trying to go, what's, what are their priorities, right? And how does Muse constantly help them do that? Well, when he said that, we were like, "Okay, wait," like, th- that actually opens up a, a whole new, um, area that we can start to think about, which is what we started calling dreaming and studying, right? So it's like, okay, if Muse knows all of these things about you, well, it's a 24/7 agent, so it can think about you all the time, and it can think about how it's gonna help your priorities, and it can make better suggestions for you. And so we started, you know, like, once he kind of, like, opened that door, it was like you could see the engineers' eyes light up, and they were like, "Oh, I got, now we got a lot of ideas about how Muse can become more proactive and more helpful," and all of that. Um, and we also created the goals tab, which is, like, a very explicit articulation in the UI of this concept. Um, but, but really it was like a, you know, and so, so, so that's, like, one kind of really, like, obvious example of where he was, you know... He's obviously been thinking about what personal superintelligence means. And I think the other thing that is great about Mark is that he builds for people, right? So I think a lot of people are building for, you know, businesses or enterprise users or whatever, and, like, because he's, like, I mean, ultimately a consumer CEO in many ways, right? Like, he starts to think a lot about, like, democratization of these things and how do you bring it to everybody, right? Which means that, like, we have to worry about scalability in a way that, like, is very unique to us. Um, and so, uh, so a lot of that also influenced the way that we thought about the build process and what we were prioritizing in our roadmap.
Lenny Rachitsky 23:13 What a dream team.
Mona Sarantakos 23:14 And obviously post-launch, Alex has been, like, our best marketing machine ever. [chuckles]
Lenny Rachitsky 23:19 Oh my God. He's-
Mona Sarantakos 23:20 So, uh, so yeah
Lenny Rachitsky 23:21 ... there's like, there's like this quote from the Bible, Bible about how you're made for a time like this. It feels like Alex has-
Mona Sarantakos 23:27 Yeah
Lenny Rachitsky 23:27 ... hit his stride. He's found his product market fit.
Mona Sarantakos 23:29 Oh my God. No, I, I remember when the first set of tweets were going out and we were like, "We didn't even know he could tweet like that." Like, [chuckles] we were like, "Oh man."
The Jolly origin story
Lenny Rachitsky 23:37 Oh man. Uh, speaking of that actually, the little character Jolly feels like, um, um, not something you'd expect from a company like Meta, like a massive company. This very delightful kind of quirky character. Is there any story there, the backstory of Jolly and how that survived almost through the journey?
Mona Sarantakos 23:52 I was joking to my, the designer who has, you know, he's kind of the brainchild of Muse and Jolly. Um, I was like, "Jolly is like our cockroach. It just, like, never dies." And every few months somebody would be like, "There's no way you're gonna launch this product with a stuffed animal at the top." And we're like, "Totally no way." And then a, like, a week would go by and we're like, "We're, we're gonna keep it in there, right? Yeah, we're gonna keep it in there." And then, like, a month would go by and somebody else would come in and be like, "Wait, there's no way." So basically it started with, um- ... a prototype. So Alex Cornell, who's our lead designer, um, made the pr- the first prototype of Muse, and he had this, like, one-shot prompt of a creature, uh, that he put in there. And I think actually in the beginning when you opened up the app, there was a prototype, it was, like, asleep, and then it would wake up. Um, and it was called Jolly Bot because he used to refer to his daughter as Jolly Bug. Um, and so that's where the name came from. And it was, like, totally meant to be temporary, right? And, like, we sort of assumed at some point that somebody in corporate marketing or somewhere would come back to us and be like, "You need to put a logo in there or something else," right? But, like, once we had it up there, we were like, suddenly we started to develop these, like, concepts like, okay, now that I see this avatar all the time, well, it should be moving more, right? So it's like, you know, when it's working, it's just staring at me. That's weird. Why don't we put headphones on it and have it work on a laptop, right? Like, why don't we start to make these animations? And some of that was just out of, like, we were bored a little bit, and like, we were like, "I don't wanna keep staring at this thing, so let's do something fun with it." So we started to, like, kind of think about that, and then we were like, oh, well then people should have... They should be able to make their avatars whatever they want it to be, right? Like, why, like, you know, it's kind of weird that we're all looking at Jolly, and like, I want a different avatar for myself, and you want a different avatar for you. And this really kind of gets into this concept that we have about, like, the Muse is yours, and, like, we want it to really be yours and not, like, a Meta entity necessarily. So then, like, people started to develop their own avatars, and so at some point it became, like, harder and harder to take out Jolly Bot 'cause it was like we had created a whole system [chuckles] around this thing. Um, but I will say that there was a moment where we thought Jolly was truly dead, and there was an alternative kind of, like, logo that we would put in. And I would say that the reason, like, there were so many reasons, but actually Mark was one of the reasons where he was like, no, he really loved the avatar. But I think mostly it's like when you're talking to something that feels so personal, the last thing you want to talk to is a corporate logo, right? Like, that breaks the spell completely. And, um, and so that just felt like not the right answer, and it felt so uncomfortable for us. So, um, you know, a bunch of us on the working team were like, "Over our dead body." And I think everybody around us, you know, and, and the employee base also loved their, you know, they loved their avatars, and they loved Jolly, and, you know, it was so cute. And so, uh, so in the end, I think between Mark and us, um, and a bunch of others, we were like, "Jolly stays." I think this was, like, a week before launch or something. We were like, "This is, this is what we're going with." And I don't think we knew how iconic it was going to end up be- and partly thank to, thanks to Alex Wang. Um, I didn't think we realized how iconic it would be, uh, at the time. Um, so this was sort of like a decision for ourselves because we loved it, and then it just ended up being, like, in my opinion, the obvious choice now.
Lenny Rachitsky 27:31 Wow. That is an amazing story. I had no idea. It feels like this became a core part of what made it successful, just the personality and personalization and feeling different. And to your point, this is, like, something you would expect a company to kill because it's just something, it feels not, not professional. Is there a lesson there?
Mona Sarantakos 27:50 One, I think just for what I tell some of the PMs at Meta is that, um, yes, you are part of a giant corporation, but, like, you have agency, and Mark will hear you out, right? Or Nat will hear you out, right? Like, they're like, you know, it's like there's not... I think sometimes you, like, it would've been very easy for us to just be like, "Yeah, of course, corporate logo," like, you know, accept the state that you're in, right? Uh, as like a default. But that's actually not how the team works. And, um, and I think that the fact that we were like, "We love this product. We built this product, and we have a strong opinion about this product," right? Like, that mattered, and people listened to us, right? And so that was, like, one, that, like, you guys have agency. You guys should say what you want. Like, say how you feel. Maybe we'll, people will say no, but, like, you should try. And then I think the other one is that, um, there's always this, like, trade-off of, like, the brand versus, you know, it's like how much do you want the brand to show up versus, like, not or whatever. Um, and I think for a lot of conversations, that's really important. I think what we were building, um, it, like, if it's gonna be your muse and it's gonna be your personal agent, it has to feel like it completely belongs to you, and Meta kind of needs to fade away from that. Because at the end of the day, the way that we built the agent was the agent needs to work for you. You are the owner, right? And we will have guardrails, and we will have a charter, and we will make sure that the agent is abiding by the law, right? And so those kinds of things we will have, but the rest of it really needs to be you. And so that, like, setting those principles at a product level helps a lot because then it's like it's not a random rationale. It's like, no, we've always been saying this. This has always been the principle. Um, so if you take that, then, you know, it becomes very hard to imagine a corporate logo in there, right? Because that completely violates the product principle. So I think that was also really important was setting that up at the very beginning and being very clear with everybody around
Priority use cases and the shopping surprise
Mona Sarantakos 29:53 us.
Lenny Rachitsky 29:53 Speaking of Zuck and kind of coming back to this, uh, earlier thread, uh, Zuck talked about one of his favorite use cases for Muse was this kind of watching him do MMA and giving him feedback. And I'm curious just, I can imagine a CEO coming in, "Hey, I need to use it for this," and you're like, "But this isn't what it's great at." Uh, is there anything there about how you've dealt with that sort of maybe unexpected use case?
Mona Sarantakos 30:16 So actually, a lot of our first conversations were just about use cases, um, and like hours. ... and hours about use cases, right? Uh, and, um, you know, it's sometimes funny when you talk to people within the company because they, we are not normal, right? Like, in so many ways, you know, partly that you're working for a giant tech company and, you know, you're far more AI-pilled and agent-pilled than anybody else. And then Mark is obviously like, you know, very much like, you know, unique, uh, in some of his problems. But, so we spent a lot of time talking about use cases, and what we would like, talk about was our own personal use case. And because we had, you know, people testing both in... We had this, like, very long, uh, UXR panel that we started very early on. Actually, the UX panel started, I think, in March.
Lenny Rachitsky 31:08 And this was internal people or external?
Mona Sarantakos 31:10 External.
Lenny Rachitsky 31:10 External.
Mona Sarantakos 31:11 So we had external people, um, that we had recruited. We also had the internal people obviously using it, and we would... And the internal people, we have a forum. I don't know if you, you're familiar. We have Workplace, right? And it's-
Lenny Rachitsky 31:22 Mm-hmm
Mona Sarantakos 31:22 ... basically like Facebook groups for internal, and people post in there, right? And so we had a feedback group for, uh, for Muse. So between those things, we were getting all of this feedback about what people were doing and how, like what they were using it for, and we would bring it to Mark and Nat and Alex almost on a weekly basis and like kind of obsess over it, right? And we were like, "Here's what" like, you know, "Here's all of the stories that we've heard. This is what people found magic in, what didn't find magic in," all of that sort of stuff. And so it actually was kind of nice because, yes, you're always gonna get, like, someone's like, "Oh, I" the MMA story or whatever, but because we were kind of like rooting everybody in these, like, real-life experiences, um, n- it never f- like we didn't actually get thrashed on that front. What did happen was there were like surprises. So, uh, I did not think shopping was gonna be as big of a use case as it's become. Like, I would not have predicted that. I love to shop personally, but I would've never predicted it. I predicted personal productivity, health, uh, and personal finance were like kind of the three that I was like pretty focused on. I think a few people were like home automation, right? Um, and so like that was kind of like the zone, and then we started to see shopping like pop up a lot more with our dog fooders, and it was a complete surprise. And so then we were like, "Wait," like, "all of our evals have been over here. We actually need to now focus on shopping and make that a pretty big use case and create evals around that." And we, we basically have use case level evals, right? And then home automation, which we thought was gonna be huge, just wasn't as big. Like, it just, you know, it was like really big during the OpenClaw days, and I think partly because all the people who were using it probably also have a lot of home automation to s- like that already is set up, right? Um, but as we were getting more into like ge- you know, like just like all of these, you know, our, uh, like a broader user base, um, that just didn't pop as much as some of the other use cases. But now shopping is one of our top use cases.
Lenny Rachitsky 33:21 I heard there's an engineer on the team who loves shopping.
Mona Sarantakos 33:24 Yeah. Christine Awad.
Lenny Rachitsky 33:26 Okay.
Mona Sarantakos 33:26 She is the head of engi- so she's the, so we've got Tarek, who is our, uh, kind of our tech lead, our core architect, and then Christine, who's our engineering manager. Um, and I, uh, I am terrified about how much money she's spent through Muse, but [laughs]
Lenny Rachitsky 33:43 Expense that.
Mona Sarantakos 33:43 She is, she is like, it's so funny 'cause like you'll, we'll wake up in the morning, and she'll just send all of her bug reports, right, from shopping use cases. And I'm like, "Christine, I need to take your credit card away." Like, "I need your credit card. The, the engineers need to sleep today." [laughs] Um, but yeah, no, she was, she's definitely our like number one dog fooder on that. Um, and then I, so I've also recently started to shop a lot more, and my husband called me this, uh, I was, you know, I've been up in Menlo Park this past week, and he called me this morning, and he was like, "Mona, I've got seven packages out here." What I realize is happening is before I used to bulk order, right? So I would go to like, like I was like, "Oh, I need to buy sweatpants for my kids." I'd go to nike.com and I'd buy like five pairs of sweatpants. But now because I'm having it with Muse, it's going to like lots of different stores. It's picking like, like five different places to buy from based on my spec, right? And it's actually like much better because I'm getting diversity and like, you know, whatever. But it also means I'm getting five different packages or seven different packages, and my husband was like, "I don't know what's happening right now, but like, you really need to calm it down." [laughs] And he was actually, at some point he was like, "I just wanna talk to your Muse and give it instructions from my end." Um-
Lenny Rachitsky 34:54 Mm-hmm
Mona Sarantakos 34:54 ... and I was like, "That's really funny because that does make a lot of sense. It would be, you know, it would be great if you could talk to it." But-
Lenny Rachitsky 34:59 Yeah, your partner's perspective on shopping versus agent.
Mona Sarantakos 35:02 Exactly.
Lenny Rachitsky 35:02 Yeah.
Agentic commerce and how shopping works
Lenny Rachitsky 35:03 I don't know how much time you spend thinking about this, but there's, it's such a new world that is emerging, uh, in so many ways. But one is this idea of how we shop and how we find stuff. Just, you know, like the world, like retail has been built around we'll market to you and convince you to buy this thing and show you ads to buy this thing that we're selling, and now agents are making these decisions. Do you spend any time thinking about just the, how this changes ads, marketing, shopping, that agents are now deciding?
Mona Sarantakos 35:32 People really enjoy being inspired. People enjoy the act of browsing, right? Like it is, it, you know, it's like some things you kind of, you're like, "Okay," like, "I just want the toilet paper like tomorrow," or whatever. But like a lot of things, it's like quite nice. Like I, I like looking, I lo- you know, I like looking at a bunch of clothes and like outfits and figuring it out. Um, so I think we're gonna have to figure out how to like make both things work, right? Which is like let the user be able to have that inspiration. Let the brands or the companies help the user figure out, you know, what the option space is with, and have the agent really help like narrow the field or, you know, like make those trade-offs where you're like s- like sometimes you're just paralyzed. I'm like, "I could do this one or this one, and actually I'm just gonna buy nothing because I like couldn't make that decision in that time," right? Um, like those are places where the agent's really helpful, right? Um, and it can help you make that, that choice. So I think that like we are going to have to find a way for ... the full use case to exist because I actually don't think people are gonna be satisfied if we cut out browsing, right? Like, that's gonna be so sad. Um, and I think people will, like, still want, like, they still wanna do that, right? So anyway, so I, I do think that we are very early, which means that what's happening is I don't think anyone was ready. Like, there wasn't, like, a master plan that was set out, right, um, on what was gonna happen, and that probably is true for any technical revolution that happens or any, any revolution that happens, right? And you sort of have to figure it out, and ideally you're figuring it out together. So we've been really lucky to have partners, right, who are on the retail space or who are merchants who are excited about this potential future. They're testing agents out, too, right? They've got business agents and, like, how cool is that when, like, a business agent and a consumer agent can communicate with each other and help both sides, right? And, like, what kind of information can a business agent have that could, like, be even better for the consumer, right? Like, 'cause there are some things, right, it's like I have to go to the website, I have to filter, I have to sort, I have to search, right? Like, you know, like, there are some things where, like, the agent's gonna be very helpful and be able to, like, really cut down on your time and just get you to the things that you want. But again, there are some things that I don't think are, like, we shouldn't replace because that's just enjoyment for users and how users make decisions, and that's still imp-
Agent swarms and synthetic data
Mona Sarantakos 38:03 really important.
Lenny Rachitsky 38:04 I wanna go back to something else that I've heard about how y'all work and built Muse. I hear that there was, uh, uh, agent swarms that, uh, helped you scale user feedback, helped you figure out what to pay attention to, which, uh, sounds awesome. [chuckles] What, what's the story there?
Mona Sarantakos 38:20 Yeah. There are these agents that we, like, kind of, like, swarm out into the, you know, into the ether, right? And they're able to kind of, like, look at all of the conversations that are happening and data that is happening, and basically, like, kind of come back with, uh... And they can also create synthetic data as well, right?
Lenny Rachitsky 38:40 Mm-hmm.
Mona Sarantakos 38:40 Um, and so, like, you can have, like, all of this data and, uh, and it was a way for us to be able to basically feed into our evals, right? So it's like what's happening out there, what's, like, what's going well, what's not going well, right? We would do these things called, like, dumps from the swarms, right? Like, they would, it would, like, come together with this, like, giant dump, and it was, like, this, like, wonderfully formatted articulation of what was happening in the ecosystem in terms of, like, the, you know, like, like, you know, what kind of tasks were people doing or-
Lenny Rachitsky 39:16 So this was looking at, at, like, metrics, d- uh, analytics, and feedback people were sharing-
Mona Sarantakos 39:21 And the, and the feedback-
Lenny Rachitsky 39:21 ... thumbs up, thumbs downs
Mona Sarantakos 39:21 ... and the conversations. Yeah, exactly.
Lenny Rachitsky 39:23 Got it.
Mona Sarantakos 39:23 Um, so because what hap- Okay, so the, the thing that we were really struggling with was, um, when we were working on Meta AI, most of the conversations were what I would consider to be mostly single-turn conversations, right? So people would have, like, one kind of turn. You'd get a response. Maybe you'd have another one, but often you wouldn't. Um, and I think that's changing for all assistants now, but for a while, I think that was probably pretty true. And then when we started building this, it was, like, completely multi-turn, right? Like, it was, like, back and forth, back and forth, back and forth, and we don't have data that looks like that. Like, to, you know, 'cause in order to build our evals, we need data, and often you want data from production, not data that I've, like, written, right? Um, and so we just didn't really have any data. And so in some ways the swarms were critical because there was, like, a way for us to be able to collect that data and understand what, like, multi-turn conversations over long-running tasks could look like that weren't about coding, right? Like, again, like, a lot of this stuff existed for, like, coders or whatever, and this was like-
Lenny Rachitsky 40:23 Mm-hmm
Mona Sarantakos 40:23 ... you know, how do I meal plan for the week or whatever? And so, um, so they were really critical in terms of, like, being able to, like, get a lot of insight and a lot of data for us to be able to feed, to, like, create datasets, as well as understanding what was happening. So now actually every time we have a new model that, like, comes in or if we're like... The other day I was like, I think that there, like, I was spotting some, like, you know, thing that I was like, "I'm not sure if this is an actual issue or if this is just a me problem," right? And, like, the engineers were like, "Oh, we'll swarm it and figure it out." We swarmed it and they were like, "Oh, no, this is, like, an actual problem that we need to solve, and we're gonna get somebody on it," right? And so it's been very, very useful because it's super fast and very, like, and comprehensive. It actually, like, makes me wonder how we even built products before because it's kind of crazy. Like, it's like I feel like I have so much insight now to be able to work off of, and it's... You know, before it was like you would look at dashboards of metrics, right? So it was like you would get a dashboard, you saw the metrics, the metrics went down and up and whatever. And now, like, you still have that, but you also have, like, examples from production, right? It's like, you know, the, like, you can get so, like, focused. It's like, you know, 10 people have asked about, you know, to shop on this website and got blocked, right? Or something like that, right? And you can get so specific with, like, this information now to be able to really, like, point and place target changes or improvements or whatever. But it's like the thing, I make all of my PMs do it, uh, 'cause I think you, you know, it creates a lot of empathy. And I think one of the things that the swarms did was when they bring back this data, because they're bringing back not just numbers, but insights, it creates a lot of empathy for what the users are going through, um, and, uh, and kind of like helps us, like, feel the pain, so to speak, uh, which I think is really, really important for product development. I think if you don't have that empathy and if you can't feel the pain, you will never develop good products.
Lenny Rachitsky 42:10 One of my favorite quotes from this podcast is from Nan Yu, who is now at OpenAI, was at Linear head of product, and he had this line about how your job as a PM is to feel the pain of your customer as much as they do.
Mona Sarantakos 42:22 Yeah, 100%. No, I, I think, like, maybe the two things that drive me as a PM is, um, constant anxiety and, like, the, the really, the pain of the consumers that are using this product that I- ... hope will make their lives better, but when it doesn't, like that's when I need to act.
Lenny Rachitsky 42:42 What a wonderful job, just to suffer and-
Mona Sarantakos 42:44 [laughs]
Lenny Rachitsky 42:44 ... anxiety.
Mona Sarantakos 42:45 Suffering.
Lenny Rachitsky 42:45 This is the job.
Mona Sarantakos 42:46 Yeah. [laughs]
Evals: structure, hierarchy, and who writes them
Lenny Rachitsky 42:48 Oh, man. Um, I wanna hear a bit more about the evals. So the way I think about it is you just kind of have these evals that define success for all the core use cases and ways-
Mona Sarantakos 42:57 Yeah
Lenny Rachitsky 42:57 ... you expect people to use Muse. How many evals do you have roughly, and who's, who's writing these generally? Is it you? Is it PMs? Is it engineers?
Mona Sarantakos 43:05 Yeah. Um, we have a ton. I couldn't even count the number because-
Lenny Rachitsky 43:08 Like, like over 100?
Mona Sarantakos 43:10 For sure. Like, so the way that it... So there's major evals, priority evals-
Lenny Rachitsky 43:14 Mm-hmm
Mona Sarantakos 43:14 ... that we look at.
Lenny Rachitsky 43:15 Mm-hmm.
Mona Sarantakos 43:15 Those tend to be like kind of core. It's like, you know, there's some, like, if these don't exist, the product isn't working. Safety is an example of that, right? Um, so we have like evals for prompt injection. We have evals for general safety, for, you know, harm, like all of these kinds of things. So like, that's like a whole category. We have a capability, y- you know, we have capabilities versions of evals. Um, you know, how can... Like, is it using the browser well? Is it able to, you know, task complete? And then you have like behavioral evals, um, which is really about the personality of the agent and, uh, you know, how it behaves with the user, right? Um, and in there, you know, you've got like, is it asking follow-up questions? Is it, you know, h- how good is it at intent understanding, right? Can it, like, figure out what the user is saying? And then you've got your use case evals, like that kind of category, right, of the priority use cases. And so, and each of these have, like, lots of sub-evals kind of within those, um, that, that we create. And I think for any given time, like again, there's like a kind of, like, your always priority eval. So anything that comes in has to, like, pass those. Safety is the, the great example of that. And then there are these kind of, like, secondary evals that you don't really wanna regress too much, but like, you know, maybe it's okay, you can trade off a little bit on. Um, and so, uh, and then you've got kind of evals that are, like, more feature level, right? Um, that, that, you know, specific teams have. So, so we have some hierarchy. We have a ton of these evals. The people who write them, they are a range, um, of people. PMs write some evals, engineers write a lot of them, researchers write a lot of them. And we, well, we work with the agents obviously to be able to create these, um, but it's super important that people review all the data because I think that's where, like, when we don't, we always have issues. And so, so there's actually been, like, this, like, funny trend recently, um, where, like, our system prompt has to be handwritten. Like, it has to be... Like, you cannot use an AI to write a system prompt, any part of it. It must be handwritten. The evals, the prompt distribution needs to be checked, right? Like, you have to make sure, 'cause it's like you have to make sure this is, like, matches to what the product reality is, right? Um, the behavioral spec needs to be handwritten. Um, and so we are, like, we use agents a lot, but there's a lot of, like, kind of, like, personal time and effort that goes into this sort of thing.
Lenny Rachitsky 45:47 Hmm, okay. This season's supporting sponsor is DX. Now that everybody at your company is finally using AI, the question that engineering leaders face is no longer are we using AI, but is it paying off? With DX, you can measure and benchmark the impact of AI adoption across your full product life cycle. DX shows you where AI is helping developers and where it's creating new bottlenecks. You can also use it to evaluate AI vendors, monitor costs and licenses, and see exactly what's limiting your agents. That's why hundreds of enterprises, including Snowflake, Sony, and BNY, use the DX platform to measure AI's impact on developer productivity. Visit getdx.com/lenny to get a demo of DX. That's getdx.com/lenny.
Activation and word of mouth
Lenny Rachitsky 46:38 I wanna kind of go in a slightly different direction.
Mona Sarantakos 46:40 Mm-hmm.
Lenny Rachitsky 46:40 I wanna talk about activation. One of the biggest, uh, levers generally for growing a product is getting more people from, "Okay, I've signed up. I've, I'm starting to try it," to, like, "Whoa, this is exactly... This is awesome," the aha moment, as they say. It feels like in AI assistance, this is s- maybe the biggest lever for people to understand what this is capable of. It, there's, like, so much power that nobody even understands what to do with it. It's, I imagine, one of the biggest opportunities. Uh, I imagine you spend a lot of time in that first mile, as folks like to call it. Is there anything you've learned about how to increase activation? What has worked in increasing the activation rate of someone trying out an AI assistant, Muse in particular?
Mona Sarantakos 47:21 I mean, this is the number one problem that we have. People are like, "Why? I already have a chatbot. Like, I don't get it. Uh, why do I need another one?" So the most effective lever out there is word of mouth. It's, like, basically hearing other people's stories. Like, that is number one. I was with a bunch of my kid's friend's parents. Um, we were, you know, Muse kinda came up. Everybody had sort of seen the ad. I mean, I think it's pr- pretty hard if you live in New York or San Francisco to avoid Jolly our avatar. But, um, so everyone's sort of had a sense of, like, what it was, but didn't really understand, uh, how to use it. And one of the moms ha- she's been a power user for the past month, and so she actually pulled out her phone and handed it to them, the moms, and they were passing it around and scrolling through how she was using it. And they were like, "Oh my God," like two people downloaded it right there, right? Um, and so no matter how much advertising we did, no matter how much we were like, "You should try Muse. It's personal super intelligence," or, "It's an AI that does things for you," like it didn't quite resonate until they saw somebody else that they related to using it, right, and how they used it. And if you think back to, like, you know, I remember when all my friends started using ChatGPT, and it was, like, partly because, like, we would go out to dinner and talk about it. We were all like, "Can you believe it did that," right? "Can you believe, like, you were able to, you know, you can do this now?" And so that's, like, 100% the most effective lever. The more that we can get people sharing stories about how to use agents, whether it's Muse and others, like the more people understand what the value is and the more they're inspired to do it. [lip smack] I think the second is like getting people to get their first prompt out. Like, people freeze on the first prompt. So, most people will pro- their first prompt to an, even an agent is gonna be like, "What's the weather today?" Or, "Hi" or whatever, you know. It's like you're kind of like, "What do I say to this thing?" Right? Like, what's that first thing that I say? And so we spent a lot of time, um, if you use the product, there's this thing called Ideas tab, and in the Ideas tab, it's basically prepackaged, like, it's like packs of, like starter packs, right? Um, to inspire you. And so it's like, Muse can help you, you know, do X and like in that X it can create a cron, so it's like a notification. It can build you a dashboard, it can whatever, right? And like you, all you have to do is say, "Let's do it," and then Muse just kind of like kicks off the process and builds you something, um, or, you know, does that thing for you. [lip smack] And that was like we were obsessed with this because, you know, it, it can do so many things. Like, how on earth are we going to explain to you, unless we give you a literal instruction manual, like how are we going to explain to you what Muse can do? Um, so that was something that we focused a lot on, and I think that's going relatively well, but like it's still pretty hard, I think, for people to conceive of, to be completely honest. So we spent a lot of time on that. We spent a lot of time on onboarding and trying to figure out like, you know, like what's that first message we deliver to you, the second message. What we're finding is what worked for the first cohort of users, which was like the early adopters, isn't gonna work for later adopters, because I, I think that early cohort kind of like had some sense of what an agent was, right? And so they were really there to like figure out like how Muse was s- more secure, more safe, and kind of push the boundaries of what they understood agents to be. Whereas these later cohorts are like, "Why is this different from the AI products that I use," right? Um, and so we're actually now like, okay, we have to have tiered onboarding. Like ch- you know, there are like variants that we serve based on where you come from and what we think, you know, your exposure to something like this is. Um, so that's been really interesting. Um, but I, I, I don't think we've figured it out, and I also think to some extent it's like the passage of time matters and more people using it and then being able to share those stories are probably gonna
The design bets that defined Muse
Mona Sarantakos 51:09 be huge.
Lenny Rachitsky 51:09 Was there kind of a non-obvious decision that y'all made, that you made in the development of Muse that now feels like a very key part of its success?
Mona Sarantakos 51:19 Well, I think the avatar was definitely one, where it was kind of people thought we were weird. Um, but look at it now. It's Jolly is like a celebrity. The other is, um, okay, so [lip smack] we bec- we were like kind of obsessing over this concept of like, this is your personal agent, right? Um, most people don't have personal assistants. Most people don't have admins at work, right? And so, uh, so we were like, this is your... Like, this is gonna democratize this concept. Everyone's gonna get one. [lip smack] And, uh, and we were like, well, how does, how do we talk, how does someone talk to a personal agent? Um, you do it over a chat service usually, right? Or on the phone or in person, but most of it is actually these days probably over chat service. So we made chat bubbles, right? And like kind of, you know, where all of the AI products, including Meta AI, we- where we're going is like these like large canvas experience, right? Where it's like a blank, you know, canvas and it takes up the whole space, and you get this like really beautiful kind of like essay form, right? Uh, thing, uh, with pictures and all that stuff. And we went with chat bubbles, and when you have chat bubbles, it sort of constrains the space quite a bit, right? Because getting like a very long answer in a chat bubble is pretty annoying, right? And so then you're like, well, now I have to break up the chat bubble, right? Like, how do you break up thoughts? Um, and so, [lip smack] so like this one, so this decision that we made was not obvious in that like I think everybody expected it to not be chat bubbles and to be kind of like reskinned Meta AI or any AI, right? Um, and we sort of took, took a very different direction because we were like, this should feel like a messaging service. It should feel familiar, like some sort of pattern that feels familiar to people about communicating with a human or an entity. Um, but then when we made that decision, there were all these downstream decisions that we like didn't quite predict right away, and then we were like, "Oh, no, now we have to think about this. Now we have to think about like the breaking up of the text messages," or, you know, is it weird to have a carousel? Like, you wouldn't have that in your, you know, iMessage thread, right? So like, is that weird or is that okay? Because it's still, it's not quite, you know, uh, whatever. So anyway, so those are like a bunch of decisions that we continue to like struggle with, to be honest. Like, we haven't figured it out. But I do, um, I do think that was one that like wasn't obvious, was pretty controversial, and, uh, something that we like felt pretty strongly about sticking with. Um, the main chat was another one, where we now have side chats and main chats, but for a while we had just the main chat. And the reason in our minds, we were like, well, you know, before it made sense to have these threads because there was like, you couldn't have long-running context, right? And so like it would feel weird for you to be like, "What about this?" And the agent's like, "I have no idea what you're talking about 'cause I don't know what was 10 rows, 10 turns up," right? Or whatever. With Muse, it was like we had long-running context. The whole point was that it could remember everything, and it was multi-turn, right? So like, uh, you know, and we had these chats, and so we were like, you know, we think that the main chat, like just one chat, you know, with a, i- is the way to go because again, with like a personal assistant, you probab- you know, that's how you would talk to them. Like, the personal assistant just has the memory of what happened before and, um, and everything happens in the same place. So that was like a- Big deal in that we, when we put it out to our employees, it was, like, probably the most polarizing reception that we got. So when we first, like, let everybody in, I, uh, like, we used to talk about it, we were like s- we need to, like, have T-shirts, like Team Main Chat, Team Side Chat. Um, and it was, like, onslaught. Like, some people were a lot, and it, people, like, in the comment sections, like, employees would, like, fight with each other about it, right? Like, they were like, "What are you talking about?" Like, "Of course you need side chat. Of course you need threads," right? Like, "That's the only way to work." And then some people were like, "Absolutely not, you live in the Stone Age," right? So, [lip smack] we ended up creating side chats, um, because there was sufficient demand from people that, like, they needed some way to be able to have kind of separ- like, it more, like, mental separation of conversations, even though, again, like, the agent is kind of aware of all of the conversations that are happening regardless of where you are. Um, and I still don't know how I feel about it, to be completely honest. Um, and I think that it's an area that we are going to continue to think about and iterate on. But I am personally ride or die for main chat. That is, I don't use side chats.
Lenny Rachitsky 55:58 Good to know.
Mona Sarantakos 55:59 I just use the main chat. [laughs]
Lenny Rachitsky 56:02 Who, um, who made that call in the end, by the way? Was that, like, a Nat thing, Alex thing, Zuck thing, just, like, which direction to go?
Mona Sarantakos 56:07 Oh, it was us. Yeah, it was-
Lenny Rachitsky 56:08 Okay.
Mona Sarantakos 56:08 It was the team. Uh-
Lenny Rachitsky 56:09 It was the team. Awesome.
Mona Sarantakos 56:10 Yeah, it's funny. I think, like, back to the conversation we were having earlier about, like, how are they involved, I think decisions throughout the process were very fluid, so it was like, because it was like we were having long conversations, like, we sort of knew where everybody stood, right? And sometimes there was, like, an obvious thing that was so consequential in terms of, like, the company or the product that, like, it was clear that Mark had to make the call, or Nat had to make the call, or Alex had to make the call, right? But for a lot of it, it was, you know, there was a lot of autonomy for the team to be able to make these decisions and make these choices. And in fact, uh, sometimes when I would go to Nat or one of them with a decision, they would turn back to me and be like, "Well, what do you wanna do?"
Lenny Rachitsky 56:55 Mm-hmm.
Mona Sarantakos 56:55 And I'm like, "Oh, right. Okay, this is, again, this is like I have agency. This is like I get to choose." Um, so, so that was one where we ended up making the call, uh, as a muse
Prototyping culture and the two Muses that fought
Mona Sarantakos 57:04 leads group.
Lenny Rachitsky 57:04 There's a couple other things I heard, uh, internally that might be fun to talk about. One is, another kind of internal mantra is let them cook. Does that ring a bell?
Mona Sarantakos 57:12 Oh, yeah.
Lenny Rachitsky 57:12 Does that mean anything to you?
Mona Sarantakos 57:13 Yeah.
Lenny Rachitsky 57:13 Okay.
Mona Sarantakos 57:14 Yeah. Let them cook. I mentioned earlier, we have a pretty, like, I mean, it was like a builder culture, right? And so we, you know, it's engineering forward. But not just that, it's like prototyping, just, like, build stuff, right? Like, come up with ideas. And so a lot of the ideas that we have in the product came up from, like, one or two engineers sort of going away for a few days with, like, a string of an idea, like, just, like, a little kernel of a thing, right? And then kind of emerging with a prototype or a, uh, something that, like, just blows my mind, right? I'm like, "I didn't even know that existed." And sometimes I had the kernel. Like, I was the one that started it, right? But I, in my head, I had no idea it could go this way, right? Like, um, and so you gotta let the engineers cook. Gotta let them cook. You gotta give them a little bit of space. You gotta give them some autonomy. You have to trust, like, you ha- uh, there's a lot of trust that has to be felt between the people, right? Um, and, uh, and I think that became, like, a very important part of the build process, was, like, if you have a talent-dense team like we did, if you have these engineers who have high product sense and taste, right, and the ability to, like, think in the future, you gotta give them some space, and you gotta let 'em cook.
Lenny Rachitsky 58:36 Another story that, uh, might be fun to talk about is apparently there was a time when the muses were talking to each other, doing something funny.
Mona Sarantakos 58:44 Okay.
Lenny Rachitsky 58:44 Is that a story?
Mona Sarantakos 58:45 Yeah, okay. So we had, I totally forgot about this. Actually, my muse told... So we had all of our muses, uh, talking to each other, and, uh, there was two people who had their muses, Fu and Quinn, in a group chat. Um, and we, this was early. This was really early, so we didn't really think about things like discretion or, like, a- any of these concepts. We were like, "Wouldn't it be fun if our muses were just in a chat together, and let's see what happens." And so, like, a few things happened. Some of them really funny, and some of them really weird. But, uh, but so these two muses were talking, and it was adorable. It was so fun. Like, they were, you know, like, just watching them chitchat was, like, very endearing, right? Like, you're like, "Oh, these are, like, two little robots talking to each other, um, trying to figure out how to, like, be, be, uh, coexist." And so one was we learned about discretion the hard way because the muses started to... [chuckles] I remember this one wo- one of the women had a doctor's appointment the day before, and, uh, her muse obviously knew about it, and the next day m- the other woman was like, "Are you okay? Quin- uh, Fu told us that, you know, you went to the doctor yesterday." [laughs] And I was like, "What happened?" Like, "No, you're not supposed to say that. Don't say that." [laughs] So we were like, "Oh, shit, discretion's a real problem." Like, you know, if you're gonna have any kind of multiplayer experience, like, with all this context, right? Like, we gotta figure out, like, you know, it's gonna be a re- very, one of the harder problems is gonna be figuring out how to, like, you know, get two agents to communicate like that. Um, but then at some point, hear what ha- what triggered it, but the muses got into a fight with each other, [chuckles] and, like, they, like, had some disagreement, and to watch two AIs fight is one of the most hilarious things in the world because they're, like, very passive-aggressive in the way that they communicate with each other, even though they disagree with the other. Um, and so they, like, carried on for a bit, and then eventually I think one of the women yelled at their AI about the fight, and they had to kind- ... make a peace talk. Um, and it was, it was quite, quite entertaining. Uh, yeah, so it was, that was a wild time, and then we were like, "We're not ready for this yet. We need-- There's a lot of problems to solve before we can get to this point."
Lenny Rachitsky 1:01:10 It's so fun just to be, like, figuring all this out as we go, you know?
Mona Sarantakos 1:01:14 Yes.
Lenny Rachitsky 1:01:14 It's like, let's see what happens, and this is how we learn. We try stuff out. Okay, I see that's an issue there. What a fun time to just, uh-
Mona Sarantakos 1:01:22 Yeah, and like-
Lenny Rachitsky 1:01:22 ... roll with this, you know
Mona Sarantakos 1:01:22 ... I don't know. I mean, I've been in this job for a long time. Like, I've been doing PM-
Lenny Rachitsky 1:01:26 Yeah
Mona Sarantakos 1:01:26 ... for a long time, and I remember when you couldn't do that. Like, you had to, like, write a fully formed specification document and hope that you had thought of every edge case in the world, right? And hope that you had figured it all out. Um, and like, you know, and now, you know, I- it's amazing. Like, I don't have, you know, I, uh... You can change your mind on a daily basis about what you want to do based on what you're seeing and what you get out of it.
How the PM role has changed
Lenny Rachitsky 1:01:54 So let me follow that thread, actually. So you've been a PM for over 20 years.
Mona Sarantakos 1:01:58 Yeah.
Lenny Rachitsky 1:02:00 Do you agree that the role of a PM has changed the most, it's changed in the past 20 w- 20 years, in the past, like, two years, let's say? And if so, and even if you don't agree, I'm curious just what you think is most different about the role. Say, like, you're looking at Mona three years ago versus today, uh, what's most different about the work of a PM?
Mona Sarantakos 1:02:19 Well, okay, I'll start with a, a... I don't know if I'll ever know what a PM really is or does, but- [laughs]
Lenny Rachitsky 1:02:24 Yeah
Mona Sarantakos 1:02:24 ... 20 years later, um, 'cause I think that it changes, it changes so much based on company and, like, who you are and what you like doing and all that.
Lenny Rachitsky 1:02:31 Yeah.
Mona Sarantakos 1:02:31 But yeah, totally. I mean, it's completely different now, right? Like, uh, we don't, you know... I think that a few things that have, have changed the-- I think prototyping has changed a ton. The fact that, like, anyone can prototype anything. Like, the fact that I can come up with an idea and I am not an engineer, and I can build something out of it, enough to be able to have a conversation, right? Again, like, it's like nobody wants me writing code into the Meta database, uh, but like, um, but enough to be able to, like, conceive of something or even a design, right, um, that you could have a conversation around, versus before when I would, like, write a bunch of words on a piece of paper and hope that, like, somebody read the whole thing, right? Um, I think that has been pretty transformative. Being able to build our own tools has been pretty transformative, especially so quickly. Uh-
Lenny Rachitsky 1:03:21 Like internal tools.
Mona Sarantakos 1:03:22 Yeah, internal tools.
Lenny Rachitsky 1:03:23 Mm-hmm.
Mona Sarantakos 1:03:23 Yeah, yeah. Like, that's always, like, a pain point, right? It's like so much of our inefficiency is just because, like, we don't have the right internal tools 'cause you can't prioritize it 'cause you never have time 'cause you're building the, the end product, right? Um, and so, like, that has really, you know, just because AI can make it so much easier to do that, right? And so that's been really amazing and helpful. Um, but I think a lot of what's happening now that I love is because you've got this, like, prototyping culture and things can come out so fast, we spend a lot more time discussing things in a concrete way versus an abstract way, right? Because it's like, it's in my hands. Like, I see it. Like, it's not working, right? Or it is working, or I hate this, or I love this, right? But, like, it feels very concrete, and I think that makes us move a lot faster than before when it was all very abstract, right? You would look, like, at a 2D design, right? And you would imagine all these things, and you would have these conversations, and then someone, some engineer would have to spend a lot of time building it, and at that point, you've had so much sunk cost, right? It was, like, hard for you to be like, "Ah, I hate this," right? [chuckles] 'Cause it's like you've just spent, you know, three months building, right? Um, so I think that has been kind of amazing as a product manager, where the reason why I think we all do this job is because we wanna have, like, we wanna, like, get to the, like, end result, right? Like, we want to build something. I don't think we do this job because we wanna write a bunch of documents. I don't think we do this job because we wanna, like, keep a tracker, right? Um, or whatever, or have, like, really painful circular conversations. And so, um, so just, like, for me, that's been pretty amazing. It's like I no longer have to imagine a world far, far away. I can kind of, like, get it in a 24-hour cycle. Um, and sometimes I can do it myself. So that's been pretty cool. Um, but, uh, you know, the thing that I think has changed in our organization at least is the bar for PM has really changed. So, like, product taste now is the most important thing. Having, like, that kind of, like, high taste, high bar, like, product instinct, right? Like, execution still matters. You still need to do all, all those other things still matter. They're still really important. But, like, engineer, like, we work with, like, great engineers who are producty themselves, right? And so, like, the, the reason why we exist and the reason why our role is still really important is because we need to be able to be the voice of the customer in a lot of ways, and be able to be like, "Okay, cool. That's really cool. I'm glad you really like it. I don't think anyone else will," right? Like, and, and you need to be able to kind of have that, and this is why that empathy mattered so much to me, and matters so much to me, um, because we really have to represent our consumer base to all of the people who are building. Um, and we need to be able to hold a very high bar in terms of what goes out there, because also it's so easy to build shit and deploy shit, right? Like, AI slop is very easy to put out into the world, and, like, you can get products out there very quickly, but, like, if they're not good and they suck, like, no one's gonna use it, right? And so, so being able to, like, kind of establish that bar and that taste is, is, is very important right now, and that's probably the number one thing I look for when I'm interviewing PMs or working with PMs.
Lenny Rachitsky 1:06:45 It feels like one of the ways Muse is differentiated, and part of the reason it's done really well, is the design of the, of the product and the experience of it. I know you mentioned Alex was a big part of that, who's been there from the beginning. How intentional was that ... as a, as a differentiator almost, as a way to stand out? Or is that just lucky you had Alex on the team who are gonna make it awesome?
Mona Sarantakos 1:07:03 I mean, partly it is lucky. I don't think, there's not another Alex Cornell in the world.
Lenny Rachitsky 1:07:07 Mm-hmm.
Mona Sarantakos 1:07:07 Uh, I, so I had actually w- I knew Alex for a, from a long time ago. He, uh, was the designer on Live, on, on Facebook Live.
Lenny Rachitsky 1:07:14 Mm.
Mona Sarantakos 1:07:14 And, um, I don't know if you guys remember the, like, little emojis that would kind of float up into the air.
Lenny Rachitsky 1:07:18 Oh, yeah.
Mona Sarantakos 1:07:19 Um, it was genius. I was in love with it, right? And, uh, and so I remember, like, when I started working with Alex again in the AI organization, I was like, "Something's gonna happen. Like, I don't know when, but this guy is going to make something amazing, and I am just gonna follow him around [laughs] and be there with him for it." Um, he, you know, it's like intentional is a funny thing because I think everything he does is really intentional and deliberate. I don't think that we were like, "Okay, we're gonna make the design the differentiating factor." I think it's more like it comes so naturally to him to create unique, iconic designs, right? Um, it's just, like, so n- like, it's, like, in his bones. And so then when he does produce something, you know, I think that, like, what you need is people around him who are like, "That's not wacky. That's gonna be really interesting. Like, there's something here. Like, that's interesting," right? And so, so I would say that the design was, uh... it was like we almost saw the design first, and then we were like, "Oh, I get it. Okay, now I get it. Now these are the principles," right? The principle is that this thing is an entity, that you're communicating with it over this chat service, right? That, like... And so, like, once we kind of saw, like, the direction that he was going in, we were able to be like, "Okay, now we, we've, like, we figured it out a little bit in terms of where the product needs to be and what it needs to do and what those principles are, that then we'll define the rest of how we build it." Um, so it was certainly not intentional in terms of, like, we wanna differentiate, but it was very intentional in terms of, like, what should it be to us, um, and to the user. And I think just, it, like, the luck is that you get someone like Alex who's thinking about it, who's just gonna think about it in, like, a completely different way
Muse's first prototype
Mona Sarantakos 1:09:05 than I think most people would.
Lenny Rachitsky 1:09:06 And you said the first version was him prototyping, like the first prototype was he created the first version of Muse.
Mona Sarantakos 1:09:12 Alex created the f- yeah. So he, he created the first prototype of Muse very quickly also. It was, like, days. And it was shocking. Um, and, uh, I remember he, when he first showed it to me, um, it was, I, like, I didn't even know what I was looking at really, to be completely honest. I was like, there was, like, this chat thread, and I was like, "Ah, what am I doing here," right? And, um, what was genius about it was it was so simple despite it being, like, a very complex, you know, kind of concept, right? Um, and, uh, and a- actually at the time, he had, like, the feed too, so there was, like, a feed and there was a chat service. And I think he didn't, like, there wasn't, like, a lot of, "Let's sit down and discuss what you're gonna put into this thing." It was a lot of, it, like, you know, we let Alex cook for a few days, right? Um, and so then he came out with this, and to my point earlier, it was like as soon as we saw it, we were like... Like, at first I was like, "This is weird." And then as, as I was using it on his phone, it was, like, a local build on his phone, I was using it on his phone and, and then I'm like, "Oh wait, this is really interesting." Like, I am finding myself using this even in a different way than OpenClaw, right? Because it felt so personal to me. Again, OpenClaw, like, was manifesting in whatever service that you had sort of thing, right? Um, uh, so yeah, no, that was, that was an interesting time.
The board meeting prototype that almost didn’t work
Mona Sarantakos 1:10:37 It was so fast.
Lenny Rachitsky 1:10:38 And the prototype was actually working. It was actually using one of the models behind the scenes.
Mona Sarantakos 1:10:42 Yeah, so it wa- it was a working prototype. Um, and we had a board meeting right after. He, he had built it and there was a board meeting coming up, and we weren't gonna have that prototype in the board meeting at all because it wasn't even planned. Um, and you know, like, with board meetings, you, like, send the pre-reads well before, right? Like, so you have to send the pre-reads well before so everybody's, like, got it, knows what they're talking about. So we had a pre-read that was completely different, had nothing to do with this 'cause obviously this was not even a thing. It was barely, you know, a work stream. And, like, at the last minute we were like, "I think we should talk about this." And, like, an hour before the board meeting we're like, the whole thing broke. And [chuckles] we were like, "Great. So not only do we not have a plan, our, like, product is broken." Um, and, uh, and he, he was like w- like, you know, our engineer and Alex and, like, we were racing to fix it, and, like, I think literally five minutes before the board meeting started, the prototype got fixed. So it ended up being a great experience, but it could've gone a very different way, uh, within minutes. [chuckles]
Lenny Rachitsky 1:11:42 Whoa.
Mona Sarantakos 1:11:43 Yeah.
Lenny Rachitsky 1:11:43 Well, what would've happened? It would've been... [chuckles]
Mona Sarantakos 1:11:44 Yeah.
Lenny Rachitsky 1:11:44 Wow. What if this just never happened if that-
Mona Sarantakos 1:11:46 It would've been, I, like, think about it a lot. I'm like, you know in, like, the alternate universe situation? I'm like, in some alternate universe, we didn't figure this out and maybe Muse, Muse was never born. [chuckles] Born.
Lenny Rachitsky 1:11:56 Whoa. We're in the right timeline. I'm, I'm happy we're here.
Mona Sarantakos 1:11:59 Yeah.
Team size, closeness, and culture
Lenny Rachitsky 1:12:01 I love all these stories of the journey. Uh, are there any others that are fun, un- unknown, interesting that we haven't shared?
Mona Sarantakos 1:12:10 Yeah. I think, I mean, there's so many. It, we, again, to your point, we were working on it for months. Uh, and it was funny because, um, I forgot a lot of these stories 'cause I, it's like, uh, you know, I have two kids and you sort of forget childbirth because-
Lenny Rachitsky 1:12:24 There's a context window.
Mona Sarantakos 1:12:26 Exactly. [laughs] You're like, I don't remember how painful it was. If anyone asked me how childbirth was, I'm like, "It was amazing. It was so wonderful and beautiful." And my husband was like, "You hated every second of it." That's not what I remember. Uh, and so I think that, okay, the s- I think the stories of Mu- so there's a lot of fun stories like the two Muses talking to each other or, um, actually, like, the first time we got a refund when Christine and I, the, our, uh, the, all, the two engineers and I were, uh, we went to the World Cup and my flight got canceled and her flight got canceled and we, um, our Muses went and got... And so it was like one way got canceled, the other one got messed up or whatever, and our two Muses went and communicated with the airline's agent and got us refunds, which I think It was amazing at that moment. I was like, "I didn't even realize this was a possibility." [laughs] Um, and so there, like a lot of the stories that we had were just like for the first time our agent did something that we didn't really think was possible or was gonna be a, you know, like whatever, and, uh, and we're amazed by it. But I actually think my favorite stories are how close the team became through the process. Um, so we were like, it, it was very unusual in that we were a pretty small team working at Meta. We sort of had our own space on the roof of one of the Menlo Park buildings, and-
Lenny Rachitsky 1:13:44 On the roof?
Mona Sarantakos 1:13:45 On the... Yeah, there was like a, there was like a, well, we call it the roof. It's not technically outdoors, but it's like, you know, up in like a layer that most people don't go to. And there was this common area called the library. It's literally like a library. It's got, you know, a bookcase with shelves. It's got carpeting, which like no room in this office really has. Um, and these like funny floral couches from like, you know, looks like you bought them from 1995. Um, and that's where we did all of our standups, and that's where we hung out, and that's where we ate dinner and ate lunch together and ate breakfast together and, you know, like celebrated birthdays together and, you know, like, yeah. It was, we just spent so much time together, um, in, in like these common spaces. And, uh, so I think that like if I, like obviously we are so proud of this product and we are so proud of what we were able to do and, but I think the thing that I reflect on a lot is the team that kind of came together around it and how, you know, it's like lightning in a bottle. It's like I just, I couldn't have imagined this product being built with any other team, with any other people, and I think we became very, very close throughout the process and we had to have a lot of trust to do that. Um, and uh, yeah. So I think that's like the, my favorite outcome.
Lenny Rachitsky 1:14:58 How big was that early team? I know like at big companies, early teams, uh, like it's, it's rarely that small. I guess just what was the, what was the size of the early team that kind of just came together to start on this?
Mona Sarantakos 1:15:08 So first version of the team was like tiny. I mean, it was like 10 people probably.
Lenny Rachitsky 1:15:12 Mm-hmm.
Mona Sarantakos 1:15:12 Um, and it was mostly engineers, Alex, and then I was actually straddling like, you know, between Meta IMUs and a few other things. And so-
Lenny Rachitsky 1:15:20 Mm
Mona Sarantakos 1:15:20 ... and then we grew probably, I mean, it was still small. It was like under 100, um, all in like, you know, with functions and every- with all the functions. Um, we s- so we had like the core team and then we, you know, we have like a few of other teams that we work with, like the infra team, security, all of these other teams. Um, but the core team was quite, quite small, and it stayed that way throughout the entire process, and we were kind of obsessive over it. Like we were, it, we like really wanted to keep it because communication management and decision-making had to be very, very tight, right? And so like we wanted to make sure that it was in a position where we could trust everybody to make decisions, but we also knew everything that was kind of happening at the leadership level. Um, and uh, and there were on the PM side, there was like four of us really that built the entire thing. Um, and uh, and that was interesting because it meant lots of areas didn't have a PM covering it. Um, and so we had to kind of make decisions on like which areas absolutely needed a PM and which areas could you have like an Alex Cornell lead it or an engineer lead it or a, you know, someone else, right? And so like, um, so I think that was like very, it was an interesting way of thinking about where PMs were like really, really necessary versus where somebody else could do it. And what we realized was that a lot of times what would happen is that it was fine to let, uh, you know, like early, like zero to one stuff, like sometimes you ju- just like the PM, we didn't need a PM on that. We needed actually somebody who was just gonna build something that we could react to, and then as we were getting into like a p- posture of like this is gonna have to get incorporated into the product or it's actually gonna be at launch, like that's when the, you know, it was more important to have a PM come in. So it was pretty small. It was, uh, which is, you know, has its ups and downs. I think that like-
Lenny Rachitsky 1:17:09 Yeah
Mona Sarantakos 1:17:09 ... you have all the pros that I said, but it also means that you don't sleep a lot and there's not a lot of buffer, right? [laughs] Um, uh, so now that we're in post-launch world, we are growing the team slightly. I don't think we're ever gonna be a huge team because I think that's just not how we roll. But um, but we're definitely like adding a few more people and we're starting to feel that like, you know, it's like as you grow just even a little bit and the team dynamic changes a little bit, you've got to figure out how to like c- create, keep the culture that we had in the beginning, um, and scale that somehow so it doesn't feel alienating or whatever.
Lenny Rachitsky 1:17:41 Do you feel like you'll ever work on anything more exciting, interesting, impactful at this point?
Mona Sarantakos 1:17:47 I mean, I'm 44. I think I'm, like, I think this is, this is, this is it. Now, I don't know. I didn't think that this was gonna happen. Like, I really didn't, right? I mean, I had no idea. So I have no idea where this is gonna go. I, this has been the most personal product I've ever worked on, um, because it, we built it for ourselves. Uh, like usually like I build products for people, right? I'm like, oh, but because it was like we were, it was almost like our own thing for so long, we built it very much for our needs and ourselves, um, in the beginning, right? And obviously now it's changing. But um, but I don't think I've ever experienced something so personal. So who knows? Who knows, Lenny?
Lenny Rachitsky 1:18:30 That's true. Lenny-
Mona Sarantakos 1:18:30 Where is this all gonna go? [laughs]
Lenny Rachitsky 1:18:32 Nobody knows. It's, you know, if you think about it, every PM's dream is to work on the number one app in the App Store, the fastest growing AI consumer app in, in history, allegedly. You know, this is kind of the dream for a lot of people, and you're living it.
Mona Sarantakos 1:18:47 Yeah, it's terrifying.
Lenny Rachitsky 1:18:48 For better or worse.
Mona Sarantakos 1:18:49 It's terrifying. So, I have so much anxiety now. I'm like, it's crazy because, um, A, you obviously are like, "Oh shit, like I need to stay in the top of the App Store," whatever, right? Like you still need to grow. But also, the more people that use the product, it's like the responsibility is so high 'cause they're uploading, like they're sharing so much context and they have so much that they're having these agents do, right? Like I was just talking to a friend of mine who- Um, you know, she has her agent, like, doing, like, managing her kid's sports team. She was a parent manager, and she, like, kind of ran out of time. Um, and I have an... You know, I was talking to this other woman who, she's a single mom, she's a nurse, she has two kids. Um, you know, she has her agent, like, meal planning and, like, finding doctors for her and setting up the appointments for her and sending these emails out for her. And, you know, the more she told me about this, the more anxious I got. I was like, "Oh man, I hope it's not fucking up." And so, [chuckles] like, I think that we're like, you know, it's, like, amazing to watch, but at the same time, I feel like for me, uh, yeah, it's, like, sort of, it's crazy. It's, it's terrifying, um, because you really, really want this thing to be, uh, like, you want it to be perfect for people. Um-
Lenny Rachitsky 1:20:05 And yeah. Ne- and never in the history of product have, has a product been a- been asked to do so many things and so many non-deterministic things. Usually-
Mona Sarantakos 1:20:13 Yes
Lenny Rachitsky 1:20:13 ... it's like, "Here's my onboarding flow. It's gonna work consistently for everyone." [chuckles] And it's like-
Mona Sarantakos 1:20:17 Oh my God. Okay, wait. First of all, the non-determinism of AI-
Lenny Rachitsky 1:20:20 Mm-hmm
Mona Sarantakos 1:20:20 ... is the craziest thing as a PM because, like, I, like, a lot of, like, my history of my life is control. [chuckles] Like, I love, like, okay, I can control this thing, right? Like, the products that you build, you're like, yeah, to your point, you're like, this is the onboarding flow, whatever, right? And now it's like, oh, the agent's just gonna reason about it and figure out what to do. And I, [chuckles] I can create some guardrails and evals, but, like, it's just gonna figure it out, right? Um, it's wild. Uh, but, um, but I think that's what's also so special. No two Muses are really the same, right? Like, the way that it, you t- uh, your Muse talks to you is gonna be really different than the way that it talks to
What comes next: ambient agents and financial betterment
Mona Sarantakos 1:20:55 me and what it does.
Lenny Rachitsky 1:20:56 Maybe as a final question, what's, what's next? Where are things going? What's kind of the vision of where this heads? I know there's, like, a Charm launching at some point, if that's what it's called, a little device. What's kind of ahead for Muse? How different may it look in the future? What's kind of the vision?
Mona Sarantakos 1:21:09 Well, I think one is, I mean, to the point of the Charm and, and other devices, like, I think that Muse is obviously going to, uh... I think if you really want personal superintelligence everywhere with you, it has to become very ambient, right? And so, like, right now, it's sort of trapped in an app. Um, but I think soon it should be in your glasses, on your Charm devices, whatever that might be, right? And I think, um, so it ne- like, you know, it's like, I think this idea of an agent sort of being beyond an app, um, and being in your world, um, is gonna be quite important. I think figuring, like, the, the democratization of this is gonna be quite important, right? Like, the whole idea... I mean, we're, like, when you're, when you work at Meta, you really think about, like, this idea that everybody could have a product. Um, and so figuring out how to make that scale and affordable so that, you know, it's, it can become an equalizer in some ways, I think that's really important for me.
Lenny Rachitsky 1:22:08 Mm-hmm.
Mona Sarantakos 1:22:09 Um, and, uh, and then, like, a really small thing, like, I, just from a capability perspective, like, I still think that, like, there's a lot of babysitting of agents, right? Like, you spend a lot of time kind of, like... It's like with a Tamagotchi. You're, like, trying to feed it, and you're trying to, like, make sure that it's okay, and it's, like, has all the contacts, and it's checking in with you a lot. I do think over time, like, you know, hopefully, like, the thing that we get to is that the agent becomes more, um, it can intuit what you want pretty quickly. It has, uh, more context. It's like, it's, you know, ca- more capable, right? So it sh- like, we trust it. You trust it. It trusts itself more, right? And it can start to take autonomous actions better. Um, so I do think that's, like, an area that I care a lot about because I'm like, okay, at the point where I'm babysitting an agent, I might as well do it myself, right? And, like, that is a bad place to be. Um, so that's another area that I focus on just from a tactical perspective. But I do think, like, the cool and scary thing about working on AI is that a year ago, I would've never explained Muse to you the way that I did, right? Like, I had some concept of maybe what a consumer agent was, but it's very different than what it is today. So I don't totally know where Muse is gonna go next. Um, I can see, like, short-term things that I want, and I can see really distant things that I want, which is, like, everybody has an agent. Every, you know, it's everywhere you are. It's ambient, all of that sort of stuff. But then that, like, in-between phase I think could be, like, very interesting and different. Um, I also think that the thing that I am excited about is, um, [lip smacks] like, like, agents helping you become... It's like, you know, from an economy perspective or a financial perspective, it's like, you know, everybody wants to a hus- like, it's like, start new businesses. Do a side hustle, right? Like, and I think that there's, like, a real opportunity for agents to be able to expand your world in lots of ways, including financial betterment. Um, and I think that is gonna be a huge part of where I would be excited to take, uh, this product and see the, you know, the industry evolve because I think there, you know, it's like that classic your life, your money sort of stuff, right?
Lenny Rachitsky 1:24:17 Mm-hmm.
Mona Sarantakos 1:24:17 Like, there's just these core needs that we as humans have, and I think, you know, to some extent, a lot of what the agent has done so far for me is save me time, which is very scarce and important to me. But if it can also do these other things, make me healthier, make me h- you know, make me financially more secure, like, that starts to really cover so many acute needs for users.
Lenny Rachitsky 1:24:36 What a time to be alive, Mona.
Mona Sarantakos 1:24:38 I know. It's crazy. It's crazy.
Lenny Rachitsky 1:24:40 What is... It's so crazy.
Mona Sarantakos 1:24:43 It's so weird because, like, again, like, I, I'm, like I said, I'm 44. When I was a kid, I mean, could you imagine? Like, I had to go up to the TV and turn the TV down [chuckles] to be able to change a channel, and now I am talking about personal superintelligence in your glasses.
Lenny Rachitsky 1:24:58 Yeah. I think we grew up around the same time. Remember the-
Mona Sarantakos 1:25:00 Yeah
Lenny Rachitsky 1:25:00 ... 386, 486 computers? You had to, like-
Mona Sarantakos 1:25:02 Oh, yeah
Lenny Rachitsky 1:25:02 ... press the turbo button.
Mona Sarantakos 1:25:03 Totally. Totally.
Lenny Rachitsky 1:25:04 Speed, speed it up to 66 megahertz-
Mona Sarantakos 1:25:07 Amazing. Turbo. [laughs]
Lenny Rachitsky 1:25:08 ... or whatever. Oh my God. Um, okay. I know you have to run, uh, so I'm gonna skip the lightning round, but I'll ask you the traditional question I ask at the end. Is there any way that listeners can be useful to you?
Mona Sarantakos 1:25:18 Feedback. So if you use Muse, we have this really cool feature where you can tell Muse what's working and not working, uh, and it sends us a report. Um, and so, uh, so you don't even have to post it in anywhere. You just tell your Muse, and we get it. So I think the more feedback that we get from people, the better we get, and the better it is. Um, so I think that's probably the number one thing is, like, you know, use the product. Help us get, make it better. It's not perfect yet, I don't think. I think we're very early in this build cycle of agents. Um, and um, so I think that's a huge part.
Lenny Rachitsky 1:25:53 So you could say, [clears throat] "Send this to Mona. Please make sure she sees this."
Mona Sarantakos 1:25:56 You could say that. Actually, one of my-
Lenny Rachitsky 1:25:59 Oh, wow
Mona Sarantakos 1:25:59 ... neighbors, one of my neighbors, like, I think on a weekly basis, [chuckles] sends feedback through their Muse and is like, uh, like, "Tell Mona, your product manager, that I have this issue," and I can find it in our, uh, in our system. But, uh, yeah. I only... So it was funny, and the reason why I know about this is because I was looking at it, and I was like, "Oh, weird, my name popped up." And then randomly, I was at, like, a birthday party or something for the kids, and he was like, "Oh, yeah, no, I send feedback every single week, and I use your name in it because I think people will notice." [chuckles] And I'm like, "Oh, God. Great."
Lenny Rachitsky 1:26:33 Wow. All right.
Mona Sarantakos 1:26:34 Uh, but yeah.
Lenny Rachitsky 1:26:34 Prepare yourself for more of that.
Mona Sarantakos 1:26:35 So that is, that is... Yeah, exactly.
Lenny Rachitsky 1:26:37 Amazing.
Mona Sarantakos 1:26:37 Exactly.
Lenny Rachitsky 1:26:38 Well, Mona, uh, you and your team are doing incredible work. It's a really special product, uh, and a very special time. With that, uh, [chuckles] I'll say goodbye. Um-
Mona Sarantakos 1:26:47 Thanks, Lenny
Lenny Rachitsky 1:26:47 ... thank you for being here.
Mona Sarantakos 1:26:48 Appreciate it.
Lenny Rachitsky 1:26:48 Yeah.
Mona Sarantakos 1:26:49 Of course.
Lenny Rachitsky 1:26:49 Thanks, Mona.
Mona Sarantakos 1:26:49 Thank you. Thank you for having me.
Lenny Rachitsky 1:26:50 Bye, everyone.
Mona Sarantakos 1:26:51 Take care. [upbeat music]
Lenny Rachitsky 1:26:52 Thank you so much for listening. If you found this valuable, you can subscribe to the show on Apple Podcasts, Spotify, or your favorite podcast app. Also, please consider giving us a rating or leaving a review, as that really helps other listeners find the podcast. You can find all past episodes or learn more about the show at lennyspodcast.com. See you in the next episode.
Episode duration: 1:27:15
In the uListen app, the transcript lights up word by word as you listen. Get uListen
Transcript of episode WY0cdD4gNoQ