Lenny's PodcastNabeel Qureshi: How Palantir's bat signal forged founders
Through forward-deployed engineers embedded at Airbus and the NIH; Palantir built Foundry and Gotham on data plumbing, breeding mission-fit founders.
EVERY SPOKEN WORD
160 min read · 31,658 words- 0:00 – 5:10
Introduction to Nabeel S. Qureshi
- LRLenny Rachitsky
30% of PMs that leave Palantir start a company. Just give us a picture of what, what the people are like.
- NQNabeel Qureshi
I feel like they screen really hard for a few traits in particular. One is, like, very independent-minded people who aren't afraid to push back. Two is people with broader intellectual interests.
- LRLenny Rachitsky
What's the difference between, say, a PM at Palantir versus a traditional PM?
- NQNabeel Qureshi
They were extremely careful about only making people PMs who had first proven themselves out as forward-deployed engineers. You basically could not become a PM any other way. There's two types of engineer at Palantir. So there's one that works on the core products, and they're a traditional software engineer. There was a different type of engineer which you sent into the field, right? You would spend maybe Monday to Thursday, and you would actually go into the building where the customer worked, and you would work alongside them. You would literally get a desk pass. And so that engineer became known as a forward-deployed engineer.
- LRLenny Rachitsky
What's something that you believe that most other people don't?
- NQNabeel Qureshi
I think this is a somewhat contrarian view within tech.
- LRLenny Rachitsky
(instrumental music) Today, my guest is Nabeel Qureshi. Nabeel is a founder, a writer, a researcher, and an engineer. He was recently a visiting scholar researching AI policy at the Mercatus Center alongside Tyler Cowen. At one point, he worked with the National Institute of Health and major clinical centers to create the largest medical dataset in the world. He worked at the Bank of England for a bit. He was founding member and VP of business development at GoCardless, one of Europe's biggest financial technology unicorns. And most related to the topic of this conversation, Nabeel spent almost eight years at Palantir as a forward-deployed engineer, working on public health projects with U.S. federal agencies, including public health services during the COVID-19 response and applied AI in drug discovery. Whether you are a fan of Palantir or hate everything that they do, they are an important and fast-growing company that is pumping out incredible product leaders, as you'll hear, more than any other company in the world. So, it is worth studying and understanding. I've never heard an in-depth conversation digging into how they operate, build product, hire, and were able to scale from a primarily services business to a software business. So, I am very excited to bring you this inside look. In our conversation, we go deep into: what the heck does Palantir even do?; why getting good at managing lots of data is an underappreciated secret to their success; a look at the unique forward-deployed engineer role that they innovated and what other companies can borrow from their insights here; also, how they hire and how they build amazing product leaders; plus a ton of advice on talking to customers, building products, and starting companies. If you enjoy this podcast, don't forget to subscribe and follow it in your favorite podcasting app or YouTube. Also, if you become an annual subscriber of my newsletter, you get a bunch of amazing products for free for a year, including Superhuman, Notion, Linear, Perplexity, Granola, and more. Check it out at lemmysnewsletter.com and click bundle. With that, I bring you Nabeel Qureshi. This episode is brought to you by WorkOS. If you're building a SaaS app, at some point, your customers will start asking for enterprise features like SAML authentication and SCIM provisioning. That's where WorkOS comes in, making it fast and painless to add enterprise features to your app. Their APIs are easy to understand so that you can ship quickly and get back to building other features. Today, hundreds of companies are already powered by WorkOS, including ones you probably know, like Vercel, Webflow, and Loom. WorkOS also recently acquired Warrant, the fine-grained authorization service. Warrant's product is based on a groundbreaking authorization system called Zanzibar, which was originally designed for Google to power Google Docs and YouTube. This enables fast authorization checks at enormous scale while maintaining a flexible model that can be adapted to even the most complex use cases. If you're currently looking to build role-based access control or other enterprise features like single sign-on, SCIM, or user management, you should consider WorkOS. It's a drop-in replacement for Auth0 and supports up to one million monthly active users for free. Check it out at workos.com to learn more. That's workos.com. This episode is brought to you by Attio, the AI-native CRM. Attio is built to scale with your business from day one. Connect your email and calendar, and Attio instantly builds a CRM that matches your business model with all of your companies, contacts, and interactions enriched with actionable insights. Sync in your product's usage, billing info, or any other data sources, and Attio's flexible data model will handle it all without any rigid templates or workarounds. With Attio, AI isn't just a feature, it's the foundation. You can do things like instantly prospect and route leads with research agents, get real-time insights from AI using customer conversations, and build powerful AI automations for your most complex workflows. Industry leaders like Flatfile, Replicate, and Modal are already experiencing what's next for CRM. Go to attio.com/lenny to get 15% off your first year. That's attio.com/lenny. (instrumental music) Nabeel, thank you so much for
- 5:10 – 13:29
Palantir’s unique culture and hiring
- LRLenny Rachitsky
being here, and welcome to the podcast.
- NQNabeel Qureshi
Thanks, Lenny. Glad to be here.
- LRLenny Rachitsky
In our chat today, I want to zero in on a post that you recently wrote where you shared your reflections on your time at Palantir. You spent something, maybe just under eight years there. The reason I'm really interested in Palantir is I've been doing a bunch of research recently looking into which companies hire the best product managers and create the best product managers, and Palantir just keeps coming up over and over in the work that I'm doing. So, I'll share a few stats real quick. So, I looked at which companies produce the most founders, especially out of their PM team, and Palantir is by far number one. 30% of PMs that leave Palantir start a company, and that's like... And number two is number- is 18%, and that's Intercom. So that's that stat. I looked at which companies' PMs that leave get immediately promoted in their next role. Palantir was number one of all companies in the world,I looked at which companies' PMs become the first PM at another startup that they join. Palantir is number two in the world. And then I looked at which companies alumni PMs become head of, heads of product down, d- later in their career. Palantir is number three in the world. Uh, also just the company is doing extremely well. It's worth, I think something like $200 billion these days. So there's a lot to learn from Palantir. I actually wanna start with a question that I imagine every employee at Palantir constantly gets that, and I still don't think people totally have an answer in their head, what does, what does Palantir do?
- NQNabeel Qureshi
That's a great question. You started off with an easy one, Lenny. Um, so Palantir is, I, the way I describe it, right, is they, um, achieve outcomes for their customers very tactically. The way they do that tends to be through a data platform. So they have what I consider to be the world's best, best data platform. And I can go into what that means in a second. And then there's a couple different versions of this. So there's one that's optimized for intelligence and defense use cases, that one is called Gotham. And then there's one that's more optimized for commercial use cases and that one's called Foundry. And that's kind of the classic, you know, explanation of what they do. So they sell a data platform. They typically work with very large customers is the other thing. So it's gonna be, you know, Fortune 50, it's gonna be governments around the world. It's gonna be those kinds of, uh, customers. So that's the kind of capsule answer, but there's lots to unpack in that.
- LRLenny Rachitsky
Awesome. Okay. And we're gonna touch on a lot of this stuff including the data piece. I wanna start with talking about just kind of the people and the culture of Palantir. You shared a bunch of really funny stories of what it's like to come to work and, and even, even interview at Palantir. There's a story you shared where I think it was maybe the co-founder, you're walking by and he's chewing ice and you're, and that's like some benefit to cognition. Just give us a picture of what, what the people are like, especially early days Palantir and the culture and how unique it might seem.
- NQNabeel Qureshi
Yeah. It's definitely, it's an n-of-one company. I, I don't know how else you would start, start this company if you were not somebody like Peter Thiel. Um, in so far as it, it seems like, you know, there was a point at which they owned a silly fraction of the office space in Palo Alto. So you'd walk around Palo Alto and it would just be, you know, Palantir hoodies, Palantir buildings everywhere and so on. Uh, and so I feel like what happened at some point is they raised a lot of money and they resorted to all these really interesting ways of just getting top talent out of places like Stanford and other, you know, other top schools. And just people who knew the founders who tended to be very interesting intellectual people. And I feel like they screened really hard for, uh, a few, a few traits in particular, right? So I would say one is, like, very independent-minded people. People who weren't afraid to push back, who, you know, questioned the frame of everything and thought for themselves and had sort of strong convictions. Um, two is just, like, people with broader intellectual interests. You know, Karp, Karp just released a new book and, you know, he's quoting Habermas and all these European intellectuals and just things you don't typically see a tech CEO do. And so I think there's that intellectual strand in the company. And then, yeah, I think three is just people who are very intensity, intensely competitive. There's a, there's a sort of win at all costs mentality to the company. And so I think those were the kind of set of traits that were like this gravity well in California at a certain time. And so you just had a lot of really fascinating people joining the company at that time. The way they screened for this was interesting too, right? So for the longest time they had, everyone does this now I think, but it's like at the time it was a little bit rarer, is a founder had to interview you in order for you to receive an offer. And so a founder, it could have been Alex Karp, it could have been Stefan Cohen. Earlier on, it might have been somebody like Joe Lonsdale, but it was always, like, one of these people. Um, and the interviews were pretty strange. Uh, so, you know, with, with Stefan it would be, you'd be chatting about philosophy for an hour and a half, and it would very much just be like he would pick a topic out of thin air it was impossible to prepare for, and then he would just go very, very deep and try and test the limits of your understanding. But it would really just be a fun conversation. And then, you know, if you passed the vibe check, you'd be in. And so there was that strong selection mechanism. There was also the question of, you know, I think it's, it might have been Thiel who mentioned this, but he thinks that a lot of the best recruiters in the world or, like, companies that attract talent, they put out this kind of distinctive bat signal, and it has to turn some people off. That's kind of the key of a good bat signal, right? So I think in the present day, OpenAI and Anthropic, they're both sucking up, like, some of the best talent that you and I know. And I think one way they do do that, and they are sincere in this, but they do really attract people who are almost messianic about the potential of artificial superintelligence, right? And who really believe this is the only thing that matters, and it is gonna be the biggest thing in the world. I think Palantir's version of that was that, you know, they were quite focused on things like preserving the west. You know, there was a slogan of save the Shire, right? So there was, there was, they were talking about military and defense and intelligence and the importance of that well before everybody else. And, and bear in mind, this was during the era when it was like social mobile local apps, right? Like, you had social media was on the rise. You had, you know, the hot companies were like Facebook and Pinterest and things like that. And so this was at the time a very strange thing. And so I think to be drawn to that, you had to look at the other options and say, "Well, this is fine, but what am I really doing in life?" Right? Whereas you had this other place that was like, "Hey, come solve the hardest, messiest problems in the world with us." And I think just at that time, that really drew some really good people.
- LRLenny Rachitsky
We're gonna talk about the thing, the reasons people don't necessarily like Palantir and, and kind of the moral question of what they do, but, uh, when people look at a company that is like, like I guess OpenAI is, to your point, is a good example where they're just, like, so turned off by maybe their approach. You, what you're missing is that's potentially intentional because that actually draws in the people they really want. It makes me think about I was involved in the creating the core values at Airbnb.And something that we, uh, learned going through that process is when you define the values for your company, it's really important to sh- clarify who this is not for, exactly as you described. Which is- feels unnatural, like, "Oh, uh, w- we want to be inclusive, we don't want to make people feel like they don't belong," but the whole idea is to be clear on here's who will thrive here, and here's who's aligned with our mission. And, uh, and what I'm hearing is Palantir can- and these companies take it to the extreme.
- NQNabeel Qureshi
100%. Yeah. On my team at Palantir one process that we followed, I could talk about this more if it's interesting, is, um, you had to, when you started a new project, you basically had to organize what they called a murder board for it. I think this is originally an army term, right? So the idea is basically you write up kind of a two-page plan for the project, you invite three or four smart folks you know who don't know anything about the project, and their job is just to tear apart your plan, right? And so you would have to write like, "Here is the vision for this, here are the goals, here are the, like, tactics over the next three months," and one section was principles that you're following for this project. And I remember giving this advice a lot was just, like, when people joined they would- they would write principles such as, you know, move fast. And I would always be like, "Everyone likes move fast, so I guess not a good principle actually, because nobody can really disagree with this reasonably, right?" You need something that actually a lot of people are gonna go, "Wait, why are you- why are you picking this principle? This seems wrong to me." So you need something that people can disagree with.
- 13:29 – 16:14
What Palantir looks for in people
- NQNabeel Qureshi
- LRLenny Rachitsky
I wanna come back to s- uh, the beginning of what you described of what they look for, what Palantir looks for in people. You talked about independent-minded, uh, a lot of interest, broad interest, and com- competitive. First of all, I think a lot of people hearing that, especially that last part, would be like, "I don't want to work there." Why does this work? 'Cause this isn't, uh, naturally what you would think of as how you build the most amazing, productive team.
- NQNabeel Qureshi
Yeah. I think it- it just draws people who wanna win, right? I think that's what was really important there. Um, the other piece of it, I think, is that there's actually... And- and this was much truer 10 years ago, right? Is there was a lot of talent that was a little bit outside of the tech ecosystem but could easily have been very successful within it. So, you know, people who got out of the military or one of the intelligence agencies and they were doing, let's say, an MBA somewhere to transition into the corporate world. And I think typically they would have taken a position at a kind of classic Fortune 500 corporation, and actually Palantir managed to get a bunch of that talent. And at the time that was very undervalued. You know, the- the people who succeed the most in the Marines or the Special Forces or whatever it is tend to be pretty smart people, they tend to have accomplished very difficult goals in very hostile environments. And it turns out that when you're starting a somewhat chaotic tech company, that's actually a very useful skill to have. Again, I think, you know, more companies are doing this now, so Scale.AI, Anduril, et cetera. But at the time that was a very differentiated talent pool. And so I think having those- those values as opposed to maybe the values that were more in fashion then, so talking about, you know, how inclusive you are or, you know, the sushi that you serve at lunch (laughs) or whatever it is, uh, it just drew a very different crowd, and I think- I think the game that was being played there was, one, it's- it's mission alignment, right? Like, you're doing a defense company, that's the kind of person you wanna attract. Uh, but I think there's also two, which is just, what is the talent that maybe is a little bit undervalued now and how do you actually draw those people to you? And I think that game is always shifting.
- LRLenny Rachitsky
This- this is definitely starting to explain why so many Palantir alumni go on to start companies and become leaders at other companies. Like, this is a- these are leaders that you're hiring, so feels like a lot of it is just the talent you hire, people that are naturally, uh, leaders.
- NQNabeel Qureshi
I think you're right. Um, and we can get more into it, but I think there's also- there was also a very concrete set of ways where that place was a training ground for founders. Um, I even think it turned a lot of people who might not have become founders into good founders, uh, because of just- because of the way it works. So I think there was a selection effect there, but there was also, um, some sort of training effect too, but it's kind of unique to the way the company works.
- LRLenny Rachitsky
And is that along the lines of the forward-deployed engineer stuff, or is that something else?
- NQNabeel Qureshi
It is that, yes. Yes. (laughs)
- LRLenny Rachitsky
Okay, cool. We're gonna get to that. I love it. Okay,
- 16:14 – 19:11
Why they don't have titles
- LRLenny Rachitsky
amazing. Before we do that, l- one last thing is something I've seen is that you guys at Palantir don't h- really have titles. Everyone's kind of the same level and just, like, generic titles for everyone.Uh, talk about that. Why do you think that was important? Why- why was that useful?
- NQNabeel Qureshi
I don't know this for sure, but I do- I do know that Thiel writes about this in Zero to One, and hi- his take is just that as soon as you have these titles, you have a thing that people are competing for, then you get these very unproductive conflicts. You get people optimizing to game the system, you get Goodhart's Law everywhere, right? So it's like you- you have a metric and then people basically manage to the metrics. There's a lot of interesting... I don't want to pick on any one company, but, um, if you take Google, for example, there's a lot of interesting posts by people who left Google and they cite this as a reason why they got a little bit disgruntled, is that there's a way to get promoted. Rather than, like, let's say improving an existing product, what you do is, like, you start a completely new product and that has your name attached to it, and then when it comes to promotion season you can say, "Hey," like, "I did this new thing." And then boom, you have a new Google product. But is- is- is maybe confusing to the end user. So I think they wanted to avoid all of these kinds of dynamics, right? And so the way that they did that was they said, "Well, titles are not gonna be this sort of memetic totem that everybody competes for. Instead everyone's just gonna have the same slightly meaningless title, which is forward-deployed engineer." And the only people who did have titles were the CEO and then there were six directors and- but that was it. And- and now I think, you know, it's a little bit more nuanced. There are different teams, there are some people with titles. But honestly it was almost like, um... We used to joke about it, right? It's like people would leave the company and then you'd see them update their LinkedIn and they would be like, "Oh yeah, I was totally the SVP of, you know, XYZ." And it's like, "No you weren't, you just..." You know? But then it's like I- I totally understand it too, because when you leave the company you have to make your experience legible to the next person. And- and so guess what? Things like SVP actually do matter, right? And so yeah, I think they didn't... They- they wanted to avoid this kind of internal c- competition.There are downsides to doing this, right? Um, so maybe the competition isn't as explicit, uh, around a specific title, but instead what it becomes about is, you know, there's a particular exec or something and you wanna gain their favor, and so it comes more about, like, who can get in the inner circle of this person or whatever it is, and there were those dynamics too. I actually am a big fan of this philosophy though, the- the no titles one. I think what it did do is that it basically said you... If you are in... Let's say you're in a role of you're leading a very important project, right, which would happen. What it said was, "This is always fluid." So you are in this role because you're very good and so it's a meritocratic thing, but if- if you stop performing well, it's actually very easy to shift that because there is no explicit, like, "I am the GM of this- this, uh, project," kind of title. And so you always had to kind of earn your place in the company. You always had to earn, uh, the right to work on what you were working on, and I think that was a good
- 19:11 – 25:23
Forward-deployed engineers at Palantir
- NQNabeel Qureshi
side effect.
- LRLenny Rachitsky
Let's start talking about forward-deployed engineers. What is a forward-deployed engineer?
- NQNabeel Qureshi
Yeah, so the way this originated was basically... You can think of it as there's two types of engineer at Palantir, right? So there's one that works on the core products, so they don't necessarily leave the building in Palo Alto or New York or wherever the office is. They're very much working on the core products and they're a traditional software engineer. Because of the way the company works, we had these very large engagements with these large entities, it was a different type of engineer which you sent into the field, right? So what that meant was you would spend maybe Monday to Thursday and you would actually go into the building where the customer worked and you would work alongside them. You would literally get a desk there. And so that engineer became known as a forward-deployed engineer. So within the company that- that function is known as business development or BD, and then PD is product development, so it's where the product is made. And so within BD, you had forward-deployed engineers. There are actually two types. So there is one that is, um, sort of a more technical software engineer, so you- you have to pass a software engineering interview and prove your chops there, and you would typically have a CS degree, but there was actually a type of forward-deployed engineer that didn't have that. So you would still... You would still get sort of a technical interview, but it would be less about, you know, do you know the specifics of this C++ algorithm and it would be more about just like, can you reason about data? And th- there... We kind of didn't have that division originally, but, um, it turns out that there's a lot of people who are, you know, technical adjacent, shall we say, who you really need, uh, in the room when you're working with these large organizations or these large companies because, you know, translating what you're doing into language that would resonate with an executive or being able to kind of navigate the social dynamics in a room, all of these are very valuable skills. And so the hiring criteria there were a little different, right? It was a bit more about, like, "Are you savvy as a human?" Um, but, you know, all of that was given the title of forward-deployed engineer, and it's just an engineer who works with customers.
- LRLenny Rachitsky
Okay, so just to make this crystal clear for people, 'cause a lotta people hear this idea of Palantir having forward-deployed engineers, a few other companies have done this, uh, it's pretty radical. So as you describe, you basically have a desk at a company, so you worked with Airbus and we'll talk about that, so I'll just make it real. So you have a desk and a computer and login access and all these things at Airbus. At... You work... You go to their office four times a week. You're sitting there with their employees working, like, side by side, building a product for them versus what most people do where they just "talk to customers" in quotes or they do an interview once in a while, they do a Zoom, they share mocks, things like that. This is like that on steroids. Is that roughly... This... The way to think about it?
- NQNabeel Qureshi
It is, yeah. And- and so we would- we would really be there a lot of the time, and so the- the side effect of that was, one, you learn to live and breathe the customer's problems and you learn to speak their language, right? And e- eventually they saw you sort of as one of them, and so you develop these really close bonds with the customers. So at Airbus I would be at the factory where the planes were produced and I... Or I'd be sitting next to, you know, people diagnosing issues with aircraft or whatever it was. Um, similarly, later on I worked with the NIH, which is part of the US government, and I actually had a badge there and I would work with civil servants and biologists and clinicians and people who were working there. And so it's this- it's this pretty radical thing, as you suggest. I think the- the key thing there from a business point of view, right, is the average kind of, um, deal that Palantir had was very large, right? It's in the many, many millions of dollars, which means that you could kind of pay for this as part of the thing that the customer got, and then it was sort of priced according to the value that the customer got, right? So as a simple example, like, if you're Airbus and you're... Let's say that you have an issue with one of your planes and you need to fix it and fixing that is worth, you know, $100 million or something to you, that's how it would be priced. It would not be priced as, "Hey, you're buying data infrastructure and it's similar to Snowflake or Databricks or one of these other providers." It's much more anchored to here is the outcome, but then, um, the job of the forward-deployed engineer is not just to deploy software, it is not just to sell software. It is to actually solve the problem, and so you would have to be there, you would have to meet the key stakeholders who are actually in charge of reporting to the CEO about the specific issue. You would have to become their friend, you would have to gain their trust, and you would have to, in some cases, create new software such that it could actually solve the novel problem that was in front of you, right? So I would have friends who worked with, uh, you know, one of our energy company customers and they would have to learn the ins and outs of how oil wells work, right? And then out of that, it turns out that, um, having streaming data is actually very valuable for this use case, and so boom, suddenly there's a product that can handle streaming data. That becomes part of the core platform. But that would be the motion, is you learn about the problem, you figure out what software would best address it, you build that software, you use it to accomplish the goal, and then eventually that kind of gets folded into the broader product suite. And so you can start to see why this would be a good forge for founders, right?And, and this was actually part of my thesis qui- going in and joining was, I said, "Well, say I got five reps of this," which I got more, more than that, right? But say you get five reps of doing this in five disparate contexts, you actually become very good at this cycle of, like, "Okay, go into the building, gain the trust of the person, meet, meet the people that, you know, are gonna become your users, talk to them about their problems, make sure you're building something that actually solves them and, you know, isn't just a boondoggle." Get really fast feedback and iteration loops, right? So every week you would have, like, a s- uh, a cadence where it's like, Monday you go in, you do your meetings. Monday night you build something. Tuesday you show it to somebody. Tuesday you get the feedback. Tuesday night you iterate on it. Wednesday you show it to somebody. Wednesday night you iterate on it. So you, you get, like, four of these, five of these cycles every single week and you're moving incredibly fast. So six weeks in, you've suddenly gotten to, wow, this is really valuable and somebody's willing to pay you, whatever, $20 million for it, and boom. Like, I think this is why you get so many kind of founders coming out of this same, same process.
- LRLenny Rachitsky
It's becoming very clear (laughs) why so many founders emerged at Palantir.
- 25:23 – 30:00
Key principles of Palantir's success
- LRLenny Rachitsky
Okay, so, uh, an important element of this, as you described, is that the idea here is build this as a one-off solution to solve a real problem at, say, Airbus or some government organization, and then the idea is you create something out of that that then Palantir can sell to other companies. Uh, what's extra cool about that is you... They pay you to solve this problem for them, and then that is, uh, funding this other product that Palantir can now sell to everyone. What a cool, what a cool business. However, early days Palantir, everyone thought it was just this services business, they were just consultants building software for companies like Airbus. There's no way they can make this, uh, a platform that works for a lot of people. Clearly that's what's happening and it worked out. This is kind of like the holy grail, solve one customer's problem and then sell it to everyone else, every, every SaaS business basically would love to do this. What, what do you think allowed them to actually achieve this and be good at this? What are some principles that, that worked?
- NQNabeel Qureshi
Yeah, that's a great question. And, and it's true. I think that from when I joined until maybe till IPO and a little bit after, you know, I was told, "Hey, isn't this basically, like, a sparkling Accenture," right? "Isn't it a consulting business kind of lopping as a product company?" And eventually it became undeniable. One, because, you know, I always laugh when people are like, "What does Palantir do?" It's like, you can go onto YouTube and just search Palantir demo and you'll get plenty of demos of how the software looks. Not many people know about this, but you can go and sign up with a credit card right now and start using it. So...
- LRLenny Rachitsky
I can have a Palantir account? (laughs)
- NQNabeel Qureshi
You actually can, yeah.
- LRLenny Rachitsky
I did not know that. That's cool.
- NQNabeel Qureshi
Yeah, it's, I think it's called AIP now.
- LRLenny Rachitsky
Hmm.
- NQNabeel Qureshi
Um, so, uh, it's not actually that mystical that there is a product, and if you look at the margins, they show that, right? So they have, like, 80% plus margins, which is not really what you would get if you were actually a consulting company, it would be closer to 20 or 30%. So then your question was, "Well, how did they actually achieve this?" I think there was just incredible talent in the product development organization, um, like, really top-tier, incredible talent. And it, it took somebody, it took some really, really smart people to take the set of internal tools that we were using at the time to create value for customers and then go, "What is a unified version of this? What is the thing that... L- what would this look like if this were a product?" And out of that process, that I saw, came Foundry. I assume there was a similar process with Gotham a while back. But basically it's, like, the motion was that you would go in and... You know, early on you were basically armed with Jupyter Notebooks and some, some kind of data integration stuff, but it was very, it was very primitive and y- you had to create value that way. But, you know, we, we kept building tooling that was useful for forward-deployed engineers, so we were our own first customers. And at some point there was this concept of, "Wait, what if we take our internal tools and we let our customers use them?" And I remember at the time this is a really radical idea, and then, um, uh, Sham Sankaragam is one of these, uh... I think he's the CTO, maybe he's the president now. He just mandated, like, "Okay, every, every customer deployment you have to have a customer using this within, you know, three months or whatever it is." And so at th- it was horrible at the time because these had been built for these, you know, nerdy Silicon Valley engineers, and so they weren't particularly usable, they would crash all the time, you'd have to debug, you know, Spark errors or whatever it was. But b- basically that process brought a lot more rigor to our thinking about the product. And out of that kind of, I would say three or four year process came the Foundry product, and then there was a lot of focus around, you know, things like performance and, um, reliability and so on. That was all really painful. And so, yeah, I think, I think the answer was just talent and then there was this recognition that we do, we do know things that most people do not know about how data works in large organizations. That was the other thing. We discovered a lot of, you know, quote-unquote "secrets" in this process of living with customers for so long. The, the basic one was just data integration is massively painful inside organizations. This is very hard to understand unless you've worked in a large organization, but it's actually impossible to... Even now to get access to a lot of your own internal data that you need to do your job, right? So you'll hear stories of people being like, "I'm trying to calculate our sales this quarter and I had to wait six weeks for some other analytics team to get me this deliverable," right? And so just the, the... Knowing problems like that and being able to focus our product efforts around those problems meant that we were able to build something generalizable there.
- 30:00 – 36:58
Gotham and Foundry
- LRLenny Rachitsky
Okay, there's a lot here. First of all, you talk about Gotham and Foundry. I know that... We'll link to videos of people checking these out, but just what's the simplest way to understand what these two products do?
- NQNabeel Qureshi
Yep, so Gotham is optimized for military and defense use cases, and Intel as well. I would say they both have some things in common, right? So, uh, they both have...I, I would, I would describe this almost as a pyramid, where the bottom layer is data ingestion, the middle layer is data mapping, and then the top layer is anything that's user-facing, so any UI component, right? And then if you think of Foundry for a second, right, there's, there's different tools that allow you to ingest data to it, there's different tools that allow you to easily build data pipelines and clean up data, which everybody has to do, and then there's a bunch of tooling that allows you to build compelling UIs on top, do point-and-click analytics, do, you know, notebook-style workflows, whichever kind of, however technical you are. And so that's what I mean when it's a platform, it's a suite of things that has kind of a common data backing, but contains a bunch of different applications. And so I think that is somewhat true of Gotham as well, but you kind of, when you log in, you see this unified interface, right? Um, so what is the actual difference then? I would say with Gotham, you're looking much more at workflows like that involve maps, for example, right? So when you're doing a military operation, like, a lot of the time you are going to be looking at a map, and you are going to be monitoring, you know, the movement of troops or tanks or whatever it is. Another big difference is the idea of graph-based analysis. So, um, Gotham, one of the kind of early use cases, right, was finding... combing through networks of terrorists and basically finding the bad guys. And so being able to do, um, queries that are sort of graph-based was important, right? So it's like, "Who is everybody that Lenny called in the last week?" Imagine, like, all the nodes kind of fanning out from there, and then it's like, "Okay, well this one looks interesting, let's zoom in on that. What is this person's, you know, location," right? And, and so it's this, like, very graph-based way of thinking. That also applies to things like fraud, and so Gotham has been deployed against fraud, but, um, if you look at Foundry, it doesn't actually emphasize that component so much, because it turns out, you know, let's say you're a B2B SaaS company, you're probably not doing that much graph-based analysis, you're doing things that look a lot more like, uh, classic SQL queries, tables, that kind of stuff. And so Foundry is a lot more kind of traditional in that way.
- LRLenny Rachitsky
That was an amazing explanation. I... For the first time, I, I'm starting to understand (laughs) what these products do. Basically, it just sucks in a bunch of data, cleans it up so you can actually trust it, and then helps you interact with it in various use cases. Maps, graphs, tables.
- NQNabeel Qureshi
Yes.
- LRLenny Rachitsky
Okay, amazing. The example you gave of what you worked on at Airbus, you described it as basically a sauna for making planes. Is that right? (laughs)
- NQNabeel Qureshi
Yes, yes, yes.
- LRLenny Rachitsky
So how much of that does bec- becomes, like, a part of this core product versus stays as one-off thing? Like, is it elements... "Oh, that's a cool innovation, let's put that into Foundry." How does that work?
- NQNabeel Qureshi
This was a really interesting story, actually. Um, the... so the initial problem that we came into with Airbus was that they had a new aircraft called the A350, beautiful aircraft by the way, I forget to... I think if you fly New York to Singapore, it's often an A3- A350, really nice. Um, and so it was a rel- relatively new aircraft at the time, and their mandate to us was, "Okay, we need to ramp up production of this really fast, much faster than we've ever done it before." So it's like, the numbers are very approximate, right? But it's like, "Okay, we're producing four this month, we need to do eight the next month, 16 the month after," and so forth, "and you're gonna help us do it." And so this goes back to what I was saying earlier, is the mandate wasn't like, "Hey, we need to upgrade our data infrastructure, and we thought you guys would be... met, met the list of requirements," it was much more just like, "Please help us accomplish this mission. This is, like, the big thing." And so we went in, scoped out the problem, um, there were a bunch of different things that we could build that helped accelerate this, but one of the basic problems that we figured out was that, um, without going too much into the weeds, the way the factory would work is that there's a bunch of stations, and you can think of the, the plane as literally moving between each station, and then each station would do a certain set of work on it, right? So initially, it's literally like a big fuselage, and the fuselage is sitting there, and then people are doing a bunch of work orders against it, they need parts in order to do that work, and then at some point they say, "Okay, this is ready to move to Station 31," and the plane is physically moved to the next station, and then Station 31 does its next thing. So in order for the next station to do its work properly, they need to know, one, like, what work was done at the previous station and what work is remaining, two is just like, if you think about this problem, like, not all work is gonna get done on time, and so things kind of, um, carry over, right, uh, to the next team, and the next team then has to kind of like... Uh, a- and so when I'm describing this problem to you, you can kind of start to visualize, like, "Okay, maybe I need some sort of Gantt chart for this, and I need the ability to click in and say, 'Okay, what did actually... what did Station 30 do, and what, what work orders remain undone?'" And then it's like, "Okay, for those work orders, what parts do I need, and where in the factory might they be?" And so this was very, very hard to do as is. A lot of it was just relying on people going and having conversations with other people on the factory floor. And, you know, coming from tech, where it's maybe not as complicated as building aircraft, that is a phenomenally complicated process, but it is easy to see, like, okay, you can actually improve this problem with software, right? They also, um... all, all their data was stored in SAP, and, you know, SAP is, like, established software, it's good at what it does, but it's not the most user-friendly necessarily, especially if you're not an expert in how it stores data. The table names are very hard to understand and read. And so one of the things we figured out was just, if you can pull in these tables that may as well be written in completely alien language, like, the, the table name would just be like S3F1_Z or something like that, right? And you'd have to know, like, "Okay, this is the table where the part ID is stored," or something. Um, if you could pull in those tables and join them in the right ways and then just map them to human concepts that humans can understand, so things like a part, a work order, an aircraft, et cetera, and basically build a kind of hierarchy or mapping between them, then what you can do is for a user, a user can just log in and say, "Okay, aircraft 79, where is that? Okay, it's at Station 31. All right, these are the work orders," et cetera, right? And so you've translated it into a more human, legible thing. And so the thing we built, uh, I mean, I kind of slightly flippantly described it as a sauna. It's a little different, but basically that's what it did, was it gave you a unified view of, okay, this is what's going on inside the factory, this is the work that needs to be done on this particular plane, and then me today going to my job at Station 31, what work orders do I need to fulfill and where are the parts that I need to do that?And so did this directly become a part of Foundry? Not exactly, because, you know, the way that other companies work is not gonna be using this same set of concepts. But the overall idea of taking a bunch of tables and then mapping them to human understandable concepts was a very powerful
- 36:58 – 38:02
The ontology concept
- NQNabeel Qureshi
one. And so this actually resulted in a big piece of Foundry now which they call Ontology. You probably heard this, you know, term as you've seen... If you see presentations, they always talk about Ontology. This is what they actually mean by that, is it is a set of concepts that is understandable to you as a human and you're not having to go and dig around and do SQL queries. You're just able to say, like, "Where is the aircraft now and where is it going next?" Right? And so the Ontology became a huge part of Foundry. It was directly informed by the learnings that we had from building that application inside that factory. And I would say it's still a very big differentiator today. Like, I don't think too many other companies ship this kind of stuff yet.
- LRLenny Rachitsky
Wow. I love how excited you still are about this 'cause I can see it being-
- NQNabeel Qureshi
(laughs)
- LRLenny Rachitsky
... so fulfilling to solve this big problem. I th- I saw a stat that I think you 4X'd their productivity. What was, what was the number there?
- NQNabeel Qureshi
It was, yeah, I, I don't recall the exact stat but we did, um, ramp up production, I think, at least 4X that one unit, which-
- LRLenny Rachitsky
Wow.
- NQNabeel Qureshi
... I mean, obviously they did this-
- LRLenny Rachitsky
That's a lot.
- NQNabeel Qureshi
... and we just helped with it. But, you
- 38:02 – 41:36
Life as a forward-deployed engineer
- NQNabeel Qureshi
know, their CEO said that we played a, a critical part, so...
- LRLenny Rachitsky
Also, you moved to France, I think, for this? That was like how forward deployed you were. (laughs) You lived in France for how long?
- NQNabeel Qureshi
Yeah. I lived in France for about a year and a half. Um, the way they build their planes is they manufacture different components around Europe. So they build, you know, the tail in Spain and the fuselage in part of the UK and, and Germany, and so forth, right? And so they basically ship everything to France to be assembled at the end. Which you can imagine this is a very messy process. And so I was mostly in France, but there would be weeks where I'd have to kind of fly between all these countries just to kind of figure out where things were.
- LRLenny Rachitsky
In your post, you wrote about how just the life of a forward deployed engineer is pretty crazy. You just get a call sometimes, like, "Hey, you're flying to this random country tomorrow. Get, get ready." Uh, is that just life as a forward deployed engineer?
- NQNabeel Qureshi
It is, yeah. The, the company had a very, um, I would say aggressive attitude towards travel in the sense of when you join, you were basically told, "Look, you have to be okay with travel. Are you okay with that?" Right? And the attitude, which again I think is a very founder friendly one, is you need to be willing to just jump on a plane that night if that's the best thing to do for this customer and if it's gonna get us to where it needs to be to when. And so there were many times when it would be like, oh, I need to take this cross continental flight tomorrow for this particular thing because it will be, it will be useful, right? And so I think that's one of the kind of takeaways for me, was just like being in person is so, so, so valuable when you are working with some external party. Just going there for, for a few days and spending time with them, maybe going out for dinner. You build so much more trust than if you're trying to close a customer over Zoom or doing engagement over Zoom. It's just the vibe is completely different. And so yeah, getting on a plane was a really cool part of our job for a very long time. This obviously changed around 2020 because COVID happened, the company IPO'd, and so there needed to be a bit more internal controls around this. But I would say pre-2020, this was like a very big part of the culture.
- LRLenny Rachitsky
I'm excited to have Andrew Luo joining us today. Andrew is CEO of OneSchema, one of our long-time podcast sponsors. Welcome, Andrew.
- NANarrator
Thanks for having me, Lenny. Great to be here.
- LRLenny Rachitsky
So what is new with OneSchema? I know that you work with some of my favorite companies like Ramp and Vanta and Watershed. I heard you guys launched a new data intake product that automates the hours of manual work that teams spend importing and mapping and integrating CSV and Excel files.
- NANarrator
Yes. So we just launched the 2.0 of OneSchema FileFeeds. We have rebuilt it from the ground up with AI. We saw so many customers coming to us with teams of data engineers that struggled with the manual work required to clean messy spreadsheets. FileFeeds 2.0 allows non-technical teams to automate the process of transforming CSV and Excel files with just a simple prompt. We support all of the trickiest file integrations, SFTP, S3, and even email.
- LRLenny Rachitsky
I can tell you that if my team had to build integrations like this, how nice would it be to take this off our roadmap and instead use something like OneSchema?
- NANarrator
Absolutely, Lenny. We've heard so many horror stories of outages from even just a single bad record in transactions, employee files, purchase orders, you name it. Debugging these issues is often like finding a needle in a haystack. OneSchema stops any bad data from entering your system and automatically validates your files, generating error reports with the exact issues in all bad files.
- LRLenny Rachitsky
I know that importing incorrect data can cause all kinds of pain for your customers and quickly lose their trust. Andrew, thank you so much for joining me. If you want to learn more, head on over to OneSchema.co. That's OneSchema.C-O.
- 41:36 – 46:36
Balancing custom solutions and product vision
- LRLenny Rachitsky
There's a lot of founders listening to this and a question that I'm thinking and they're probably thinking, and there's kinda two questions here. One is just when to go, like how hardcore to go potentially with their own forward deployed sort of operation. And then two is just how, and a company I know is actually doing this, how far to go with one company's problem and invest in just like, "We're gonna nail solving this one customer's problem with the hope that this is something we can abstract and sell as a big platform." So let me act- let me start there. In your, you know, you're building a company. Any just, I guess, insights or advice on just how far to go down this road of, "We'll solve customer one's problem and we bet that this is gonna be a big opportunity for a lot of other companies"?
- NQNabeel Qureshi
So I would say on the, on the forward deployed piece, um, my friend Barry McArdle, who's the CEO of Hex, uh, the analytics company, he wrote a really good post about this actually. And his take was just like you probably don't need forward deployed engineers, it's very specific. But I, I think basically the, the thing there is you have to be willing to be quite almost wasteful. (laughs) Like, you have to be willing to invest a lot in, uh...... finding the thing. And for that you just need a certain ticket size, right? So you need each customer's revenue to be probably in the billions of dollars. If it's below that, you're probably not looking at a traditional forward-deployed engineer motion, it's something a little bit different. And so, you know, I think one thesis that a lot of people left Palantir with and started companies around was there's a lot of, a lot of customers that Palantir won't serve because, you know, maybe they're too small a ticket size. And so actually, you could go and do something like Palantir for those, uh, companies, um, but instead of charging them $5 million, you're charging them 250K. Uh, and so in a scenario like that, you might still have forward-deployed engineers, but they're not really, they're not going to France and spending five days a week in a factory. It's more like you'll have one person and they're looking after, you know, five different customer accounts. It's more of that ratio in order to make the numbers work. And so, I think a lot of the principles can be, um, can be abstracted from that experience, but it is a really specific sales motion that depends on the specific way of doing business. Um, I think to your other question, yeah, I think there's, it's, it's obviously one, something that is very hard to give a general answer to. My main thing here is just that you can definitely tell when you are just doing consulting and when you are closer to building a product. And I think the error that people make more often than not is they are actually too stuck on their own product vision. That's the mistake I've seen a little bit more actually than the other way around, right? So if you, if you go to, um, I'm trying to give an example. If you go to an enterprise customer and, let's say, you th- you think you're doing analytics software and it turns out they don't actually care about internal analytics this much, they actually have this other massive burning problem and they don't have a good solution to it yet, I think a lot of people are unwilling to go and pivot to the big problem because they're like, "Well, we're analytics software and so maybe this customer isn't a fit for our thing." And maybe that's the right call. In some scenarios, that is the right call and you should go find a different customer where your thing resonates more. In other scenarios, it's actually the right call to pivot and go and just put everything on that big problem instead and then go and find other customers for that thing. There's no hard and fast rule. I remember reading a really interesting post by, I think it was David Su from Retool, who had this exact thing, and I think he worked at Palantir for a while too. And, and he said that they had the Retool product and it wasn't getting any traction at all. And then he tried an outbound email campaign where he literally just changed the subject line to, "Build internal tools easily." And then suddenly, they started getting all these replies from CTOs who were just like, "Oh, yeah, this is actually a huge pain point for me." But the exact same solution, they were previously kind of framing it as, uh, I think it was like supercharged Excel or something like that, and nobody was biting. Um, and so they just changed the way they framed it, found a different set of buyers, and succeeded that way. So yeah, no, no hard and fast rule, but I think it's always, you need to kind of have this matrix of options in your mind and be very deliberate about which one you are going with and why.
- LRLenny Rachitsky
I think your piece of advice is really important there of, uh, usually in your experience you're saying people index too far too. And they're like, "No, what they're asking you to do is not kind of what I think they need or what customers will need." You're saying it's actually more likely they're right, and that's maybe where you should be focusing more versus this kind of abstract vision and original idea you had.
- NQNabeel Qureshi
I think so, yeah. I think it's very hard to not be anchored to your own experience and your conceptions as a problem. And one thing I've seen in really strong founders is they're able to sort of drop a bunch of those assumptions and almost treat something, a new opportunity as a completely blank slate and then just figure out how to reshape things so that you're taking advantage of that. And that's how you don't
- 46:36 – 50:41
Advice on how to implement forward-deployed engineers
- NQNabeel Qureshi
get stuck in a local maximum.
- LRLenny Rachitsky
Your other piece of advice is also really great. So people hear this and they're like, "We don't, we can't afford an engineer to sit at our one customer prospect's office and build stuff for them." But your point is you can have one for five different customers, they're not there full time, they kind of bounce around, but they're kind of, it's almost like sales engineering, just like, uh, what do you call it? Sparkling sales where they help make it successful. I know Looker is a famous example. They, I think they called them forward-deployed engineers. Do you know of any other companies, by the way, that did some version of forward-deployed engineers?
- NQNabeel Qureshi
There's a lot. I mean, I know that the AI labs are hiring forward-deployed engineers now and they're building, um, forward-deployed engineering teams. And, and, you know, they could, they could make it work, right? But I think there's gonna be key differences, right? Like I, I don't see Anthropic going into an enterprise customer and building some entirely from scratch solution for them. It's going to be something that leverages the Anthropic set of products. So there's a lot of companies that have this label now, but I think what's really confusing about it is just that it means a few different things. There's another post by Ted Mabry who's I think the head of commercial at Palantir, and that's a very good one to, to point, point listeners to.
- LRLenny Rachitsky
So say someone was, uh, "I wanna try this sort of thing in my company." And what would be like a few bullet points of things they should get right? You're describing kind of the spectrum of pe- what people describe as forward-deployed engineers. If they were to try to do this, what do you think they need to most do correctly for it to be successful?
- NQNabeel Qureshi
The key things that made our model work were, one, um, they were actually real engineers who could build product themselves. That's a very big difference, right? I think a lot of the time companies will say this person's a forward-deployed engineer, but actually they're mostly there to be more of a solutions architect or they're not necessarily building anything de novo. They're just listening and trying to find a way of deploying the existing product. They're not empowered to do new products. And so the really radical thing Palantir said was, "No, like, go in, and if you need a completely new product to do this, you can go ahead and build it." (laughs) And, and I think that's really the key difference. The other stuff, you know, I've, I've already mentioned the value of being in person and I think building close...... personal bonds with your customers. I do think the better founders do this anyway, right? Like they're on texting terms with their buyers, they become friends with them outside of work, and they see them as humans who they're trying to help. I think that's very motivating. Gaining a really deep understanding of the business that your, uh, your customers are in and knowing how those dynamics work. So, you know, a simple example might be, uh, you know, like, say, hospitals in America, right? Like, I think if you, if you go into it, um, it's very counterintuitive to think of a hospital as a business. People think of it as, you know, it's, it's a place where you get healthcare, right? But actually, like, if you kind of view it the way a CEO or a CMO views it, it's going to look very, very different to you. As a very simple example, uh... Sorry, this is a little bit dark, but you know how kind of restaurants want to turn over tables as fast as possible in order to kind of maximize their revenue for the day? Hospitals actually kind of want to do the same with patients, right? They would like to treat you and then get you out of a bed so they can free up the bed to get a new person in there. And so that's not super intuitive unless you kind of think hard about how the revenue for that hospital works. But then once you think about it, you're like, "Oh, this has a bunch of problems associated with it," right? And you start to go in really interesting directions, so...
- LRLenny Rachitsky
There's just, like, the words and memes, uh, take you a long way working this-
- NQNabeel Qureshi
Yes.
- LRLenny Rachitsky
... and understanding it. Okay, so essentially, things you want to get right. Make sure it's in person, make sure the person is technical, make sure they have a deep understanding of the business and the problems they're having. The technical piece is interesting with AI tools these days making everyone technical in some sense. Uh, you could argue this is gonna become more common. People can just, you know, open up Cursor, Wind Surf, and just start adding features. (laughs)
- NQNabeel Qureshi
I think this is a really interesting thesis you've just hit on, and I expect to see a lot more startups that take advantage of that insight.
- LRLenny Rachitsky
Mm-hmm. Basically, it makes forward deploying engineers cheaper.
- NQNabeel Qureshi
Exactly.
- 50:41 – 53:15
The current state of forward-deployed engineers at Palantir
- NQNabeel Qureshi
- LRLenny Rachitsky
What is the current state of forward deploy engineers at Palantir? Like, how much has it changed over the past few years? Like, if you join now, r- is this still something you can do?
- NQNabeel Qureshi
Yeah, of course. I mean, I should, I should obviously emphasize that, one, I left the company in 2023, and so this is just my personal view. I don't speak for them. Um, I think that... You know, if you think about it, right, uh, the, the thing that... One of the kind of metrics that the company had to measure its own success was essentially revenue per engineer, right? And so the more kind of, quote-unquote, product leverage you had, the higher that number was. So if you had to throw a lot of people at every marginal problem, then you weren't doing so well at that because you're basically building a new thing every single time, and you are, in effect, a consulting business. If, on the other hand, every time you encounter a new customer, the product turns out to be kind of relevant to them, then, then great. And so this product leverage metric was actually a very unique thing and kind of a north star for the company for the whole time I was there. If you reason that out, what that means is that in the early stage of the company, you will have a customer, and then you might have five to 10 engineers working at that customer, right? And so over time, you want that ratio to change. So you want it to be, you know, each customer, because the product is so powerful, maybe AI coding's gotten a lot better, each customer, you only need two people. And then maybe you actually get to a point where you can have one person looking after multiple customers, and I, I think that's how the job has changed, is now it's a little bit more about you have multiple customers, maybe you're spending less, like, deep time with each individual one of them, but it's a lot clearer what problem you're solving across multiple customers, and you have more of a kind of defined offering. Um, and so I do think that has been a bit of a change, but, um, the company remains a very interesting and dynamic place to be. Like, in some sense, this story is only starting, right? Because one, one lens through which you can view this company is they spent 20 years basically building the mother of all data foundations for every important institution in the world. And guess what's very valuable now that AI models are out is proprietary data that isn't public. Suddenly, you have access to that, and you are in a very privileged position to help your customers deploy AI in a way that makes them successful and that solves real business problems. That is essentially the bull thesis for this company and why it's probably gonna, you know, 100X again, right? Um, and so it's still a really interesting time to join, but I do think the, the kind of nature of the ratio of people to a customer, for example, is one big
- 53:15 – 59:25
The power of ingesting, cleaning and analyzing data
- NQNabeel Qureshi
difference now.
- LRLenny Rachitsky
Not investment advice, but it might 100X. Uh, that's, uh... I totally understand why that might happen. So let's talk about the data piece. You said that this might... This was one of the secrets of Palantir's success. There's early insight into the, the power of ingesting data, cleaning data, being able to analyze and work with it. What, what more can you share there, just, like, what they figured out about why this is so valuable, why it's so hard, and how they achieved it?
- NQNabeel Qureshi
I think it's just very obvious as soon as you step into a corporation and spend a couple of days there, right? is you're like, all right. Like, let's suppose your job is to increase sales, okay? So the first thing you want to do is get a clear picture of what's going on. All right. So, like, let me go and query the sales database. Oh, wait, where is the sales database? I can't get access to this. Uh, okay. I need to file an access ticket. All right. Now, I have to wait one week, right? And so every, everywhere we went, this was the big pain point, was we have to wait six to eight weeks just to get data access, and then when you do get data access, it's not like the data is in an easily queryable format. You actually really have to know what you're doing in order to get the right metrics out, and so on and so forth. And so it turned out, like, okay, it's, it's this iceberg analogy where the actual analysis is actually just the tip of the iceberg. It's kind of the last 5 or 10%, and the 95% before that is, "I'm gaining access to the data. I am cleaning the data, I'm joining the data, I'm normalizing it, putting it all in the same format." And so once, once we spotted that, then it's like, okay, there's actually a lot of product to be built there just to make that process easier. This is one way I think Palantir does... People don't think of Palantir as this-... place where innovative new product and UX ideas come out, but I actually think it's been one of the most generative companies for that specifically in the last 20 years. It's just that most of that didn't see the light of day and so people don't know, but if you look at the, the product primitives that they developed in order to make the things I just mentioned a lot easier, they're actually really valuable and interesting and could probably form the basis of, of, of independent companies themselves. And so, yeah, like, it, it, it just took like... Every single step of that process became much, much easier once there was a software solution around it, right? So if you talk about data ingestion, there's essentially a kind of universal data adapter that's part of Foundry. It can read anything, so JDBC, S3 buckets, whatever you want, and it can pull that. It can... it, it allows you to kind of look into the data, maybe preview the first 20 rows, and then it allows you, when you're ready, to set up a schedule and just pull it in on some cadence. That process alone, for an engineer, it take- used to take a long time, especially pre-bipe coding. And, and managing all those cron jobs and doing this on a Linux VM somewhere inside the customer's tenant was a huge pain, right? And so you productize that piece, then it's like, okay, once you have the data, it's like how do you actually join it? What if you're non-technical? Is there like a... Is there a way for a non-technical user to be able to join tables and see what the result is? And so there's all these, like, very fascinating business problems that, because I think the access was very difficult to gain, people hadn't really solved before, and so there was a lot of white space to do some product innovation. So now I would say Foundry's definitely the best data platform in the world just because it has all these different applications within it that solve these discrete parts, and it's just... It came out of this years of painful experience watching people have to clean data and join it and figure out what this table name meant and so on and so forth.
- LRLenny Rachitsky
You shared in your post this kind of evocative story of some people's jobs is just to kind of gatekeep the data. Like, they're the... they're there to help you, to give you access to this very valuable data within the organization, and how hard it is to get. Like, that was a lot of this work, is just breaking through those political battles of like, okay, we need this data for the good of the company, and took a lot of work. I guess, anything there you want to add?
- NQNabeel Qureshi
It is, yeah. I mean, it's, it's a... it's a huge pain, and there are good reasons for it, right? Like, it's not like folks are malicious here. It's, it's if you're IT or if you're a in- info sec type of person, then your goal is to prevent data breaches and to make sure that sensitive information doesn't spread too wide. And so what's the easiest way to do that is to lock the data down and, you know, be- basically be a gatekeeper for access, right? I think where it got a little bit more interesting was, um, where your skills are valuable and depend on you being the gatekeeper. So what I mean by that is like, let's say I'm the guy who... I'm the only guy who understands the, the way the sales calculation pipeline works, right? And I write the SQL for it. All the requests from business SMEs come to me. I have a big queue of them. It takes me weeks to get through this queue. I have a great job. I have great job security. Um, and people depend on me, right? And so now along comes this company, and they're like, "Hey, actually, we want to make sales data available to everyone, and we want to make it point and click." Suddenly you're like, "Hey," like, "hang on. Uh, what am I gonna do?" Right? And so that's where I think there was a lot of difficulty, and, and, and I always say, like, you know, people are like, "What are Palantir's competitors?" I don't think it's the ones you would think of necessarily. Palantir's biggest competitor is a company rolling its own solution, right? And so the biggest difference would just be a C- a C- a CIO saying, "I'm gonna build my own data infrastructure. I'm gonna own it. It's gonna be on top of one of the hyperscalers, and we're all just gonna do our own analytics ourselves." And what we came along was, which was quite disruptive to this model, was saying, "No, actually, all your data is gonna get ingested into this one platform, and everybody in your company is going to use it. The trade-off is it's going to be really, really easy for everyone to do things." But as you can imagine, some people weren't a huge fan of that model, so...
- LRLenny Rachitsky
Feels like Glean is the biggest competitor to Palantir after I hear this. Do you know about that company?
- NQNabeel Qureshi
I do, yeah. Glean is... Glean looks amazing from the outside. I mean, you know, so many, so many differences there, right? I can totally see why you would say this, um, but-
- LRLenny Rachitsky
Clearly a different use case, but, uh-
- NQNabeel Qureshi
(laughs)
- LRLenny Rachitsky
... but it feels like the reason they've been successful is they figured out a lot of this data ingestion, permissions, search stuff-
- NQNabeel Qureshi
Totally.
- LRLenny Rachitsky
... and rolled out of it that way.
- NQNabeel Qureshi
Yeah.
- LRLenny Rachitsky
Interesting.
- 59:25 – 1:05:30
Hiring for mission-driven startups
- LRLenny Rachitsky
Okay. I want to talk about hiring. You talked a bit about this. You're starting a company again. What are some of the, kind of the key lessons you've learned from your time at Palantir when you are hiring people for your company? I don't know if you're actually hiring people yet. Maybe when you may start hiring.
- NQNabeel Qureshi
Yeah. We, we have, um... We have six people at the moment, so really reasonably small team. Um, you know, I think... (laughs) With hiring, it's funny, man. Like, there's so much hiring advice online, and you read it and you're like, "Yeah, this is super obvious." And then when you live it, you're suddenly like, "Ahh, this is why people say this," right? So a few simple examples are, I think the thing that is really hard to find is somebody who really, really cares a lot about (laughs) doing the thing and will go that kind of extra 20%. Like, I think, I think when you hire out of... Especially, not to pick on them, but I th- I think if you hire out a FANG, right, it's like people, people want, like, a 400K a year job. They would like to work a certain number of hours. They would like to ship some code and then go home. Like, that's basically the model that you get accustomed to, even if you don't intend to when you work at a big company, and so if you hire out of that for a really small startup, it can be really challenging because a lot of your success as a startup depends on each individual person being like, "No, I'm really gonna... I'm gonna work this evening if that's what it takes to get this thing working, and I'm not just gonna check my boxes. I'm actually gonna look towards what is the real outcome that this business is trying to achieve." And...Everything I'm saying is, feels kind of obvious, but when you actually feel that difference between somebody who's just checking the boxes and somebody who's kind of an animal in this way, like they'll actually go and pursue and accomplish the end outcome, that- that difference is very, very big and it matters so much for your first 20 people, right? And there's no science to finding these people. It's not like you can just put, like, "Somebody who cares about outcomes" in your JD and then suddenly you'll get all these people applying. Uh, and so then it's like, okay, well how do you screen for that and how do you find those types of people? And so, that- that's where it gets really interesting. I think that's where the mission alignment comes in. And so you, you do have to find people who, for what you're doing, have this extra, maybe private reason to care about it a little bit more than the average person, right? So I think for Palantir, they did hire a lot of vets, for example, or maybe people who were a little bit more patriotic or pro-America than the average tech employee. And that, those people had an extra reason to join Palantir and an extra reason to try that little bit harder. And so, you know, what I'm doing is a little bit more in the kind of medical and health space, and so I think people who have themselves had experiences with this system, have maybe had relatives, you know, go through difficult experiences with things like cancer or whatever it is, they're just that extra bit motivated to really care about the thing you're trying to do and then work that little bit harder. And so I think aggressively filtering early on for things like mission fit, how much have you cared about stuff in the past and what's an example? You know, you ask questions like, "What's the hardest you've ever worked to get something done and why," right? And that, like, does differentiate a lot of people. A lot of people don't actually have a great answer to that. So I would say that's been a really big learning, is it's less about testing for the right skills. Yes, that's important too. It's much more about just, like, who has that extra 20%?
- LRLenny Rachitsky
That is really interesting. As you just said, it's, what all, everything you've shared is essentially around motivation and drive and passion and kind of just, like, commitment to working on this, uh, intently. And, uh, it almost, like, it's almost like a second thought of just, like, oh, so they're, like, really smart and skilled at stuff. Like, it feels like that's just table stakes, and this is actually what makes the difference in your experience.
- NQNabeel Qureshi
Yeah, I totally agree, and I think it's, it's different for every business, right? So I think if you're in a space like B2B SaaS where maybe it's a little harder to tell the story of like, oh, this is so mission critical, like whatever. There are other ways of getting at this thing, right? So for example, I know, I know a lot of people, again, it's a little played out now, but, um, I know a lot of people who for sales teams, they will explicitly go for people who are professional athletes or played sports in college, right? And it's like, okay, what does that test for? It's like, you are very, very disciplined, you're very, very goals and numbers oriented, and you're willing to just work really, really hard. And so there's all these kind of lateral ways of getting at these qualities that I think you just have to be kind of intentional about as a, as a founder. Like, as a personal example, I'm a runner, and so I actually love meeting fellow runners and I always like to... I kind of joke like, "Oh, maybe I'll go hire from, like, run clubs or something like that." But it's just, like, same with, you know, I play a lot of chess. Like, I love, I love meeting chess players. I'm not necessarily saying that's the right kind of hire for me, but I think having this- this thing of here are some traits that seem uncorrelated but which actually give you good signal to this person's personality, those are actually really important. The last thing I'll say, just as a funny illustration of that concept is, uh, I think Max Levchin tells this story of somebody interviewing at PayPal early on, and he passed all the skill interviews and then it just got to the final round, and he said something about liking to shoot hoops, like he liked to play basketball, and they were like, "Instant reject." (laughs) And it was just like, (laughs) the- the- the vibe here was just like if you're not like a mega, you know, Linux nerd, hardcore computer person, then we don't want you here even if you actually passed all the tests just 'cause you like to shoot hoops. Now, whether that was the right call or the wrong call, I don't know, but um, that's an example of what I'm talking about.
- LRLenny Rachitsky
I think that's, like, a great echo back. Like, people hearing this may be like, "What the hell? How..." That's like, how, like, how dare they do that? But this is exactly what you said at the beginning of our conversation, that if you're try- like, an approach to building a generational business is to be very clear about who this is not for, and that's okay. It's your company. Not everyone needs to work there. And it's almost saving them time because they may, they, they might realize, "This isn't for me. This isn't the people I want to be around necessarily." So I think it's important to see that side of it is, like, you're, it's your business. It's important to be clear about who is a good fit for the company and who's not.
- 1:05:30 – 1:10:00
What makes Palantir PMs different
- LRLenny Rachitsky
Speaking of that, let's talk about product management for a bit. I know Palantir PMs are, like, not very, not traditional product managers. Uh, what- what is like... do the... I- I imagine people have the title product manager at Palantir. Okay, so if so, what, as far as you understand, how, what's the difference between, say, a PM at Palantir versus a traditional PM, say, at a FAANG company?
- NQNabeel Qureshi
Palantir was, as far as I remember, quite anti-PM for a while, and eventually we did need them because we just got more serious about ............................
- LRLenny Rachitsky
Classic story. Classic story.
- NQNabeel Qureshi
A classic story. (laughs)
- LRLenny Rachitsky
Many companies.
- NQNabeel Qureshi
The- the big difference, or one big difference I noticed was that they were extremely careful about only making people PMs who had first proven themselves out as fully deployed engineers. You basically could not become a PM any other way. So, um, as an example, the, uh, when I mentioned earlier the, the thing that we built for the plane factory, the person who was managing that deployment, she later became the PM for Ontology. And it was just because she'd kind of proven her mettle in the field. And, you know, the reason for that's pretty simple, right? It's gonna be someone who understand who, how customers work and has that customer empathy, and it's gonna be someone who has this drive to get things done, because that's what we selected for. I think the failure mode that they were very, very averse to in, in traditional PMs was this kind of Google Docs syndrome of like, okay, I'm gonna write my...... product requirement documents and I'm gonna kind of manage it in this, like, very s- sort of sane, rational way, I think. The... So, the company was really rigorous about that. And so basically, PMs were almost always internal promotions and they always came from, um, from BD. It was not... Like, I, I'm not aware of a single case where we took somebody who was a PM at a place like Google, which produces many excellent PMs, and hired them successfully into Palantir. Just a very different vibe. Um, so I think that was one thing. Uh, you know, this is, this is maybe more of a classic PM trait, right? But you just had to be either an engineer yourself or extremely good at working with engineers. And the ones I saw who succeeded the most were just best friends with their engineering team, right? And, uh, the team would always just be, like, one, you know, it was called a group PM, and then it would be a lot of very, very good engineers. And basically, their success or failure mode was just, like, do the engineers like and trust you? And, uh, I mentioned before, like, Palantir has very kind of almost disagreeable personalities. And so, uh, if you didn't gain the trust of your engineering team pretty fast, you didn't last very long.
- LRLenny Rachitsky
I think we've cracked the problem, the, the question of why are Palantir PMs so successful. First of all, the hiring bar is just, like, basically hiring for leaders in a lot of different ways to this, like, I don't know, forge for founders where they're working with a company solving a real problem, building a real product that makes money. And then those are the people that become the PMs at Palantir, and that... Then they go on to leave, and that's why 30% of them end up starting companies. I'm surprised it's not higher. (laughs) Uh, or become first PMs at other companies or heads of product.
- NQNabeel Qureshi
Yeah, absolutely. I mean, it's, it's crazy. I was part of a pretty small team within Palantir. I think it was 20 to 25 people when I joined. And I think at least six of them now are either unicorn or just pre-unicorn founders, um, from, from that, like, group of 25 people, which is actually a crazy ratio, and then a bunch more have become founders recently at an earlier stage. So yeah, there's all these little pockets of excellence, and, um, it's been really interesting to see. I think the other thing that's driving that a little bit is, you know, when you leave, it's just such an interesting company to work at that, um... You know, I think the retention numbers were actually very high for that company. Like, people would often stay a lot longer than maybe the average, average Falley tenure. And, um, so when you left, it was really this decision of just, like, something very specific is pulling you and you want to kind of play the next level of the game. And so, it was very unusual for someone to leave and then join maybe a more traditional tech company. It's sort of like you're either going to go become a founder or why would you leave when there's so many interesting different things to work on here?
- LRLenny Rachitsky
Mm-hmm.
- NQNabeel Qureshi
And I know that sounds a little culty, but that's just, that's what everyone thinks.
- LRLenny Rachitsky
I could totally see that. A lot of people that left Airbnb have never found something more meaningful.
- NQNabeel Qureshi
Yeah. Right.
- LRLenny Rachitsky
It's just hard, especially if you're early. There's a stat that I didn't share that I think is really interesting, uh, uh, when you look at YC founders and their... where they've come from. I think you maybe shared in this in your post, that there's more YCX Palantir founders than there are X Google founders, in spite of Google being something like 50 times bigger sample size.
- 1:10:00 – 1:16:03
The moral question of Palantir
- LRLenny Rachitsky
- NQNabeel Qureshi
Yeah, yeah.
- LRLenny Rachitsky
Let's talk about the, the moral question of Palantir. A lot of people probably seeing the title of this episode, hearing this, are... will not be excited about Palantir being highlighted and promoted, and a lot of people kind of disagree with what Palantir is doing. You know, it builds products that kill people in some ways, they work with governments they don't agree with. I know you wrote a really insightful, uh, way of, of how you approached this question when you decided to work at Palantir, and how you see people tackle with this. Could you just talk about the kind of the framework that you landed on and how you thought about this yourself?
- NQNabeel Qureshi
Yeah, it's a really interesting topic. It's definitely very nuanced. I think what I was trying to say in that post was a couple of things. One was that there was a lot of upside there, right? So, you know, I worked on the US COVID response. I have friends who, you know, worked on Operation Warp Speed and, and, you know, th- these are all things that I think saved a lot of lives, and I was pretty focused while I was working at NIH on cancer research. And so, to me, these were just obviously good things and you couldn't do them anywhere else. And so that was alone a reason to stay. Um, the, the question I had in that post was, well, okay, there are definitely going to be other pieces of this that people object to, right? So during the kind of 2016 to 2020 era, it became a pretty common thing to go into work in New York and you'd have people protesting outside your office or, you know, doing all kinds of things. And so, there was this question of, well, is this okay? And I think the point I was trying to make was I don't think that... It's rare that disengagement is the correct answer, and I think it's more recognized now, but especially then, it went a bit too far, right? So, the famous example here is Google kind of disengaging with a Pentagon, uh, AI project just because some people felt that working with the Pentagon was itself morally bad. I think that's way too sort of the left of what the median American would say. I think the median American would say it's fine to work on defense stuff, you know, within, within reason, and assuming you're doing largely good things. Uh, and so, there was just this kind of almost arbitrage there at some point of just like, hang on, like, it's not like working on defense is inherently evil. It's actually a pretty interesting thing. And then there's this question of, well, would you rather be in the room and making this better or not, right? And so, I'm struggling with how much I can share here. But, like, as a simple example, if you're doing a... even a workflow, which I think many people would not be super comfortable with, like, let's say you're targeting somebody for some kind of strike. If you compare what... the way it's done now to maybe the way it was done in 2010, it's going to be a lot more targeted, it's going to be a lot more accurate. And so, you've actually improved that process and reduced the chance of error. Maybe you should feel good about that, right? Now, that is a bullet many people are not willing to bite. Um, I, I didn't work on the defense side of the company myself, but I think, I think you have to be okay with these kinds of gray zones and, and actually actively thinking about what you are doing. And, um-That doesn't mean that it's always the right thing to do to work at a defense company, right? Maybe we go into a very dark future and we start being the bad guys in some ways, and then it's probably not a great idea to work at a defense company, right? Um, so it's a, it's a shifting landscape, but I think... I, I kind of felt pretty strongly that a lot of people in tech just didn't want to think about this at all, right? So like, you have engineers now who are working on optimizing short form videos for higher engagement, and you sort of want to say to them like, "Hey, are you thinking about what this is doing to the brains of young children?" Or, "Have you seen, you know, an 11-year-old kind of scrolling something for five hours, and do you think this is a good thing?" And I think people don't want to think about this stuff too much. I'm not saying I know the answer, but there was almost this refusal to look at what tech was doing from a political lens for a very long time. It was just like, "Hey, let us play with our toys. Let us sit in Menlo Park and like, don't bother us, and we're just gonna build cool stuff and launch it." And 2025, we're in a very, very different state of the world, right? You know, tech is involved in politics now, and politics basically came to tech, right? There's this famous image of Mark Zuckerberg sitting in Congress, and he kind of looks very pale and he's like, "Why have, why have they dragged me in here again?" Right? But I think, I think tech went through this journey of, "Oh, we're suddenly becoming important now. Oh, we're really, really important now. Oh, we better start playing this game of politics." And so I think what I'm saying now is a lot more consensus than it was 10 years ago, but at the time the feeling was just like, "Look, what we are doing is political, so you better engage with that."
Episode duration: 1:37:28
Install uListen for AI-powered chat & search across the full episode — Get Full Transcript
Transcript of episode xQkSenlJvwA
Get more out of YouTube videos.
High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.
Add to Chrome