Skip to content

By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.

Sourcery with Molly O'SheaSourcery with Molly O'Shea

Mercor Raises $750M at $20B Valuation | CEO Brendan Foody

Mercor has raised $750 million in a Series D at a $20 billion valuation, with participation from Nvidia, Benchmark, General Catalyst, Funds managed by affiliates of Apollo, XTX Ventures, Salesforce, and others.

Brendan FoodyguestMolly O'Sheahost
Nov 10, 202654mWatch on YouTube

Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.

Great conversations run long. Their best ideas don't have to.

uListen is free on iPhone, iPad, Android, Chrome, and Claude.

See how

Transcript

  1. 0:00 – 1:00

    Brendan Foody, Co-Founder & CEO Mercor

    1. BF

      Darsh and I have had opportunities where we could walk away with a lot of cash, but that's not what motivates us. Like, we'd rather work 100 hours a week to solve a really important problem in the world. So now, if we're paying out, call it, $5 million a day, two years ago, 24 months ago, we were paying out a million dollars a year.

    2. MO

      Do you have any chips on your shoulder?

    3. BF

      I would say I always have, like, varying chips on my shoulder. We have no interest in being second place in a market. [upbeat music]

    4. MO

      Brendan, welcome to Sourcery.

    5. BF

      Excited to be here. Thanks for having me, Molly.

    6. MO

      I mean, we were just talking about this, but we first went on a walk probably over a year ago.

    7. BF

      Mm-hmm.

    8. MO

      And how much have you grown since?

    9. BF

      We've grow- I, I think this was in September of last year, so we've grown by more than 5X on-

    10. MO

      [laughs]

    11. BF

      ... yeah, on a mid nine-figure base. [laughs]

    12. MO

      That's crazy.

    13. BF

      It's been pretty wild, yeah.

    14. MO

      So how are you gonna become a

  2. 1:00 – 2:22

    Mercor’s Path to a $1T Company

    1. MO

      trillion-dollar company?

    2. BF

      [laughs] Great question. Well, I think it starts with working backwards from how will humans contribute to the economy. 'Cause right now, most work is relatively repetitive, where people will repetitively respond to customer support tickets, or repetitively red line a legal contract, or repetitively edit a, a d- podcast in all the different, uh, formats that they're used to. When, in the future, it's gonna much more look like training an agent one time how to automate these repetitive tasks. And so what we see emerging within enterprises is the shift away from all these repetitive tasks and how work has been done in the past, and moving towards people contributing to the economy through creating evals, updating skills files, training agents how to automate all this repetitive work. And so if we subscribe to the fact that the whole way that, like, humans contribute to the economy is transforming radically, clearly leading that industry, defining that industry, and building all of the technology around how that work happens is... It creates the opportunity to build a legendary category-defining company. Um, a- and that's what we've always been focused on from day one, is just solving this problem of how do humans fit into the economy, as

  3. 2:22 – 4:05

    Mercor’s 3 Products

    1. BF

      that is evolving ever so quickly.

    2. MO

      So let's break that down.

    3. BF

      Mm-hmm.

    4. MO

      Let's break down how Mercor is operationally structured. So I know you wanna talk about reinforcement learning environments a bit-

    5. BF

      Mm-hmm

    6. MO

      ... also known as RL environments. So if you break that down, how the products of Mercor work, how does it all fit in?

    7. BF

      Yeah. So there's broadly three main products that we have to produce a given data type. The first product is what we built initially, our talent platform, where we have over five million people actively looking for work, pay out over $4 million a day. 70% of the people come from referrals, so there's a lot of network effects associated with how we can mobilize software engineers, doctors, lawyers, et cetera, for any specific type of data that we want to create in the economy. From there, we onboard those experts to Studio, our data platform, where they have an AI co-pilot and all of the agentic QC and automated capabilities for how they would create an RL environment, populating all the context that mirrors what they would do in their job, all of the tasks, all the verifiers, et cetera. And then the third platform is our AI project manager, where we basically automate all of the manual work associated with how we would manage all the experts on these projects. So similar to how we would have project managers, uh, setting KPIs for people, uh, saying who's doing a good job, who's doing a bad job, giving them feedback, we now have agents that are autonomously running these projects, hiring people, determining the data quality, and ultimately being accountable to the customer outcomes.

    8. MO

      So you're doing 5 million in payouts

  4. 4:05 – 5:40

    $5M a Day in Expert Payouts on Stripe Connect

    1. MO

      a day?

    2. BF

      Yeah. Uh, now, now well over that, yeah.

    3. MO

      How does that work?

    4. BF

      [laughs] It, uh, uses Stripe Connect as the back end. Uh-

    5. MO

      [laughs] I love how you go right into the infrastructure answer.

    6. BF

      But, but, but the, the, the team is spectacular. I mean, it's been incredible, 'cause one of the things we realized early on is we were working with another, um, uh, player in the space that was having a lot of payout issues very publicly, where we were providing talent to them, and we got flooded with support tickets that, uh, we'd hired over 1,000 people for them, people often in third-world countries, and they were not getting paid and struggling to put food on the table for their families, is literally we were receiving many support tickets about that. And so really, that was one of the large catalysts for we need to have a direct relationship with the labs. We need to be able to be accountable for the experience of the experts on our platform and making sure that they get paid on time, and we need to over-invest in how do we have a world-class payments team that never makes mistakes and always makes sure that people are paid out. And so to date, we've, you know, paid out just about a, a billion dollars, uh, historically, um, which is on a pretty steep ramp. And, uh, we, we haven't had any major issues or, uh, of, of that sort. And so it's been an incredible process of how we scale the payments team. Actually, I've written some blogs about this, um, 'cause there's a lot of interesting technical problems, uh, in there.

    7. MO

      Wow. I mean, for some people

  5. 5:40 – 8:51

    Why Mercor Is Not a Marketplace

    1. MO

      who don't understand the business model, going out to, like, the broader umbrella of Mercor-

    2. BF

      Mm-hmm

    3. MO

      ... you're, you're not focused on GMV. It's not a marketplace. So how does the business model fit?

    4. BF

      Yeah, so I think the largest misconception about the business is that people think about us as a marketplace like Uber, where we would just match, uh, experts with a job and then take a fee on that, when actually the experts are one component. ... of the data sets, the RL environments that we deliver to the labs. And so, uh, an RL environment includes three parts. The first part is all of the apps, which are like clones of Google Workspace and other popular applications that, uh, people would want to, uh, teach agents how to use within the economy. The second is the worlds, which is all the content within those apps. So think the messages, the slides, the docs, the sheets, et cetera. And then the third part is the tasks, which are prompts and rubrics, similar to how a professor would create a rubric to grade an essay, where the model can attempt the problem and then get a grade on how well it did that it's able to learn from. And the barrier to automating the entire economy is, how do we cover the full distribution of all of the RL environments that mirror everything in the distribution of the economy? So cover all of the different apps people use, all of the different worlds, and all of the different tasks. And so ultimately, these, like, RL environments is the end data that we deliver to our customers, and the experts that work to populate the worlds and the tasks are one ingredient, one moat, that has been a foundation for how we do that effectively and scalably.

    5. MO

      Obviously, a lot of this is predicated on models, but how has the, kind of, the advancement of agents coming into the entire AI system changed and maybe increased what you're doing?

    6. BF

      Yeah. I think that one of the large benefits is that agents have made it much more productive for someone to spend time creating data and training an agent. And so, as an example, like, say a hour of someone's time would previously get, uh, X amount of, uh, product, uh, model improvement. Now, an hour of their time might get three to five X. Uh, that, because they're able to use an AI copilot to make them more productive in how they build out all of these data sets. But ultimately, what's happened as we've made the experts more productive is that it's been this case of Jevons paradox, where the demand just expanded exponentially, because ultimately, like, 99% of, of knowledge still lives in people's heads, and if we just make it more effective and productive to have humans teaching models, that just increases the amount that people teach models throughout the economy, because it ultimately ties back to the principle I mentioned at the beginning, which is that it doesn't make sense for people to do repetitive work. They should just, like, train the model how to do it, and that's a far more scalable and productive way to contribute to the economy.

    7. MO

      So one kind of

  6. 8:51 – 12:20

    Is Human Data a Durable Category

    1. MO

      comment on this category in general is that it's a non-durable category, that training models using all this knowledge work, all this kind of stuff that goes into it, is only gonna last for so long. Do you see that? Obviously, you don't see that happening, but, like, what do you, what are your arguments against that?

    2. BF

      I think it ultimately comes down to your super intelligence timelines, because the market for humans teaching models how to do something is bound by the amount of things that humans can do that models can't do across either the digital world or the physical world. And so, so long as there are things in the economy that a human can do, and it might be something that is joining a Google Meet and having a persuasive conversation, or running a scientific experiment in a wet lab, or repairing a car, whatever it is, we need humans that measure that frontier. Like, the primary way that models improve is that they need some stasis point for what is the place where they're making a mistake, how do they measure that, and then how do they use that as a reward that they can learn from? It's sort of analogous to the way humans learn of, imagine if you are in an English class learning how to write better essays, and the teacher just says that you need to, like, grade all of your own essays, and, like, no one else can give you feedback. Uh, you, you just gotta grade your own essays, right? It's, like, pretty difficult to measure what is beyond the frontier of your own capabilities, and that's why we have feedback. There might be some domains where you can learn based on a clear signal, like math is a good example because there's calculators where you can sort of check your work. But in the vast majority of domains in the economy, the way that we learn and the way that we improve is getting the feedback from our teacher, our professor, our managers, our colleagues, et cetera, and that's very similar to how models learn and how most of the top researchers at these labs expect that they'll continue to learn for decades to come.

    3. MO

      This episode is brought to you by Brex, my favorite. You become what you spend on, and I refuse to spend my time on work that shouldn't exist; expense reports, receipt chasing, and manual closes. The companies building what's next, from Vercel, OpenAI, Anthropic, Granola, and Deepgram all made the same call. They all run on Brex. Brex is the intelligent finance platform that combines cards, expenses, and banking into a single stack with agentic finance built in. AI agents that handle expenses automatically enforce policy before spend happens and close your books in minutes. That's why Sourcery runs on Brex, so I can spend time on building and not busy work. It's time to get Brex AF. Learn more at brex.com/sourcery. That's B-R-E-X.com/S-O-U-R-C-E-R-Y. Bye. From handshake to signature faster, Harvey, the AI platform built for legal work, is trusted by 80% of the Am Law 100 and over 20% of the Fortune 500. Learn more today at harvey.ai. That's harvey.ai. How good is AI at real professional work? Mercor's AI Productivity Index, or APEX, tracks it with every major frontier model release. Built with partners like Harvey and Cognition, see where the frontier

  7. 12:20 – 15:45

    How Mercor Finds and Evaluates Experts

    1. MO

      actually stands at mercor.com/apex. I have to ask, how do you find these experts, and how do you evaluate them?

    2. BF

      So 70% of them come in through referrals. Uh, there's also other channels that we use, but that's the one we're most focused on because we find that people that are referred tend to be the highest quality. And then evaluating them is a really cool process, and this was actually one of our first large breakthroughs 'cause we built the first AI interviewer when Adarsh Sourcery and I were in college in April of 2023, right after ChatGPT came out. And [laughs] the first one had, like, a seven or eight-second latency. It would make an API call to GPT-4, uh, and that based on s- do some pre-processing based on the resume, make an API call, s- say the question, ask people, um, and then y- evaluate the interviews according to a rubric or a set of criteria to see how well people do. And the realization we had as we scaled that up is that so much of the challenges in labor-matching just come down to scalable data collection. And an analog for that is that if you're hiring Stanford AI PhDs, you can probably meet with five people, and, like, one of them's gonna be pretty good versus if you're hiring software engineers from a remote place in India, you need to meet with sometimes hundreds, uh, or a thousand people to find, like, the really world-class engineers, but they are, they are there, and many of them are on our team. And so as we were able to scale up the amount of interviews that we did to solve these, uh, differences in talent density, that was really one of the large drivers of, how do we get spectacular people? Um, a- and also analyzing all the different filters people might not be considering of what are... wh- who referred them, of what is their, um, uh, what are their personal projects that they do on GitHub, on Figma or whatever it is, um, all of these things getting pulled into context then analyzed. So we now do over five... Or we do, we've done over seven million interviews, um, and it's been pretty crazy to see things scale up as we, um, have now created the fastest-growing job category in history.

    3. MO

      It's crazy.

    4. BF

      Yeah.

    5. MO

      Literally so fast.

    6. BF

      It's very surreal. Yeah, I mean, I for, as a frame of reference, so now if we're paying out, call it $5 million a day, as of two years ago, 24 months ago, we were paying out a million dollars a year.

    7. MO

      Oh, my God.

    8. BF

      So it's like, um, I, I think that many people at the company [laughs] don't fully realize just that, like, that ha- that's ever happened before, um, and that it's this very special opportunity where we found this giant market before anyone else, and we've become the category leaders in how we, um, create this really important new category.

    9. MO

      Yeah, that's amazing. I mean, I have so many questions off of that. Um, one of the questions that I was, like, super curious about, just to deviate for a second, is, like, you look at your team. You're all early 20s.

    10. BF

      Not all of us, but a, a lot of our, like, early people-

    11. MO

      You founding team-

    12. BF

      Yeah. [laughs]

    13. MO

      ... early, early

  8. 15:45 – 18:00

    Holding Category Leadership With a Founding Team in Their Early 20s

    1. MO

      20s, right?

    2. BF

      Mm-hmm.

    3. MO

      You're dropouts of college. You've been able to grasp and really hold on to one of the fastest, if not the fastest growing new category in AI and in technology in years. And meanwhile, like, you have very large competitors get bought out by, like, Meta. You have other ones that are popping up, like, every other month and somehow reaching fi- like, a billion in revenue. And yet, like, and you guys, like, you know, you overcome challenges like the data leak and that kind of thing, but still, you're, like, number one in the market. So what is it about your culture and your founding team that you guys are able to continue to persevere and win?

    4. BF

      I would say there's probably three values that we have that are explicit values in the company, but they're really operationalized, that have been super impactful. The first one is high standards, just having, like, a really high hiring bar and making sure that we don't compromise that has been a huge differentiator relative to everyone else in the company, and the quality of the people on the team is unparalleled. The second thing is a value we call time travelers, which is about being super, like, long-term orientated, just, like, living in the future of, what is the world gonna look like in five years, and how do we work backwards from there? And that was how we sort of found the market before all of these other, uh, talent networks, and we just have always understood the frontier of the research super well, and how what's happening at the frontier is a leading indicator of what happens at the AI-native companies and application-layer companies, is a leading indicator of what happens in the global economy. And just being very thoughtful about how things systematically flow through these adoption curves, um, has been really important. And then the third thing is customer obsession. Like, we are an incredibly hardworking, customer-obsessed company, where we move mountains for our customers because they build the most important technology on Earth, and we, um, are extremely committed to the mission of how we help them to do that. And I would say those

  9. 18:00 – 28:25

    Chips on the Shoulder and Avoiding Mimetic Competition

    1. BF

      three things have been, uh, the most formative as we've developed market leadership.

    2. MO

      Would you say you have clean fuel, or at this point do you have a little bit of redemption fuel?

    3. BF

      What was, what was the first one? Clean fuel?

    4. MO

      Clean fuel.

    5. BF

      How do you define clean fuel?

    6. MO

      Like, okay, Dylan Field explained this to me before their acquisition by, I, I forget, was it Adobe-

    7. BF

      Yeah

    8. MO

      ... got scrapped. Like, he was just running on pure clean fuel. Like, nothing put a chip on his shoulder. Then that happened, got a major chip on his shoulder, and he was like, "Now I'm gonna fucking win."

    9. BF

      [laughs]

    10. MO

      And like do it with, you know-

    11. BF

      Yeah

    12. MO

      ... some gumption. Do you run off of clean fuel? Or what, do you have any chips on your shoulder?

    13. BF

      I would say I always have, like varying chips on my shoulder. I... Like, we always have had a maniacal sense of urgency where, um, the company's super intense. Like, if, um, people aren't executing, um, we keep a really high bar and m- we move super quickly. Um, and so we always want to be thoughtful about what our competitor's doing, how can we move faster. But the thing I would caveat is that I think many companies fall too much in the tr- into the trap of looking at what their competitors do, which becomes mimetic. Like, it's a really good way to be second place in a market, right? And we have no interest in being second place in a market, right? Like, we have an interest in defining important categories, and I think that just requires more of this, like first principles thinking, uh, more motivation from being a time traveler, of working backwards from what will the world look like in five to 10 years, less so focus on competitors. Um, so maybe that's related to, to your question of what motivates me. But I, I think all of my co-founders in our early team are really just excited about how do we build a legendary company that solves this problem of how do humans fit into the economy over the next decade.

    14. MO

      What were the biggest challenges that you had to overcome?

    15. BF

      There's been so many. I mean, I think that a lot of people who haven't actually founded companies don't know the feeling of just getting punched in the face-

    16. MO

      [laughs]

    17. BF

      ... over and over again. And you, you know, we've, we've had s- so many cases where we've lost our, y- you know, our seed stage customers early on, 'cause the, the initial business for the first roughly year and a half was all seed stage companies. [laughs] And so, you know, 80% of them go out of business within 12 months, and it was, uh, sort of fighting that constant tension. Uh, some of them became large companies, like Cognition. Um, but that was definitely always a little bit painful. Um, there have been, uh, cases like the security incident. There's been cases where, uh, y- we lose a, a early member of the team. Like, there are so many things where you just get punched in the face, and I think founders gain an appreciation that, like, chaos is the norm, and you just have to get used to, uh, chewing glass and staring to the abyss, as Elon says, because ultimately, it's the impact on the other side of that five to 10-year journey that is motivating and makes it all worth it.

    18. MO

      How do you manage that for your team? It's really interesting. Like, we... I, I think we... So I saw you at the Upfront Summit-

    19. BF

      Mm-hmm

    20. MO

      ... not too long ago, and I was interviewing Alfred Lin on stage, and something that he's talked about a couple times, even through our interviews, is they like to be shock absorbers-

    21. BF

      Yeah

    22. MO

      ... for their founders and their companies. So do you like to be a shock absorber for your employees? How do you help direct them and let them know what's going on?

    23. BF

      I agree with this. I think what Alfred was saying is super accurate, that when everyone feels like they're on top of the world, that's when you need to be, like cr- cracking down on what are all the things going wrong. And when things are not going well, and, you know, it's one of the rough patches, that's when you wanna be the cheerleader that's telling everyone how good a job they're doing a- and, and helping to rally the company. I think that, um, that is certainly super important. The other thing that relates to this is just driving the long-term orientation. Like, even on our executive team, someone, like, uh, put up, like a weekly revenue graph, and I was like, "No, we, I don't want the company, like, looking at this," [laughs] right? It's like the company should be looking at how happy are our customers, how happy are our experts, um, how well utilized are our experts, all, all these different things that, like, actually drive creating value in the world, um, and how that compounds. 'Cause I think that that is one of... A- as I've learned and been fortunate to get insights from people who've been at a lot of the legendary companies early on, this long-term orientation is one of the most important characteristics of the people and the companies that accomplish extraordinary things.

    24. MO

      Who are some people that you look up to?

    25. BF

      Well, I do think Elon is the greatest entrepreneur-

    26. MO

      [laughs]

    27. BF

      ... uh, by results. I wish he didn't get into politics so much, but I, I think-

    28. MO

      Luckily, he's out of it.

    29. BF

      [laughs] Luckily, he's out of it, yeah. I, I, I heard from someone that he said that the government is the one institution that wasn't fixable. [laughs]

    30. MO

      [laughs]

  10. 28:25 – 31:22

    Why Mercor Acquired Deeptune

    1. MO

      Hire anyone, anywhere. Get visas handled fast, and get back to building. Visit deel.com/sourcery. That's D-E-E-L.com/ S-O-U-R-C-E-R-Y. So let's talk about the state of the business today.

    2. BF

      Mm-hmm.

    3. MO

      So you recently had some big news. You acquired DeepTune.

    4. BF

      Yeah.

    5. MO

      Why did you do that?

    6. BF

      So it really ties back to what are the critical ingredients of the RL environments we need to automate everything in the economy, where the three parts I mentioned are, first of all, the apps, second of all, the worlds, and third of all, the tasks. And the thing that we have the deepest competency in is all of the worlds and all of the tasks, because that's what a lot of the experts do, and we have agents that help to augment and make that efficient. And our largest bottleneck was how do we get the apps that clones of Salesforce and Adobe and Google Workspace that w- we can have all of the experts populate with the relevant content, because naturally, that is not what we started doing. It wasn't as much of our comparative advantage. And so one of the customers that we work with actually suggested proactively that DeepTune was their top apps partner, and w- they should just give us apps that we could populate as we were building out these environments. And so it's sort of ironic when, like, a customer initiates a partnership.

    7. MO

      [laughs]

    8. BF

      It's a, a good signal that y- there's something there. And so we started working with them. I got to know Tim, the founder, better. Um, and he was spectacular, and that's obviously half of any of these things, right? Just like who are the people that you wanna work with for the next decade? And it was clearly just a one plus one equals three kind of thing, where we were setting up our New York office. They were in New York. They were very- ... mission-aligned, culture-aligned team, and we could both solve one another's bottlenecks in scaling to solve important problems for the world. And so we took the leap of faith and made it happen.

    9. MO

      Was this your first acquisition?

    10. BF

      This was our second, but it was much larger than our first. Um, we also acquired a company called Sepal, um, founded by Robbie and Kat, who are also spectacular. Um, but Tim, uh, yeah, Tim ha- had made a- a giant amount of progress with DeepTune, and, uh, had just raised his series A from A16Z, so it was a little bit further along.

    11. MO

      Mm. Do you have an A- M&A plan going forward? Or, like, how does... How do you think about this strategically?

    12. BF

      I think M&A is really important. Um, or it depends a little bit on the type of company, but it's at least something that is super high leverage, right? Where you can make mistakes, uh, at, at large scale, but you could also achieve, like, high positive impact at large scale. And so it's definitely something we think about, um, and we're exploring a few different categories that we think could be interesting.

  11. 31:22 – 34:40

    Turning Down Acquisition Offers

    1. MO

      Have you gotten poached?

    2. BF

      Have I gotten poached?

    3. MO

      Yeah.

    4. BF

      Uh-

    5. MO

      Are people trying to acquire you? [laughs] I'm sure you've-

    6. BF

      There have been-

    7. MO

      ... gotten a handful.

    8. BF

      There, there have been cases of that. Um, but it really ties to what motivates me and my co-founders. Um, like, Adarsh and I have had opportunities where we could walk away with a lot of cash, and never work again, and get whatever we want in life, but that's not what motivates us. Like, we'd rather work 100 hours a week to solve a really important problem in the world. And we have the privilege of doing that in an incredible market with a spectacular team, and it's hard to know if we'll have, uh, that privilege again. And so I think it's, uh, re- that's really the thing that frames it and how we think about our priorities and what we want to accomplish.

    9. MO

      How would that work? Like, who would you get acquired by? Like, what happened with the Scale acquisition? Because they still have outside customers.

    10. BF

      Yeah, the Scale acquisition is a little bit funky, uh, of course because of the M&A stuff, uh, or the M&A restrictions. But it's Alex and the core team went over, and then a lot of the rest of the team stayed at Scale, and Scale pivoted most of their business to just focus on Meta. Um, I don't think we would ever do something like that.

    11. MO

      But does Meta still use other people?

    12. BF

      Meta still uses other, uh, vendor... Or I, yeah, I shouldn't speak too much to-

    13. MO

      Yeah

    14. BF

      ... what they do, but yeah.

    15. MO

      Well, Alex is very talented.

    16. BF

      He's incredibly talented. Um, and I, I've only met Alex once, but I've been fortunate to work with a lot of the people that spend a lot of time with him, and I think he was one of the most generational entrepreneurs of the last decade. And so it's been great to see, um, what he's been able to accomplish at Meta as well.

    17. MO

      It's funny 'cause we just had Scott Wu on.

    18. BF

      Mm-hmm.

    19. MO

      We just put out this episode about being independent.

    20. BF

      I watched that. Scott is so fun to listen to. [laughs]

    21. MO

      He's great.

    22. BF

      Yeah.

    23. MO

      I mean, we cut out a lot 'cause there was a lot of laughing going on. [laughs]

    24. BF

      Yeah, yeah, yeah.

    25. MO

      But, [laughs] but he's awesome. Their team is cracked.

    26. BF

      Totally.

    27. MO

      I don't think people use that term anymore, but-

    28. BF

      Yeah

    29. MO

      ... Cognition is cracked. Um-

    30. BF

      They're great

  12. 34:40 – 41:30

    Harvey, LAB and Why the Model Is the Product

    1. MO

      we talked with-

    2. BF

      I love those guys too, yeah.

    3. MO

      They're great.

    4. BF

      Yeah. [laughs]

    5. MO

      Their, their off- their office is gorgeous.

    6. BF

      I know. I was there the other day, and, uh, yeah, it's, it's, uh, very beautiful.

    7. MO

      I don't think I've seen a prettier office than that.

    8. BF

      Well, you'll have to check out our office soon.

    9. MO

      [laughs] Okay.

    10. BF

      [laughs] Our- ours is nice. It might not be the same caliber, but yeah.

    11. MO

      Theirs is, like, is, like, really-

    12. BF

      Yeah

    13. MO

      ... really nice. [laughs]

    14. BF

      Totally.

    15. MO

      Anyway, so we had Winston on, we had Gabe on, and we had Niko on, and we talked about LAB-

    16. BF

      Mm-hmm

    17. MO

      ... and the recent benchmarks that they put out. And you were mentioned as one of the partners that helped with that. So can you walk through how you helped and, like, what your, I guess, your role in LAB was?

    18. BF

      Mm-hmm. Well, so it's similar to the process I described where the work that we do with them corresponds to starting with great experts across all the granular domains that they care about, and then ultimately helping to curate what are the management processes and specific data shapes that those experts build to translate to a really high-quality data set. Um, and we've put out a lot of public legal benchmarks such as Apex and Apex Agents. And so they, um, found some of that work really interesting, and of course have a unique lens in looking at this problem because of all of th- understanding all of the taxonomy of what law firms care about, and how to cover the distribution that, uh, the labs aren't effective at. And so I'm really excited about the work that they're doing in post-training models. I think that that is... Uh, like, my mental model for how the AI market is gonna develop is that- The frontier labs are a leading indicator on what the AI, uh, native companies like app-layer companies are gonna do, which is a leading indicator on the enterprises. And the app-layer companies that are going to survive need to be building the frontier model in their specific domain, like Harvey building the frontier model in law, because ultimately the model is the product, and you need to be able to have frontier capabilities to stay competitive and build a moat relative to the labs. And so we're super excited to, um, partner with them on that, and there's a lot more coming soon.

    19. MO

      That's really interesting. I think you also said that AI app-layer companies are gonna die.

    20. BF

      Not exactly. [laughs]

    21. MO

      [laughs]

    22. BF

      Well, what, what I said is that there's sort of three main categories of companies that have meaningful revenue scale outside of data companies. Uh, the first one is frontier labs. The second one is the inference providers. Uh, so first one being, you know, Anthropic, OpenAI. Second one being Fireworks, Base10, and the third one is the app-layer companies like Harvey. And my thesis is that there are large portions of each of those businesses that get commoditized, right? Like, if everyone's buying GPUs in the inference layer, then the GPUs got commoditized. If, uh, the app-layer companies are building software layers, those will get commoditized as it becomes cheaper and cheaper to build software. But the two things where companies are able to build moats that I've seen that have been durable is, first of all, their brand, of which Harvey has a world-class brand, um, certainly, uh, top in the law category and maybe more generally across application-layer startups. And then second of all, their data moats, uh, which we can help with meaningfully of how do they understand this flywheel from the, not training on customer data, but learning the distribution of what do their customers care about, and using that to inspire what are the benchmarks that they wanna build, um, what are the training data sets that they need to curate to be best in the world at those. And I, I think those are really gonna be the two primary moats t- to look for in the application-layer companies that are able to build durable and potentially legendary companies.

    23. MO

      What are the moats for the top two layers?

    24. BF

      Well, with the frontier labs, there's certainly a lot of economy of scale associated with just spending more on compute and more on data, um, where if you have the most distribution and revenue that you can generate from your models, you can invest more in having, uh, more compute and, uh, m- more RL environments, uh, which the labs are scaling up their investments in exponentially. I, I think there's also... So I'd say it's probably mainly economies of scale, and then, uh, there's some flywheels associated with a given model helping them to improve their subsequent model more, uh, i.e. recursive self-improvement, which won't be a vertical takeoff, but it, you know, it will contribute and make things slightly faster over time. Uh, and then brand moats, I would say, are the main ones for foundation models. For the inference companies, some of them are s- I, I would say the primary one that I think the inference companies need to get right, and Fireworks is executing really well on, is building custom models, right? It's just the other side of the coin of what Harvey's thinking about because the switching costs of reselling GPUs are zero. Uh, as much as people try to tell this nice story of how there's great margins, like of course when you buy a bunch of GPUs and those appreciate, like, 50%, you'll have, like, good margins for a period of time. Th- the real switching costs and durable margins come from how do you help a customer customize a model that has high switching costs and can't be ported over to other infrastructure? And so that's how I think about sort of the moats that are developing at the frontier model labs, and then also the moats that are developing in the inference layer, uh, a- and how those companies will, uh, build durable, durable businesses.

    25. MO

      Which is the most vulnerable?

    26. BF

      Hmm. I think that it feels like the switching costs for APIs are so low, um, that I think investors overrate some of the revenue quality of API businesses, um, because ultim- like so much of these just boil down to switching costs if you make it that simple. Um, yeah. A- and, like, we switch between APIs on a daily cadence, uh, based on whatever model's performing the best on our evals for how we run the business. I think every company will do that as they mature and have scaled inference bills. And so some of these companies may be really big, uh, but I think the, um, I, I think the revenue quality is sometimes overrated.

    27. MO

      Okay. Well, since

  13. 41:30 – 43:40

    Why Data Is Mispriced in the AI Stack

    1. MO

      we're talking macro, there was another tweet you put out. By the way, that was a tweet, so we'll-

    2. BF

      [laughs]

    3. MO

      ... tag that tweet.

    4. BF

      Yeah.

    5. MO

      But there was another tweet that you put out that AI progress requires three things.

    6. BF

      Mm-hmm.

    7. MO

      Compute, algorithms, and data. Why do you think data is mispriced between that stack?

    8. BF

      I think data is still contrarian is the top thing, where for some reason there has been this perception by investors that we will get super intelligence in three years, and AI will be better than humans at absolutely everything, and, uh, so we won't need humans to then create evals and train models. And the investors have been saying this for the last three years. Um, like I remember [laughs] even at our seed round, uh, like, you know, most of the top firms in Silicon Valley... We- we've always been very fortunate to, uh, work with investors we love, but a l- a lot of the top firms in Silicon Valley just thought, um, that the market would dissipate within a couple of years. And I think the thing that- Everyone has always missed is the case of Jevons paradox or, or functionally the lump of labor fallacy, which is just, like, as we make the experts more efficient, as the experts are able to improve models three, five, 10 times more, that has dramatically increased the amount of demand for people to improve the models. And ultimately, as long as we don't have super intelligence, as long as there are things that humans can do that AI can't do in the economy, we need humans to measure that frontier. And so I think that has been the largest disconnect, and I honestly feel sort of grateful for it in a lot of ways because we've always had lots of access to capital, but it being contrarian reduces the amount of competition in the market. Um, [laughs] so I'm glad it's- I'm glad our market is not nearly as competitive as the foundation model business. Um, but I think that it is on the verge of becoming consensus, especially as people see all of the enterprises that are starting to, uh, evaluate agents

  14. 43:40 – 49:55

    Every Fortune 500 Becomes a Neolab

    1. BF

      that they're deploying in post-trade models.

    2. MO

      So how does this play out over the next 10 years?

    3. BF

      I think that the key development is that every Fortune 500 is going to look like a Neo lab, where they have their core data sets, their core, uh, distribution that they care about to serve their customers, and they need to mobilize some combination of their full-time employees and contractors to curate really high-quality tasks for evaluation and training of the models that they're building. Because ultimately, so many of these processes that are currently human are going to become agentic, and this is the most efficient and scalable way to distill all of that human knowledge throughout their company into the models. And so that will be a giant transformation that we're just starting the first inning of.

    4. MO

      Damn, I was gonna ask you that.

    5. BF

      [laughs]

    6. MO

      So I, I actually- I asked Winston for-

    7. BF

      Yeah

    8. MO

      ... some questions ahead of time, and he wanted me to ask about AI data sovereignty.

    9. BF

      It- it's gonna be so critical. I mean, it's- there's a reason that Jensen and Alex Karp and Satya are all talking about this. Like, I think that Anthropic and OpenAI will have extraordinary businesses. I think both of them could very well be 10 trillion-plus dollar companies. But ultimately, we don't want them to subsume the global economy and be the only place that you can go to access, uh, frontier intelligence. And for value to accrue to every other company i- in the Fortune 500 a- and Americans more generally, we need to make sure that all of these companies are able to train their own models and build their own intelligence that codifies their competitive advantage. Like, I think there's sometimes this narrative from certain labs when they're fundraising that all of a sudden they're just gonna turn on training on the usage data flywheel of all of the enterprise data-

    10. MO

      Mm

    11. BF

      ... and the Fortune 500s are gonna be fine with this, and this is the way that they're gonna, like, collect all the environments throughout the economy, wh- when, like, clearly that's not the case, right? Clearly, the reason that a company like Goldman Sachs exists is that they have a set of competitive advantages associated with the people, the processes, the documents, et cetera, in their business. And turning on, uh, allowing a frontier lab to train on that data would be analogous to just sharing all of it with a competitor, and so they're not gonna do that. And I believe that instead, they're going to be building their own models, uh, deploying their own agents that codify all of this knowledge. And, and really the heuristic to look out for what is the catalyst of this chan- uh, transition and happening within the enterprise is how much they're spending on inference. 'Cause what we basically find is that when a company is spending under $10 million on inference, they don't generally care that much about, uh, evals or, like, how to optimize it or whatever. They're still figuring things out. Once they go from the 10 to $100 million on inference range, then they generally wanna spend-

    12. MO

      That is such a wide gap. [laughs]

    13. BF

      Yeah, it's a wide gap, but, like, I mean, we're spending almost, like, a million dollars a day on inference.

    14. MO

      Mm.

    15. BF

      So, like, some companies scale fast. And, um, once they're in the 10 to 100, then it's roughly 10% of their inference budget should be going to eval of how do they build out the data sets that tell them, like, what are all the models they should route this to. Once they're past $100 million in inference, like a Harvey or a Cursor or all of these companies, then they need to be really seriously thinking about how do they post-train models because the economics start to check out. If you can spend tens of millions of dollars a year, sometimes, you know, hundreds or billions in the case of Cursor, in training your own models because you can amortize that fixed cost across all of the inference that you have. And so I expect the inference spend of enterprises will ramp materially, but they'll also go through these curves of adoption where they roll out evals in that 10 to 100 range, and then start post-training in the 100-plus range as they deploy frontier intelligence throughout their businesses.

    16. MO

      Because you have such a unique and advantageous perspective, I mean, you see literally every company-

    17. BF

      Mm-hmm

    18. MO

      ... and you see how their data's being used and all this kind of stuff, what advice do you have, taking into account everything that you just mentioned on inference, what advice do you have to these enterprises as they continue to build up their sovereign AI stack?

    19. BF

      I would say that the largest thing that enterprises misinterpret Is how frontier models actually learn, where the vast majority of where the compute gets spent on in trading is no longer just, like, read all the documents in the company or, uh, learn from inputs and outputs in SFT. Like, most of the compute is now going towards RL, where the model will attempt the problem many times and then get a score on one of these rubrics. And RL, in the vast majority of cases, requires subject matter experts that are able to create these rubrics and tasks to evaluate and train models. And so for any company that is training their own model, they need to build tasks that produce clear eval scores. And then once they feel confident in the eval, then they should scale up the distribution of what they care about to help climb that eval. So maybe those are the two pieces of advice is, first of all, uh, build tasks rather than just, like, pretending the model can read everything and learn. And second of all, that they should start with the eval because that is the foundation for how every AI lab and successful application layer understands how well they're doing and has a baseline in improving their models

  15. 49:55 – 54:12

    IPO Timeline and the Next 12 Months

    1. BF

      that they're training.

    2. MO

      Good advice.

    3. BF

      Thank you. Yeah.

    4. MO

      Okay, so two more questions. What are you most looking forward to in the next 12 months?

    5. BF

      Mm-hmm.

    6. MO

      What can we expect from Mercor? Are you gonna go public?

    7. BF

      [laughs] I don't think we'll go public in the next 12 months-

    8. MO

      [laughs]

    9. BF

      ... but we are [laughs] ... We... It's funny, I, like, think in 2024, I tweeted IPO by end of year, and-

    10. MO

      [laughs]

    11. BF

      ... people... And, and we, we were... I thought it was, like, clearly a joke 'cause we dropped out of college like 12 months prior.

    12. MO

      [laughs]

    13. BF

      And people were like, "Whoa," like, "No way."

    14. MO

      [laughs]

    15. BF

      And so we're, we're not gonna go public in the next 12 months, but it's certainly on our, on our radar. The thing I'm most looking forward to is really the stuff on enterprise, where I think that it's starting to happen so quickly as the inter- as the inference bills mature, that the really classic companies, um, the Fortune 50 non-technology companies, are, are starting to understand how important this is.

    16. MO

      Mm.

    17. BF

      Um, some of those companies are facing existential threat from the frontier models as those companies creep into, uh, their sectors. A- and that's just gonna be a huge catalyst for transitioning the way that intelligence gets used and deployed in the economy. And so I, I think it'll be incredible to see.

    18. MO

      Cool. Well, I know this is a very strange closing question, but you asked me this before we started recording.

    19. BF

      Mm-hmm.

    20. MO

      You were like, "How do you spend your days?" So I wanna ask you, Brendan-

    21. BF

      How do I spend my days?

    22. MO

      ... how do you spend your days? Are you flipping donuts?

    23. BF

      [laughs] No longer flipping donuts.

    24. MO

      [laughs]

    25. BF

      Uh, I... Let's see. So I generally will wake up around 7:45, and then i- if I'm... I, I work out most days around 7:50 until 8:30, and then I'm in the office by 9:00. And then I would usually have four hours of meetings a day. Sometimes it's closer to eight to 10. Uh, and I would knock out lots of messages, emails, and docs elsewhere. And the- and my time is probably roughly a third on hiring, a third time with customers, and a third time on research and product. Um, and then I'm in the office until 10:00 PM, and I rinse and repeat six days a week.

    26. MO

      Wow.

    27. BF

      And then Sundays I work from home. [laughs]

    28. MO

      [laughs] Nice. It was interesting when I talked to Winston, I got so, so many people reached out to me listening to that episode because they're like, "Oh, my God," like, "It's really great to hear someone who's going through that hypergrowth of how they're managing their day and what they spend their time on." And there was one part where he was talking about, like, fixing people's calendars-

    29. BF

      Mm-hmm

    30. MO

      ... and, like, deleting meetings.

Episode duration: 54:13

In the uListen app, the transcript lights up word by word as you listen. Get uListen

Transcript of episode xzA6lYBzmzQ

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.