Skip to content
a16za16z

The $700 Billion AI Productivity Problem No One's Talking About

Russ Fradin sold his first company for $300M. He’s back in the arena with Larridin, helping companies measure just how successful their AI actually is. In this episode, Russ sits down with a16z General Partner Alex Rampell to reveal why the measurement infrastructure that unlocked internet advertising's trillion-dollar boom is exactly what's missing from AI, why your most productive employees are hiding their AI usage from management, and the uncomfortable truth that companies desperately buying AI tools have no idea whether anyone's actually using them. The same playbook that built comScore into a billion-dollar measurement empire now determines which AI companies survive the coming shakeout. Timecodes: 0:00 — Introduction 1:07 — Early Career, Ad Tech, and Web 1.0 2:09 — Attribution Problems in Ad Tech & AI 3:30 — Building Measurement Infrastructure 5:49 — Software Eating Labor: Productivity Shifts 7:51 — The Challenge of Measuring AI ROI 13:54 — The Productivity Baseline Problem 17:46 — Defining and Measuring Productivity 20:27 — Goodhart’s Law & the Pitfalls of Metrics 21:41 — The Harvey Example: Usage vs. Value 24:18 — Surveys vs. Behavioral Data 27:38 — Interdepartmental Responsiveness & Real-World Metrics 30:00 — Enterprise AI Adoption: What the Data Shows 32:59 — Employee Anxiety & Training Gaps 37:31 — The Nexus Product & Safe AI Usage 41:08 — The Future of Work: Job Loss or Job Creation? 43:40 — The Competitive Advantage of AI 52:45 — The Product Marketing Problem in AI 54:00 — The Importance of Specific Use Cases SOCIALS Follow Russ Fradin on X: https://x.com/rfradin Follow Alex Rampell on X: https://x.com/arampell Stay Updated: If you enjoyed this episode, be sure to like, subscribe, and share with your friends! Find a16z on X: https://x.com/a16z Find a16z on LinkedIn:https://www.linkedin.com/company/a16z Listen to the a16z Podcast on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX Listen to the a16z Podcast on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711 Follow our host: https://x.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details, please see http://a16z.com/disclosures.

Russ FradinguestAlex Rampellhost
Dec 1, 202557mWatch on YouTube ↗

EVERY SPOKEN WORD

  1. 0:001:07

    Introduction

    1. RF

      85% of the companies we talked to said they really believe they only have the next 18 months to either become a leader or fall behind.

    2. AR

      You know, we have our little group chat where we have another friend who's like, "Oh, all this stuff is overhyped and it's going to zero."

    3. RF

      Totally wrong.

    4. AR

      But you'll never know.

    5. RF

      Every time I use AI, it's amazing.

    6. AR

      There's somebody at every big company who has figured out, "I could do something in one minute that used to take eight hours."

    7. RF

      28-year-old guy who was using ChatGPT really, really well, and they had him create a 30-slide deck, and they did a global call for everyone in the investment bank for this guy to spend an hour walking people through how to use ChatGPT. But that's absurd. That's an absurd way to hope people adopt world-changing technology. Cursor has taken mediocre engineers and made them good, but it's taking amazing engineers and made them gods. Every board meeting I go in for my other four metrics, I have some report of how are we doing against those reports, and on AI, all I have is the amount of stuff we bought.

    8. AR

      When a measure becomes a target, it is no longer accurate as a measure.

    9. RF

      Even though we thought we had our quota set and we thought everyone was productive, it turned out we thought we were productive, and actually it turned out we could be much more productive.

    10. AR

      But compared to what? [upbeat music] I'm excited to be here with my friend Russ

  2. 1:072:09

    Early Career, Ad Tech, and Web 1.0

    1. AR

      Fradin, um.

    2. RF

      Yeah, good to see you.

    3. AR

      Uh, I've known you for a long time.

    4. RF

      That's right.

    5. AR

      And I think when I first met you, I still actually remember meeting you the first time. It was from, uh, I think Josh McFarland. Um, and Josh was at Google, and he was like, "Yeah, there's this guy, Russ Fradin, and he started this company, Adify, and he sold it to Cox for all this money."

    6. RF

      [laughs]

    7. AR

      You know, back then, $300 million was a lot of money.

    8. RF

      I know. It's- it is amazing. I, I, I-

    9. AR

      Now it's like a B round. But, like, back then, like, that was a huge acquisition. And, uh, the- there, there was like, "Oh, like, Russ, like, I ha- like, amazing person that pulled this off." Um, and, uh, I think we met in Florida-

    10. RF

      That's right

    11. AR

      ... uh, on a Silicon Valley Bank trip, [mouth clicks] and kind of all things, uh, e- everything comes full circle in the end. But, um, you know, AI is probably the hottest thing in the history of the world. Um, but you also worked in what was the hottest thing in the history of the world in Web 1.0.

    12. RF

      Yeah.

    13. AR

      But now there's this big question. Actually, it reminds me of Ad Tech. I think it's kind of a, a nice little segue because, like, Ad Tech, you're trying to figure out, does the advertising work?

    14. RF

      Right.

    15. AR

      Like, a lot of Ad Tech is, here's an advertisement, and there's this attribution

  3. 2:093:30

    Attribution Problems in Ad Tech & AI

    1. AR

      problem-

    2. RF

      Yep

    3. AR

      ... of the sale happened. Who is responsible for that sale? Was it the banner ad on Yahoo? Was it the last click that happened on Google? Was it the coupon site that, you know, stuffed a cookie on your machine? So part of Ad Tech is just how do I fi... Like, I'm buying ads, that's part of it, but part of it is also did it work? And AI, there's all sorts of stuff around making AI work, which is, like, technically very, very challenging. But then there's the question of did it actually yield a benefit?

    4. RF

      Yep.

    5. AR

      Which is probably the biggest question for... I mean, there, there's, there's a lot of, like, myths on this on both sides, but would love to kinda hear about the origins of Larridin and how you think about even some similarities between the two.

    6. RF

      Sure. Yeah, there, there's a lot of parallels really to what happened in the '90s with advertising and the growth of the internet and what we're seeing with AI. I mean, forget the capital markets perspective. It is, it is funny to think about, uh, what, what is defined as big from an exit these days versus five years ago, 10 years ago, 20 years ago, w- and that's, that's kind of its own topic. But just when I moved out here, I moved out to Silicon Valley in 1996, and I was the first guy at the first online ad network. And in the early days, it was just there are websites, we should put ads on them. Great, how do we do that at scale? Great, what are the metrics we should capture? Then you saw the growth of things like comScore and Nielsen as they moved into television

  4. 3:305:49

    Building Measurement Infrastructure

    1. RF

      to figure out, like, how do I actually plan this? How do I spend this? How do I give tools? Right. All of the money lived in TV or in radio, and there were these tools like Nielsen, Arbitron, IMS Health on the pharmaceutical side. There were all these tools to help people understand what they were getting when they advertised on television. You had to build that entire stack for the internet. You had companies like DoubleClick or Flycast where I was, or, uh, companies like Omniture building a different part of the stack, companies like comScore building a different part of the stack. And those companies, obviously Google and Facebook are two of the most amazing companies ever built, but if it wasn't for all of that infrastructure, their revenue just wouldn't have grown as quickly. And I, I really do think we'll see the same thing in AI now, the technology is unbelievable. And, you know, my core thesis when I was thinking about starting Larridin after having been, you know, the first guy at the first online ad network and having been maybe the first, one of the first two executives at comScore way, way 25 years ago back in the day, um, my, my partner Jim and I sat down and we said, "Look, you know, every time there's a tremendous shift in budget, and especially when it happens at a great pace, like what happened from TV to digital advertising, which happened in a lot of categories from client server to cloud, anytime that happens, people need to rebuild all of the infrastructure. There's a great opportunity to build all of these tools around measurement, around governance, not with the goal of stopping anything, frankly with the goal of accelerating it. Because if I am a large company, yes, I'm going to experiment a ton with AI today. It's the most exciting thing that's happened in the last 20 years from the technology standpoint. It's amazing. It's wonderful. But also there are very boring but important questions. I have 35,000 people in my workforce. They can't all get retrained all at once with perfect knowledge and perfect security. How does it affect my D&O insurance? Was the project ultimately valuable? And so we really wanted to start a company about how would you build kind of the measurement and governance set of tools, not to be a gatekeeper, but to empower more of this spending. I, I think as we grow, we will be the best friend to all of the AI companies.

    2. AR

      Yeah, and, and, um, I mean, maybe we can get into how you're doing this.

    3. RF

      Mm-hmm.

    4. AR

      But, um, just to kind of level set a little bit, and I love this framing that you gave me. I've, I've stolen it. Um, wh- when I steal a phrase, it's the most sincere form of flattery-

    5. RF

      Of course

    6. AR

      ... of course. But, um, I, I

  5. 5:497:51

    Software Eating Labor: Productivity Shifts

    1. AR

      just released a, a little video about kind of, uh, how software is eating labor.

    2. RF

      Mm-hmm.

    3. AR

      So, you know, software eats the world. This was a thesis that our firm is founded on, but it's eating labor, but it doesn't actually mean that, like, jobs are gonna go away.

    4. RF

      For sure.

    5. AR

      Largely, what it means is that people are going to be, like, 10 times more productive, where I can't hire anybody to do this job, but I can hire AI to do it.

    6. RF

      Mm-hmm.

    7. AR

      So you have companies where, uh, their software budget is very, very smallBut their labor budget is enormous. And step one of, like, the mega opportunity that excites us as a firm is that people say, "Oh, I'm gonna start hiring software." But now that means that your software budget is enormous.

    8. RF

      Yes.

    9. AR

      Because right now, if you have, like, a $10 billion labor market-- labor budget and, like, a $1 software budget, you're not gonna try to cut, you know, optimize your $1 software budget, but you're really gonna say, "Okay, do I need to hire more people? Can I make people more productive?" You know, all these things that are going through people's minds right now, and this is yielding a lot of the mega growth curves of the AI software companies. But now this chart is gonna be a little bit more balanced-

    10. RF

      Sure

    11. AR

      ... of, like, the $10 billion of labor, you know, maybe that goes to eight, and now you spend two bill- or $1 billion on software. So, like, the, the net spending for the company is actually lower. The company is more profitable, productivity gains galore. But then is this productive?

    12. RF

      Right.

    13. AR

      Like, I, I always wanna know if the humans are productive, but then, like, is the software yielding more-- me more productivity, and how do I measure that? So everybody's excited about this gold rush. I'm gonna use these t- these tools, but, like, do they work, and how well do they work, and what's the baseline?

    14. RF

      Yes.

    15. AR

      So, so I, I've stolen your framing of it's like, you know, if Chase spends $18 billion on software or what- whatever-

    16. RF

      Right

    17. AR

      ... and now they can double that-

    18. RF

      Two hundred billion. Right

    19. AR

      ... but, like, they need to know if they're getting their money's worth. They need to figure out if this is actually efficient spend.

    20. RF

      Yes. Look, a funny thing, uh, uh, not funny, a thing you will hear said frequently by the people running the largest AI companies in the world, the people running the largest firms investing in AI in the world is they'll say something along the lines of, you know, today global IT spend is $1 trillion, and we think because of AI and agents, that

  6. 7:5113:54

    The Challenge of Measuring AI ROI

    1. RF

      could go to $10 trillion. And, you know, let's ignore whether that's true or false. It's certainly the bull case for NVIDIA, for OpenAI, and for all of the other things that we spend all of our time doing. And so when you think about it, I think we said, um, I think if I remember correctly, JPMorgan Chase's global IT spend is on the order of $18 or $19 billion, and they spend a couple hundred billion dollars a year on people. So if you really think about that, well, is their IT spend gonna go from $18 billion to $180 billion? Uh, seems unlikely in the next couple months, but it's certainly gonna go up. And if it's gonna go up, what does the CFO need to understand? And at the same time, because of the pace, you know, a, a way I like to frame this that I think everyone knows but I think it's important to say out loud is yes, there have been tons of shifts, right? We've shifted society a million times. We've shifted from farms to cities, right? We, we all know all of these examples. But we ca- we've never had a time where we've expected the entire global workforce of knowledge workers to be retrained immediately on a new set of tools that didn't exist six months ago, right? And so there is an element where everyone needs to figure this out as we go along. So what did we start with as a company, right? Our first set of tools is just what do you have in your company, and are people flat out using it? You've spent all of this money. Are people using it? And what you find is, you know, 80-something percent of our customers find far more tools being used by their employees than they know about and they've licensed. That doesn't mean it was bad, by the way. Some of those tools are dangerous, and they should worry about that. Some of those tools are-- might be very popular, and they need to bring them into the fold and understand what's happening. But from an IT standpoint, you normally don't allow software to just be used across your organization with access to your organization's data and have no idea what's happening. We're letting that happen in AI all the time, and I don't really say that to our customers as a fear sell. It's to be expected. Things are moving quickly. You have to know what's going on. So we start with the baseline of just flat out what's happening. The second set of things we try and solve is how do we get people using this stuff more in a productive way on the AI side, on the agent side? How do we get people using this in their workflow? I'm a marketer working at General Mills or something like that, right? I'm a marketer working at General Mills. How is General Mills going to help me use these tools? And what I've generally found with employees, if you really wanna drive employee usage of tools, you have to make them feel safe so they won't look dumb, and you have to make them understand that they can use this safely without getting fired. Because again, it's one thing if you're 22 years old and you've been using these tools effectively your entire life since, you know, high school. But if you're a 42-year-old person who's been, you know, had a 20-something-year career and you're working in your job every day, and by the way, you also have things you do at home, and you have business travel. You have all of these things you have to do. Also, you have to become an AI expert. You really would like to not look dumb, and you'd like to accidentally not upload the wrong data and get yourself fired. This is actually a bigger issue in some countries where there's a bunch of EU regulations around AI that do matter, and if I'm an employee at a company, I don't want to look dumb. So if I'm a CFO, we bought all these tools. What did we actually buy, number one?

    2. AR

      Right.

    3. RF

      Number two, how do we get people actually using these tools? Because the usage on these tools in the enterprise is less than people would think today-

    4. AR

      Mm-hmm

    5. RF

      ... which makes sense, by the way. I'm gonna get to the productivity thing in a second. But, you know, anyone listening to this, if you've ever been a part of any software rollout at any enterprise ever, a very boring but very important question is how do we drive actual usage? And sure, everybody uses email. People use Workday, 'cause if you don't use Workday, you're gonna get fired, right? You're not gonna get your paycheck. But most enterprise software, your intranet software from SharePoint, things like that, are used by a relatively small set of the population that you wish were using it. And so if the goal is to get people more productive using AI tools, you want to drive actual employee engagement.

    6. AR

      Right.

    7. RF

      So we built a suite of tools around that. And then you have to get into productivity, which is did this get people actually more productive? Is my organization actually more productive? So today I, I know where I wanna go with Larridin. What I like to think about today is what we're doing today on the productivity side is not as far as I'd like it to go, but it's certainly better than anything that exists in the market. And so what we're doing today is we're marrying the behavioral data that no one else has, which is, is Alex a heavy user of ChatGPT or not? Just flat out. We're, we're not doing it at the individual level, but we'll use that example for the podcast 'cause we have to worry about the employee privacy concerns that companies have for their own employees. But at the end of the day, I wanna understandDid my users in the legal department that were using this expensive legal tool I bought-

    8. AR

      Right

    9. RF

      ... are they more productive than my users in the legal department that are not? Because what I've definitely done is I've driven up my OpEx.

    10. AR

      Right.

    11. RF

      I've bought this software, I've driven up my OpEx, but are they more productive? Are my marketers that are using Claude or ChatGPT actually more productive?

    12. AR

      And how do you measure that?

    13. RF

      So today we do it the only way productivity research has ever existed so far, which is we take the normal productivity survey market research that people have done for 50 years, not ideal, but it is the gold standard. It's McKinsey, it's Towers Watson, it's Accenture, and we lay on top of it proprietary data that other folks don't have, which is actual usage. So the way I think of it is, the worst way to measure productivity is I'm gonna send a survey to my employees and say, "Do you feel more productive today from using ChatGPT?" First of all, there's a definition issue. Second of all, people are gonna answer the way you hope they'll answer. But third, you have no idea if they're actually using the tools.

    14. AR

      Right.

    15. RF

      So a better way to do that, I learned this years ago at comScore. I-- one of the things, one of the many things I did at comScore is I ran our survey market research group, and one of the reasons the comScore surveys were great is we had the behavioral data married with the actual survey responses. We're doing the same thing here. Where I ultimately would like to get to is full passive measurement on productivity. The truth with that is for enterprises, that's gonna require a level of additional data sharing that we're not getting yet from customers. We, we will eventually get there.

    16. AR

      But to kind of, like, put a finer point on this, um, so I'm a lawyer.

    17. RF

      Mm-hmm.

  7. 13:5417:46

    The Productivity Baseline Problem

    1. AR

      I work at, you know, at, at some big company. Um, you know, productivity to a certain extent, like, if I only have to work four hours a day versus eight hours a day, like, that's great for me.

    2. RF

      Mm-hmm.

    3. AR

      Like, I kinda feel like it's a win because I, I often think about, like, the principal-agent problem, right?

    4. RF

      Sure.

    5. AR

      So, uh, everybody is an agent, and then there's the ethereal being of the corporation, which is the principal, and it's like, you know, yeah, I guess if I own stock in my corporation, I want it to be more profitable.

    6. RF

      Sure.

    7. AR

      But really I wanna work as little as possible and get paid as much as possible. Like, that's kind of every individual agent's job.

    8. RF

      Right.

    9. AR

      And then you have these tools, so, like, theoretically it's like everybody's gonna adopt these things if they get to be lazier.

    10. RF

      Yep, yep.

    11. AR

      Like, everybody wants to be lazier.

    12. RF

      Sure.

    13. AR

      Right? They wanna be lazier and richer.

    14. RF

      Yes.

    15. AR

      I feel like these are, like, the universal, like, kind of human conditions. Like-

    16. RF

      There's some small set that want promotions, but I agree for 90%

    17. AR

      But it's richer, right?

    18. RF

      Yeah. That's true. That's true.

    19. AR

      So, like, if you can get the promotion by doing less work-

    20. RF

      Sure

    21. AR

      ... I'm sure people would opt for that. But I guess, like, how... Like, think about everybody will use these tools or, like, I think I was telling you this sad story because our kids go to the same school.

    22. RF

      Yeah.

    23. AR

      It's like younger kid gets busted cheating-

    24. RF

      [chuckles]

    25. AR

      ... right, with ChatGPT. Like, clearly productivity gain for him.

    26. RF

      Right.

    27. AR

      Right? Because it allowed him to be lazier and, you know, r-richer with his video game time-

    28. RF

      Sure

    29. AR

      ... until we confiscated his phone. Um, but-

    30. RF

      But also a set of rules that you can get in trouble for.

  8. 17:4620:27

    Defining and Measuring Productivity

    1. RF

      FTE versus 2,000 FTE, and AI's gonna break all of that for, for sure. And so our main goal today is just to build the baseline for our customers, which is at the end of the day, are the people using these tools fundamentally more productive than the folks that aren't? Layer on top of that tonnage of amount of time worked.

    2. AR

      Mm.

    3. RF

      You can get a pretty good... It's never perfect. People are on vacation. You have to measure this as groups, right? Any given person was out sick one day or was on a flight one day or was at a training one day that it's impossible to measure, and you, you... It seems from a systems standpoint they weren't working. They actually were working. They were doing a training, right? So think of this as at the aggregate data. It's never useful. None of this data is ever useful at the Russ Fradin level.

    4. AR

      Right.

    5. RF

      I mean, to get existential, was I productive yesterday? It's, is unknowable. I, I can't know if I was productive yesterday.

    6. AR

      I, I think you were. I, I-

    7. RF

      Let... I, I was all for it. But what we're trying to do at the systems level for companies is understand is there some correlation between specific use of these tools on an advanced side, light side, heavy sideHe-heavy user of the tool-

    8. AR

      Yeah

    9. RF

      ... lighter user of the tool. Were the u- were the users more productive in their job? Were the employees more productive in their job? And then measure on top of that amount of time those segments of workers were actually working. 'Cause the goal if I'm a CFO today is not to understand did Ben do a good job and did Tina do a good job. The goal is to understand I have definitely been asked to spend 50% more on OpEx.

    10. AR

      Right.

    11. RF

      Did I drive something?

    12. AR

      Yeah.

    13. RF

      Right? And, and then by the way, there are interesting questions. We know this around staffing size and will companies get more done because people will actually work eight hours?

    14. AR

      Yep.

    15. RF

      Look, it will turn out it-- I suspect it is true that this is one of the things managers do. I suspect it is true over time if it becomes clear that all of your employees are now working four hours a day instead of eight, you will probably decide to have fewer employees and-

    16. AR

      Right

    17. RF

      ... they will work, the remaining employees will work six hours a day. So I'm not sure I really buy in the next couple of years you will see people in large companies actually just working half as much. You know, sole proprietors i-is what it is. Like I, if I were a sole proprietor lawyer, kind of my only measure of productivity today is to myself anyway, right?

    18. AR

      Right.

    19. RF

      It's how hard do I wanna work for and how much money do I wanna make?

    20. AR

      Well, there the principle is the agent.

    21. RF

      Right. So that's fine.

    22. AR

      This is why it's like yeah... But this is, this is why it's so important, and this is why, I mean, candidly, I love what you do.

    23. RF

      Sure.

    24. AR

      Obviously, I love what you do. That's why you're here. Um, but, uh, you-- there is no baseline. Like it's like-

    25. RF

      Right

    26. AR

      ... did this work? Well, first you have to know how, like, you have to define the outputs. You have the inputs-

    27. RF

      Right

    28. AR

      ... which are largely just like time and money.

    29. RF

      Right.

    30. AR

      Um, and then you have the outputs. And part of it is actually it is

  9. 20:2721:41

    Goodhart’s Law & the Pitfalls of Metrics

    1. AR

      kinda complicated to come up with an output. Like, uh-

    2. RF

      For sure

    3. AR

      ... do you know, uh, Goodhart's law?

    4. RF

      Uh, go ahead.

    5. AR

      So Goodhart's law, I lo- I love this one. It's like when a target becomes a measure... Sorry, when a measure becomes a target-

    6. RF

      Yes

    7. AR

      ... it is no longer accurate as a measure.

    8. RF

      Yes.

    9. AR

      Right? So if I say, "Okay, I'm gonna judge you based on... I'm gonna..." Like, how many emails are sent every day? Well, that's a measure. But once it becomes a target, it's like, "I want you to send more emails," well, you're no longer m- Like, the measurement gets-

    10. RF

      Sure

    11. AR

      ... corrupted-

    12. RF

      Th-this is p-p-

    13. AR

      ... because, because now, now people decide to do more things to hit this target, and it's no longer an objective measure. So, you know, part of it is if I'm trying to figure out like, okay, there's a product called Harvey.

    14. RF

      Right.

    15. AR

      A lot of people love Harvey, and it seems to make people a lot more productive, but compared to what?

    16. RF

      Right. And so to me, the only way you answer that... Let, we'll talk about Harvey. Nothing against Harvey. I'm sure Harvey's amazing. Uh, to me, the only way to really understand this, and that's why I think the traditional way companies are doing this just doesn't work at all, which is, hey, let's survey the people that use Harvey and ask them if they were productive. And by the way, they will all say yes because no one ever answers they weren't, number one. And number two, uh, my boss paid for the product. I'm-

    17. AR

      Right

    18. RF

      ... I'm gonna say it was a good product, right? Unless we all universally hate it, which I assume is not true of Harvey 'cause everyone seems to like Harvey, so that's wonderful. So I think all you can

  10. 21:4124:18

    The Harvey Example: Usage vs. Value

    1. RF

      actually do is... It's why I think the traditional way of measuring this is broken. Look, it's why we started LearnIt. All you can really do is understand without asking people how much usage of Harvey are these people actually doing, right? We have five people, we have six people, whatever they'd say on a survey. Two have never logged in, right? We've all seen the joke about, you know, your project is due, it's due in an hour, you said you were caught up, and then you, "Oh, shit, I have to ask permission for this Google Doc," right? So there's two of the six, I'm making these numbers up of course, two of the six people actually signed up for Harvey the day they were told and then never went back to it at all. They're very happy with the way they work. They work that way all day, every day. Two of the six log in and use it a little bit, and two of the six use it all the time. The only way I can even begin to understand if that software is valuable is by knowing that data passively-

    2. AR

      Yeah

    3. RF

      ... without asking those folks a question.

    4. AR

      Yeah.

    5. RF

      And then asking everyone the same questions about productivity and measure it with amount of work actually output. And if I take those three things together, then I can begin to form an understanding of was Harvey useful.

    6. AR

      Right.

    7. RF

      You and I had a discussion with someone, uh, where they were talking about one of the ways they m- uh, incent their engineers at their company is they have a leaderboard of the amount of money each engineer spends on Claude Code. And the founder was talking about how, uh, he went to one of his best engineers and said, "I don't understand what's happening. You're one of our best engineers. Why aren't you spending m- any money with, uh, Cursor?" I'm sorry, not Claude Code. "Why aren't you spending m- any money with Cursor? I, I really don't get what's going on." And so that, that was an example of for these companies where they're very developer-heavy-

    8. AR

      Right

    9. RF

      ... you probably don't need us. If you're a very developer-heavy company, probably measuring amount of money spent on Cursor plus your kind of normal management understanding of is this person actually working? If they come in for two hours a day, you may be happy with that, you may not. That's gonna be company specific and lifestyle specific and culture specific. But you're in the office, I see you're there. You're not spending any amount cur- money on Cursor. What's up, right?

    10. AR

      Right.

    11. RF

      We have these metrics. The issue, though, is we see this explosion of there's hundreds of AI tools, and companies have hundreds of roles. And so that's why we wanna try and replace, you know, the McKinsey Corporate Health Index with Tows Watson or the Accenture surveys with some real useful data around AI. But I think that kind of Cursor example really crystallized in my mind what you'd wanna be able to do for a whole company, which is how much did this person work? So I have that quali-- you know, I have that quantitative judgment. Qualitatively as a manager, right, we're not replacing this, did they do a good job? And then fundamentally, did they use the tools? And when you take those three things together, that's the only way you're gonna have measurement. And like I said, when you think about my, you know,

  11. 24:1827:38

    Surveys vs. Behavioral Data

    1. RF

      micro world of if you really think JP Morgan's gonna go from spending 18 billion a year in IT to 30 billion or 40 billion, the CFO's not just gonna say, "No problem," right? Today, our customer is the CIO. I think over time our customer becomes a partnership with the CIO and the CFO. The numbers are just big.

    2. AR

      Yeah.

    3. RF

      It's like cloud spend. They, the numbers are just so big people are going to pay attention. It's going way beyond experimental.

    4. AR

      But, and obviously the companies themselves, like if you ask any company that is trying to sell you anything and you ask them-

    5. RF

      Sure

    6. AR

      ... "Does your product work?"They will probably 99 times out of 99-

    7. RF

      Sure

    8. AR

      ... say like, "Of course it does."

    9. RF

      Sure.

    10. AR

      Right? That, like, it's the best, it's the best. You need to have an independent arbiter. Um, and that, that's where you guys come in. But kind of like double-clicking on this, this point before, it's almost like reinforcement learning at a company-wide level-

    11. RF

      Sure

    12. AR

      ... right, of what is the outcome that I'm looking for? And sometimes it's clear-

    13. RF

      Right

    14. AR

      ... right? So, um, and th- this is where the, the measurement and target thing is also-

    15. RF

      Sure

    16. AR

      ... relevant because it's like I want you to write more lines of code. Well, if that's... There's a measurement of, like, how many lines of code were written-

    17. RF

      Sure

    18. AR

      ... but if it becomes the target, then you're just, like, writing gobbledygook code and, like, you're... For sales, it's very easy.

    19. RF

      Right.

    20. AR

      I want you to sell more stuff, but there's a lot of latency between, like, you go talk to a customer, and then you go collect money. So you might have targets in between. You might have measurements in between.

    21. RF

      Sure.

    22. AR

      If you're a lawyer, draft more contracts. So I guess, how do you try to define the goals? Because some of them are just, like... It's kind of, I think of it as, like, background information that's going through. It's like emails that are being sent-

    23. RF

      Right

    24. AR

      ... or, you know, Slacks that were sent or Google Docs that were edited. Like, there are these key-- Like, there are these very, very clear measurements, but those aren't necessarily outputs.

    25. RF

      So first, your point on measurement, this is why I said earlier, if you think about any time true third-party measurement exists, there's this interesting dynamic, and we saw this at comScore, but everyone has seen this anytime they tried to build a third-party measurement company. Omniture saw this in the early days. Google at some point fought it and then actually bought Urchin and built Google Analytics, right?

    26. AR

      Right.

    27. RF

      Because it turned out it's actually good when your customers can track value if what you do is actually valuable.

    28. AR

      Right.

    29. RF

      And so my general perspective is I think today a lot of the AI companies probably look askance at us, but I think over time, certainly the AI tools that actually provide value are gonna love us, right? The way you will ultimately unlock real enterprise budget is because people believe these tools are actually valuable. So w- what we do today, and this is a journey, right? The company's about a year old. So what we do today is we work with all of our customers, say, "Look, here are the baseline productivity questions that are gold standard that people have asked for seventy years." You know, there's pros and cons to them, but this is-- You have to start somewhere. This is where we start. And let's define a set of metrics for each of your, uh, departments. One of the things we've found that actually seems to matter, not as a metric that companies share with their employees, 'cause then you have the Goodhart's law problem, but as an actual reality on the ground-

    30. AR

      Right

  12. 27:3830:00

    Interdepartmental Responsiveness & Real-World Metrics

    1. RF

      And so what we found is, one of the things we found is just almost an interdepartmental SLA, which is it turns out if I roll out these tools and I'm not firing employees, 'cause one way to look at this is could I fire half my lawyers? Turns out companies don't really like firing people. Companies do fire people if they have to, but I've actually never met a CFO that got excited about firing thirty percent of the workforce. Outside of call centers, that's a different issue we could talk about. Like, companies treat their call center employees different from the rest of their employees. But outside of call centers, I've never met a CFO who is... If you went to a CFO and said, "You can fire half your FP&A people," he doesn't wanna fire Tina. He knows Tina. He's met Tina's husband and children. Like, he doesn't wanna fire Tina. He'd like Tina to be happier and more productive, and actually, he'd like her to do a great job and never quit, right? Companies don't really like churn. So one of the metrics we found that people seem quite excited about is just did this raise or lower the interdepartmental responsiveness? So our measure would be, am I now comfortable sending more things to legal, right? If I'm gonna keep my legal department the same size, I'm not gonna start suing more people. We're talking about companies here, not law firms, where it's a different measure of productivity, right? They're cost centers, not profit centers. So one thing to do it is did over time, because my lawyers are now more productive, are other departments asking them more questions? Are they getting their responses faster? When I'm in product and I'm asking for input from engineers, are they responding more quickly, right? That is a, that is a good way for me to see behaviorally we become more productive that's not lines of code. Now, by the way, I agree, if you expose the metric and say, "Hey, you better be responsive," people can lie. They can-

    2. AR

      Yeah, yeah

    3. RF

      ... send Slack messages back and forth. But what I'd really like to understand is, as a map, which of my departments use these tools more, and do they become more responsive to my other departments? 'Cause there's an element of when you're at a big company, people know this. It's one of the reasons small companies do so well in innovation. There's just a giant coordination problem for all of these companies, and we know this. And, you know, in Silicon Valley, it's fun to make fun of these companies, but actually every pr- entrepreneur's secret dream is to become so large that they have a giant-

    4. AR

      Right

    5. RF

      ... bureaucratic company.

    6. AR

      Right.

    7. RF

      Of course. Google did not plan to have a giant bureaucracy thirty years ago. They just became so successful, they now do have a giant bureaucracy.

    8. AR

      Right. And, uh, you know, kinda that, that's kind of a good segue into perhaps the, the state of A-AI enterprise, right? So you went on this whole, like, list... You talked about three hundred and fifty people?

    9. RF

      [clears throat] Yeah. We, we interviewed-

    10. AR

      That's a, that's a large number of people

    11. RF

      ... three hundred and fifty heads of IT at major companies.

    12. AR

      Um, and a-across the whole, the whole gamut,

  13. 30:0032:59

    Enterprise AI Adoption: What the Data Shows

    1. AR

      right?

    2. RF

      Yeah. Yeah, yeah.

    3. AR

      It was- it wasn't just, uh, you know, kind of Silicon Valley companies that-

    4. RF

      No, not a, not a... I mean, in all honesty, my whole career, basically, I spent a couple years helping my friend at Carbon, and I spent a year trying to fix Wine.com. But other than that, my whole career has been selling software to large companies, mostly large companies or older companies.

    5. AR

      Right.

    6. RF

      Yes, there's the occasional Silicon Valley company that grows very quickly, but if you're in the Fortune 500, you are going to be twenty-plus years old ninety-nine percent of the time, right? And so if you're gonna sell to someone with more than a thousand employees, they're almost by definition an older company.

    7. AR

      Yeah. So what-- May-maybe give us the highlights of, of what you learned.

    8. RF

      Sure. We, we saw a bunch of different things, and, you know, people have seen this before. I, I actually don't think of this... You'll see people turn this into kind of clickbaity fear-mongering things. I don't, I don't really think of it that way. So first of all, we saw, like, this-- we know this from Gartner, this, like, seven hundred billion dollars being spent in enterprise AI. It's growing very, very quickly. It's gonna keep growing quickly. And one of the things we found is something like seventy percent of leaders we talked to saidWe are sure we are wasting money here. It's being spent so quickly. And by the way, shame on us, we had no system to measure this in the first place. I'll get back to the report in a second, but I was talking to a customer today. Uh, why did we sign them as a customer? They're a very profitable business owned by a PE firm, and their bosses, the p- their PE owners, gave them five things they had to do this year, and one of the five was adopt AI across the organization. And he said, "Every board meeting I go in for my other four metrics, I have some report of how are we doing against those reports. And on AI, all I have is the amount of stuff we bought."

    9. AR

      Right.

    10. RF

      It, it's, it's not-

    11. AR

      So yes.

    12. RF

      Yeah, yes.

    13. AR

      We adopted AI.

    14. RF

      Yes, I'm doing great, but it turns out-

    15. AR

      We have, we have a large family of AI. We adopted all these AI children.

    16. RF

      Yeah, we bought all of it.

    17. AR

      Yes.

    18. RF

      It's all great, but it turns out we wanna actually do it. And so what we found is these leaders like maybe they are right that 70% of their projects are failing. Regardless if they're right, it's a giant problem they feel that way because they have no system to figure it out in the first place. No one believes 75% of their ad spend is failing. It's not because their ad planners are smarter than their AI buyers. It's because there are 20 years of systems in place to help me understand when I buy this ad campaign, when I spend this money, when I do this app install, whatever it is, did it actually drive value for me? And we just don't really have that in AI, like I said, outside of some very, very specific verticals. And so really the biggest thing we found was... It, it was kind of three things. One, you saw the AI spend. Two, something like, as I said, they believe 70-something percent of AI projects are wasted. But the other thing we found is basically 80, 85%, I can't remember, 80, 85% of the companies we talked to said they really believe they only have the next 18 months to either become a leader or fall behind. So I think one of the things, one of the reasons you've seen this giant unlock in budget is there's tremendous anxiety at these enterprises going like, "We're going to lose if we don't adopt this stuff," yet so we're adopting it quickly. We have no particular idea if it's succeeding. Our employees aren't really using it. By the way, a forgotten group in the company for all of this AI, and, uh,

  14. 32:5937:31

    Employee Anxiety & Training Gaps

    1. RF

      for my last company, we built a very, very large HR, uh, technology company. Uh, we sold into heads of HR, touched all the employees in the company, but we sold into heads of HR. And so as we've talked to a lot of our old customers who aren't really our customers today, but they're influencers, what they will all say at all of these large companies is, "Hey, our employees are really worried." It's not even they're worried they're gonna lose their job. Ev-there's a base level of worry about AI and the economy, all that stuff. It's not even they're worried they're gonna lose their job. It's just they're getting told to use a new system all day, every day, right? Generally, if you work in a large company, there's one or two new systems initiatives a year. Now there's 20 new tools.

    2. AR

      Yeah.

    3. RF

      They don't know, they don't know what they're allowed to do, and they have no training. How do they actually... How do I get people using these tools? And so you have this weird w- you have this weird, almost perfect storm. It's why we're excited about Larridin. It's why you're excited about Larridin. You have this perfect storm of tremendous growth in budget, tremendous anxiety that none of it is working, tremendous anxiety from their employees about what they're even allowed to do. And so what we're trying to do is, I don't think we solve all of that, that would be an absurd thing to say, but I think we really help with all of that about, like, what is your plan to measure this in the first place? Did anyone use it? Did they become more productive when they did? How do you give them the tools to use it more?

    4. AR

      Yeah. Well, and that, that kind of last point is super interesting as well because it's like there's the did it work, how well did it work, you know, what are the measurements, make sure that the measurements don't become targets-

    5. RF

      Right

    6. AR

      ... like all the stuff that we just talked about. And then to use the metaphor of my, my son who cheated on his math homework, um, there are people that are just like, wow, like they're, they're the go-getters in the company.

    7. RF

      Sure.

    8. AR

      This is actually why I am convinced that AI is under-hyped.

    9. RF

      Yes.

    10. AR

      Uh, you know, we have our little group chat where we have another friend who's like, "Oh, all this stuff is over-hyped and it's going to zero." No, no, no.

    11. RF

      Totally wrong. Every time I use AI-

    12. AR

      Totally wrong

    13. RF

      ... it's amazing.

    14. AR

      Because you go... It does, it has not diffused. You, you have like the 19-year-old kid-

    15. RF

      Yes

    16. AR

      ... or, you know, my, my 13-year-old son who's like, "Wow, normally homework would take me two hours."

    17. RF

      Right.

    18. AR

      "Now it takes me one second."

    19. RF

      Right. It's amazing.

    20. AR

      Right? And obviously that's bad, right?

    21. RF

      Sure.

    22. AR

      Like I'm not using him as the, uh-

    23. RF

      Sure

    24. AR

      ... that's why we confiscated his iPhone, right?

    25. RF

      Sure.

    26. AR

      But there are these productivity unlocks where it's probably not gonna happen top-down.

    27. RF

      Sure.

    28. AR

      It's like somebody in the company, and sometimes again, I, I, not to like oversimplify human behavior, but it's like I wanna be lazy and I wanna be rich.

    29. RF

      Yes.

    30. AR

      Right? Like these are the two things that are motivating people, and like I found this tool that allows me to be lazier and richer that actually helps the company.

  15. 37:3141:08

    The Nexus Product & Safe AI Usage

    1. RF

      with this Nexus product is effectively a product where we said... Or I'll, I'll, I'll use an anecdote. I was in the UK in July, uh, and, uh, I went on a bunch of sales calls, and I was talking to someone at a bank, very large, very reg- European bank is among the most regulated folks in the world, least, you know, fast to adopt new technology for, for good reasons, honestly. And they were telling me a story about how they had a, it was a 28-year-old guy, I don't remember what level that makes you in investment banks, so let's say a director, but I don't remember. 28-year-old guy who was using ChatGPT really, really well in the investment banking side of the business. And they had him create a 30-slide deck, and they did a global call for everyone in the investment bank for this guy to spend an hour walking people through how to use ChatGPT.

    2. AR

      Yeah.

    3. RF

      I'm sure that was very cool for him, but that's absurd. That's an absurd way to hope people adopt world-changing technology. Another absurd thing to do is to go out and buy some LMS course that HR is gonna buy that, you know, the secret to a lot of LMS is other than things you must do or you will lose your job, like sexual harassment training, HIPAA training in certain orders, no one, no one does it. They, they just don't go. And so how do I actually get people using these tools? And this was my point from earlier, is you wanna help them, A, not look dumb, and B, know they won't get fired. And so what we effectively did is built these wrappers that exist around the models, and so we don't tell people to use Claude or to use Gemini or to use ChatGPT.

    4. AR

      Right.

    5. RF

      Then the other thing we built, 'cause again, people were also worried about getting fired. They're worried about getting fired 'cause of the economy, 'cause of AI, 'cause whatever, it's a new tool. I would like to think I could get fired. By the way, when you're talking about European banks, there's a lot of regulation that is a legitimate concern of, if our employees do the wrong thing, we will get fined.

    6. AR

      Right.

    7. RF

      Forget whether you fire them. These companies don't wanna get fined. And so the other thing we did is we, we basically trained our own kind of customized Llama model to block people from asking questions that are illegal or the company doesn't want you to. And so we're not talking about hackers here. True bad actors in the company has plenty of security solutions. What we're really talking about is the X percent of the people who I'm in people ops in HR at a large company, I'm supposed to do a workforce analysis. Am I allowed to go into ChatGPT and load in our full employee database with race and gender? I don't know. I would like to not get fired. Maybe I'm allowed to and maybe I'm not. And by the way, I think it's incumbent on the company to say to our employees, "Here is a safe space. Nothing you can do here is going to get you fired." So we-- Oh, Alex, you're not allowed to up-- That has Social Security data. Don't, don't share that. You're not allowed to ask that prompt because in Europe, we're not allowed to use HR-- we're not allowed to use AI to write employee reviews. I don't know if that's a good law or a bad law. I, I didn't write the law. But there are companies that look at the EU AI regulations and say to themselves, "Our read of the regulation," I'm not gonna, you know, prosecute that, "our read of the regulation is we believe it's illegal, and we will get fined-

    8. AR

      Yeah

    9. RF

      ... if our employees use AI tools to do employee reviews." So great, if I am a European-based company and I want my employees using AI, I have to block them from using it for those use cases. And so what we've tried to build is this almost like harness to say, "You can be more productive. You're not gonna look dumb. You're gonna be more productive, and you're not gonna make any mistakes that get you fired." And so what we found is that actually drives more AI usage, surprising literally no one. And from a company standpoint, what do you want? A, I want the usage, and B, I wanna build up that IP of what really works for my company. It's a total unlock. And same thing on the coding side, right? Uh, you know, Cursor has taken mediocre engineers and made them good, but it's taking amazing engineers and made them gods, right? And so our goal should be how do we help people get much more productive with all of this? How do we help them use Cursor more effectively, Harvey more effectively? We started with

  16. 41:0843:40

    The Future of Work: Job Loss or Job Creation?

    1. RF

      all of the LLMs more effectively.

    2. AR

      Yep. Um, so maybe we could talk, I mean, this is a little bit philosophical, but future of work. Um, because to a certain extent, like, all right, you're, you're the me- like, if you're the measurement-

    3. RF

      Sure

    4. AR

      ... like, the measurement inevitably will become a little bit more of a target.

    5. RF

      Mm-hmm.

    6. AR

      Um, and I, I always like to kinda remind people that I think it was 97, 98% of Americans when the Constitution was ratified were farmers.

    7. RF

      Right.

    8. AR

      And they all lost their jobs, um, due to these pesky things-

    9. RF

      And all worked out okay

    10. AR

      ... like the tractor and-

    11. RF

      Right

    12. AR

      ... fertilizer and all these things, and l- I think the, the average, uh, life expectancy was, like, 35, and-

    13. RF

      Right

    14. AR

      ... most children died in childbirth or shortly thereafter. It's like, you know, we, w- things have changed-

    15. RF

      Right

    16. AR

      ... but this is what, uh, this is what technology brings you. Um, I mean, nobody knows the answer to this, but given that you're, you're in char-

    17. RF

      Sure

    18. AR

      ... you're in charge of a company that's, that's measuring AI productivity and human productivity and kind of AI and, and humans working together, I mean, what, what's your timetable for, like, how fast things change? Are we going to see, you know, net new jobs created? Like every-- And by the way, like-

    19. RF

      Sure

    20. AR

      ... behind every one of these, there are all sorts of jobs that start becoming around that didn't exist before. So maybe that's kind of part two of the question, because, like, the job that we have right now, like, you know, filming a podcast-

    21. RF

      Sure

    22. AR

      ... like, that wasn't a job like 200 years... Like, there's so many jobs that just, like, nobody could even think of.

    23. RF

      Of course.

    24. AR

      So, so I guess, like, where do you think things are going, and, like, what types of, maybe to put a nuance on it, like, what types of, like, future jobs do you see in and around this, like, new stuff?

    25. RF

      So I don't buy for a second there's gonna be large-scale job loss because of AI, f- frankly, because of what we've seen through all of history, which is just flat-out capitalism. If my two choices are I can maintain my base level of productivity, but fire a bunch of my employees and be more profitable, that is a fine idea in the short term. If I'm-- That's probably a good idea for a PE firm to go along and go around and buy a bunch of m- minorly profitable companies, fire half their employees, and make them more profitable, but that's what PE firms have done for a long time for non-competitive companies anyway, yet employment has still increased, right? So you can argue we've always had a func- or for the last fif-40 years you can argue we've had a function whose goal is to take underperforming companies and fire a bunch of employees, right? And let's, let's say that that's what PE firms have done and that's, you know, what AI could theoretically do, yet employment has increased. So I, I don't buy an AI... And look, it's philosophical and, you know, I don't have any special expertise 'cause I am building a measurement company. But I don't buy it because your competitor across the street is not gonna fire all those employees. He's just gonna do more with those employees and he's gonna

  17. 43:4052:45

    The Competitive Advantage of AI

    1. RF

      kill your business, right? I mean, this is the, um, Jeff Bezos "your margin is my opportunity" line. To the extent that AI is going to drive up your margin, that will be all of your competitor's opportunity to be less profitable and compete with you. So i- other than some very niche, monopolistic, I can fire everybody, you know-

    2. AR

      Right

    3. RF

      ... one-man firm, like, will we have one-woman firms that do a billion in revenue? Probably. But today we have very profitable, you know, one-man, one-woman operations. Not many people work at the Joe Rogan podcast. I, I don't think that many people work for Ben Thompson Incorporated, and yet I imagine those are quite profitable businesses-

    4. AR

      Right

    5. RF

      ... the best I can tell. So that, that, that's amazing, and there'll be a ton of opportunity to be more successful solo entrepreneur, so I absolutely believe there'll be even more entrepreneurs. But at a very high level, I just don't believe the Fortune 500 will employ fewer people in 30 years than they do today, because the ones that try and cut all the people will no longer be in the Fortune 500. So I just flatly... Because we live in a competitive world, it's w- we haven't seen any proof yet-

    6. AR

      Yeah

    7. RF

      ... that the economy is zero-sum, right? W- maybe, right, you can argue that, but we haven't seen any proof yet. GDP keeps increasing. It increases slower in some places and faster in other places, but it's generally grown. Employment has generally grown. I just don't know why you'd believe that this time is different, because the competitive point of view. I-- The tech is different. The tech is amazing, but fundamentally what will almost definitively happen, there is an interesting theoretical question that, you know, is more like a, you know, I don't know, a Ivy League grad school, you know, discussion about wouldn't it be more fun as a society, wouldn't we all be happier if everyone agreed we'd work half as much and be just as productive as we are today? I don't know, maybe, but that's not human nature, right? And so I'm not even sure that's true. I, I tend to believe in the Tyler Cowen point that all that really matters is growth. And so my general perspective is y- you as a VC would just never get excited if one of your companies came in here and said, "Hey, we got to 100 million in revenue." And you know why? Because AI tools are so good, we're gonna fire 90% of our employees and we're gonna make 90 million in profit. You would not be excited with that entrepreneur because you know that Sequoia is gonna fund a direct competitor to that company who's gonna keep hiring-

    8. AR

      Yeah

    9. RF

      ... who's gonna be happy with 10% margins, and is gonna destroy your company. And we, we all know this, so I-

    10. AR

      Right

    11. RF

      ... I don't... It's one of these things of, like, you know, there's a lot of fun headlines about, oh, AI, and then you have to have the counterpoint of, oh, it's gonna take the jobs, and oh, kids these days. I don't know, like, when you... We, we all know this. We've all seen this. You can find articles about when the TV came out, it was the end of reading. When newspapers came out, it was the end of conversation. So I do think it is scary that new tools are coming out and it is impacting the entire globe of all knowledge workers everywhere. So what? So I think there'll be opportunities to be podcasters. There probably will be more plumbers. There will be a lot more employment around building data centers, right? There's going to be a whole set of engineers. Maybe we will ha- need a lot more astronauts. Elon says we're going to Mars. Like, someone is going to have to scrub the toilets in the space station, and someone is going to have to pilot the plane, to pilot the ship to the space station.

    12. AR

      Well, it's the self-driving-

    13. RF

      Yeah

    14. AR

      ... s- s- self, self-driving spaceships. Um-

    15. RF

      So, uh, by the way, there is a chance I will turn out to be wrong, and in that case, I don't know, uh, maybe I'll spend more time on vacation.

    16. AR

      Well, it's interesting. Uh, I, I talked to this economist, Ed Glaeser, um, uh, I think he's at Harvard, and he was saying... Uh, I, I asked him this question.

    17. RF

      Sure.

    18. AR

      It's like, you know, "What, what's gonna happen with jobs, and, you know, how do you compare this to everything else?" He's like, "Well, what's really interesting is that this is arguably the first time that the job losses might be borne by, like, white collar-

    19. RF

      Sure

    20. AR

      ... super educated people."

    21. RF

      That's why everybody gets scared.

    22. AR

      Well, but, but so he actually had a different framing on it. So, so yes, agreed, but, uh, almost tautologically, hyper-educated people are hyper-educated-

    23. RF

      Sure

    24. AR

      ... so should be able to rejigger themselves and do something else, versus in all of these previous revolutions where it's like you have somebody that really has no skills-

    25. RF

      Right

    26. AR

      ... and just, like, showed up at work with no skills and got paid.

    27. RF

      Yes.

    28. AR

      And there are a lot of jobs that look like that when there's tremendous labor shortages.

    29. RF

      Yep.

    30. AR

      So if you were doing anything in 1849-

  18. 52:4554:00

    The Product Marketing Problem in AI

    1. AR

      what can be done, and, like, the things that have really kind of gone hypergrowth, it's like, oh, like, I have AI, it does everything.

    2. RF

      Right.

    3. AR

      Oh, I will help you code a hundred times better.

    4. RF

      I will help you code better.

    5. AR

      Oh, I want that.

    6. RF

      I have this chatbot for... Yeah, look, a long, long time ago, but it's, it's funny when you get old. Uh, a long, long time ago, I was, like I said, I was the first guy at comScore, and comScore's sales pitch in the early days, comScore, for those that don't know, right, basically had all the data for everything that was happening on the internet. And so the founders were true geniuses, and they basically knew everything that was happening everywhere on the internet. And our sales pitch in the early days would be, "We know everything." I mean, obviously not, but would basically be like, "We know everything. What would you like to know?" And it turned out that wasn't a really good sales pitch. You would sometimes accidentally run into someone who would go, "Oh, my God, I need to know this. Could you do this?" And we'd say, "Yes, we could," and there you go. But it turned out we only had a couple sellers that could figure that out in real time. And then it turned out if we said, "We can tell you the market share for Visa versus MasterCard versus others in Japan," turns out Visa really wants to know that.

    7. AR

      Yeah, yeah.

    8. RF

      Uh, but I can also tell you the share for your pharmaceutical drug versus others in research online. Turns out they also want to know that.

    9. AR

      Right.

    10. RF

      Uh, after, I'm gonna get it wrong, but Ford had some giant issue with Bridgestone tires setting on fire. It turns out they

  19. 54:0056:58

    The Importance of Specific Use Cases

    1. RF

      really do wanna know that did employees... did search for Ford get worse because of Bridgestone, right? So people do wanna know these specifics, and like I said, I, I think that's exactly the right way to think about it is you need this product marketing problem. Look, it's why we're so focused on what's happening, are they more productive-

    2. AR

      Right

    3. RF

      ... how do you get them to use it more? We can actually do a lot of things, but you can't sell things that way. I mean, that's, that's more, like, general entrepreneurially advice.

    4. AR

      Right.

    5. RF

      But it turns out building something amazing that people don't know how to use mostly doesn't work, unless it does, which is ChatGPT, right? So one in a million times it does work out, Facebook, ChatGPT, on the consumer side.

    6. AR

      Well, just like there, it's just like it's magic.

    7. RF

      Yeah, it's magic.

    8. AR

      If you, if you show somebody a magic trick or you get somebody addicted-

    9. RF

      Right

    10. AR

      ... um, and y-you'll guess-

    11. RF

      Sure

    12. AR

      ... which one I'm referring to for, for which. But, um, the... If you ever watch Seinfeld-

    13. RF

      Yep

    14. AR

      ... there's this great episode where Jerry buys his father a Sharp Wizard, which was, like, an early PalmPilot ki-

    15. RF

      Oh

    16. AR

      ... It was, like, this early smart computer, like, in the 1990s. Never went on to, to great things, but it did everything.

    17. RF

      Right.

    18. AR

      It was like, you know, you could run these applications, and Jerry's trying to explain it to his dad, and he's like, "Well, I don't, I don't get it. What does it do?" He's like, "Well, like, look here. It has a tip calculator." He's like, "Oh, my God, a tip calculator?"

    19. RF

      Right.

    20. AR

      And then he explains it to all of his friends. He's like, "Look at this."

    21. RF

      This tip-

    22. AR

      "My, my son, he's a comedian. He's doing great. He got me a tip calculator." And Jerry's like, "No, it does other things." And it often ends up being frustrating for the company that does the other things-

    23. RF

      Sure

    24. AR

      ... because they aspire to have this, like, more broad horizontal platform. But what we kinda need is more of these, uh, these tip calculator things. Um, so I know, I know we're, we're-

    25. RF

      Yes, thank you. This has been a lot of fun.

    26. AR

      But actually, w-why don't we just, uh, is there anything that we haven't talked about that you wanna get in, like a little sol-soliloquy that you can, uh-

    27. RF

      No, I... Look, I think, Pete, I'll leave you with two thoughts, the one, one, one related to something you brought up in the conversation and the professor, but one related to Larridin. So look, my general perspective is anytime you see some giant shift in budget, you're going to build a set of very important but very boring tools. What's actually happening? Are people more productive? How do I get them to use it more? And, you know, there's, there's a ton of business there, and then I'll leave you with a... w-leave you with an unrelated thought to your, to your Harvard professor. So as you said, uh, uh, our kids go to the same school, and, uh, my oldest kid is in 12th grade and just got into college, and he got into his top choice, and he's very proud of himself, and it's a very highly rated school, and I'm very happy for him. And he came home and he said, "Dad, look at this ranking." And he showed me the new US News World Reports ranking that showed the different rankings. And, um, and I was like, uh, his name's Henry. I said, "Henry, I'm very proud of you. There's gonna be a lot of different rankings over a lot of different years, and there's only one thing you have to know for sure. Whatever the ranking says, everyone knows number one is Harvard."

    28. AR

      [laughs]

    29. RF

      "And so it doesn't matter. Don't get excited. Whatever it says, wherever it puts your school, everyone always knows whatever the ranking is, Harvard's number one." I did not go to Harvard. [upbeat music]

Episode duration: 57:07

Install uListen for AI-powered chat & search across the full episode — Get Full Transcript

Transcript of episode VMv00WR8EaA

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.

Add to Chrome