Skip to content
a16za16z

Box CEO: Why Big Companies Are Falling Behind on AI | a16z

Steven Sinofsky, board partner at a16z, Aaron Levie, CEO of Box, and Martin Casado, general partner at a16z, discuss the reality of AI inside enterprises. They cover the gap between Silicon Valley and the rest of the world, why most AI initiatives fail in large organizations, and how agents, infrastructure, and workflows are evolving beyond the hype. Timestamps: 00:00 - Trailer 01:05 - Introductions & The Silicon Valley vs Enterprise Gap 04:30 - Why Enterprise AI Efforts Keep Failing 09:16 - The Architectural Shift: Treating AI as a User, Not Software 14:38 - The Integration Wall Agents Can't Climb 20:12 - Should Agents Be Treated Like Humans? 24:40 - Salesforce Goes Headless & What It Means for SaaS 39:16 - Scale, Entropy & Why AI Coding Creates as Many Problems as It Solves 47:53 - Will AI Kill Jobs or Create More of Them? Resources: Follow Aaron Levie on X: https://twitter.com/levie Follow Steve Sinofsky on X: https://twitter.com/stevesi Follow Martin Casado on X: https://twitter.com/martin_casado Stay Updated: If you enjoyed this episode, be sure to like, subscribe, and share with your friends! Find a16z on X: https://twitter.com/a16z Find a16z on LinkedIn: https://www.linkedin.com/company/a16z Listen to the a16z Podcast on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX Listen to the a16z Podcast on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711 Follow our host: https://x.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see http://a16z.com/disclosures.

Aaron Levieguest
Apr 28, 202658mWatch on YouTube ↗

EVERY SPOKEN WORD

  1. 0:001:05

    Trailer

    1. SP

      So the board goes to the CEO and what does the board say? "We need more AI." [laughs]

    2. SP

      Yeah.

    3. SP

      And what does the CEO say? "Oh, okay. I'll get like a consultant to do more AI." And then they have some centralized project that nobody knows how it works. They haven't aligned their operations, and those things will fail.

    4. AL

      The funniest concept that the more code we write, the less we would need engineers, it'd be the opposite because n- now your systems are even more complex than before, which means that you're gonna be running into even more challenges of when you need to do a system upgrade or when there's downtime and you have to figure out like, what, well, how do I fix that problem, or when there's a security incident. I mean, we're just getting started with the jobs on this front.

    5. SP

      They're gonna hit a wall at integration.

    6. AL

      Yes.

    7. SP

      And, and this, the thing that's not different about AI, and that agents don't fix, that nothing fix, is that any enterprise of a thousand people or more or that's older than 10 years is just a mass of stuff that's sitting there waiting to be integrated. And, and you can't just say it's gonna integrate. AI actually doesn't help to integrate anything.

  2. 1:054:30

    Introductions & The Silicon Valley vs Enterprise Gap

    1. SP

      Hey, we are here monitoring the situation l- live, and we're very excited to talk about a bunch of AI stuff, and we have, uh, three of us are here today. Uh, there's me, Steven Sinofsky, and M- Martin Casado, who will wave and say hi. I'm Martin. And-

    2. SP

      Hello. Hi, Martin

    3. SP

      ... and Aaron Levie, who is, is working on the elevation of his hair today, so we're excited about that.

    4. AL

      I, it, it just keeps getting more vertical, and, uh, I thought I could kinda tame it, but it didn't work.

    5. SP

      A- and is that just a token issue or a parameter, number of parameters issue with the-

    6. AL

      [laughs] It is too many parameters. Too many parameters.

    7. SP

      Okay. I have the same thing, but in reverse. Okay. So-

    8. AL

      [laughs]

    9. SP

      [laughs]

    10. AL

      You... Hey, listen, you have a distilled model.

    11. SP

      There... Yeah. [laughs]

    12. AL

      Yeah.

    13. SP

      That's my... I run local.

    14. AL

      Yeah.

    15. SP

      So we had a lot of, uh, there's been a busy week of things, but we're- we wanna bubble it up a little bit and just start talking about where, where things are, are heading. Um, but I'll, I'll let... I- just kick it to you, Aaron, and you start where you are the most excited this moment because you have visited a ton of customers this week and have learned a lot. You've shared a lot on X, but I think you're the most in-the-trenches CEO who is really talking to customers every single day in the enterprise, which is what the three of us tend to look at the most.

    16. AL

      Yeah, I think my, uh, it feels like my job these days is just bring reality to the Valley and then bring the Valley to reality as, uh, as much as possible, and it's a, it is a kind of a crazy divide that, that, that exists at the moment. Um, you know, the past couple week-

    17. SP

      Well, so let's take a step back.

    18. AL

      Yeah.

    19. SP

      I actually think it's super interesting. What, what is it, what's the gap caused by? What's, what, what is that?

    20. AL

      The gap is caused by... Yeah. Well, I think the gap is, and M- Martin, I'm sure you see this, but I think the gap is caused by the styles of work that exist in Silicon Valley and in engineering roles versus sort of the rest of the world. So, and we've talked about this a couple times in, in different forms, but, but, you know, the, the technical aptitude of an engineer is just like insanely high. The level of wiredness to what's going on in the internet is insanely high. The, the ability to use your own tools and make your own choices is insanely high, and when things go wrong with the systems that you choose, you can just like quickly debug them and then make them sort of work for you. And then obviously you have all the benefits of just the models are really good at code and, and the work is verifiable. So you have like, you know, five or 10 things that make agents work in an enterprise context for engineering, or at least a, even a startup context for engineering, that, that tend to be a, th- there tends to be a gulf between the way you work that way in engineering and the rest of, of sort of knowledge work. And so, and so a lot of what I see is trying to figure out how do we kind of, you know, bottle up all of the greatness that is, you know, what we are seeing from coding agents, what we're seeing from agents that can use computers, um, to how do you bring that into the enterprise where the workflows are, are, you know, quite different. The users are less technical. The data is much more fragmented. The systems are much more legacy. And so that, that tends to be the divide. So it's not even that we're like talking past each other, like in a, in a, one of those kind of classic like government versus industry. It's, it's just literally like there is just a pure workflow and, and, and technology set divide and, and that's why it's gonna be, you know, a number of years for this sort of diffusion to, to roll from what we're seeing in Silicon Valley, what we're seeing as tech startups all around the world, into the rest of knowledge work.

  3. 4:309:16

    Why Enterprise AI Efforts Keep Failing

    1. SP

      Martin, just to build a... You have a ton of experience in big companies. I- one of the other issues, though, is scale.

    2. SP

      Yeah.

    3. SP

      And the, the way, the difference in scale that Silicon Valley operates at, at the startup level versus everyone else.

    4. SP

      Yeah. I al- I also think that, I mean, these secular trends, like the internet was like this, actually start with individuals, and big companies tend to make decisions centrally, and this is one of the fastest growing secular trends. So like, uh, there's probably a lot of individuals in big companies that are doing it where like-

    5. SP

      Yes

    6. SP

      ... the big companies themselves don't know even how to think about it. And so when you hear stats like, oh, like AT&T had this stat, like 95% of AI efforts in big companies fail. Like, that's clearly silly because I am sure everybody's using ChatGPT very effectively. What-

    7. SP

      Yes

    8. SP

      ... what they really should be saying is, you know, whatever. Like I, listen, I sit in these boards too, so the board goes to the CEO and what does the board say? "We need more AI." [laughs]

    9. SP

      Yeah.

    10. SP

      And what does the CEO say? "Oh, okay. I'll get like a consultant to do more AI." And then they have some centralized project that nobody knows how it works. They haven't aligned their operations, and those things will fail. And so I don't... You know, when we say scale, often we, we think about things like system scale or number of peoples. I think the secular trend is scaling wonderfully, which is being reflected in the numbers of these companies, but organizations don't know how to adjust these kind of, you know, age-old processes that have been, you know, worked on for a decade around, you know, data and governance and operations and compliance, et cetera. That's kind of right now where I think Aar- like Aaron is right between the secular trend and the, the organizational decision body. Uh, and this is something that we actually track very closely because we're starting to see now, I would say in the last few months, finally some real kind of inroads into the enterprise, but it's, it's, it's tepid because... And, and the last thing I'll say of this, one of the reasons is there's a lot of skepticism because the board wants AI, CEO AI failures have created some-... amount of bruising, which is, you know, you know, requiring these companies to get past it in order to do kind of the second go at it.

    11. AL

      Well-

    12. SP

      And so I think this is exactly where we are.

    13. AL

      Yeah, I, I, a hundred percent agree with that, which is that it's good to start with agreements because we, we know how quickly that fades, uh [laughs]

    14. SP

      [laughs] Because we'll disagree the rest of the show. Exactly.

    15. AL

      Yeah, exactly. Exactly. That's the only time we're gonna agree.

    16. SP

      [laughs]

    17. AL

      Um, I, I think maybe one more point on the board for agreements, maybe, maybe you guys would, would agree. Um, there, there's also this very interesting, um, dynamic. I, I would say this is a minor one relative to everything else. It's probably 5% of the problem. I, I think it'd be more fun to talk about the, the real problem, but, but there is a fun kind of, as an aside, there's a fun dynamic where, you know, you go to an engineering team classically for the past, you know, and, you know, Steven, you can take us back in, in history on this one, and one of, like, the easiest ways to stall a project was just getting the architecture, you know, kind of the, the fights on, you know, what language to use, what architecture path to go down. That could take months and months to kind of work through as your teams work through that.

    18. SP

      Yeah.

    19. AL

      Um, because of the pace of change in AI, um, you actually have this incredible dynamic where the, the labs, uh, you know, are, are obviously leapfrogging each other so frequently, but with, with not the exact same paradigm of how you should deploy agents and how they will work, and is the, i- is the, is the agent harness in the computer? Is it outside the computer? Do you run it in your cloud? Is it hosted? What tools does it have access to? Like, we are... Like, this is not a, a, a, a point where these are completely fungible technologies, and so that actually creates a, a, a bit of paralysis because now as an enterprise architecture team in the real world, you're like, "Man, like, what, what horse do I wanna, you know, kinda get behind, and, and which architecture path do I wanna get behind?" Because I've been burned by doing the wrong thing-

    20. SP

      Yeah

    21. AL

      ... in AI maybe three or four years ago, and I went down some path that now is deprecated or not the right strategy anymore. So, so to some extent, the speed of our change in, in tech actually reduces the ability for the tech to get diffused into the really, really important workflows because now you have a lot of paralysis in, in just making decisions. So, so I actually think it's kind of fine because there's still so much upgrade work people need to do in their infrastructure and their systems and their data, but this is kind of an interesting dynamic where I'll, I'll go have conversations with CIOs and their AI teams, and I'll say, "Hey, what, what are you using for your chat system or your, you know, core agent orchestration?" And they'll say, "Yeah, we're in the middle of a debate between these two or three paradigms."

    22. SP

      Right. Right.

    23. AL

      And it's... And, and you, and you hear that across almost every single customer because there is a little bit of a nervousness of, like, who do you get in bed with and, and how, how much do you sort of, you know, fully lock yourself into one particular path? And we also know that, that if you don't lock yourself into a path, it's always... Then, then you're building for this sort of duality which is, you know, also takes a lot of work architecturally.

    24. SP

      Oh, and actually-

  4. 9:1614:38

    The Architectural Shift: Treating AI as a User, Not Software

    1. AL

      Yeah

    2. SP

      ... I, so I, I, I hate to jump in, Steve.

    3. AL

      No.

    4. SP

      I just like, there's a, like... So Aaron is totally correct, and there's a, there's a very specific instance of this playing out in product companies right now.

    5. AL

      Mm-hmm.

    6. SP

      And I'll tell you what it is. So, so, so software product companies, um, you know, circa six months ago, they viewed integrating AI was like you're actually integrating it into the product, right? So everybody was, like, adding, like, whatever, this chat feature or, like, the... You know, and so it's kind of like this fusion or this hybrid model. What we're seeing instead is instead of viewing AI as software-

    7. AL

      Yes

    8. SP

      ... like, just view it as a user. And so [laughs] instead, like, take your product, make it a CLI tool, and then have the AI be an agent that actually uses this. You're not fusing the two. You're just making it more useful for AI. This is a very, very significant architectural and mental shift, right?

    9. AL

      Yes.

    10. SP

      And so we started as pure product, and then we didn't quite know what the end thing looked like, so we created this h- you know, this, you know, AI software hybrid that hasn't worked, and now we're kind of going to the agentic model, which basically means th- th- the agent is gonna be whatever. It's gonna be cloud code or whatever, and then my product now just should be something that can s- consumed by that, and, like, that's the actual modality. But, you know, within a year now, you've had to rearchitect your software twice. And so I think no matter... But many places that you look in the industry is having this dilemma of actually trying to figure out what the final form looks like. And Steven, you will remember. Remember all the hybrid versions of cloud? [laughs]

    11. AL

      [laughs] Yeah.

    12. SP

      Remember, like, you know, like, remote desktop and all these things? Like, I think we're kind of, like, speed running that evolution to the final form.

    13. AL

      Right, and I, and I think that, that people, uh, in Silicon Valley don't quite l- appreciate when a big company says, "Well, we have to map out our bet that we're gonna make."

    14. SP

      Yes.

    15. AL

      Because, like, that just seems stupid, and, you know, if you have... If your job history is, you know, five two-year stints at startups that went from seed to series A to acqui-hire or something-

    16. SP

      Yeah [laughs] you didn't learn anything

    17. AL

      ... you, you, well, you, you never... You, you don't... Your frame of reference is not, you know, picking an accounts payable system-

    18. SP

      Right

    19. AL

      ... that's gonna last 40 years.

    20. SP

      And living with the consequences. Yes. Right.

    21. AL

      Yeah, I, I actually, m- I have, like, all these visual aids today. So here's, like, the ultimate, the ultimate engineer if you're in Silicon Valley, is, is-

    22. SP

      Lower, lower, lower, lower, lower

    23. AL

      ... oh, lower, lower. Where?

    24. SP

      Yeah. Yeah, exactly.

    25. AL

      Yeah, yeah, is Guilfoyle.

    26. SP

      [laughs]

    27. AL

      And, and Guilfoyle is like, "I, I don't wanna talk to anyone."

    28. SP

      Yes.

    29. AL

      "And I, I will just write the code, and you go do your thing." And the, the thing is, is that you, you have people in, in enterprises that are saying, "I'm gonna use the model and do my thing," but they're only... They're gonna hit a wall at integration.

    30. SP

      Yes.

  5. 14:3820:12

    The Integration Wall Agents Can't Climb

    1. AL

      No, no, I, well, but we should, we should drill into your integration point, because I do think this is something for, you know, sort of some reality to settle in, in, in the Valley on, on the real world's sort of journey to fully being agentified, and what that's gonna take and what that's gonna look like. And, and your, your point about b- being passed to the different human, you know, based on the role that you need to interact with, you know, agents basically don't have any... There's no real exception yet for the agent having the same problem, because you basically, you know, as you pass through a different human, it's, it's a different set of access controls that, that, that that human has. And if an agent can sort of bypass any of those steps, then, then that's how you instantly get the security risks that, that, like, w- you, you need to kind of pass through those steps so that way you don't accidentally, you know, get to the wrong piece of information-

    2. SP

      Right

    3. AL

      ... and there's verification. And so there's a lot that, that you need to kind of build out for agents to be able to go and, and work with all these systems. And, and we've talked about this, but, like, most legacy environments don't have the most authoritative, you know, access controls. So you're always as a human going and saying, "Hey, Sally, can you share that thing with me that, that I don't have access to?" Or, "Hey, Bob, what's the number inside your data system for this question?" And so if agents just get the exact same permissions that you had, then they'll just run into these walls everywhere and they won't be able to complete the process. And unlike a human, they're not gonna know to go talk to Sally or ask the question of Bob, so they're gonna just be kind of s- you know, stuck. So what's gonna happen is you're gonna have a lot of agents that don't have access to the right data, um, they're, they're kind of working through systems that, that are, you know, not, not the real sources of truth for the information. They're getting the wrong number. They're getting the wrong document. So this is the real work that enterprises have to go through right now. The good news is that, that it's actually a great time, again, if you're a startup, because you can just, you get to know all the problems, uh, right at the, right out of the gate, so you can design your organizations, you know, to try and avoid this. But for big companies, there's real work that goes into, how do I upgrade my systems? How do I modernize my technology environment? How do I make sure that, you know, agents will have access to the right data, the right documents, the right context to be able to do their work? And that's sort of the, the, the work ahead. And, and there's, you know... I, I, there was this, uh, uh, you know, kind of headline of, of OpenAI working with, um, uh, in Codex, you know, working with Accenture, Deloitte, all, all the major system integrators, and there were some kinda, like, you know, snarky comments online around it, um, that, that I was fascinated by because it sort of sh- showed how, uh, h- how maybe, you know, great that divide is from the rest of the world versus those in tech. Because to me, it was, like, the most obvious announcement of all time-

    4. SP

      Right, right

    5. AL

      ... which is a large enterprise is gonna have to go through the, the change management, the systems implementation, the integration of technology for these agents to be able to go and work. And so there was this sort of, like, you know, people thought it was somewhat ironic that, oh, we need people to implement the agents that are gonna go automate the people, and it's like, no, that's exactly how it works.

    6. SP

      Right, right.

    7. AL

      Like, you, you, you actually do need to do lots and lots of work to be able to be in a position where agents can actually go and, and help you do, you know, any of the automation. So, so that is... And that's gonna be, there's gonna be businesses that are doing that for decades. Like, it's gonna be an incredible opportunity for this kind of next generation set of firms, as well as existing ones that, that lean into that.

    8. SP

      Let me throw this out there. Well, first, I think the other thing that people shouldn't celebrate when those fail, uh, because they will fail, because they're, as Martin was describing, they're gon- a lot of them are gonna be these sort of top-down mandates where they pick, like, the most acute problem in the company and think, "Oh, AI is gonna go solve that." And the IT people are gonna be like, "Oh, God, that's the worst-"

    9. AL

      Yes. Yeah, don't do that. Yeah.

    10. SP

      That's, that, that's the worst system to try to do that. But the CEO or CFO or whatever is gonna be obsessed with solving, or the most likely the customer service person will be obsessed. But, but I do think if I were, if I were advising a startup specifically in order to, to, to sort of enter the enterprise space in that way, definitely would be thinking about not just, like, building a company that's step one. I only work with all the headless SaaS software that's out there, because there just won't be any. Like-

    11. AL

      No

    12. SP

      ... the, but the, the thing you can do is structure the value that you offer, and also this applies to what you go do in a company, is it's really a fork, and the fork is-Is this an agent that is seeking information and presenting it to an, to some human, or is this an agent that's supposed to go act and do something? Like, is this-

    13. AL

      Yes

    14. SP

      ... is it acquiring or is it doing? Because if, if it's, it turns out that's how, what happened with the internet. The internet got very, very valuable when the first step was just providing access to things to people.

    15. AL

      Yes.

    16. SP

      And, and like all of a sudden, all the sites that were like that literally did integration. Like, "Hey, I need expense reports, but viewed by department," or, "I need to see our current inventory status across, like, the two companies we've acquired." All of a sudden, the web became the integration point. And so I do think that, that if you just show up first and just say, "Hey, we can actually use agents to learn stuff about what's going on in a company," and in particular, because you're here, Aaron, like, learning across the files becomes way more possible than it ever was before. In fact, AI might be the first time that inside a company's search can actually provide-

    17. AL

      Yes, yes

    18. SP

      ... immediate value.

    19. AL

      Yes.

    20. SP

      'Cause the web just wasn't structured to deliver those results. And, and then you start to think, once you can bring them all together, then you can add, like, an Approve button or a Reject button or something like that.

  6. 20:1224:40

    Should Agents Be Treated Like Humans?

    1. SP

      Let, let me, let me just try and provide... Finally, the point where I get to disagree. [laughs] So let-

    2. SP

      Uh-oh. We're in trouble now.

    3. SP

      No, no, no. I, I just-

    4. SP

      Well, you can get invited back. You're invited back, so good.

    5. SP

      No, no. I, I think this is a very legit view, but it's not the only view, and in light of AI, it's, I think it's not the only kind of compelling view. So here's the oth- so the, let, let me just try and rephrase. So the, the current view is we've got, like, AI is software. It, it, it works in a different way. Um, we have a current set of systems, and we have to integrate this new type of software with our existing systems so that it can get access to data, it can do things, but in a safe way, right? So here's to the kind of end-to-end argument of why this isn't abov- about evolving software systems. The end-to-end argument is these LLMs are non-deterministic, they are smart, they deal with the long tail of complexity, and it turns out those are all things humans do, too, and we've spent 40 years building interfaces, processes, and design to deal with messy humans. And, you know, we know who to access and we have access control. And so if you have the mindset that an agent is more like a human, and you hire the agent, you give it its own email address, it can access documents like humans can, it can log in, it can request the things that it needs, then it will be drafting on all of the process that, that we've put in place for humans, not for software. And so I would just encourage us as we have this discussion, like listen, I grew up like you guys in software. I always think of every system like software, but these models don't integrate well with software. Actually, I think it turns out, and what we're learning as an industry, is if you view them more like humans and you draft on the, um, mechanisms we've put in place for humans, they're much easier to integrate.

    6. SP

      Well, that-

    7. SP

      And I think we're seeing-

    8. AL

      Yeah, I love that point. I, I think we, I think we agree with that, for sure. I think the issue is humans have a bunch of extra benefits that the agent doesn't have. The human has a lot of context that it gets for, that they get, that we get for free by virtue of we can keep track of the myriad relationships that we've built in our organization and the person to tap on the shoulder when, when we need something done or we need to get information. That's not documented in a company yet, um, in a, in a way that the agent can just sort of draft on. And so, so I, I like, I, I mean, I think we all would agree that, that you ha- you can't treat this like software. You treat these as, as people accessing systems and tools, but they are at a, they're both at an, a massive advantage that they can work in parallel in, at, you know, at infinite scale, and they're at a disadvantage in that they don't know who to tap on the shoulder.

    9. SP

      Right. I, let's-

    10. AL

      Yeah

    11. SP

      ... Aaron, I am all for agent onboarding. Like, you know-

    12. AL

      [laughs]

    13. SP

      ... the agent comes and it goes to orientation.

    14. AL

      Yeah, yeah, yeah.

    15. SP

      And then the CEO gives it the culture discussion, and then every... [laughs] I'm not kidding.

    16. AL

      No, you're probably right. Every department-

    17. SP

      Every department-

    18. AL

      100%

    19. SP

      ... every department does their pitch.

    20. AL

      Yes.

    21. SP

      Like, "This is what we do."

    22. AL

      Yes.

    23. SP

      And like, I mean, I think, I, I actually honestly think given, given the technical nature of these agents-

    24. AL

      Yeah

    25. SP

      ... and how much entropy they have and kind of how unruly they are, we're gonna have to go through the processes that we've refined around humans.

    26. AL

      Yeah, 100%.

    27. SP

      Because humans have all of those things.

    28. AL

      Yes.

    29. SP

      And so I just, you know, it's more about providing schools for them than somehow building some, you know, fancy index database.

    30. AL

      No, no, no.

  7. 24:4039:16

    Salesforce Goes Headless & What It Means for SaaS

    1. AL

      Well, well, and so, so the big news last week was, uh, was I, I, I think, you know, Salesforce, I don't know if they surprised people or not, but, but I mean, based on the reaction, it seemed like it was maybe a surprise. They, they went full headless, and they basically said, you know, like, "We wanna be used everywhere across all of our, uh, all, all the different agents."Um, and I see that as a, a little bit of a bellwether because I think as Salesforce goes, so does a lot of, of, of enterprise software. And I think a lot of people are gonna try and f- you know, have to figure out what is the new business model in this headless world. You know, do you, do you charge a little bit of a, a small just API tax? Is there a seat for the agent? So there's obviously some work to do with that, and Steven, I, I saw one of your tweets on, you know, s- some of the, some of the, you know, complications there. But, but, but, uh, but I think as a, as a moment it's a big deal because, because I think it's a recognition that, that, you know, software will be running in the background. It always has for machine users and applications, and now it is for these sort of probabilistic machine users and, or non-deterministic machine users. And what's cool and, and where I think this gets pretty exciting is, you know, as soon as I saw that announcement, like, I had like five to 10 personal use cases where I would need, you know, the headless version of Salesforce, 'cause I'm always doing just a tremendous amount of, of customer-related intelligence work. I'm going into a meeting-

    2. SP

      Yeah

    3. AL

      ... I need some information. I need to do... I'm going into a city. Who should I be meeting with? And so if you imagine, you know, being able to run compute in the form of agents across all of your data systems, like, the use cases become, you know, pretty wild around what that opens up. So I think this gives, I think this gives a lot of software platforms all new use cases that they can tap into that where, again, you were normally constrained by the number of people on these platforms, but now the headless user can be, you know, 100 or 1000 X the scale, um, of those human users. So this is a, a, I think an exciting moment because as you have more of these agents running around and the headless software modes, um, you just have, you know, way more use cases for these tools.

    4. SP

      I also think-

    5. AL

      So-

    6. SP

      All right, just, I think on this one-

    7. AL

      Please, please. Yeah

    8. SP

      ... what's so, what's so super cool is, is that of course the first step is doing exactly what you described, which is just looking stuff up. And so the, the most interesting thing is using this notion that an agent is just a, an entity, it's mo- it's incredibly obvious to me that it's another license. Now, it might have a different-

    9. AL

      Exactly

    10. SP

      ... license model, but it hac- it has to have an identity. Like when you go look something up in, in the Box, um, CRM system, I, I don't know if it's Salesforce or not.

    11. AL

      Yep.

    12. SP

      When you use the Box CRM system, it has to be a person, like with a certain amount of access rights.

    13. AL

      Yes.

    14. SP

      And you presumably, as CEO, you might have access to a bunch of stuff. But also there's a lot of ways that they actually don't want you to have-

    15. AL

      Right

    16. SP

      ... the rights at the right time. Like, you might be able to look and see who is on the account, but you don't need the up-to-date quota-

    17. AL

      Right

    18. SP

      ... of those salespeople and stuff, and that might be HR sensitive, and you should probably have some other level to go see that. But as you go down the org, the agent is never gonna have more permissions than the person who's getting it to go do something. And in fact-

    19. AL

      Right

    20. SP

      ... it's just gonna be like a peer to somebody else in an organization, because otherwise you have all of these issues where the peer, where a human can just say, "Oh, get me the super smart agent that knows everything that I'm not allowed to know."

    21. AL

      Right.

    22. SP

      And to, to the, in the mo- in the IT architecture sense, what's so fascinating about that is you have to build... You, you can't let the agent get the results and then try to figure out what works or not. But first of all the points that Martin made about, about, um, who, about the, the LLM stochastic model, which is you're not gonna be able to figure out. It's not like a record in a SQL table that you could just apply ACLs to. It's-

    23. AL

      Right

    24. SP

      ... it's actually like it could be words in a sentence or just the number that shows up.

    25. AL

      Yeah.

    26. SP

      And so I actually think it, it, that whole discussion about headless for me made the SaaSpocalypse seem even dumber than it was already, and it was already dumb.

    27. AL

      [laughs]

    28. SP

      So like, it was like at first it was dumb, and then I'm like, oh my God, it's actually much dumber than I thought it was-

    29. AL

      [laughs]

    30. SP

      ... in the first place.

  8. 39:1647:53

    Scale, Entropy & Why AI Coding Creates as Many Problems as It Solves

    1. SP

      Let me, let me ask this. It occurred to me as you were saying it. Like, I, my, I sort of got all tense when y- when the idea became-

    2. AL

      [laughs]

    3. SP

      No, like, oh, we have 10,000 people hitting our, hitting our SaaS system today, and we've got it all working and it's all great, but, um, now we're gonna have 10,000 new pe- people, which are the agents for each of those 10,000 employees, and they're, they're actually hitting it 500 times as much.

    4. AL

      Mm.

    5. SP

      Okay, so that SaaS product will collapse.

    6. AL

      [laughs]

    7. SP

      So, like, that's the, the first order because it wasn't architected for that volume. Like, we saw this with, with all the BI tools. Like, when all the-

    8. AL

      Mm

    9. SP

      ... BI tools came out, all of a sudden they, they were looking at the SAP data and trying to snapshot it and absorb the whole thing every night for a new kind of set of slices and dice that your view across all 500-

    10. AL

      Yes

    11. SP

      ... pro... And, and, like, all the people making ERP were like, "Well, we don't do that." And so they had to go build all of this themselves because they had the knowledge of the data. Their API just couldn't, was not designed for, for that kind of lookup. So my, my sort of thing to throw out there and, and fight about is what is it, what does the change management look like in a company? Because you, you can't let loose an agent that hits the system at 500x the humans. And it's not a token thing. It's an actual, like, wow, we don't have the network bandwidth and the, the throughput to handle 500x for any one of our customers. So what happens?

    12. SP

      So, so I've, so I've got a provocative adjacency, which you guys can tell me if I'm doing too much on a tangent here, but, but here's my provocative adjacency, which is I don't know if having more agents is that big of an architectural shift. I just feel like we understand, like, whatever. If it's read-only data, you cache it. You know, like, all the state issues are around mutable, mutable globally shared state. We understand the limits of those. We know how to architect around those. We had to tackle all of those things when we went to the internet. And so if you built your system not to handle it, like, you suck at building the system-

    13. SP

      [laughs]

    14. SP

      ... and you deserve to go down, and just go build a system that doesn't suck. And, like, I just feel like this is kind of standard computer science. However, I do think agents do introduce, um, something that organizations, uh, technically have to deal with, and I'll- l- let me just give the analogy in code, which is in-

    15. AL

      I think, uh, Steven, this is what we call mogging on a, on a podcast.

    16. SP

      [laughs]

    17. SP

      I, I don't know. No, no, I think it's a great question.

    18. AL

      You've been question mogged.

    19. SP

      I just-

    20. AL

      He's been question mogged

    21. SP

      I have no idea what he just did, but I-

    22. SP

      [laughs]

    23. SP

      ... I'm, I'm just looking forward to how he magically made the problem go away. But go ahead. [laughs]

    24. SP

      No, no, no, no, no, no, no, no, no. No, the problem is there. I just think, like, we know how to go from 10 users-

    25. SP

      Yeah

    26. SP

      ... to 1,000 users.

    27. SP

      It's there for stupid people.

    28. SP

      But-

    29. SP

      We just got rid of the stupid people, so now everybody's smart.

    30. SP

      No, no.

  9. 47:5358:22

    Will AI Kill Jobs or Create More of Them?

    1. AL

      S- by, by the way, this is actually why I remain unbelievably optimistic on jobs.

    2. SP

      Yeah.

    3. AL

      Because I don't think-

    4. SP

      Oh.

    5. AL

      You, you, like, I just think we've gotten it wrong on, on thinking w- you know, all the places where you're gonna remove humans from this because you still need a human in that, you know, somewhere in the loop. Maybe the abstraction is a little bit higher and you don't need the human in the loop at every, at every single stage that you needed a year ago, but, uh, but you do need a human sort of kicking off the process, reviewing the process, and incorporating whatever the work was. Um, and so that creates just still a tremendous amount of opportunity and jobs across these organizations.

    6. SP

      Oh, let me, I have to jump in 'cause I, I have, I have a whole bunch of, like, visual aids I brought today to make it exciting. We got-

    7. AL

      Okay.

    8. SP

      You got a bunch of comments on, on the MTS Live thing about people agreeing with you, so I don't wanna let that slide because-

    9. AL

      Okay

    10. SP

      ... you know, we complain about not agreeing with you. But, but, like, here-

    11. SP

      Well, totally agree

    12. SP

      ... to your point, to your point, this was a book in the '80s called The End of Work.

    13. AL

      Yeah.

    14. SP

      [laughs]

    15. SP

      And, and I... This, so or actually, sorry, it was in the '90s. It, it, it came out, like, six months before the internet hit, and the whole thesis was the technology revolution was a complete bust and we got no gains in productivity, but now there's gonna be no more jobs 'cause the economy is stagnant. Well, and it just w-

    16. AL

      Yeah.

    17. SP

      And this was a guy, he called himself a futurist.

    18. AL

      Yeah, yeah.

    19. SP

      And, and, and, like, so the whole-... notion that it, it, that's a, like one of the neat things about this whole AI moment is, like, the number of things that when you hear them the first time you think they're stupid, and then you go back and think about it and you're like, "Oh my God, it's way stupider."

    20. AL

      Yeah. [laughs]

    21. SP

      And, and this idea that, like, AI just gets rid of jobs, it's as ancient as, like you p- talk about the accountant. Like, one of the things people thought was that computers would get rid of accountants.

    22. AL

      Yes.

    23. SP

      And, and that was, like, IBM's pitch in, like, 1965, but-

    24. AL

      Yeah

    25. SP

      ... what it actually did was like, "Oh my God, we could do so much more with accounting-

    26. AL

      Yeah

    27. SP

      ... now that they're not, like, literally just adding numbers all day."

    28. AL

      Yes.

    29. SP

      And, and I think-

    30. AL

      Well-

Episode duration: 58:23

Install uListen for AI-powered chat & search across the full episode — Get Full Transcript

Transcript of episode dvVbA9OcBqs

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.

Add to Chrome