EVERY SPOKEN WORD
35 min read · 7,491 words- 0:00 – 0:49
Cold Open Trailer
- RHRene Haas
There's no computing problem that's ever been invented that doesn't utilize and can't utilize the microprocessor. It is the heart of everything. All roads lead through it, around it, past it. Something has to do the orchestration, arbitration decision around where those tokens go. That's what CPUs do. Chip design can take anywhere from twenty-four to thirty-six months, depending on the complexity of the chip, et cetera, et cetera. The actual design is not the largest amount of time. The largest amount of time is in the verification, the validation, the debug. AI is really good at that, and if we were to shut it off, it's like being in the nineteen-nineties. You've got internet, and you're now saying, you know, "Only internet between the hours of two and four." Yeah. After that, go to the library that we have down the hall. It'd be anarchy. Yeah. The genie's out of the bottle, and there's no stopping that.
- SGSarah Guo
[upbeat music]
- 0:49 – 1:14
Rene Haas Introduction
- SGSarah Guo
Hi, listeners. Welcome back to No Priors. Today, Elad and I are here with Rene Haas, the CEO of Arm and SoftBank Group International. We talk about the position of Arm within the chip industry, the resurgence of interest in chip innovation, the challenges of the supply chain, the future of robotics, energy, his place in the SoftBank group, and how he sees workloads changing in the future and for Arm. Rene, thanks so much for doing this with us.
- RHRene Haas
Pleasure.
- 1:14 – 2:37
Arm and Chip Supply Chain
- SGSarah Guo
Congratulations on the chip presentation at Hot Chips and, you know, uh, all of the, um, progress that Arm has made. I think there's enormous amount of interest from the technology industry and the software industry in just sort of better understanding the chip supply chain recently. Um, for anybody who's not super familiar, can you explain Arm's position in it? And then we'll get into sort of more recent topics.
- RHRene Haas
So we have, uh, we have two positions in the, in the chip supply chain. Our primary business is licensing IP, the CPU core that finds its way into smartphones, data centers, automobiles, you, you name it. Our customers are the ones who either build the chips themselves, the Samsung who's got their own fab, or the vast majority of companies that take their chip designs and go to TSMC and get them, get them taped out. So in that world, and this is, uh, the cool thing about Arm, because we're so broad in terms of the markets that we serve, we kind of see everything. We have a very good sense of what's going on in automotive, data center, smartphones, so we see the supply chain situation from, from all angles. We also introduced our first product last March, the one you just mentioned, uh, at Hot Chips, the Arm AGI CPU. Uh, so now we're in that soup ourselves [laughs] from the standpoint of we're also having to figure out how to buy substrates and buy wafers and buy memory, et cetera, et cetera. So we're d- we're, we're up to our waste in everything on the supply
- 2:37 – 4:23
Shift from IP to Manufacturing CPUs
- RHRene Haas
chain.
- EGElad Gil
Why, why'd you make the move now? So for, uh, you know, Arm, I believe, existed for a few decades now. The focus was always on IP, which is effectively like designing the way that different chip components are put together, and then you license that out to other people to actually manufacture and incorporate into their designs. Why did you decide to start making some of your own CPUs?
- RHRene Haas
Yeah, it was, it was an evolution from the early days of where we just supplied simply the IP components, the pieces, the, the CPU IP, the GPU IP, the system IP, et cetera, et cetera. Few years ago, what we were starting to see was that product cycle times aren't slowing down. Uh, chip manufacturing times are extending. Uh, the ability to get solutions out faster was becoming more and more important, so we moved from these individual components into what we called compute subsystems. I used-- When we went, did the roadshow a few years ago, I used the, the Lego analogy where essentially we're providing the blueprint on, here's how you stitch it all together. Demand for that was, was insane. Uh, and what we were finding was we were-- And we initially-- People thought, well, people aren't gonna want these subsystems because that's what a chip designer does. Why are, why are you providing that c- piece? But it saved time to market, and it saved a whole lot of t-things in terms of cost, speed, et cetera, et cetera. The physical product was sort of the next, the next leap, if you will, and there are certain sets of customers that we'll license IP to, and they've got all the capability in the world to, uh, to build chips based on Arm. There's a lot of companies who want to have product based on Arm. Not all of our customers build products that serve those markets. So Meta was that first example. They wanted a general purpose agentic CPU. There wasn't anybody out who could give, give it to them. They came to us and said, uh, "Hey, why don't we do this together?" And, uh, and that's how
- 4:23 – 6:55
CPU IP and Customers
- RHRene Haas
we got into it.
- SGSarah Guo
Uh, how has that landed with the rest of your customer base?
- RHRene Haas
So one of the things that we were very careful about was getting, making sure the ecosystem was on board with this because we do CPU IP, which is really only as good as the ecosystem, the ecosystem of chip people and the ecosystem of software folks and people who build around that. So we talked to just about everybody who were customers and said, you know, "How do you feel about this as the direction we're going?" And surprisingly, we got a lot less pushback than I, than I thought. And the reason for that was the more software that's available in the wild, whether it's proprietary and/or open source, benefits the broader ecosystem and the customers themselves. So whether it was NVIDIA, Amazon, Microsoft, Google, all people who build Arm-based server chips, they were all on board. And I think the ultimate proof point was when we announced a product last March, we had Jensen, we had Ronnie Boker, we had Amen, we had James Hamilton, you know, all the folks from those customers I mentioned all saying, "Congratulations. It's a great thing." So, uh, it's been okay.
- SGSarah Guo
Uh, what is the-- You know, where are you in the learning cycle as a business now selling physical chips? That feels like a lot of new capabilities.
- RHRene Haas
Yeah. So we, we-- Obviously, to, to deliver a product and, and, and we're a fabless semi company, right? We, we don't have a fab, and we have no intention to build a fab. So-- But we, we fit in that ecosystem, but that means you need supply chain operations people. You need to work with, as I said, the TSMCs and the Samsungs of the world. You need to work with the Samsungs and the Microns, SK Hynix to get memory allocation. And then on the engineering side, uh, you need a lot more different capabilities. You need back-end people, layout people, implementation people. Bring up labs, physical stuff, right? We didn't have a lot of physical stuff, um, which was kind of the beauty of the business, the original business.
- EGElad Gil
I remember discovering that Arm had a ninety-eight point five percent gross margin.
- RHRene Haas
That's, yeah, kind of beautiful. I-
- EGElad Gil
Yeah
- RHRene Haas
... I, I, I, I-
- EGElad Gil
I don't think I've seen that otherwise, yeah
- RHRene Haas
... I came from Nvidia before I, I came over here, and most of my career was in the chip world, and I remember coming to Arm in twenty thirteen and thinking, "No inventory, no RMA, no scrap. What's, what's not to like?"
- EGElad Gil
Mm.
- RHRene Haas
Uh, so we had to add a lot of those capabilities. Uh, we have a lot of people on the leadership team, uh, who've come from that world. Uh, I've got execs from Broadcom, uh, Qualcomm, Nvidia. I worked for Nvidia. So w- we have the leadership that's done this before in other companies, um, so we've been able to build up that, uh, that muscle pretty
- 6:55 – 10:15
AI Adoption at Arm
- RHRene Haas
quick.
- EGElad Gil
How have you approached AI adoption? So, you know, we, we were speaking earlier that there's news from Open Editor today about Jalapeno and a chip that they designed. Their claim is it was a very fast time to market, and part of that was using AI tooling to sort of design chips faster. Um, how much adoption have you seen there? I know other companies have also talked about things like adopting formal verification at Amazon or other places for their training chips. So I think the chip world is starting to evolve in terms of AI usage, and I'm just curious about how you've done that at Arm and-
- RHRene Haas
Well, personally, I'm a huge believer in AI as a utility that's going to help productivity for every single industry. Um, it is gonna be the great leveler in terms of companies that can get started super quickly. And for industries, whether it's healthcare, infrastructure, robotics, every industry is gonna l- use artificial intelligence as a utility, end, end stop. So since I'm such a believer in this, of course, we use it very heavily, you know, ins- inside of Arm. Um, on the non-engineering side, we're using it all over the place, but on the engineering side, we've seen huge, huge benefit. You mentioned verification. Chip design can take anywhere from twenty-four to thirty-six months, depending on the complexity of the chip, et cetera, et cetera. The actual design of, of the, the architecture, the, the RTL generation, if you will, the, the mapping of the architecture, is not the largest amount of time. The largest amount of time is in the verification, the validation, the debug, the documentation, et cetera, et cetera. AI is really good at that, uh, and I would say we probably have eighty to ninety percent of engineers today inside Arm who use it on a daily basis. And if we were to shut it off, uh, my analogy I give to people, it's like being in the 1990s. You've got internet, and you're now saying, you know, "Only internet between the hours of two and four."
- EGElad Gil
Yeah.
- RHRene Haas
After that, go to the library that we have down the hall that's got all the books that you can go, go up and look all this information up. People... It'd be anarchy. So the genie's out of the bottle, right? There's... And, and there's no, there's no stopping that. Now, there's certain things that the tools are still not that mature of. Uh, one of them is really around RTL generation and then physical design and implementation in best of class, and that's simply because the models, you know, they're, they're trained on, on what's available publicly. Uh, and a lot of the information is quite proprietary. That being said, there's massive opportunity between the ecosystems and everyone in the industry to make that better. It, it's only gonna get better.
- EGElad Gil
Have you been fine-tuning models to try and address that gap, given the proprietary information that you all have possessed?
- RHRene Haas
We've been working with model makers, uh, around that, absolutely, uh, and I think that's a big, big opportunity. And one of the things that I'm proud of at Arm is, given our business, our core IP business, we probably have the richest IP portfolio, both in terms of not only the IP, and this is the killer, the documentation, the test benches. You know, how, how you build the IP. You know, I've worked for chip companies in the past that have said, "Hey, why don't we license this IP that we've got because it's really, really valuable?" And then you get into a, "Wait a minute. There's, there's no documentation."
- EGElad Gil
[laughs]
- RHRene Haas
"There's no explanation on how you would-
- EGElad Gil
No one's ever gonna be able to use this.
- RHRene Haas
It's unusable, and it's untestable.
- EGElad Gil
Yeah.
- RHRene Haas
Right? And, and if it's unusable and untestable, it's actually untrainable. And if it's untrainable, it's not usable for AI. I think we have some, some built-in advantages based on our business model that'll allow us to really be, uh, able to take advantage of the tools as
- 10:15 – 13:27
Changes in Chip Time to Market
- RHRene Haas
they get better.
- EGElad Gil
So exciting. How much do you think, um, if you were to extrapolate out, and this is a little bit of a uncertain question, but if you were to extrapolate out two, three years, and all the tooling that's likely to come in AI and the ability to fine-tune models against, you know, some aspects of the design that you mentioned, do you think that twenty-four to thirty-six-month cycle shrinks to a year, to six months? Do you think it stays roughly where it's at? I'm a little bit curious about how does that really impact these cycles and time to market, because that has pretty dramatic ramifications-
- RHRene Haas
Yeah
- EGElad Gil
... in terms of the clock speed of the entire industry.
- RHRene Haas
I don't know. I don't know if it's, uh, in two to three years away, but five-plus years-
- EGElad Gil
Mm-hmm
- RHRene Haas
... can you go from idea to a GDS2 file? A GDS2 file being the, the file that you actually send to the fab to, to go get built. For certain designs, quite possible. So it takes that whole design piece out of the way. It takes that whole piece out of the way relative to the verification. So I think for the more straightforward designs, quite possible. Now, if you go into the tool and say, "Design me something that's ten percent faster than Vera Rubin, twenty percent cheaper, and thirty percent more efficient on this model," you're not gonna be able to go press a button and have it happen right away. Uh, but I think in five to ten years, you know, our industry as well, uh, we're gonna see some amazing differences relative to how chips are designed.
- EGElad Gil
How does it change, um... I'm sure you had some prediction of this, but how does it change the way you look at the business, given, uh, there's just a, a big diversity of large players and new players that all, you know, want to have their own chip designs now? And, you know, the, the Veras and the Gravitrons of the world, they all use Arm. Um, it's a, it's a big step up for them, but it's a, it's a big diversification of the customer base, right? That can be only good.
- RHRene Haas
Oh, ab- absolutely. Uh, I think what's going to matter, back to the earlier discussion we had on supply chain, it's understanding the supply chain impacts, uh- How all of that gets built and, and put into ultimate end products, uh, I think that's gonna become a, a much more important muscle, uh, as we, as we go forward because it's one thing to name-- Say it another way. There's a lot of really great young companies today doing AI chips, well-known companies getting tons of funding, innovative designs, et cetera, et cetera, selling into an industry where the capital requirements are just massive, and the relationships with memory vendors is incredibly critical, or the relationship with substrate vendors. So companies are going to have to be much more-
- SGSarah Guo
Or access to a three-nanometer line, a six-nanometer line, advanced packaging line, whatever it is.
- RHRene Haas
All of it. Yeah, all, all of that. And I, and I think that is, um, that's not going to stop in twelve months. It's not gonna stop in twenty-four months. I think we're gonna be in this constrained environment for three to five years at least. Uh, so long as the transformer is the unit of energy relative to how you generate AI training and AI inference, by design, it is a, it is, it's very compute-intensive, it's very memory-intensive. So if you think about that, that's gonna drive a lot of demand on having supply chain acumen, which then goes back to people who've got great ideas on chip design, they're gonna have to have, need a lot of other things just to be able to get access to capital, wafers, everything you just talked about.
- 13:27 – 15:13
Data Center Buildout Bottleneck
- EGElad Gil
We've just had a cascading series of things that have been the bottleneck to more compute for the AI industry. So, you know, two years ago or so, I think it was, like, packaging and packaging-related items. And then eventually now people want to talk about how it's memory and things like that that are in some sense limiting to certain systems being built at, at sufficient scale. Uh, do you have a view of what is the next sort of bottleneck that's coming?
- RHRene Haas
I think building out the data centers is, is gonna be a bottleneck. And when I say building out, um, if you look at all the projects that are being done today, um, not a lot of them are ahead of schedule, uh, and needing less labor than they thought.
- EGElad Gil
Mm-hmm.
- RHRene Haas
Right? [chuckles] And then when you, when you layer on top of that a lot of buzz that's coming from different parts of the, of the, of the country in the United States here relative to slowing down data center development or putting restrictions around it, I think that, uh, infrastructure build-out, uh, could be a headwind just relative to, to everything going on, which may be, you know, end quote, okay, because if it wasn't, if, if infrastructure build-out was not a headwind, uh, I think capacity for wafers, capacity for memory, that probably would be a, would be a headwind. So I think you're gonna see a number of different governors, if you will, not governors of states [chuckles] , but different things that are gonna throttle the growth of this. Uh, which, just expounding for a second, I'd been on a bunch of panels, and I get a lot, I get a lot of questions about AI bubble, and when's it going to stop. And there's-- setting aside the valuation bubbles, which is a, a s- a stock market index, uh, component, the, the bubble in terms of are we over, um, oversupply to demand, not even close.
- EGElad Gil
Mm-hmm.
- RHRene Haas
And I think, again, that's because, uh, the demand is insatiable just given the way these models work, and infrastructure build-out, access to wafers, access to memory, all of that's combining.
- 15:13 – 17:43
Softbank Leverage and Capital Strategy
- SGSarah Guo
Uh, you mentioned that, um, and I think a lot of companies are learning today that, um, strategic use of the cap table, access to capital in an era where you either need to consume a lot of compute, or you need to put a lot of CapEx into the ground, or you're just doing big technical projects like coming up with, um, uh, CPU IP. You run SoftBank Group International. You have this one dominant shareholder. Arm itself as a business is just like a beautiful cash flow machine from the outside, right? I, I'm sure you think a lot about, like, the, the leverage of SoftBank and how to use that well. Like, what advice do you have for entrepreneurs navigating these CapEx-intensive industries from where you sit?
- RHRene Haas
Yeah. So one of, one of the benefits we have, uh, at Arm, uh, publicly traded, yes, uh, but a very, very large, uh, single shareholder, so I have lots of informal investor meetings with my chief shareholder, you know, all the time about this. Uh, we have a big advantage in that, uh, there's a lot of things symbiotically we can do together that can help Arm advance its initiatives by having SoftBank as our largest shareholder that we look to be very, very, um, innovative around. Uh, to your point in terms of, you know, young companies, I would say strategic partnerships incredibly early, uh, whether it's with people inside the supply chain, uh, people in private equity, you know, the banks, the, the banks themselves. It's a different game, you know, now. On one hand, semis are kind of back b- because you've, you now have a, a, a wave of semiconductor startups. Um, there was a long time where that was just not happening, uh, investment in the industry. Now we've got a lot. But access to capital is gonna be the, the, the gate for them in terms of how they, how they get through that. So I think getting much more creative in terms of how they work with the ecosystem is gonna be super, super key. And we at, and we at SoftBank, that's one of the things we look at very strategically, you know, companies that we can bring in, into the portfolio that we can help, uh, that we can provide a combination of either, uh, the backstop, you know, and/or if you think about SoftBank, we just announced, we being SoftBank, uh, SoftBank Neo-
- SGSarah Guo
Mm-hmm
- RHRene Haas
... uh, which is our intent to become a, uh, uh, a Neo cloud. And in that world, we could become a home for these young companies who have, uh, chip technology that in other worlds they'd have to go out and figure out how to get a design win at Microsoft or Google. Uh, we can provide a lot of interesting avenues for
- 17:43 – 20:13
Softbank Portfolio Overview
- RHRene Haas
that.
- EGElad Gil
Can you talk a little bit more about the portfolio of things that fall under your purview at SoftBank? I, I know it was mentioned there's Arm, and then there's, uh, this sort of broader suite of things.
- RHRene Haas
Yeah.
- EGElad Gil
So I'd love to hear, we'd love to hear more about what else you're responsible for, and we had some specific questions for some of those as well.
- RHRene Haas
Yeah. So it's, the way, the way to think about it is, uh, SoftBank Group, which is, uh, headed in Japan and, and, and that is Masa, uh, have a lot of different operating companies underneath them. One of the largest ones is SoftBank KK, which is essentially SoftBank, SoftBank Mobile. Uh- Inside the US, uh, there's a lot of investment activity that's going on, uh, with SoftBank Group International. There's SoftBank Vision Fund. Uh, but increasingly, a lot of the strategies that we're trying to do around SoftBank is helping the strategies that Masa talked about publicly at, uh, at the-- his, uh, shareholder meeting in, in Japan, which is around robotics, open AI, infrastructure, and Arm. So I've probably got my eyeballs on, on a lot of stuff, uh, to be honest with you, in terms of helping Masa really realize the, the execution of that vision. So yes, I, I'm, I'm leading the direction of Ampere and Graphcore and, uh, another company called Stack AV that's doing things around autonomous. But maybe a better way to think about it, Elad, is that I'm kind of in the room on a lot of discussions that Masa's having, uh, and helping him sort of formulate that strategy and, and more importantly, help execute it.
- EGElad Gil
Mm-hmm.
- SGSarah Guo
How does, um... how is, uh, being part of the SoftBank Group or working with all these different companies or even SV Energy and the-- and, um, the broader ecosystem changed your point of view on what you can do with Arm?
- RHRene Haas
Well, one thing it does, it gives us, uh, a, a huge, uh, bird's-eye view relative to, uh, where the broader industry is going, whether it's around infrastructure, whether it's around capital, whether it's around energy. But also, you can imagine it could provide a home for, for our products, right? So it, it doesn't need to be the home, but it certainly can be a home, uh, which is also a big, uh, a, a big, uh, big help, uh, when we think about the verticals that SoftBank's involved with: robotics, energy, data center infrastructure. And then you look at the products that Arm has, the only one we've announced so far is the Arm AGI CPU. You can start to connect the dots and say, "Gosh, there could be some very interesting opportunities that, uh, that could be an opportunity for Arm," which necessarily doesn't mean that we're getting into the broad merchant chip business. We could be just doing products simply back for, uh, for SoftBank.
- 20:13 – 24:49
Robotics Opportunities for Arm
- SGSarah Guo
We're a couple years into, um, you know, serious efforts in more, uh, generalized robotics at this point, right? If you compare it to, like, about a decade for, um, LLMs. There's increasingly interesting demo results from companies on generalization of task and environment, more robustness, maybe even in-context learning, but not, like, wide-scale deployment quite yet.
- RHRene Haas
Yeah.
- SGSarah Guo
Um, uh, first, would you agree with that characterization?
- RHRene Haas
Hundred percent. Yep.
- SGSarah Guo
What predictions do you have about the, uh, robotics market and, um, any opportunity for Arm there?
- RHRene Haas
Oh, well, bro-broadly speaking, uh, I think the-- whether it's humanoids or, or dedicated, uh, machines to do certain level of tasks that can be retrained is gonna be enormous, right? And the, the Robotics 1.0, which is a purpose-built industry, uh, you had a s- piece of mechanics designed to do a certain task and the software that was optimized for that task. If you had to... a brand-new automobile line came up or some different piece of equipment, if the robots weren't well-suited for that, rip up the line, et cetera, et cetera. So as, as you can imagine then, the, the barrier was, was pretty high. Getting to a world where the, the robots can learn just based upon either being trained or what they see, and then when you then combine that with can you design something mechanically general purpose enough that can take advantage of being reprogrammed, and then when you layer on top of that the cost coming down, you look at it and say, "Oh my gosh, what, what will it not be able to do?" So it's almost like something out of The Jetsons, right? Where a lot of things will ultimately be done by robots. Uh, construction, infrastructure, service, security. You know, right now you see a lot of stuff on Instagram or TikTok of Olympic races with robots, et cetera, et cetera. I don't think anyone's gonna have any interest in watching a sports league of, of robots. There may be an enthusiast class-
- SGSarah Guo
Mm-hmm
- RHRene Haas
... who, who might be interested in that. But the, the broader utility is going to be around, uh, a lot of human labor tasks, um, that w- can ultimately easily be replaced by robots. There's no question it's going to happen.
- EGElad Gil
A lot, a lot of the hypotheses people have about the form factor of robotics tends to split into two or three camps. One of the camps is that they're gonna be, uh, humanoid or roughly sort of the human footprint because so much of the physical world is already designed that way, and the tooling is designed that way, and so you can just slot robots right in. Others view it as there's gonna be much more sort of specialized task-specific form factors. Do you have a hypothesis on-
- RHRene Haas
I think it's both.
- EGElad Gil
Yeah.
- RHRene Haas
I think it's both. There's a lot-- There, there are a lot of jobs and work tasks that are optimized around-
- EGElad Gil
Mm-hmm
- RHRene Haas
... a person being six feet tall and, and having arms of a certain length, et cetera, et cetera. Uh, but I think it'll be both. You know, and, and I think the f- the fact that they're gonna ha-- be smart and can learn... And to answer your earlier question, Arm is gonna be everywhere. Uh, we are-- we have a tremendous amount of technology from a real-time sensing standpoint around microprocessors that'll be out at the fingers that can do perception and sensing. That's all gonna be Arm-based. Uh, today, whether it's NVIDIA or some of the work that Qualcomm does, most of the brains, the brains that you see in the humanoids, those are all, all running on Arm, uh, today. Uh, so I think for us going, going forward, robot-- the robotic industry will be powered by Arm.
- EGElad Gil
Are you seeing any early indications? I mean, you have this great seat, to your point, where given the ubiquity of Arm in a lot of these different types of devices, you can kind of see the future before others in terms of where adoption is happening or where shifts are happening from a technology perspective. Are there specific pockets that you think will be most likely the early adopters of robotics that you're starting to see some signal from?
- RHRene Haas
I think it's still a little bit early because the business models have not been actually figured out. The c- the cost of robots are so high, right? Because the cost of robots are so high, people buying the robots themselves, that's a, that's a tough, it's a tough model to sort of get people's heads around the... those that actually replace. So I think costs need to come down, and the business model need to be, need to be, uh, ultimately vetted.
- EGElad Gil
Because I know the robotic footprints tend to be things like automotive or, um, certain surgical robots or data ce- or, uh, excuse me, distribution centers, right? There's a few very sort of bespoke applications that I think are most of the robotic sales today. And so that's why I was a little bit curious if like there was-
- RHRene Haas
Distribution centers for sure.
- EGElad Gil
Yeah.
- RHRene Haas
I mean, that, that can ultimately go completely automated-
- EGElad Gil
Mm-hmm
- RHRene Haas
... right? Relative to... And even to the, ultimately to the delivery, right? Uh, and, and you can question To me, loosely speaking, uh, uh, a truck that has an autonomous i-is a robot of sorts. So around factory automation and d-delivery and distribution, that will be one of the very first to be automated, no doubt.
- 24:49 – 28:59
US Manufacturing Protectionism
- SGSarah Guo
There is increasing, you know, debate and, uh, very quickly, like policy or EOs around supply chain controls and usage controls around both robotics, um, and chips and data centers, right? Um, sorry, I'm gonna throw export controls in there, so four types of controls. Um, all, all, uh, all of these controls are relevant for you, and now, um, either in, from your end customer perspective or as a relev-relatively new entrant to, you know, we're gonna own the end product and have a supply chain organization of your own. Like, um, what's your, what's your stance on, you know, how, uh, how protectionist... I, I realize it's not an American company, but you do a lot of business here. Uh, how protectionist the US or the West should be about manufacturing of chips, creation of data centers, robotics, like, what, what are your overall stances here?
- RHRene Haas
So putting my American citizen hat on for a moment, and Arm, as you said, is not a, it's not an American company-
- SGSarah Guo
It is a UK-based, correct
- RHRene Haas
... but it's our, our HQ's in the UK-
- SGSarah Guo
Yeah
- RHRene Haas
... but we have a lot of employ- We have, uh, I wouldn't say half our employees, maybe thirty percent are in the US. I think forty percent are in the UK and maybe thirty percent Asia. So we're a g-
- SGSarah Guo
Okay, you're global
- RHRene Haas
... we're a global company-
- SGSarah Guo
Yep
- RHRene Haas
... but with a huge, you know, a huge US, uh, footprint. But as a, as an American citizen and someone who grew up in semiconductors, and, uh, I, I remember in the 1980s, uh, when the US was the leader in semis and Japan Inc., uh, started to really get very, very aggressive in terms of memory pricing and essentially taking a lot of market share, the US started something called, uh, SEMATECH, you know, back in the day, which is really around how to refortify, uh, the American semiconductor industry, which I thought at the time was, was, was the right move, and there was a lot of energy around that. Uh, internet hit, SaaS companies were all the, were all the rage. People kind of forgot about semis being a strategically important, uh, asset. But I think it is critically important for the United States to have as much of that technology inside, uh, on, on, on US soil. And I would say the same thing just to, to UK, lesser just because of the scale of the UK.
- SGSarah Guo
Right.
- RHRene Haas
But when you think about the, the size of the US market, uh, the criticality of semiconductors to what the US does, whether it's Intel, whether it's Micron, uh, I think we need more US fabs. Uh, it's critical for national security. It's also critical for diversification of, of supply chain. Uh, so I'm a, I'm a big believer in terms of that as a strategy. I think it's really, really critical. You know, as far as the export controls go, and we're gonna limit, uh, we're gonna limit the chips because, uh, we don't want China to, to, to win the race, you know, end quote. You know, my, my personal view is that it's an infinite game, I believe, first, in terms of the race, that there's not gonna be a winner, the race is gonna be over. But you could get to a situation where a lot of the critical technologies are not US-based.
- SGSarah Guo
Mm-hmm.
- RHRene Haas
And that's not gonna be a good thing, right? Because, well, people say, "Well, you know, the cost will go down and, and, and goods are cheaper." But ultimately, and I'm a big believer of this, um, number one, for both national security reasons and economic, you want to be at the forefront of technology because it drives innovation, but it also drives ecosystems. Uh, if you think about the US auto industry in the 1950s, post-World War II, where Detroit was the center of the universe, you had spots across Wisconsin, Ohio, Illinois, whether it was Firestone or Bridgestone, or Bridgestone's Japanese, but oth-other companies in that ecosystem that fed into it. Data centers are kind of the same way. People look at data centers and say, "Oh, it's a big Costco box, and there's two parking, two cars in the parking lot, and all of that is being driven automatically, so there's no jobs." I call BS on that because if you think about whether it's around energy, liquid cooling, all of the things that make the data center better, that's, all, those are all jobs that can be created and done here. So I think as a national policy, it's incredibly important for us to be investing, A, in the United States, and B, making sure that we stay, uh,
- 28:59 – 32:30
Data Center Backlash
- RHRene Haas
stay in the lead.
- EGElad Gil
On the data centers side in particular, it seems like, um, a lot of the, the actions that are being taken to try and prevent future data centers feel more coordinated than not. I know it's phrased as grassroots efforts and, uh, but it, it seems like there's some coordinated function there. Do you have a hypothesis in terms of, like, why there's been this sudden unexpected outcry on data centers from certain corners?
- RHRene Haas
I think there is a f- to, to... We were maybe chatting about this a bit earlier, that there's a fear that AI means job loss, and, and job loss means for all these things kind of implications. So I think unfortunately, unfortunately-
- EGElad Gil
And do you think that fear is well-grounded or... Because somewhere-
- RHRene Haas
No
- EGElad Gil
... it seems like it's only creating jobs right now.
- RHRene Haas
No, I think it's, I don't think it's well-grounded at all. I, I-
- SGSarah Guo
I think the electricians labor union specifically said, "Please don't ban the data centers. We need these jobs," very recently.
- RHRene Haas
Oh, completely. I mean, it, it, it... And these are jobs that make people... That's a great, that's a great example, right? Because here's one where there may have been a stigma to being an electrician, right? Electrician is either, it's not maybe viewed as a highly educated job, or you don't need a PhD. It's a highly skilled job that requires a lot of training and certification, and you need tons of them, you know, to, to do this kind of work. Uh, and that's very, very critical to the, to the data centers. Um, so I think to your question, I think part of the backlash is just from fear.
- EGElad Gil
Mm-hmm.
- RHRene Haas
There's just, there's just a fear that my jobs are gonna go away. Uh, the AI boom, for good or for bad, has benefited a lot of people, and there's a lot of people who have no benefit from it, right? And, and, and there's a lot of America, just again, on the American political scene, who it's tough to make the mortgage. You know, their paychecks haven't gone up, and now they've got this AI thing that just like it's gonna even harder. So I think the, the data centers have become a bullseye Unfortunately, for all the things that could be bad about AI, which I think is just-
- EGElad Gil
People also are holding up like fake tainted water and claiming that, you know-
- RHRene Haas
Yeah
- EGElad Gil
... it's ruining the water supply. So I feel like there's other kind of things that are just being made up about data centers as a way to try and create fear.
- RHRene Haas
For sure.
- EGElad Gil
Um-
- RHRene Haas
Yeah, for sure. And unfortunately, it's become the boogeyman for a lot of, a lot of things.
- EGElad Gil
Mm-hmm.
- SGSarah Guo
I, I think it's also pretty clear that there's like, um, you know, uh, organized media influence around these issues as well. Um, uh, but it doesn't... I, I think it, you know, you can have all three separate points here, including yours, Rene, which is, um, there are benefits, uh, uh, from the construction of essentially like a rapidly growing new industry that can create new technology and new jobs and create, you know, um, external wealth for the communities around them, but it, it's on the industry to go communicate that.
- RHRene Haas
Yeah, I mean, on, on first principles, whether it was smartphones, the internet, personal computers, fill in your favorite technology, there is no downside from being the leader.
- SGSarah Guo
[laughs]
- RHRene Haas
There's, there's just not-
- SGSarah Guo
This is maybe the most important point.
- EGElad Gil
There's no country today-
- RHRene Haas
There's just not a downside from being the leader.
- SGSarah Guo
Yeah.
- RHRene Haas
There are, there are second and third order effects that you may not like.
- SGSarah Guo
Mm-hmm.
- RHRene Haas
But to be the laggard, you, you, the, you are having the entire script dictated to you and everything that kind of comes with it. I mean, look at other parts of the world that are just not the leaders in this space. Economically and socially, they're, they're left behind, and governments, you know, carry the large tax burden of it. So if you're on the wave of some technology, uh, innovation, and I would argue to some extent, AI is a little bit of the final frontier o-of, of what can be done with essentially intelligence. Of course, you want to be in the lead. Of course, you want to be driving that because the benefits for society are going to be enormous.
- 32:30 – 33:31
Arm Outlook
- EGElad Gil
What are you most excited about in the coming year or two for Arm?
- RHRene Haas
Being in the center of all that. Yeah. Honestly, I think we are, we are... I feel fortunate every day that we are in the heart of all of this and, and, um, the fact that we can be a participant in that ecosystem, we can help drive the innovation, we can be involved with leadership companies, develop leadership products. Uh, we're right in the middle of it all because, A, all the AI needs some level of compute. That's what Arm does. And that compute needs to be power efficient. That's what we're really, really good at. So those roads all lead through us. So what I-- And I've, you know, been in this industry my, my entire career, had a lot of times thinking about, gosh, what's the next product we're gonna need? Do people really need another tablet? And does it need to be eight point nine inches or nine point two inches? And now it's, I, I... there's no... the abundance of opportunity and innovation is so great with AI. So yeah, I'm just ex-- I'm, I'm super excited and, and, and, and feel blessed to be leading a company
- 33:31 – 37:06
CPU Opportunity
- RHRene Haas
that's in the center of it all.
- SGSarah Guo
The need for chips is driven by like massive change in workload, right? And we have continual massive change in workload, so no better place, time to, uh, uh, you know, go work on chip designs and, and sell to all of the people working on that innovation. Um, my understanding of like the CPU opportunity, uh, in this era is like two core pieces and then, you know, s- future, future devices and robotics as well. Um, but there's, there's the CPU in the rack. This is the Veras and the Gravitrons of the world. And then there's the, um, use from a agent perspective, like, you know, sandboxes and, um, uh, agents being able to use all of the, the software we already have and, um, API calls, tools, et cetera. Do you have any guess as to, you know, both these things are growing, but the scale of opportunity, or am I missing things that you guys are really excited about from the CPU perspective?
- RHRene Haas
Well, from the CPU standpoint, um, and I think when, when, when the data center thing was kind of exploding with-- Let me back up. When ChatGPT had the explosion thing and, and everything was all about the accelerators-
- SGSarah Guo
Mm-hmm
- RHRene Haas
... uh, I think there was so much focus on no matter what the question is, the answer is the accelerator. There's no computing problem that's ever been invented that doesn't utilize and can't utilize the microprocessor. It is, it is the heart of everything.
- SGSarah Guo
Mm-hmm.
- RHRene Haas
All roads lead through it, around it, past it, et cetera. So you do-- you look at fundamental system design, and you have to have CPUs. They just don't kind of go away. They were a little bit forgotten as this accelerator thing kind of took off. But what then became very obvious was as more and more of the data was moving away from training, training is obviously very important to recursive learning, reinforcement learning, to inference, the use of the tokens, the use of the information. Well, of course, in a system problem, something has to do the orchestration, arbitration decision around where those tokens go, right? The token factory just generates all these tokens. It's, it's like literally, where are the trucks that are gonna take the tokens away and give them to the users? That's what CPUs do. So until something's invented that says the CPU has gone away, and we're now doing it through some other mechanism which has yet been defined or invented, the CPU is gonna be doing just fine. Uh, and there's gonna be a lot of demand for it, a ton of demand, in addition to the accelerators that generate the tokens. But the way to think about it is, is, is it's a system, which again, going back to, you know, memory. Well, of course, memory is needed because in a computer von Neumann architecture or computing architecture-
- SGSarah Guo
Mm-hmm
- RHRene Haas
... you have a CPU, you have some accelerator, whether it's a floating point, a GPU accelerator, and memory. System design hasn't changed. I think some of the focus kind of moved around. But for Arm, and what-- By the way, that applies whether I'm talking about a data center, it applies whether I'm talking about an automobile, a robot, a phone, wearables. And in fact, as you get to the smaller footprints where more and more AI is going to take place, that's gonna be a sweet spot for Arm because the CPU is table stakes anyway. You have to have it to do all the things that are required in the edge device. But now we have an opportunity with our, uh, instruction set architecture to do a lot of things where you just can't put a fifty-watt GPU on your head, right? You're gonna have to do that sc- AI processing somewhere locally. So it's a great place.
- SGSarah Guo
[upbeat music] Find us on Twitter @NoPriorsPod. Subscribe to our YouTube channel if you want to see our faces. Follow the show on Apple Podcasts, Spotify, or wherever you listen. That way you get a new episode every week. And sign up for emails or find transcripts for every episode at no-priors.com.
Episode duration: 37:06
Install uListen for AI-powered chat & search across the full episode — Get Full Transcript
Transcript of episode 85Y6h_jbRfs
