No Priors Ep. 63 | With Sarah Guo and Elad Gil
Sarah Guo (host), Elad Gil (host)
In this episode of No Priors, featuring Sarah Guo and Elad Gil, No Priors Ep. 63 | With Sarah Guo and Elad Gil explores aI’s Next Frontiers: Local Models, Long Context, Energy Limits, Music Sarah Guo and Elad Gil discuss rapid advances across the AI stack, from creative tools like Suno and Udio to small, locally-run language models and Meta’s latest AI products. They examine how platform dynamics play out as Apple, Meta, Snowflake, Databricks, and hyperscalers all jostle over models, data, and distribution. The conversation explores technical directions such as long-context LLMs and specialized hardware, alongside looming constraints like data center energy, nuclear power, and policy. Throughout, they frame massive AI CapEx as comparable to past infrastructure waves and debate which layers—models, platforms, apps—will hold durable value.
AI’s Next Frontiers: Local Models, Long Context, Energy Limits, Music
Sarah Guo and Elad Gil discuss rapid advances across the AI stack, from creative tools like Suno and Udio to small, locally-run language models and Meta’s latest AI products. They examine how platform dynamics play out as Apple, Meta, Snowflake, Databricks, and hyperscalers all jostle over models, data, and distribution. The conversation explores technical directions such as long-context LLMs and specialized hardware, alongside looming constraints like data center energy, nuclear power, and policy. Throughout, they frame massive AI CapEx as comparable to past infrastructure waves and debate which layers—models, platforms, apps—will hold durable value.
Key Takeaways
AI music tools are expanding who can create and personalize audio content.
Models like Suno and Udio make it trivial for non-musicians to generate full songs with lyrics and vocals, enabling concepts like ‘personal soundtracks’ in a favorite artist’s style and foreshadowing broader creative AI applications.
Get the full analysis with uListen AI
Small, on-device models will redefine latency, privacy, and user experience.
Apple’s small open models and demand for 1–3B parameter LLMs suggest a future where many AI tasks run locally, enabling low-latency, persistent, and proactive features without constant cloud inference costs.
Get the full analysis with uListen AI
Platforms will likely absorb generic AI UX layers, but vertical or cross-platform plays can still win.
History shows OS vendors and platforms tend to subsume core experiences (like Office or launchers), yet niche or vertical products (e. ...
Get the full analysis with uListen AI
Meta’s multi-pronged AI push shows the advantage of scale and distribution.
Meta is shipping capable consumer agents, image/animation tools, and strong open-source models, demonstrating how large players with massive GPU budgets can push past ‘optimal’ training points and still gain performance.
Get the full analysis with uListen AI
Long-context models will change how we architect prompts and applications.
With context windows in the millions of tokens (as seen at Magic and in Gemini 1. ...
Get the full analysis with uListen AI
Frontier model training is converging on a capital and energy game.
As training runs demand 500 MW–1 GW-scale data centers, hyperscalers and energy-rich regions (e. ...
Get the full analysis with uListen AI
Nuclear power and policy choices will materially influence AI’s trajectory.
Elad and Sarah argue that decades of underinvestment in nuclear—driven by policy rather than technology—now constrain cheap, abundant energy for AI data centers, turning energy policy and geopolitics into core AI strategic variables.
Get the full analysis with uListen AI
Notable Quotes
“It just seems like an interesting moment in time from the perspective of, look at all these different creative things that people are now empowered to do.”
— Elad Gil
“There’s been huge demand for models that actually have useful capability in a one and three billion parameter size that'll fit on edge devices.”
— Elad Gil
“In aggregate, a handful of players in terms of the hyperscalers are spending almost 200 billion dollars this year on compute for AI.”
— Sarah Guo
“These are actually very solvable problems if we choose to solve them, which is why I thought that job posting on the Microsoft website was so interesting.”
— Elad Gil
“If you do think of AI as a strategic issue and a national security issue, not using every energy resource we have is yet another dependency that we're creating for ourselves.”
— Sarah Guo
Questions Answered in This Episode
How might AI-generated music change the economics and culture of the music industry, especially around rights, personalization, and artist branding?
Sarah Guo and Elad Gil discuss rapid advances across the AI stack, from creative tools like Suno and Udio to small, locally-run language models and Meta’s latest AI products. ...
Get the full analysis with uListen AI
What concrete user experiences become possible once small LLMs reliably run on phones and laptops without cloud calls?
Get the full analysis with uListen AI
Where is the sustainable edge for independent AI startups if hyperscalers and platforms control frontier models, data, and distribution?
Get the full analysis with uListen AI
How should policymakers balance safety, climate concerns, and competitiveness when considering large-scale nuclear power to support AI data centers?
Get the full analysis with uListen AI
At what point will longer context windows stop delivering meaningful gains, and what new application patterns could emerge before we hit that limit?
Get the full analysis with uListen AI
Transcript Preview
(music plays) Hey, listeners. You are here for another episode of No Priors, just with me and Elad. And there's been a lot going on in earnings and in the technical world, so I think we will start with maybe just one fun thing that seems to have taken flight in terms of music generation. Elad, what do you make of the popularity that Suno and Udio have found?
When you said fun things, I thought you were going to talk about my hats. I have two hats.
(laughs) We can talk about your hats.
I have my Bitcoin halving hat that I got from Coinbase. As you see, the Bitcoin halving. And then, um, Zaid has these Make AI Great Again hats, that he's actually selling. I think it's going to fund his data labeling habit.
That's a lot of hats.
I know, yeah. That's all I got. That's all I got left here.
If anybody has read Jared Kushner's book, there's a great bit about how much money they're making from all the, uh, MAGA swag, and so-
Yeah.
Listeners, Elad and I are making hats and tequila for the guests.
Yeah.
But for the low, low price of one H100 GPU, we will give, uh, each of those to you too.
Or a Bitcoin. Either way.
Okay, I'll take the Bitcoin instead. Yeah.
Me too. I know, yeah. (laughs) I think we all would at this point. We can check in again in a couple months when the D100s come out, or whatever time period. So, um, yeah, so, you know, as you know, there's been some really interesting things happening on the music generation side. And so, um, there's both Suno and Udio, and both seem to be kind of taking people by storm in terms of really interesting music-based models and, um, it feels like one of those things where it's early, but it's really giving a glimpse of what's coming in terms of the ability to create other types of content. Obviously, the very first content wave in some sense was simple text-based things on GPT-3 like Jasper, and then we hit a image gen wave, and that was Midjourney and Stable Diffusion and things like that. And then we had obviously chat come out as sort of a new type of format and interaction modality, and then we had video with things like Pika, and so it just feels like sequentially we're hitting these different formats. And then obviously Suno from, um, from OpenAI, and now we have these really interesting music models where you can specify, um, the type of music that you want. You can write the lyrics. It'll add vocals. And so, you know, these really seem to be the two models initially at least that people are really adopting. And so it just seems like an interesting moment in time from the perspective of look at all these different creative things that people are now empowered to do, and look at the different ways to engage. And of course you could imagine going forward in time and saying, "Okay, s- at some point there'll be voice cloning where..." And I think, um, I think it was Drake who put out a song, right, where he had two or three other rappers that he just voice cloned in. And you can imagine a world where you could use anybody's voice, assuming there's permissions and everything else, to, to generate your own songs and content and the whole thing. So it just seems like a very exciting future world between Udio, Suno, and some of those other companies.
Install uListen to search the full transcript and get AI-powered insights
Get Full TranscriptGet more from every podcast
AI summaries, searchable transcripts, and fact-checking. Free forever.
Add to Chrome