Skip to content

By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.

Latent SpaceLatent Space

The AI Frontier: from open weights to open research — Eiso Kant, Poolside AI

From spending $12 million building language models for code before the world cared to creating a Model Factory that can take a model from pre-training to release in eight weeks, Eiso Kant has spent more than a decade betting that code is…

Eiso KantguestswyxhostVibhuhost
Jul 22, 20261h 56mWatch on YouTube ↗

Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.

At a glance

WHAT IT’S REALLY ABOUT

Poolside’s case for open research, model factories, and persistent agents

  1. Eiso Kant traced his path from building code models pre-transformers—prompted by Andrej Karpathy’s RNN essay—through a $12M startup failure that later felt “vindicated” by ChatGPT.
  2. He explained Poolside’s renewed commitment to openness, arguing for a world with “100 foundation model companies” and positioning open research as more enabling than merely releasing weights.
  3. He detailed Poolside’s “model factory” philosophy: model building as an end-to-end engineering process optimized for fast, trustworthy experimentation at high volume and rapid model shipping cadence.
  4. He described how immutability, reproducibility, and streaming data into training improved both iteration speed and scientific rigor, and how internal agents are increasingly automating research and engineering tasks.
  5. He emphasized that Laguna S’s performance reflects post-training-driven behaviors like persistence and verification, suggesting smaller models may become far more capable while Poolside continues scaling larger models.

IDEAS WORTH REMEMBERING

5 ideas

Poolside chose openness to avoid an “oligopoly of intelligence” and enable many competing model builders.

He described a shift from keeping heads-down to revisiting openness after concluding that a future dominated by only a handful of model builders would be dystopian; he said Poolside’s contribution is releasing both weights and research even while key questions remain (business model, misuse, government response).

Open research matters more than open weights for reproducibility and for helping others catch up.

He framed weights as “a binary” that doesn’t let others recreate the process, and argued that sharing lessons from “tens of thousands of experiments” is a more meaningful accelerant for other teams than weights alone, despite practical limits around datasets.

Model building is “90% engineering,” and the competitive edge is a high-throughput model factory.

He said the hard part isn’t a single training run but building an end-to-end “industrialized process” that minimizes time from research idea to trusted result, enabling frequent model cycles (he cited five-week and eight-week pretrain-to-launch timelines).

Streaming data plus immutable datasets and versioned code unlock both speed and scientific rigor.

He credited streaming data into training (rather than repackaging and copying datasets) and treating the data layer as immutable, paired with fully versioned code, as key enablers of fast iteration and the ability to reproduce runs “down to the single token.”

Agentic automation is already accelerating research workflows inside model development.

He described agents increasingly handling parts of the model factory—writing code, launching jobs, evaluating results—while humans remain in the driver’s seat, and said this shows early “twinklings” of recursive self-improvement.

WORDS WORTH SAVING

5 quotes

I owe getting into this space to Andrej Karpathy.

— Eiso Kant

We failed ultimately at the time, and it kind of was like biggest failure of my career, right? You blew $12M of investors' money, which was a lot back then.

— Eiso Kant

I rather live in a world that has 100 foundation model companies than a world that has five, even if I was one of the five.

— Eiso Kant

Our view from very early on in the company was that model building is ultimately 90% engineering.

— Eiso Kant

I think MCP and tools are stupid.

— Eiso Kant

Read the available transcript
Karpathy’s RNN influence and early code modelingStartup failure, scaling hindsight, and ChatGPT vindicationOpen weights vs open research and ecosystem pluralityGlobal remote hiring and talent strategyModel factory and experiment velocityStreaming data into training and immutable datasetsReproducibility, scientific rigor, and ablations at scale

SPEAKERS

  • Eiso Kant

    guest

    Co-founder/leader at Poolside AI, focused on frontier coding/agentic foundation models and applied research/engineering.

  • swyx

    host

    Co-host of Latent Space and AI engineering writer/community builder who frequently leads technical interviews.

  • Vibhu

    host

    Co-host of Latent Space who asks technical questions on model training, evaluation, and AI infrastructure.

High quality AI-generated summary created from speaker-labeled transcript.

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.