No Priors Ep. 26 | With Weights & Biases CEO Lukas Biewald

How are ML developer tools helping to advance our capabilities? Lukas Biewald, CEO of Weights & Biases, joins Sarah Guo and Elad Gil this week on No Priors. Lukas explores the impact of ML in various industries like gaming, AgTech, and fintech through his insightful perspective. He discusses the impact of LLMs, puts them in context of the evolution of ML engineering over the past decade and a half, and tells the backstory of Weights & Biases' success. He gives advice for aspiring AI company founders, placing emphasis on customer feedback and using insecurity as a vehicle for better customer discovery. Prior to founding Weights & Biases, Lukas attacked the problem of data collection for model training as the Founder of Figure Eight, which he sold in 2019. He holds an MS in Computer Science and a BS in Mathematics from Stanford University. 00:00 - Lukas Biewald's Journey in AI 08:16 - Startup Evolution and Machine Learning 18:54 - Open Source Models Implications and Adoption 29:54 - ML Impact in Various Industries 40:27 - Advice for AI Company Founders

Elad GilhostLukas BiewaldguestSarah Guohost

Aug 2, 202343mWatch on YouTube ↗

WHAT IT’S REALLY ABOUT

Lukas Biewald on building ML tooling, data, and the LLM shift

Lukas Biewald, founder of Figure Eight and Weights & Biases (W&B), traces his path from early, often-frustrating academic ML work to building two companies around data labeling and ML tooling. He explains how Figure Eight struggled for years in a tiny ML market, then caught the self‑driving wave just as Scale AI out-executed them, ultimately freeing him to start W&B. W&B focuses on simple, developer-first experimentation and MLOps tools, and is now pivoting aggressively to support LLM workflows with its Prompts product as Biewald sees GPT adoption as an existential shift. Throughout, he emphasizes data quality, long-term product thinking, deep customer contact, and the emerging but still-embryonic real-world adoption of LLMs, especially in verticals like pharma and agriculture.

IDEAS WORTH REMEMBERING

5 ideas

Data quality and collection often matter more than model choice.

Biewald’s experience at Yahoo showed identical ranking models performed very differently across countries purely due to training data rigor, inspiring Figure Eight to put ML practitioners closer to the labeling process.

ML markets evolve in discontinuous waves, not smooth growth.

Figure Eight endured nearly eight stagnant years because there simply weren’t enough serious ML customers until self-driving cars emerged, illustrating how timing and new application waves dramatically reset the opportunity landscape.

ML tooling must be designed for researchers and developers, not DevOps abstractions.

Biewald argues that tools like Git LFS, Docker, and Kubernetes are too complex or ill-suited for many ML practitioners, who need simple, ergonomic ways to handle experiments, data versioning, and reproducibility within their workflows.

LLMs are an existential shift for many traditional ML workflows and tools.

Tasks like sentiment analysis and document structuring can now be handled directly by GPT-style APIs, pushing W&B to rapidly build LLMOps features (Prompts) even before revenue data reflects the change, based on observed customer behavior.

Enterprise LLM adoption is still very early despite the hype.

Biewald notes that only a small number of companies have LLMs truly in production; most are still prototyping, and long enterprise planning cycles mean the real tooling market size is currently modest relative to the buzz.

WORDS WORTH SAVING

5 quotes

I just really wanted to work on something that people cared about.

— Lukas Biewald

I kind of realized, you know, I am actually getting out of date myself.

— Lukas Biewald

This is actually our kind of first real existential threat, I think.

— Lukas Biewald, on LLMs impacting W&B’s core business

Very, very few people have LLMs in production… it’s just an insanely saturated tools market with very few people getting things out.

— Lukas Biewald

Everybody knows [you should] make something people want, but no one cares about it enough.

— Lukas Biewald

Early machine learning research with Daphne Koller and limitations of pre-deep-learning methodsFounding, growing, and selling Figure Eight/CrowdFlower as a data labeling companyOrigins, product philosophy, and adoption of Weights & Biases as an ML developer toolImpact of deep learning and LLMs on traditional ML workflows and toolingClosed-source vs open-source approaches to ML tools and developer ergonomicsReal-world ML adoption across industries, especially pharma, gaming, agriculture, and fintechFounding lessons and advice on customer focus, long-term thinking, and product–market fit in AI startups

High quality AI-generated summary created from speaker-labeled transcript.

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.