Skip to content

By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.

YC Root AccessYC Root Access

Context Engineering for Engineers

Jeff Huber, founder of Chroma, shares why building with large language models isn’t just about prompts or RAG—it’s about context.

Aug 25, 202511mWatch on YouTube ↗

Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.

Episode Details

EPISODE INFO

Released
August 25, 2025
Duration
11m
Channel
YC Root Access
Watch on YouTube
▶ Open ↗

EPISODE DESCRIPTION

Jeff Huber, founder of Chroma, shares why building with large language models isn’t just about prompts or RAG—it’s about context. He explains how deciding what goes into the context window shapes reliability, why performance drops with long inputs, and how careful filtering and compaction can make AI systems faster and more useful. Chapters: 00:00 - Introduction to Context Engineering 00:26 - Understanding AI Systems as Programs 01:29 - The Concept of Context Engineering 02:02 - Building Reliable Software with AI 02:31 - Challenges with Long Contexts 03:07 - Chroma's Technical Report Insights 03:57 - Needle in a Haystack Problem 05:08 - The Importance of Context in AI Tasks 06:05 - Gather and Glean Model 06:44 - Data Gathering Techniques 07:31 - Gleaning and Optimizing Data 08:26 - Content Engineering for Agents 09:35 - Challenges with Agent Performance 10:13 - The Role of Compaction 10:57 - Conclusion and Final Thoughts

EPISODE SUMMARY

In this episode of YC Root Access, Context Engineering for Engineers explores How to curate AI context for reliable engineering and agents LLMs should be treated like software programs whose outputs depend heavily on the instruction set, tools, and information placed in the context window.

RELATED EPISODES

Using LongMemEval to Improve Agent Memory

Using LongMemEval to Improve Agent Memory

Advanced Context Engineering for Agents

Advanced Context Engineering for Agents

Context Engineering: Lessons Learned from Scaling CoCounsel

Context Engineering: Lessons Learned from Scaling CoCounsel

Salient: The Fintech Startup Processing $1B+ in Loans with AI

Salient: The Fintech Startup Processing $1B+ in Loans with AI

How Diode Is 10x-ing Hardware Design

How Diode Is 10x-ing Hardware Design

The Startup Powering Billions In Trades Every Day

The Startup Powering Billions In Trades Every Day

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.