Skip to content

By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.

YC Root AccessYC Root Access

Context Engineering: Lessons Learned from Scaling CoCounsel

Jake Heller has spent years building AI tools for lawyers. With early access to GPT-4, he and his team realized the model could finally perform legal work at a professional level—scoring in the 90th percentile on the bar exam where GPT-3.5…

Jake Hellerguest
Aug 25, 202520mWatch on YouTube ↗

Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.

Episode Details

EPISODE INFO

Released
August 25, 2025
Duration
20m
Channel
YC Root Access
Watch on YouTube
▶ Open ↗

EPISODE DESCRIPTION

Jake Heller has spent years building AI tools for lawyers. With early access to GPT-4, he and his team realized the model could finally perform legal work at a professional level—scoring in the 90th percentile on the bar exam where GPT-3.5 had only reached the 10th. That breakthrough led to Co-Counsel, an AI legal assistant for research and contracts, and eventually to Casetext’s acquisition by Thomson Reuters. In this video, Jake breaks down what it takes to turn powerful models into reliable products, and the lessons he’s learned from building AI for one of the world’s most demanding professions. Chapters: 00:28 - Early Work with GPT-4 00:53 - Pivot to Co-Counsel 01:38 - Success with GPT-4 02:34 - Acquisition by Thomson Reuters 02:57 - Introduction to Context Engineering 03:24 - Developing Co-Counsel: Three Big Steps 03:44 - Defining the Customer Experience 04:57 - Legal Research Example 06:13 - Linear vs. Agentic Tasks 08:02 - Writing Effective Prompts 12:44 - Importance of Context 13:33 - Challenges in Prompt Engineering 15:49 - Tricks and Tips for Prompt Engineering 18:18 - Reinforcement Fine-Tuning and Model Selection

SPEAKERS

  • Jake Heller

    guest

    Co-founder and CEO of Casetext, where he led development and scaling of the CoCounsel legal AI assistant.

EPISODE SUMMARY

In this episode of YC Root Access, featuring Jake Heller, Context Engineering: Lessons Learned from Scaling CoCounsel explores How CoCounsel scaled legal AI using evals, context, and tuning GPT-4’s leap in legal reasoning quality enabled Casetext to pivot to CoCounsel and deliver lawyer-like performance at scalable speed.

RELATED EPISODES

Motion: Redefining How Work Gets Done

Motion: Redefining How Work Gets Done

Exa: Organizing the World’s Knowledge

Exa: Organizing the World’s Knowledge

HappyRobot: Automating the Work That Moves the World

HappyRobot: Automating the Work That Moves the World

Context Engineering for Engineers

Context Engineering for Engineers

Using LongMemEval to Improve Agent Memory

Using LongMemEval to Improve Agent Memory

Advanced Context Engineering for Agents

Advanced Context Engineering for Agents

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.