Skip to content

By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.

Latent SpaceLatent Space

Building Legal Agents When You Can't See the Data — Jacob Lauritzen, CTO of Legora

Legora can’t read a single trace of what its agent does for a lawyer. The data belongs to the law firm’s clients. How do you build and test an agent when you can’t see its work? Jacob Lauritzen is the CTO of Legora, one of the fastest-growing companies in legal tech history. The team started in a Stockholm basement with ChatGPT, Swedish law, and a search tool. Today, a lawyer can use Legora to draft and edit Word documents, review 10,000 contracts in a single table, or run due diligence. The agent also coordinates work between lawyers, clients, and other agents. When Legora made its own acquisitions, the team used it for diligence. What we talked about • Why Legora resisted adding a model picker for years, and why it finally added one • Jacob’s estimate that models already do about 60% of legal work well, and why the rest takes a smarter model • How three engineers and three lawyers build test environments modeled on customers’ work, much like the “worlds” used in reinforcement learning • A citation problem where the model got it right 70% of the time, then 99% after one release. Legora didn’t have to change anything. • Why Legora runs everything on Azure and why it doesn’t use ElevenLabs • Tabular Review, the million-cell spreadsheet the industry copied down to the name • How intake works, how agents create lists, and how a list can start another agent • What legal engineers and forward-deployed engineers each do, and who gets to write code • The 300 Spartans slide Jacob used to argue that 20 engineers would be enough forever. Now there are 100, and he still feels short-handed. • Why Jacob finds Fable and Opus too chatty for drafting and likes Astra’s concise writing • Why drafting a long contract is a search problem • Whether model labs will cut off legal tools the way they cut off coding tools • What happens to law firm partnerships, the billable hour, and jobs for junior lawyers Legora is hiring engineers in New York, Stockholm, and London. Chapters 0:00 Cold open 0:40 Meet Jacob Lauritzen, CTO of Legora 1:05 Starting out as underdogs in a Stockholm basement 1:54 How Legora grew from ChatGPT with Swedish law into a legal agent 4:12 The switch from assistant to agent 5:23 Which models Legora uses and why it added a model picker 7:48 Are today’s models good enough for lawyers? 8:20 What agents couldn’t do nine months ago 9:18 Testing the agent in simulated worlds and a 10,000-file data room 10:07 The evals team and Legora’s 100 legal engineers 11:03 When evals didn’t seem worth it and one release took citations from 70% to 99% 12:18 What legal practice could look like in five to ten years 14:18 Will the law firm partnership model survive? 16:40 What happens to paralegals and junior lawyers? 18:00 The billable hour and why earlier legal tech fell short 19:39 Where the money goes now 22:44 How Legora used its own product for acquisition diligence 23:59 How Swedish and American law firms differ 26:12 Product metrics when you can’t read the traces 27:41 Paraphrasing traces and narrowing failures down to 10 or 20 types 28:42 Why data privacy led Legora to run everything on Azure 30:04 Open-weight models and model arbitrage 30:55 Transcription models and why Legora doesn’t use ElevenLabs 33:33 The agent, Tabular Review, projects, and the Word add-in 34:24 How a lawyer uses Tabular Review 35:51 Why a spreadsheet works and what you learn from the first 10 rows 37:53 How the legal intake bot works in Slack 39:11 How agents create lists and lists start agents 40:15 Building products on those same pieces and acquiring Wexler 42:37 What forward-deployed engineers do at Legora 43:52 How legal engineers and forward-deployed engineers onboard a big client 46:43 What’s next for the forward-deployed team over the coming year 47:24 Why Legora resisted building APIs 49:26 Can the agent be the API? 50:12 The 300 Spartans slide and the plan to stay at 20 engineers 51:32 The bets nobody asked Legora to make 53:05 Post-training open-weight models for legal research 54:05 Search, retrieval, and late interaction 54:51 What makes a good legal agent harness and why drafting depends on search 56:25 Which model writes the best draft? 57:03 Hallucinations and Legora’s citation system 57:41 Do lawyers check the citations? 58:19 MapReduce or one big context window for a million-token contract? 1:00:16 Getting anonymized examples and the idea of buying a law firm for its data 1:01:53 Why Jacob advises against default embeddings 1:02:44 Will lawyers work in Legora or through Claude? 1:03:26 Will the model labs cut Legora off? 1:04:24 Law schools and scholarships for computer science majors 1:05:28 Hiring in New York, Stockholm, and London 1:06:09 Why most work eventually becomes legal work Guest — Jacob Lauritzen, CTO of Legora https://legora.com Co-host — swyx, Latent Space Host — Basil Chatha, Forward Deployed https://forwardeployed.com

swyxhostJacob LauritzenguestBasil Chathahost
Nov 2, 20261h 7mWatch on YouTube ↗

Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.

CHAPTERS

  1. 0:00 – 0:40

    Cold open: job displacement debate and why citations matter

    The hosts open with a provocative take that paralegals and junior lawyers are “gone,” and Jacob pushes back with what Legora is actually seeing in practice. He also previews how a model update dramatically improved citation behavior without the team changing anything.

    • •The host argues much legal work doesn’t need “Mythos-level intelligence,” implying junior roles could disappear
    • •Jacob says that’s not what Legora is seeing in reality
    • •Jacob describes a citation issue that jumped from roughly 70% to 99% after a model release
    • •The host frames Legora as the kind of tool you’d want for very large, high-stakes transactions
  2. 0:40 – 1:54

    Meeting Jacob Lauritzen and Legora’s “underdog” culture

    Jacob introduces himself (including the origin of his Danish surname) and explains how Legora’s European roots shaped the company. He describes starting as an underestimated team in a Stockholm basement and learning to be bolder as they expanded into the US.

    • •Jacob explains the meaning and origin of “Lauritzen” as a patronymic surname
    • •He describes Legora’s early positioning as an underdog competing against larger US players
    • •Jacob says the team’s default posture is humble because they had to fight for credibility
    • •As Legora entered the US, they had to learn to more openly communicate confidence and ambition
  3. 1:54 – 4:12

    From “ChatGPT + Swedish law search” to a broader legal work platform

    Jacob walks through Legora’s product evolution, starting with a simple research agent and expanding into drafting, editing, organizing files, and complex analysis. He frames the platform as both doing legal work and orchestrating how legal work gets done.

    • •Legora began as a ChatGPT-like interface combined with Swedish law search for legal research
    • •Jacob describes legal research as finding precedent cases and relevant prior decisions
    • •The product expanded to drafting, editing Word files, organizing files, and running analyses
    • •Legora adds workflow/orchestration features like Lists, Intake, and Portal for collaboration
  4. 4:12 – 5:20

    The assistant-to-agent shift and what “agent” means at Legora

    Jacob pinpoints a shift from “assistant” to “agent” about a year prior, in a period before “agents” became mainstream. The discussion frames Legora as ChatGPT-like for lawyers, but enhanced with domain-specific tools embedded in the UI.

    • •Jacob describes a deliberate switch from assistant behavior to agent behavior
    • •The timeline discussion references YC timing and the era before agents “took off”
    • •The host characterizes the core UI as “ChatGPT for lawyers,” plus specialized tools in the sidebar
    • •The conversation sets up later deep dives into Tabular Review, Intake, and other modules
  5. 5:20 – 7:48

    Model routing, the model picker, and why lawyers don’t want to think about models

    They discuss using multiple models depending on task, and why giving users a model picker is controversial but sometimes demanded. Jacob and the host emphasize that lawyers mostly want the system to choose the best option, since model selection isn’t their job.

    • •Jacob says Legora uses different models by task and sometimes by tool
    • •Legora includes a model selector for the agent’s primary model, though Jacob isn’t sure it will remain
    • •The host argues domain wrappers should abstract model choice away from end users
    • •They note some users still want to try new models and accept burning credits faster
  6. 7:48 – 9:25

    Are models good enough yet? Evals, regressions, and what improved in nine months

    Jacob describes current model capability as a distribution: a majority of work is already handled well, while complex analysis still needs more intelligence. He explains how Legora tracks model performance across practice areas and tasks, and notes that releases can improve some areas while regressing others.

    • •Jacob estimates a large portion of legal work is done well today, with remaining gaps in complex analysis
    • •He describes sub-agent delegation as a key capability that improved significantly
    • •Legora maintains a heat map of model performance across practice areas and task types
    • •Jacob notes model releases can regress some tasks even when they improve others
  7. 9:25 – 12:09

    Simulated eval “worlds,” the evals team, and leveraging 100 legal engineers

    Jacob explains how Legora evaluates agents using project-like simulated environments, such as due diligence in a large data room, and grades outputs like reports and red-flag detection. He details an evals team combining engineers and lawyers, plus a larger pool of “legal engineers” who act as force multipliers for product and evaluation work.

    • •Evals are structured as project “worlds,” such as a due diligence with a very large data room
    • •They break tasks into components like drafting the final report and finding red flags
    • •The evals team includes both engineers and lawyers working together
    • •Jacob describes “legal engineers” as ex–Big Law lawyers with strong tech backgrounds, used heavily in product shaping and evals
  8. 12:09 – 22:44

    Where legal economics changes: partnership incentives, junior roles, and the billable hour

    Jacob predicts lawyers will become more productive and spend more time on judgment and client work, while less time goes to tedious document trawling. They debate how this affects junior roles and the pyramid, then unpack why billable hours historically resisted efficiency—and why pricing is already shifting toward fixed/project fees for some work.

    • •Jacob forecasts higher lawyer productivity and more focus on strategic judgment and client relationships
    • •He analyzes why partnerships exist in professional services: aligning ownership with human capital
    • •Jacob argues firms need durable “intangible capital” by codifying firm-specific ways of working into systems
    • •They discuss billing shifts: some work moving to flat/project fees, and even some work done for free to maintain relationships
  9. 22:44 – 26:12

    Dogfooding Legora in M&A diligence and how client behavior differs by region

    Jacob explains how Legora uses its own tools to conduct parts of acquisition diligence, while still bringing in counsel for strategic risk assessment—especially across jurisdictions. He also contrasts American and European customers: US firms move faster and often want custom builds and integrations, while European firms more often prefer off-the-shelf workflows.

    • •Jacob says Legora frequently uses its own product for diligence work in acquisitions
    • •They still use outside counsel for strategic assessments and jurisdiction-specific issues like payroll
    • •Jacob declines to share specific red-flag examples but confirms they’ve paused deals based on findings
    • •He contrasts US appetite for deep custom integrations with Europe’s preference for off-the-shelf adoption
  10. 26:12 – 28:42

    Measuring product success when you can’t read traces: privacy constraints and safe signals

    Jacob outlines standard enterprise product metrics (usage, renewal, engagement) plus lightweight online eval signals used for rollouts. He emphasizes a core challenge: Legora generally can’t inspect user traces or customer data because it belongs to law firms’ clients, forcing the team to approximate behaviors via eval sets and classify failures into broad types.

    • •Legora tracks usage metrics like engagement and renewals, and uses online eval signals for feature flags
    • •Jacob says they largely cannot inspect traces due to confidentiality and client-owned data
    • •They discuss paraphrasing/abstraction as a spectrum, and choosing the safest approach
    • •Jacob describes classifying failures into roughly 10–20 known modes to get actionable signal without seeing data
  11. 28:42 – 33:32

    Privacy-driven infrastructure choices, model arbitrage, and speech/transcription trade-offs

    Jacob explains Legora’s infrastructure runs on Azure, originally because many law firms rejected AWS and trusted Microsoft due to existing 365 security approvals. They then discuss “model arbitrage”—optimizing across model cost, latency, governance, and availability—and why transcription quality is still not “good enough” in legal contexts, including vendor constraints from strict data processing agreements.

    • •Jacob says Legora chose Azure because many firms wouldn’t accept AWS or other vendors at the time
    • •He notes on-prem interest has largely faded as firms accepted cloud as safe (and often safer)
    • •They discuss routing tasks across frontier and open-weight models based on cost/latency/governance trade-offs
    • •Jacob highlights transcription use cases (including uploaded hearings) and notes vendor limitations due to strict DPAs
  12. 33:32 – 42:37

    Product deep dive: Agent, Tabular Review, Word add-in, Intake, and the Lists primitive

    They walk through Legora’s major product surfaces, focusing on Tabular Review for bulk extraction across thousands of documents and Intake for Slack-based request routing. Jacob explains why a spreadsheet form factor works, how users validate by running the first 10 rows, and how Lists act like a flexible database that lets agents trigger workflows and build new products—including litigation-oriented “fact intelligence” from the Wexler acquisition.

    • •Tabular Review is used for large-scale diligence: each row is a document, each column is a question to extract
    • •The agent can automatically spin up a Tabular Review, analyze results, flag red flags, and draft memos
    • •The spreadsheet format supports citations to source documents and collaborative review, including marking cells reviewed
    • •Intake in Slack creates tasks in Lists; Lists can trigger agents and agents can create/read Lists, enabling automation and modular product building
  13. 42:37 – 53:05

    Forward-deployed engineering, onboarding big clients, and why Legora resisted broad APIs

    Jacob describes how legal engineers and forward-deployed engineers help clients get value quickly, with clear separation: legal engineers configure without code, while forward-deployed engineers ship production integrations. He explains why Legora delayed expanding its API surface—moving fast as a small team made versioned APIs costly—and explores whether “the agent could be the API,” balanced against determinism, cost, and latency concerns.

    • •Jacob says forward-deployed engineers are “true engineers” who write production code, unlike legal engineers
    • •Onboarding varies by client; teams map existing workflows into Legora and build integrations when needed
    • •Forward-deployed engineers may be onboarded like client employees (e.g., given a laptop) but still avoid touching client data
    • •Jacob explains API reluctance: rapid product iteration made API maintenance too expensive early on, and he considers whether triggering the agent could replace some API needs
  14. 53:05 – 58:35

    Post-training open-weight models, search as the core bottleneck, and citation-backed hallucination control

    Jacob explains Legora hadn’t fine-tuned models historically, but is now post-training open-weight models for bounded tasks where it matters—especially legal research as a fan-out retrieval problem. They discuss search architecture choices, harness/scaffolding around drafting and editing, dealing with verbosity in drafting, and a citation system that links claims back to highlighted source evidence; Jacob notes lawyers’ verification habits vary, similar to code review.

    • •Jacob says Legora is beginning post-training for narrow tasks, not trying to build a general frontier model replacement
    • •Legal research is highlighted as a key target: fast, cheap, low-latency retrieval and reasoning
    • •They discuss harness elements like file editing workflows, analysis pipelines, and how drafting depends on finding the right precedents
    • •Jacob describes a citation system with clickable links that highlight exact source passages, while acknowledging many users won’t verify everything
  15. 58:35 – 1:07:21

    Long-document limits, getting anonymized examples, embedding strategy, and the platform outlook

    Jacob notes long-document reasoning and consistent edits across massive contracts remain difficult, forcing teams to switch between chunking/orchestration and “put everything in context” approaches as models evolve. They discuss asking customers for anonymized examples to reproduce failures, the limits of buying data, and the importance of not relying on default embeddings—while also needing multilingual support. The episode closes with questions about whether lawyers will work inside Legora or via general assistants, vendor risk from model labs, early thoughts on law-school adoption, and hiring locations.

    • •Jacob says long-document reasoning and consistent cross-document edits are still hard for models today
    • •They discuss requesting anonymized customer examples to debug issues that can’t be inspected directly
    • •The host and Jacob argue against “default embeddings,” while Jacob flags multilingual needs as a key constraint
    • •Jacob predicts both workflows will exist: enterprises may use general assistants plus tools, while law firms may prefer using Legora directly; they close with discussion of law-school programs and hiring in New York, Stockholm, and London

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.