Skip to content

By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.

Latent SpaceLatent Space

GPT 4.1: The New OpenAI Workhorse

We’ll keep this brief because we’re on a tight turnaround: GPT 4.1, previously known as the Quasar and Optimus models, is now live as the natural update for 4o/4o-mini (and the research preview of GPT 4.5).

Alessio FanellihostswyxhostMichelle PokrassguestJosh McGrathguest
Apr 15, 202545mWatch on YouTube ↗

Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.

At a glance

WHAT IT’S REALLY ABOUT

GPT 4.1: developer-focused models with stronger coding and million context

  1. OpenAI released GPT 4.1, 4.1 Mini, and 4.1 Nano, with the guests emphasizing developer-centric improvements in instruction following, coding, and a one-million-token context window.
  2. The guests said the “4.1” name signals a large jump over the 4o line while remaining smaller and cheaper than GPT 4.5, which they described as stronger on some intelligence evaluations but not the best fit for most developer usage.
  3. They discussed long-context challenges as primarily about dense, ordered, and multi-step reasoning over context, and highlighted newly open-sourced evaluations involving ordering and graph-walking as better measurements than simple retrieval tests.
  4. They described instruction-following work informed by opted-in, anonymized real API data, arguing that many common public evals focus on instructions that are easy to grade rather than what developers actually ask for.
  5. They framed GPT 4.1’s coding gains as the result of multiple targeted workstreams (diff quality, repo exploration, compiling/tests) plus broad post-training improvements, and mentioned an internal reduction in unnecessary code edits compared to GPT-4o.

IDEAS WORTH REMEMBERING

5 ideas

GPT 4.1 is positioned as a developer-focused lineup with long context.

Michelle Pokrass said the release includes GPT 4.1, GPT 4.1 Mini, and GPT 4.1 Nano, with the goal of being “great for developers.” She highlighted improvements in instruction following and coding, and said they shipped their first one-million-context models.

The 4.1 vs 4.5 naming reflects capability/price trade-offs, not a straight progression.

Michelle Pokrass said GPT 4.1 is a big improvement over the 4o line, but is smaller/cheaper than GPT 4.5 and therefore doesn’t match GPT 4.5 on certain intelligence evals. She added that for most developers, 4.1 can replace much of their 4.5 usage.

OpenAI emphasized post-training as a major driver of GPT 4.1 gains.

Michelle Pokrass said Nano is a new pre-train, Mini is also a new pre-train, and the larger 4.1 is a new mid-train, but emphasized that “a significant amount of the gains come from new post-training techniques.” She framed this as squeezing more performance from post-training rather than only scaling pre-training.

Long-context progress is being measured by harder reasoning-over-context tasks, not just retrieval.

Josh McGrath said “needle in a haystack” style retrieval is often easy for models, and that the harder part of long context is complex context use and reasoning. He described two open-sourced evaluations: one focused on reasoning about ordering and another on walking through graphs.

Graph traversal benchmarks are used as a clean proxy for multi-hop reasoning in long contexts.

Josh McGrath explained Graph Walks as encoding a graph via edge lists in context and asking the model to perform an operation, then evaluating it against the true executed result. He said early models could loop or get stuck when unsure how to use context, and that the benchmark is an idealized lower bound for multi-hop reasoning across many documents with implicit connections.

WORDS WORTH SAVING

5 quotes

We released three new models today: GPT 4.1, GPT 4.1 Mini, and GPT 4.1 Nano. And the real focus on these were just making dev- models that were great for developers.

— Michelle Pokrass

We find that actually a significant amount of the gains come from new post-training techniques.

— Michelle Pokrass

Needle in a haystack, we were able to saturate f- uh, pretty easily. Um, and then the most of the work came at this, these harder tasks.

— Josh McGrath

We found that from 4o, which got 9%, which is pretty crazy, 9% of the time making an extraneous edit is a lot. 4.1 is at 2%, so it's a pretty big improvement.

— Michelle Pokrass

We’ve increased our prompt caching discount from 50% to 75% on these models.

— Michelle Pokrass

Read the available transcript
GPT 4.1 / Mini / Nano lineupModel naming confusion (4.1 vs 4.5)Post-training vs pre-training contributionsOne-million-token context windowLong-context reasoning evaluations (ordering, graph walks)Instruction-following benchmarks using opted-in API dataAgentic persistence vs extraneous code edits

SPEAKERS

  • Alessio Fanelli

    host

    Partner and CTO at Decibel and co-host of the Latent Space podcast.

  • swyx

    host

    Founder of Smol.ai and co-host of the Latent Space podcast.

  • Michelle Pokrass

    guest

    OpenAI research lead in post-training (previously associated with the API team).

  • Josh McGrath

    guest

    OpenAI post-training researcher on Michelle Pokrass’s team, focused on long-context work.

High quality AI-generated summary created from speaker-labeled transcript.

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.