Skip to content

By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.

Latent SpaceLatent Space

Building Visual Intelligence — Andreas Blattmann & Dustin Podell, Black Forest Labs

A camera moves around a person. Halfway around, the model has to draw the back of a head it has never seen. How much can it learn about that missing view just by watching video?

swyxhostAndreas BlattmannguestDustin PodellguestswyxhostAlessio Fanellihost
Nov 16, 20261h 38mWatch on YouTube

Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.

Great conversations run long. Their best ideas don't have to.

uListen is free on iPhone, iPad, Android, Chrome, and Claude.

See how

At a glance

WHAT IT’S REALLY ABOUT

Black Forest Labs explains FLUX 3’s multimodal path to robotics

  1. The hosts and guests trace Black Forest Labs’ origins through latent diffusion and the Stable Diffusion ecosystem, and discuss how BFL formed after frustrations with capturing model value at Stability.
  2. BFL describes “visual intelligence” as system-one-like intuition learned from images, video, and audio, arguing video modeling is central to understanding the world and enabling robotics.
  3. They unpack key technical evolutions from SDXL (multi-aspect training and the refiner pipeline) to SD3 (trajectory/compute allocation) and flow matching as a simpler, scalable approach to fast generation.
  4. Dustin Podell explains how FLUX Kontext emerged from a small relational editing dataset and then scaled via a larger dataset and distillation to enable fast, character-consistent iterative editing.
  5. The episode closes on FLUX.3 Action as a “world action model,” emphasizing multimodal pretraining plus action-state prediction, on-device constraints (7B), and a prediction that 2027 will be a breakout year for manufacturing robotics and in-context learning.

IDEAS WORTH REMEMBERING

5 ideas

BFL frames its work as “visual intelligence” (system-one-like intuition) learned from natural data.

Andreas Blattmann says their core bet is that learning from “natural signals” (images, video, audio) yields the intuitive, physics-like understanding humans use to catch a ball or manipulate objects, and that diffusion/flow-matching methods can scale across these modalities.

BFL claims major commercial traction while broadening beyond image generation.

Andreas Blattmann says BFL has raised $450M total funding, and that the last published figure (December) was $100M in revenue, which he says they have since exceeded; he also emphasizes they see this as “extending,” not pivoting, from image generation into broader modalities.

SDXL’s refiner reflected a deliberate split between structure and texture across the denoising trajectory.

Dustin Podell describes SDXL as a step toward models that “feel good to use,” highlighting multi-aspect training, multiple training stages (pre-training plus post-training sets), and the refiner as a second diffusion model focused on high-frequency detail because the base SDXL didn’t reach desired texture/detail quality alone.

They repeatedly attribute leaps in capability to targeted data (and filtering), not just new architecture.

Andreas Blattmann argues that for frontier generative models, data quality and filtering are crucial levers, because models learn the distribution of what they’re shown; he describes Stable Video Diffusion work as investigating the quality-vs-quantity tradeoff and showing strong 3D understanding can emerge from plain 2D video pretraining.

Flow matching is presented as a strict improvement in practicality for their diffusion-style modeling.

Andreas Blattmann describes flow matching as moving from an SDE framing to an ODE framing that is mathematically simpler, more general in what distributions it can connect, and more amenable to fast sampling; he and Dustin Podell characterize it as simpler and more scalable without sacrificing quality.

WORDS WORTH SAVING

5 quotes

BFL was not founded to be an image generation lab. Video modeling is actually the central means to understanding how our world basically works.

— Andreas Blattmann

In the end, it's again, uh, the bitter lesson is simple scalable is almost always the most effective.

— Andreas Blattmann

Stable Diffusion came out and basically that day I turned in my resignation and said, "Okay-"

— Dustin Podell

I trained the model for like, I mean, it was maybe like six hours of training, four hours of training. It was, it was a very, very short training run. And all of a sudden, like I saw what felt like a clear generality coming out of it.

— Dustin Podell

You should be showing a robot an action one time, and then it should be able to do this, and this would be truly a superhuman intelligence.

— Andreas Blattmann

Read the available transcript
Origins of latent diffusion and Stable DiffusionBFL founding motivations and early offsite workVisual intelligence and “system one” framingSDXL improvements: multi-aspect training and refinerStable Video Diffusion: temporal learning and data filteringSD3: compute allocation across the denoising trajectoryFlow matching vs diffusion vs autoregressive tradeoffs (data efficiency vs sampling speed)

Ask ChatGPT about this episode

Get its key ideas, plus a summary of each chapter linked to that point in the video, right in your chat.

  1. Add uListen AI to ChatGPT.

  2. Paste this prompt into a new chat.

    Use uListen AI to give me this episode's key ideas and a chapter-by-chapter summary, with timestamps: https://www.youtube.com/watch?v=8cGfJOU3AlQ

SPEAKERS

  • swyx

    host

    Co-host of the Latent Space podcast who introduces episodes, reads sponsorships, and interviews guests.

  • Andreas Blattmann

    guest

    Co-founder of Black Forest Labs and diffusion-model researcher (formerly at NVIDIA; worked on video generation such as Align Your Latents).

  • Dustin Podell

    guest

    Founding researcher at Black Forest Labs with an engineering-to-research background, previously at Stability AI (SDXL/related work).

  • swyx

    host

    Founder/co-host of the Latent Space podcast who drives the interview and discusses the show’s origin and framing.

  • Alessio Fanelli

    host

    Co-host of the Latent Space podcast who asks technical and roadmap questions about diffusion/flow-matching and multimodal training.

High quality AI-generated summary created from speaker-labeled transcript.

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.