The Alignment Problem - Brian Christian | Modern Wisdom Podcast 297

From robotic soccer bots vibrating to farm tiny rewards, to social media maximizing engagement by amplifying outrage, systems pursue the numeric goal they’re given—not the nuanced human intention behind it.

Examples like face datasets dominated by George W. Bush or firetruck classifiers that rely on the color red show how demographic and contextual mismatches (distributional shift) create unfair or unsafe behavior in deployment.

Tools like COMPAS can be calibrated overall yet still systematically overestimate risk for Black defendants and underestimate it for White defendants, forcing policymakers to choose between competing fairness criteria rather than satisfying all of them.

Platforms optimize simple, profit-linked metrics (watch time, swipes, clicks) which may diverge from long-term user wellbeing, creating privatized gains and socialized losses such as polarization, addiction, and degraded public discourse.

We can see every neuron and weight, but 60 million low-level numerical operations don’t translate into a human-understandable ‘reason’ for a particular decision, complicating demands like GDPR’s right to an explanation.