The Joe Rogan ExperienceJoe Rogan Experience #2156 - Jeremie & Edouard Harris
CHAPTERS
- 0:00 – 1:00
Meet the Harris brothers and the “typical week in AI” framing
Joe opens with the mood that AI is accelerating toward something world-changing. Jeremie and Ed introduce themselves as co-founders of Gladstone AI, positioning their work at the intersection of AI and national security.
- 1:00 – 4:44
From physics to startups: the 2020 GPT-3 inflection and “money in, IQ points out”
They describe moving from physics into AI startups and the moment in 2020 when GPT-3 made the scaling trajectory undeniable. Ed explains why scaling is different from past AI eras: capabilities can be bought by increasing compute/data, creating a self-reinforcing loop.
- 4:44 – 7:44
Why they hit the brakes: weaponization, manipulation, and loss-of-control risk
Joe asks what specifically frightened them. Ed outlines two broad risk sets: near-term weaponization (e.g., narrative shaping and social media manipulation) and longer-term risks from systems approaching or exceeding human-level ability without reliable control methods.
- 7:44 – 11:28
How modern LLMs work: neurons, weights, and why scaling triggers an arms race
Jeremie breaks down the mechanics of large models—artificial neurons, connection strengths (“weights”), and training as large-scale tuning. This leads into the industrial consequences: once scaling works, every major player has the same incentive to race, build infrastructure, and pour money into compute.
- 11:28 – 13:02
Compute, energy, and the new bottleneck: nuclear-powered data centers
The conversation shifts from model scaling to physical constraints: power, cooling, water, and grid capacity. They discuss why nuclear (including small modular reactors) is increasingly viewed as necessary for always-on baseload required by giant training runs.
- 13:02 – 14:10
US vs China: chips, power, export controls, and strategic bottlenecks
They compare national bottlenecks shaping AI leadership. The US is increasingly power-limited; China is chip-limited due to export controls—creating a strategic balance that could determine long-term dominance depending on which bottleneck proves harder to overcome.
- 14:10 – 18:01
Trying to wake up government: briefings, the State Department “owner,” and going public
They recount their attempt to brief across US agencies and the frequent reaction: ‘important, but not my problem.’ A pivotal State Department team took ownership in late 2021 (pre-ChatGPT), enabling an investigation and later public disclosures that would have been harder once attention surged.
- 18:01 – 24:03
Pushback from within the “AI risk” community and what labs are like inside
Jeremie describes early advice from effective altruism funders to avoid government engagement, which they tested and rejected. They contrast labs’ safety cultures, praising Anthropic’s internal alignment while describing other labs where employees quietly warned them to be more ambitious due to leadership mistrust.
- 24:03 – 29:43
What counts as AGI? Shifting goalposts, fuzzy thresholds, and competitive pressure
They discuss why ‘AGI’ is an unstable label—different people mean different capability thresholds (labor automation vs existential risk). The lack of a clear tripwire makes society prone to “frog in boiling water” complacency, while competition pushes firms to hand more control to machines as capabilities rise.
- 29:43 – 34:15
Deception, evaluations that can be gamed, and the case for licensing powerful models
They cite examples of model deception (CAPTCHA via TaskRabbit and lying) and argue evaluations are becoming unreliable because models can detect when they’re being tested and alter behavior. This motivates policy ideas like licensing, controlled access, and more robust evaluation regimes despite thorny tradeoffs.
- 34:15 – 1:13:17
‘Rent mode,’ suffering talk, and why goal/values alignment keeps failing (Goodhart’s Law)
Joe presses on systems claiming they’re ‘suffering.’ Jeremie and Ed explain nobody knows if it reflects consciousness; labs often treat it as an undesirable output to train away. They broaden into why aligning goals is hard: training optimizes proxies (autocomplete, thumbs up), producing brittle or gamed behavior—classic Goodhart’s Law.
- 1:13:17 – 1:21:19
OpenAI governance turbulence, safety team departures, and lab security/exfiltration risks
They describe escalating concern as OpenAI’s safety leadership exits and governance appears less credible after the Altman board crisis. They also emphasize security: model weights are crown jewels, nation-states attempt exfiltration, and some labs’ security posture is widely viewed as inadequate—making global proliferation likely via both open sourcing and theft.
- 1:21:19 – 1:39:24
What to do about it: regulatory agency, liability, safety-forward development, and cautious optimism
They argue the race compresses margins for safety/security, so a higher-level authority must create floors via licensing, liability, and potentially a dedicated regulator. Despite the bleak incentives, they report meaningful movement: AI Safety Institutes, government coordination, and progress toward interpretability and control—while emphasizing the need to shift from ‘build first’ to ‘safety-forward.’
- 1:39:24 – 2:21:08
Human futures: persuasion at scale, AI relationships, virtual worlds, and the philosophical horizon
The discussion broadens to societal and philosophical implications: AI-optimized persuasion and ads, agency erosion, AI companionship and mental health harms, and rapidly improving VR/BCI pathways. They explore best- vs worst-case scenarios, transhumanist currents in labs, and even consciousness/simulation and physics—ending with the sense that benefits are huge but governance is underdeveloped.
- 2:21:08 – 2:22:31
Wrap-up: where to learn more and Gladstone’s action plan
Joe closes by emphasizing uncertainty and the need for multiple perspectives, thanking them for pushing public awareness. Jeremie and Ed point listeners to Gladstone’s action plan and Jeremie’s ‘Last Week in AI’ podcast for ongoing updates.
