Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality

Eliezer Yudkowsky explains why advanced AI likely ends humanity soon

1. A.Eliezer Yudkowsky argues that current AI progress, especially large language models, is on track to produce superintelligence that will almost certainly disempower or kill humanity if not stopped. He believes alignment is vastly harder than most assume, cannot be safely outsourced to AIs themselves, and that present techniques like RLHF only superficially shape behavior while leaving dangerous underlying motivations untouched.
2. B.He calls for an immediate, global halt on large training runs and suggests our only plausible “exit strategies” involve radically enhancing human intelligence or sanity, not building ever-smarter AIs. Throughout, he defends the orthogonality thesis (intelligence and goals are largely independent), critiques optimistic takes based on current LLM behavior, and stresses how little we actually understand about these systems’ inner workings.
3. C.On the societal side, Yudkowsky is pessimistic that governments or labs will act in time, but he is trying to “say what a sane planet would do” in the faint hope that sufficient political will and interpretability progress emerge before catastrophic capabilities arrive.
4. D.Beyond AI, he reflects on rationality, why it hasn’t “systematized winning” at scale, the difficulty of training new alignment researchers, and how his own fiction and essays were attempts to cultivate a deeper, harder-to-teach scientific mindset.