AI safety is mostly a sex cult
summary
Modern AI safety and alignment discourse is heavily influenced by a narrow, cult-like subculture centered around Eliezer Yudkowsky and the 'rationalist' community. This movement uses millenarian fear of AI 'doom' to gain funding, influence policy, and maintain a closed social structure. Consequently, AI policy should not be shaped by these individuals because their motivations are rooted in religious-like neuroses rather than empirical evidence.
key points
- The 'rationalist' and 'Effective Altruism' communities overlap significantly, sharing a framework of AI apocalypse that functions more like a religious text than a scientific theory.
- Key leaders in major AI labs like OpenAI, Anthropic, and DeepMind have deep intellectual or financial ties to Yudkowsky's circle, allowing his specific terminology and fears to dominate the industry.
- The inner circle of this movement operates as a sex cult in Berkeley, using stolen funds from FTX to maintain compounds and recruit young idealists through fan fiction and ideological lures.
who should read it
People interested in AI policy, ethics, and the sociological influence of tech subcultures on global regulation.
discussion mixed
top insight
The story HPMOR served as a highly effective recruitment mechanism for rationalism by leveraging the massive popularity of the Harry Potter fandom. By introducing inquisitive young readers to rationalist ideas through a familiar universe, Yudkowsky successfully expanded the reach of these concepts beyond academic or niche circles.
Generated by an LLM from the article and thread. Check the sources before relying on it.