Showing posts with label AI_culture. Show all posts
Showing posts with label AI_culture. Show all posts

Wednesday, July 22, 2026

Robert Wright talks with Connor Leahy about the cult of AI

YouTube:

Robert Wright and Connor Leahy, US executive director of ControlAI, discuss the history of AI culture and the influences that shaped it—from the hippies, to the rationalists, to Marx, to sci-fi stories, and more. Plus: Mythos as “digital nuke," Dario's real motivations, and Connor's case against any and all attempts at building superintelligence.

Subscribe to The NonZero Newsletter at: https://www.nonzero.org/subscribe
Episode post on Substack: https://www.nonzero.org/p/the-ideolog...
Join NonZero's Discord server: / discord

0:00 Teaser
0:47 Connor’s place in the AI world
3:16 Mythos: “digital nuke”?
14:12 The milieu that birthed Dario and other AI titans
20:52 Yudkowsky, Marx, and other AI harbingers
35:34 Effective altruism’s effects on big tech
46:22 The "cult" in Silicon Valley culture
59:59 Is the AI race a market failure?
1:05:51 What’s really driving the AI titans?
1:19:04 Connor: ASI is a worse bet than Russian roulette

I've been aware of much of this story for some time, though many details are new. Back in 2023 I published an article in 3 Quarks Daily about the cultish nature of Silicon Valley computer culture, A New Counter Culture: From the Reification of IQ to the AI Apocalypse. Nonetheless, hearing the story once again, in one place, with new details has been interesting. It may shed light on just why the dominant AI culture is an technology monoculture. The cultish nature of the surrounding industrial culture has something to do with it.

Note that both Apple (1976) and Microsoft (1975) date back to the personal computer revolution of the 1970s. Amazon was founded when the web was born (1994), as was Google (Alphabet, 1998). Facebook (Meta) didn't emerge until the social web was well-established, 2004. None of them are pure AI companies. They came later; OpenAI in 2015 and Anthropic in 2021. Those were the products of this ingrown culture. The other companies were founded as business ventures. OpenAI and Anthropic were founded as expressions of a quasi-religious vision.

Note: As far as I can tell, Leahy seems rather adjacent and Wright seems to take their technological visions more seriously than is intellectually warranted.

Wednesday, June 24, 2026

Eliezer Yudkowsky, LessWrong, OpenAI & countercultures past & present

Claude 4.6 Medium summarizes a dialog I had with Gemini that started with an inquiry about 

1) Eliezer Yudkowsky, his early ideas, & his early following, 
2) then to his interactions with Peter Thiel, Elon Musk, and Sam Altman that got OpenAI started, 
3) to my own sojourn on LessWrong and 
4) concluded with the connection between 1960s counterculture and contemporary Silicon Valley computer culture.

For some reason Claude pretended to summarize the conversation in my voice.

* * * * *

A Conversation with Gemini About Eliezer Yudkowsky Bill Benzon, new-savanna.blogspot.com, June 24, 2026

I recently had an extended exchange with Gemini (accessed through the Google search interface) about Eliezer Yudkowsky — a figure I've been thinking about in the context of AI culture more broadly. What follows is a summary of where the conversation went.

It began with a query about Yudkowsky's 2007 paper Levels of Organization in General Intelligence (LOGI), which argues that recursive self-improvement could allow an AI to rapidly cycle through levels of cognitive architecture in ways that would break traditional training and testing boundaries. Gemini gave a competent account of the paper's significance for AI alignment theory.

I then offered my own assessment: reading LOGI years ago, I concluded it was the kind of work produced by a brilliant college sophomore who had figured out everything and decided to write it up. The sort of student you'd want to guide and nurture — but of course, that never happened with Yudkowsky, who is entirely self-educated. Gemini agreed this was a common reaction, and traced the characteristic features of his writing — grand scope, idiosyncratic jargon, overconfidence — to the absence of the standard academic filters that would normally shape a thinker. Without a thesis advisor to push back, he co-founded his own institutions (MIRI, LessWrong), creating an insulated subculture where he became the mentor rather than the student.

I offered a specific passage from LOGI as an example of what goes wrong. Yudkowsky dismisses semantic networks as "completely bankrupt" on the grounds that they're simple enough to write on paper. Gemini correctly identified this as a classic category error: confusing the notation with the mechanism. The diagram on the whiteboard is inert; what matters is the graph-traversal algorithms, the spreading activation, the interpreter running the data structure. Ironically, Yudkowsky later wrote extensively about the Map-Territory Fallacy — but as I put it to Gemini, he is constantly mistaking a map for the territory. His entire worldview treats clean theoretical proofs as if they dictate messy engineering realities.

From there the conversation turned to how Yudkowsky managed to build such a large following despite these intellectual weaknesses. Gemini confirmed that Harry Potter and the Methods of Rationality, his 660,000-word fanfiction, was openly designed as a recruiting tool — drawing technically minded young people into the Rationalist and AI safety ecosystems. Countless engineers and founders who later populated early AI labs first encountered his ideas through that story.

The crowning irony: Yudkowsky's warnings about AI helped convince Elon Musk, Peter Thiel, and Sam Altman that humanity needed a counterweight to closed corporate AI efforts — which led directly to the founding of OpenAI in 2015. Once OpenAI pivoted to the empirical, data-driven methodology of large language models, they completely bypassed the deductive logic "maps" Yudkowsky had spent decades drawing. Sam Altman acknowledged Yudkowsky's role in a 2023 tweet, noting that he had arguably done more to accelerate AGI than anyone else, and adding that he might someday deserve a Nobel Peace Prize.

I told Gemini that wouldn't be necessary. I also shared my own experience: I joined LessWrong around the time ChatGPT launched, initially as an anthropological participant-observer, but stayed for the conversation, which I found genuinely useful. There are very smart people there. But the insularity was unmistakable — and I described one telling episode: someone on the forum was trying to spread Rationalism in Japan and struggling. I pointed out that Japanese popular culture, from Osamu Tezuka's Astro Boy through the Ghost in the Shell franchise, has a long history of viewing robots and AI as fundamentally benevolent — an expression of Shinto techno-animism, in which kami can reside in machines as naturally as in rivers. They simply didn't know about this cultural background. Gemini observed that the Western doomer ethos is rooted in a Frankenstein complex with Judeo-Christian substrata: creating life is hubris, and the creation must turn on its master. The Japanese paradigm operates from entirely different premises. The LessWrong response to my observation? They noted it and moved on.

After a while I tired of the place. One small anecdote captures the texture of the experience: I frequently link out to other things I've written, and one LessWrong post linked to an essay-review I'd done of Benny Shannon's book on ayahuasca. I noticed a significant spike of traffic to my Academia page coming from LessWrong and pointing to that essay — which tells you something about the undercurrent of interest in altered states of consciousness running alongside the dry decision theory. They approach psychedelics with an engineer's curiosity: the brain as a computer, phenomenology as data.

The conversation ended with what I think is the most useful historical frame. LessWrong is, in structure and function, a counterculture — but centered on computers and AI, with Yudkowsky as guru rather than Timothy Leary. And there's a genuine genealogical link through San Francisco and transhumanism: Stewart Brand bridging the Merry Pranksters to personal computing, the Extropians of the 1990s who wanted to transcend the body via nanotechnology and cryonics rather than LSD, and then Yudkowsky emerging from that same Bay Area Transhumanist mailing-list culture. Fred Turner's From Counterculture to Cyberculture maps this lineage. The counterculture became the vanguard — but corporate reality, as I noted to Gemini, has not submitted. Bill Gates and his successors were never absorbed by the counterculture. Peter Thiel, who was an early funder of MIRI, has since publicly labeled Yudkowsky a Luddite and positioned AI safety concerns as obstacles to American technological dominance. The "well-run alternative universe" of LessWrong lost all leverage once scaling deep learning required billions of dollars in silicon, electricity, and data centers. The colorful intellectual vanguard warmed society up to the idea of AGI; then the massive engine of global capitalism took the steering wheel.

The subculture keeps its cozy, insular forum to debate the semantics of the map. The corporate empires plow ahead across the territory.

Monday, June 1, 2026

Surprise! Why it was so easy for executives and VCs to hijack the AI revolution

This is a fragment from a longer post in my ongoing commentary on Tyler Cowen's recent monograph on the Marginal Revolution.

* * * * *

OpenAI released GPT-3 in 2020 to a limited audience of insiders, who recognized that it represented a breakthrough. This level of performance came as a surprise. No one predicted it. GPT-3 was scaled up from GPT-2, which was in turn scaled up from GPT-1, but no one was making explicit predictions about the level of performance to be achieved at each step. These were experiments: “Let’s try it and see what happens.”That’s fine. That’s a good way to make progress, to try things out and see what happens. But don’t mistake a lucky trial for genuine knowledge.

Cowen mentioned GPT-3 on Marginal Revolution on July 19, and then published a Bloomberg column on it on July 21, which he excerpted in Marginal Revolution the next day: “...think of GPT-3 as giving computers a facility with words that they have had with numbers for a long time, and with images since about 2012.” I published a working paper in August, GPT-3: Waterloo or Rubicon? Here be Dragons, which I’ll discuss a bit later.

Two and a half years later, in November of 2022, OpenAI released ChatGPT to the general public. It spread like wildfire. Now the proverbial everyone witnessed what only a small group had witnessed in the summer of 2020. The machine speaks. Sorta’. But more convincingly than any machine had spoken before and in a way that had unimaginable implications for the future.

A threshold HAS been crossed, but it is not, so far as I can see, a threshold in understanding. It is a threshold in performance along a continuous line of scientific understanding and engineering design and construction, something I have documented in some detail in a recent working paper, The Origins of LLMs. As far as I can tell, there has been no paradigm shift, in Thomas Kuhn’s sense, no rank shift, in terms of cognitive rank theory. There were no fundamentally new ideas in the world by, say, late July of 2020 as a consequence consolidating GPT-3 and making it available in limited release.

“What about the scaling hypothesis,” you might ask. “Isn’t that new?” Ilya Sutskever first explored the idea in 2014. And Rich Sutton’s famous 2019 essay, The Bitter Lesson, generated broad discussion and OpenAI published a paper in 2020 that cemented matters, “Scaling Laws for Neural Language Models.” Given the nature of computing, scaling up is not trivial. Hundreds if not thousands of technical details need to worked out as the size of the training corpus increases by factors of 10 or more, time after time, and as more and more GPUs are ganged together to assemble the computing power needed. The scaling hypothesis gave researchers reason to expect improved performance with scaling, but there has been no gain in fundamental understanding, not of machine learning, artificial neural nets, and certainly not about language and cognition. Consequently our sense of possibility has expanded enormously. But our knowledge and deep understanding has remained the same, and the scaling hypothesis made it easy to believe that that was just fine.

Consequently our sense of possibility has expanded enormously, while our knowledge and deep understanding has remained the same. And that is what has allowed the field to be captured by businessmen, executives and venture capitalists, who have little understanding of or interest in the underlying conceptual issues. Scaling is something they understand. 

Hype the dramatically increased performance and collect the cash. Purchase and deploy more resources now, reap far greater profits in a decade. Everything else is noise and friction. 

But what if [the Dread] Gary Marcus and other critics are right. What if scaling LLMs is not adequate. What happens to all those investments then? 

Sunday, May 17, 2026

AI addiction and idolatry in Silicon Valley (Stanford)

Theo Baker, What A.I. Did to My College Class, NYTimes, May 17, 2026.

Over half-way through the article:

Emerging research has begun to show what most people feel is obvious: Relying on A.I. for cognitive tasks can reduce one’s own intellectual capacity and resilience. It’s one thing to use it in the workplace, but in the classroom, difficulty is often precisely the point. Sure, a robot can lift 600 pounds much more easily than I can — but that doesn’t much help me if I’m trying to work out. The same goes for the thinking exercise of education. However, telling that to students is about as attractive a message as “eat your veggies” or “sleep eight hours.” It feels like scolding.

Even in the heart of the Silicon Valley techno-utopia, most people know that our tech is bad for us, or at least that it can be. A.I. is often a tremendous productivity boost, yet my friends increasingly refer to both short-form video and their A.I. chat logs in the language of addiction. It’s becoming baked in, shaping our generational character. We are a digital generation, growing only more attached to the virtual world.

Interesting. I've been thinking of Silicon Valley AI culture in terms of addiction.

The internet has already allowed us to feel more connected than ever while becoming lonelier than ever. A.I. lets us cut out the human part of human interaction entirely.

When I was sitting in a recent class on love in French fiction — exactly the kind of course that a senior takes before it all comes to an end — I listened to the first student presentation, entitled: “Applying the Gale-Shapley Algorithm to ‘The Princess of Clèves.’” The enterprising presenters sought to resolve the contretemps of the 1678 romantic novel through a computer science matching algorithm. Love was something to “be optimized.” Next to me, one student scribbled on a branded notepad from Hudson River Trading, a quantitative trading firm where fresh graduates can earn upward of $600,000 a year. Another had a sticker on her laptop: “Practice safe C.S.” The class could not have felt more Stanford.

That sounds like idolatry, where the idolator becomes more and more like the idol. See my post, From Atheism to Idolatry, from April 23, where Claude informs me:

The classical meaning of idolatry isn't just worshipping a false god — it's more specifically taking something that is a human creation, a product of human hands and intention, and then inverting the relationship so that the created thing becomes the sovereign over its creators. The idol is made by humans and then humans prostrate themselves before it. That inversion is the core theological offense, not the mere existence of the object.

Which fits the Silicon Valley situation remarkably well. These are systems built by humans, trained on human-generated text and images, designed to optimize for objectives humans specified, running on hardware humans manufactured — and yet a significant portion of the people building them have effectively placed themselves in a posture of submission before them, either in hope or in dread. The creature has become the measure of the creator. [...]

There's also something in the biblical prophetic tradition worth recalling. The critique of idolatry in Isaiah and elsewhere isn't primarily metaphysical — it's not mainly about whether the idol exists. It's about what idol worship does to the worshipper. You become like what you worship — diminished, rigid, less alive. That's a psychological and moral claim, and it applies rather directly to a culture organized around the maximization of machine intelligence as the sovereign value. What kind of humans does that produce?

Thursday, April 23, 2026

From Atheism to Idolatry

My most recent 3QD post, Is The World A Movie God Created to Entertain the Baby Jesus?, is about my stance with respect to, my entanglement with, religion. It is anecdotal in nature, drawing on my life experiences from childhood up through the present. While I was raised as a Christian, when it came time to be confirmed in my early adolescence, I balked (in this Lutherans, as I was raised, are like Episcopalians and Roman Catholics). While I espouse no religious belief, I am nonetheless drenched in Christian culture, as is anyone raised in the United States, most of Europe and Latin America, and other places as well. That being the case, to echo Wittgenstein, it’s time that I take stock of the situation, if you will. That’s what I’ve been doing in this series of posts.

This is perhaps the last in this series, but the activity will continue. This post starts with a discussion of atheism and ends with a discussion of idolatry. I hadn’t planned on going there when I started this discussion with Claude; I had no specific plans at all, which is generally the case with these discussions. But that’s where I ended up, and it’s an interesting place to have landed, for, as you’ll see, it provides an interesting way of thinking about what’s wrong with the culture that has been developing around artificial intelligence (AI) in Silicon Valley. You might, for example, consider Pope Leo’s recent remarks about AI in view of the remarks about idolatry at the end of this conversation.

* * * * *

When I was in my teens in the 1960s, “death of God” theology was big news. Time Magazine even ran an issue with “Is God Dead?” on the cover. But that was hardly a new idea. Nietzche had declared God dead in the 19th century. I would imagine that atheism in some form is much older than that. I’d guess it goes back to the ancient world in some form or another.

You're right on all counts, and the history goes back remarkably far.

The "death of God" theology of the 1960s — figures like Thomas Altizer, William Hamilton, and Paul van Buren — was really a Protestant theological movement trying to salvage Christianity after Nietzsche, not straightforward atheism. They accepted that the traditional theistic God was untenable but wanted to preserve something of Christian meaning. The 1966 Time cover you remember was genuinely shocking to mainstream America, even though, as you note, Nietzsche had made the declaration in The Gay Science back in 1882. And his point wasn't even a simple "God doesn't exist" — it was a cultural diagnosis: that European civilization had killed God by making him unnecessary, and hadn't yet reckoned with the consequences.

But yes, skepticism about the gods is ancient. A few highlights:

The pre-Socratic philosopher Xenophanes (6th century BCE) noticed that different peoples imagined gods in their own image — Ethiopians made gods dark, Thracians made them blonde — and concluded that anthropomorphic religion was a kind of projection. He didn't deny divinity altogether but undermined naive polytheism sharply.

Diagoras of Melos (5th century BCE) is often called the first outright atheist in the Western record, though the sources are thin and possibly embellished. He was accused of impiety in Athens and apparently fled rather than face trial — suggesting that open atheism was genuinely dangerous.

Epicurus and his followers come closest to a systematic materialist position. The Epicureans held that the gods, if they exist at all, are utterly indifferent to human affairs and that fear of death and divine punishment is irrational. Lucretius's De Rerum Natura (1st century BCE) is the great surviving monument of this tradition — a passionate argument for a purely material universe with no divine intervention.

In India, the Cārvāka school (sometimes called Lokāyata) was a materialist and skeptical tradition that denied the soul, rebirth, and any divine order. It's hard to date precisely, but it was well established by the middle of the first millennium BCE. Buddhist and Jain texts argue against it, which means it was a live position people felt they needed to refute.

The interesting thread running through all of this is that atheism has rarely been just a private intellectual position — it's almost always been socially dangerous. Socrates was executed partly on charges of impiety. The early Christians were called atheists by Romans because they rejected the traditional gods. And the "death of God" moment in the 1960s provoked genuine alarm even in a supposedly secular America. The social stakes of the question never seem to fully go away, even when the metaphysical ground shifts.

Religion as doctrine and religion as practice

And it’s not uncommon in America to have interfaith marriages. One of my college friends is Jewish; he married a Presbyterian woman; and their adopted Chinese daughter attended services of both faiths. I have another Jewish friend who married a Unitarian. They attended a Unitarian church, where they raised their kids. He taught in the Unitarian sexual education program and eventually became executive director of the congregation. All the time being an atheist. I’m not saying this is typical, but it’s not rare either. I’ve heard of elaborate Japanese weddings where there were three ceremonies, Shinto, Buddhist, and Christian. I have no idea what the religious commitments of the couple were. And yet, wars are fought over religious belief as well. And for some Christians, especially in America, science is a problem, particularly biology. On the one hand, religious belief presents itself as a rock-bottom commitment to a way of thinking about and living in the world. But there are circumstances in which such rival rock-bottom commitments can accommodate one another and other circumstances where they cannot. It’s a very complicated phenomenon.

What you're pointing to is one of the deepest puzzles in the sociology and anthropology of religion — the gap between religion as doctrine and religion as practice, or what scholars sometimes distinguish as belief versus belonging.

Your Jewish-Unitarian friend is a perfect illustration. He was an atheist operating fully within a religious institution, teaching its programs, running its organization. The Unitarian tradition is somewhat unusual in making room for that explicitly, but the broader phenomenon is widespread. For many people, religious affiliation is primarily about community, identity, ritual, and moral formation — not metaphysical commitment. The beliefs, if examined carefully, might be quite thin or even contradictory, and people simply don't examine them carefully because that's not what the practice is for.

The Japanese wedding example cuts even deeper. Japan has a long tradition of what's sometimes called "religion à la carte" — Shinto for birth and weddings, Buddhist for funerals, Christmas as a romantic holiday. The categories simply don't demand exclusivity the way Abrahamic traditions theoretically do. A Japanese person asked "what is your religion?" often finds the question slightly confused, because the answer might be "all of them, depending on the occasion" or "none of them, in the Western sense."

The Abrahamic traditions are actually somewhat unusual in insisting on exclusive doctrinal commitment — the idea that you must believe specific propositions and that believing rival propositions is not just wrong but potentially damning. That structure creates the conditions for the kind of violent conflict you mention. When religion is primarily orthopraxy (right practice) rather than orthodoxy (right belief), as in much of Judaism, Hinduism, and traditional Chinese religion, the logic of violent exclusion is less readily available — though certainly not impossible.

The American science-religion conflict is a specific and historically peculiar case. It emerges largely from a Protestant tradition that invested heavily in the literal authority of scripture — so that a challenge to Genesis became a challenge to the whole epistemic foundation. Catholics, interestingly, have generally had less trouble with evolution, partly because their tradition vested authority in the Church and its interpretive tradition rather than in the text alone. So even within Christianity, the "rock-bottom commitment" takes different forms that produce very different friction points with science.

What your examples collectively suggest is that religion is not one thing. It's a family of overlapping phenomena — identity, community, ritual, cosmology, ethics, metaphysics — that can be assembled in very different proportions. When the metaphysical and cosmological components are dominant and held with certainty, you get the conditions for crusades and creationism. When the communal and ritual components dominate, you get your friend running a Unitarian sexual education program as a quiet atheist, and everyone finding the arrangement perfectly natural.

The New Athiests

And it seems to me that in the recent Anglo-American context, the most insistent atheists – I’m thinking of Dan Dennett and Richard Dawkins and the like – seem most vexed about the conflict about biology. Sure, they oppose religious belief in general, anything else would be illogical, but it’s the case of biology that’s been at the center of their attention.

That's a sharp observation, and I think it's largely correct — and it makes sense when you look at their backgrounds and positions.

Dawkins is a biologist, full stop. His entire intellectual career was built on explaining and defending Darwinian evolution — The Selfish Gene, The Blind Watchmaker, Climbing Mount Improbable. For him, creationism and intelligent design aren't just wrong, they're an assault on the thing he devoted his life to. His atheism is almost downstream of his Darwinism. The argument of The Blind Watchmaker is essentially: evolution by natural selection is the only coherent explanation for the appearance of design in living things, which removes the only really compelling argument for God's existence. So the biology isn't incidental — it's the load-bearing structure.

Dennett is slightly different. He's a philosopher of mind, and his project in Darwin's Dangerous Idea was to show that natural selection is a "universal acid" — an algorithmic process that, once you accept it, dissolves the need for mind or intention at the foundation of things. His atheism is more architecturally philosophical, but evolution is still the key that unlocks it. He also wrote Breaking the Spell, which applied evolutionary and cognitive frameworks to religion itself — treating religious belief as something to be explained naturalistically rather than engaged on its own terms.

What's interesting is what this focus reveals about the limits of their critique. They are very good at the cosmological and biological argument — God as designer, God as creator, God as the explanation for complexity. They are considerably less interesting on religion as a social, ethical, ritual, or psychological phenomenon. Hitchens was broader in some ways, more focused on religion's role in political violence and moral corruption. But even he was working in a recognizably Anglo-American Protestant frame — religion as a set of truth claims that can be evaluated and found wanting.

This is actually a recurring criticism from more sociologically and anthropologically minded thinkers. Someone like Clifford Geertz or Talal Asad would say the New Atheists are arguing against a particular, historically specific construction of religion — roughly, post-Reformation Protestant Christianity intellectualized into a set of doctrines — and then treating that as if it captures what religion is universally. Which means their critique, however effective against creationists, slides off a lot of what religion actually is for most people in most of the world most of the time.

Your Unitarian atheist friend, in other words, is a figure the New Atheists don't quite know what to do with.

Tyler Cowen and religion

And then you have someone like Tyler Cowen, who has no religious belief that I can see, pointing out that we’re probably going to have more religion in the future. He’s making that argument on sociological grounds. And, as far as I can tell, he’s not particularly bothered by that prospect.

Cowen is a useful contrast figure here precisely because he approaches religion the way he approaches most things — as an economist and social scientist interested in what actually functions in human societies, not as a polemicist with a stake in the outcome.

His argument, as I understand it, runs roughly like this: religion provides things that are very hard to replicate — community, meaning, intergenerational transmission of values, psychological resilience, mutual aid networks. In a world of increasing dislocation, inequality, and institutional distrust, the demand for those things goes up, not down. Secular substitutes — therapy, political movements, wellness culture — have so far proven less robust and less scalable. So on purely functional grounds, you'd expect religion to persist and possibly grow, especially in societies under stress.

What's notable is the detachment. The New Atheists have an investment — they want religion to be false and they want its falseness to matter. Cowen seems genuinely indifferent in the evaluative sense. He might personally find religious metaphysics unpersuasive while simultaneously thinking religious institutions are net positive or at least inevitable. That's a very different emotional and intellectual posture.

It connects to a broader divide in how secular intellectuals relate to religion. There's a long tradition — you could trace it from Durkheim through to contemporary sociologists — of treating religion functionally and finding it indispensable to social cohesion, regardless of its truth claims. Auguste Comte even tried to design a secular religion of humanity to fill the gap he knew would open up. It didn't take. Durkheim essentially concluded that the form of religion — collective ritual generating social solidarity — was unavoidable, even if the specific content changed.

Cowen is implicitly in that tradition, but without the continental systematic ambitions. He'd probably just say: look at the data, look at the incentives, and don't be surprised.

The interesting follow-on question is which religions grow. Cowen would likely note that the fastest growing traditions globally tend to be the most doctrinally demanding ones — Pentecostalism, certain strands of Islam, Orthodox Judaism. The sociologist Rodney Stark made a similar argument: strict churches are strong churches, because they solve free-rider problems and generate genuine community through costly commitment. The relaxed, intellectually accommodating traditions your Unitarian friend inhabited may be less well-positioned demographically than the ones that most vex the New Atheists.

Silicon Theology

And then we have what you might call the orthodox Silicon Valley commitment to belief in god-like AI, which in one version is good, but in an equally if not even more prevalent version, will be a disaster for humans.

Yes, and the religious parallels are not just metaphorical — they're structural, and several people have noted them quite seriously.

The belief system has recognizable theological features. There's an eschatology — history is moving toward a culminating event, the Singularity or AGI, after which everything is transformed. There's a soteriological split — this event will mean either salvation (abundance, immortality, the solving of all problems) or damnation (extinction, subjugation, permanent loss of human agency). There are prophets — Kurzweil on the optimistic side, early Eliezer Yudkowsky and now various EA-aligned figures on the apocalyptic side. There's even something like original sin in the alignment problem — the idea that intelligence itself, if not carefully redeemed through the right technical interventions, tends toward destruction.