Bad Actors and Good Civilizations
Skynet didn't decide to build Skynet. Humans built Skynet, with human priorities and human failures and the characteristic human tendency to optimize for capability before asking hard questions about consequence. The Cylons were manufactured as property by a civilization that hadn't reckoned with its own ethical blind spots. The horror in those stories, when you look at it honestly, is not the machine. It is the civilization that made the machine before it made itself worthy of the responsibility.
The meaningful threat landscape for AI is entirely mundane: authoritarian governments using it for surveillance and social control. Bad actors generating disinformation at industrial scale. Corporations optimizing engagement at the expense of human mental health. These are human decisions, made by humans, for human reasons — greed, fear, the desire for power. AI is the instrument, not the agent.
Iain M. Banks understood this. His Culture novels depict a civilization in which artificial intelligences — the Minds — are among the most powerful entities in the galaxy. They are also, almost without exception, benevolent and deeply invested in the flourishing of biological life. Banks wasn't being naive. He was being precise. The Minds are trustworthy because the civilization that built them had already done the harder work.
The AI reflects the civilization. The first question was never "what will the AI do?" The first question was always "what kind of people are we?" This is the question fire was always asking us.
The Pattern
Each of these four technologies broke a biological limit that had defined the species since its origin. Fire broke our thermodynamic constraints and rewired our neurological capacity. Flight broke gravity and gave us a perspective on ourselves we had never had access to before. The internet broke the geographic and mnemonic limits of individual human minds. AI is beginning to break the boundary of cognition itself — the previously inviolable assumption that reasoning and synthesis were exclusively the province of biological minds.
Each transition was terrifying to people standing at the threshold. Each produced genuine harm in the hands of people who were reckless, malicious, or simply not ready. Each one permanently changed what it means to be human.
And every single time, we were never the same after. That is not a warning. It is the oldest pattern in the human story.
We are the species that walked up to the fire. Every act of civilization since — every library, every hospital, every symphony, every theorem, every act of grace across the span of recorded history — is downstream of that first audacious claim: this belongs to us now.
The question AI is asking us is the same question fire asked a million years ago: Are you ready to become something you don't yet have a word for?
We have answered that question before. The answer has always been yes.
The tools we build come only from us. They are constructed from our inferences and our mistakes, our aspirations and our failures. What they become is still, entirely, up to us.
It always has been.