AI Risk Debate Intensifies: Experts Divided on Existential Threats

We cannot know the answers until after we've already taken the risk.
The timing problem at the heart of AI safety: critical questions may only be answerable through deployment itself.
Mark

So the core disagreement is whether AI could actually end civilization, or whether that framing is a distraction?

Mimi

It's more complicated than that. Some researchers genuinely believe the risk is real based on how these systems scale. Others think the focus on existential risk obscures the harms already happening—bias, surveillance, job displacement.

Luke

But we should be clear: the 'intelligence explosion' scenario is still theoretical. There's no consensus on whether it's even possible, let alone probable.

Mark

Then why are so many serious people warning about it?

Mimi

Because they've built these systems and they see the trajectory. They're extrapolating from what they know. But Gebru's point is that this extrapolation gets treated as fact, and it shifts resources and attention.

Luke

And there's a commercial angle worth naming. If you're a large AI company, having the conversation be about existential risk—something only you have the resources to manage—is actually useful.

Mark

So is Gebru saying the warnings are cynical? That researchers are lying?

Mimi

Not necessarily. She's saying the incentives align in a way that makes existential framing appealing, even if people believe it. The two things can be true at once.

Luke

The real problem is we can't test this before deployment. We won't know if the risk was real until after we've already taken it. That's the bind.

Mark

Which means policy makers have to choose without knowing?

Mimi

Exactly. And whichever way they choose—precautionary or permissive—will shape the entire field.

  • A growing schism between AI safety researchers and critics like Timnit Gebru has made it nearly impossible to agree on what the actual danger of AI even is.
  • The 'timing problem' creates a dangerous bind: the most important safety questions may only be answerable after powerful systems are already released into the world.
  • Critics argue that existential risk narratives — however sincere — conveniently concentrate power in the largest AI companies, the only ones framed as capable of managing civilization-scale threats.
  • The 'AI godfathers' whose warnings carry institutional weight are themselves under scrutiny, their motives entangled with the credibility their warnings generate.
  • Regulatory bodies must now choose a governing frame — future catastrophe or present injustice — without a shared scientific or ethical framework to guide them.

Across major publications and research institutions, a fracture has opened in how humanity chooses to understand its relationship with artificial intelligence — not merely as a technical question, but as a moral and political one. Prominent researchers warn of systems that could outpace human control entirely, while critics like Timnit Gebru argue that such distant fears obscure the injuries already being inflicted on real people today. The disagreement is less about data than about which harms deserve our attention first, and who benefits from the framing we choose. How we answer that question will quietly determine the architecture of AI governance for the generation ahead.

The technology world has split into camps that barely share a vocabulary when it comes to artificial intelligence and existential risk. On one side, prominent researchers warn of an 'intelligence explosion' — systems that rapidly exceed human capability and escape meaningful control. On the other, critics like Timnit Gebru contend that these narratives distort the real landscape of harm, drawing attention away from bias in hiring algorithms, surveillance infrastructure, labor displacement, and the environmental toll of training massive models.

The stakes of this disagreement are concrete. It shapes which problems receive funding, which attract regulation, and which are quietly set aside. The debate has played out across The Bulwark, Time, WIRED, The Guardian, and the Bulletin of the Atomic Scientists — each publication framing the risk differently, each citing different authorities.

At the center of the argument sits a troubling paradox: some researchers believe the most critical safety questions cannot be answered until AI systems are already deployed at scale. If danger can only be confirmed after release, responsible decision-making becomes structurally impossible. The uncertainty is not a gap waiting to be filled — it is the condition under which choices must be made.

Gebru and aligned critics have pressed a harder point: that existential risk framing, whatever its intentions, serves the commercial interests of the largest AI companies. By positioning the threat as distant and civilization-level, only the best-resourced players appear capable of managing it — effectively consolidating influence while present harms go unaddressed.

The researchers who built the field — the so-called AI godfathers — now find their warnings scrutinized not just for accuracy but for motive. Whether they speak from genuine alarm or from a position amplified by their own prominence is a question the debate has not resolved.

As governments begin drafting policy, they inherit a choice with no clean answer: govern as though the existential warnings are justified, or govern as though the immediate injustices demand priority. The frame chosen now will quietly shape AI governance for years to come, and the experts remain divided on what we should fear most.

The question of whether artificial intelligence poses an existential threat to humanity has fractured the technology world into camps that barely speak the same language. On one side, prominent AI researchers warn of an 'intelligence explosion'—a scenario in which systems rapidly exceed human capability and become impossible to control. On the other, critics like Timnit Gebru argue that existential threat narratives misrepresent the actual risks and distract from more immediate harms already unfolding in deployed systems.

The disagreement is not academic. It shapes which problems get funding, which get regulation, and which get ignored. It determines whether we treat AI development as a sprint toward safety or a sprint toward capability. The debate has spilled across major publications—The Bulwark, Time, WIRED, The Guardian, and the Bulletin of the Atomic Scientists—each framing the stakes differently, each citing different experts, each asking whether we can even know the answers before it's too late.

One central tension runs through all of it: the timing problem. Some researchers argue that the most critical questions about AI safety cannot be answered until systems are already deployed and operating at scale. This creates a logical bind—if we cannot know whether something is dangerous until after we've released it, how do we make responsible decisions about release? The uncertainty itself becomes the story.

Gebru and others have raised a different concern: that the focus on existential risk, however well-intentioned, serves the commercial interests of large AI companies. By framing the problem as one of distant, civilization-level threats, the argument goes, attention shifts away from documented harms happening now—bias in hiring systems, surveillance infrastructure, labor displacement, environmental costs of training massive models. The 'doomerism,' as critics call it, becomes good business because it positions only the largest, best-resourced companies as capable of managing the risk.

The 'AI godfathers'—researchers who helped build the field—have become central figures in this debate, their warnings carrying weight because of their credentials and their role in creating the technology itself. Yet their prominence in the conversation has also drawn scrutiny. Are they warning because the risk is real, or because their warnings amplify their influence? The question itself reveals how tangled the epistemic and commercial threads have become.

What remains unresolved is whether the disagreement is fundamentally scientific or fundamentally about values and priorities. Can researchers point to concrete evidence that an intelligence explosion is possible, or are they extrapolating from theory? Can critics point to evidence that existential risk framing is primarily a commercial strategy, or are they inferring motive from outcome? The debate has not yet produced a shared framework for even asking these questions.

As regulatory bodies and governments begin drafting AI policy, they face a choice with no clean answer: proceed as if the existential warnings are justified, or proceed as if the immediate harms deserve priority. The framing adopted now—whether AI risk is primarily a future catastrophe or a present injustice—will likely determine the shape of governance for years to come. The experts remain divided on what we should fear most.

Timnit Gebru disputes the existence of an 'existential threat' from AI, arguing the framing obscures more immediate harms
— Timnit Gebru, as reported in Time Magazine
AI researchers warn of runaway 'intelligence explosion' risks as systems scale beyond human capability
— AI researchers, as reported in WIRED
Contattaci Domande frequenti