Swedish lakes reveal how 'dark diversity' solves Darwin's 160-year invasion puzzle

The invisible species mattered more than the visible ones.
Dark diversity—species that could live in a habitat but don't—proved more predictive of invasion success than simple species counts.

For over 160 years, ecologists have wrestled with a paradox Darwin himself posed: do invading species succeed by resembling their new neighbors or by being unlike them? A sweeping 340-year study of fish introductions across 516 Swedish lakes has now offered a resolution — not by counting the species present, but by accounting for the ones that are conspicuously absent. The concept of 'dark diversity,' the invisible pool of species that could theoretically inhabit a place but do not yet, proves a more faithful guide to invasion success than any visible measure, suggesting that what is missing from an ecosystem may matter as much as what is there.

  • A 160-year ecological debate has persisted because researchers lacked datasets capturing both successful and failed invasions — this Swedish study, spanning 340 years and 748 introduction events, finally provides both sides of the ledger.
  • The tension at the heart of the puzzle is real: in restrictive lakes with small species pools, closely related invaders win; in richer lakes with larger pools, distantly related newcomers find unclaimed niches — the same question yields opposite answers depending on context.
  • Traditional metrics like species richness, lake area, and temperature consistently underperformed, exposing a blind spot in how ecologists have long assessed invasion risk.
  • Dark diversity — statistically inferred, never directly observed — emerged as the more powerful predictor, reframing the question from 'how many species are here?' to 'how many species could be here, and how many are still missing?'
  • The framework now awaits stress-testing across other taxa and habitats, and researchers acknowledge gaps in introduction-size data, but the consistency across multiple robustness checks lends the findings unusual durability.
  • As climate change accelerates species movement worldwide, conservation managers may gain a sharper risk-assessment tool — one that looks not at the community in front of them, but at the shadow community that surrounds it.

For more than a century and a half, ecologists have been divided over a question Darwin himself raised: does an invading species succeed by resembling the locals, already fitted to the same conditions, or by being different enough to exploit resources the natives have left untouched? A study drawing on 340 years of fish introductions across 516 Swedish lakes now proposes that both answers are correct — and that which one applies depends on something ecologists have largely overlooked.

The dataset is unusually powerful. Across nearly three and a half centuries, 748 introduction events involving 22 exotic fish species produced a mix of successes and failures — a combination rare in invasion research, where most studies examine only the species that won. Having both outcomes allowed the team, led by Meelis Pärtel of the University of Tartu, to isolate what actually separated establishment from collapse.

The decisive variable was dark diversity: the set of species that could theoretically live in a given lake under its current conditions but simply do not occur there yet. Invisible by definition, dark diversity cannot be measured by counting fish. But combined with the species already present, it reveals the full potential of what a habitat could support — the species pool. The study found that species pool size and community completeness, a measure of how much of that potential is already realized, predicted invasion success far more reliably than conventional metrics like species richness, temperature, or lake area.

The resolution to Darwin's paradox emerged from these two measures together. In lakes with smaller, more restrictive species pools, closely related invaders held the advantage — their shared traits suited them to demanding conditions. In lakes with larger pools, the pattern reversed: more distantly related species succeeded by filling ecological roles that native fish had not yet claimed. Community completeness refined the picture further: where most potential species were already present, close relatives did better; where many were still missing, more distant newcomers gained the edge.

The authors are measured in their claims. The analysis covers freshwater fish in one region and needs broader testing; data on the number of individuals introduced — a known factor in invasion success — was unavailable; and dark diversity itself must be statistically inferred rather than directly observed. Yet the findings held across multiple robustness checks, different estimation methods, and alternative definitions of evolutionary distance.

The practical implications reach beyond academic debate. As climate change and human activity continue to move species into unfamiliar places, the framework suggests a more informative question for conservation managers: not merely how many species are present, but how many could be there — and how many of those are still absent. That shift in perspective could sharpen both invasion risk assessments and broader efforts to protect biodiversity in a world that is rapidly being reshuffled.

For more than a century and a half, ecologists have been caught between two competing ideas about how species invade new habitats. Charles Darwin himself posed the question: does a newcomer succeed by resembling the locals—by already being suited to the same environment—or by being different, avoiding direct competition and exploiting untapped resources? A study of fish introductions across Swedish lakes suggests the answer has been hiding in plain sight, not in the species you can see, but in the ones that should be there and aren't.

The research draws on a remarkable dataset spanning 340 years of fish introductions in 516 Swedish freshwater lakes. Across those centuries, 748 separate introduction events involved 22 exotic fish species, some establishing successfully and others failing entirely. That combination of success and failure is rare in ecological research—most studies focus only on the winners. But here, the researchers had both, which allowed them to compare the conditions that separated triumph from collapse.

The key insight comes from a concept called dark diversity: the set of species that could theoretically live in a place under its current conditions but simply do not occur there yet. It is invisible by definition. You cannot see it by counting the fish in a lake. But when you combine dark diversity with the species already present, you get a fuller picture of what the habitat could in principle support—what ecologists call the species pool. The study found that this fuller picture predicted invasion success far better than traditional measures like species richness, lake area, temperature, or elevation.

The researchers, led by Meelis Pärtel of the University of Tartu, estimated dark diversity for each lake and then calculated two measures: species pool size, reflecting how many species the lake could potentially support, and community completeness, describing how much of that potential was already realized. These two measures resolved Darwin's old puzzle. In lakes with smaller species pools—environments with more restrictive conditions—introduced fish that were closely related to resident species had the clearest advantage. They shared traits suited to the same demanding environment. But in lakes with larger species pools, the pattern flipped. More distantly related species were more likely to establish, finding ecological niches that native fish had not yet filled.

Community completeness added another layer. In lakes where a high proportion of the potential species were already present, closely related newcomers did better. In lakes with lower completeness—more missing species from the potential pool—more distantly related invaders gained the edge. The crucial finding was this: the number of species currently present did not reveal these relationships on its own. Models based on ordinary species richness had weaker explanatory power than models using species pool size and community completeness. The invisible species mattered more than the visible ones.

The pattern held up across multiple robustness checks. When researchers used different ways to estimate dark diversity, different definitions of the potential pool, and alternative measures of evolutionary distance, the results remained consistent. The findings also stayed similar when they accounted for lake area or limited the analysis to first recorded introductions. At the community level, the pattern persisted: in lakes with larger species pools, successful exotic fish tended to be more distantly related to native species. In lakes with higher community completeness, successful exotics tended to be more closely related to natives.

The authors are careful about the scope of their claims. The analysis focused on freshwater fish in one region, so it still needs testing across other groups and habitats. They also lacked data on the number of individuals introduced, a factor known to affect invasion success. And dark diversity itself cannot be directly observed; it must be inferred statistically. Yet the study argues that these inferred measures may be more useful than the standard stand-ins ecologists have relied on for decades.

As climate change, species range shifts, and human transport continue to move organisms into new places, this framework could reshape how conservation managers assess risk. Instead of asking mainly how many species are already present, the work points to a more informative question: how many species could be there, and how many of those are still missing? If dark diversity can be estimated from native community data, managers may gain a more practical way to judge whether an ecosystem will favor close relatives already adapted to local conditions or newcomers that fill different ecological roles. That distinction could improve risk assessment for invasions and sharpen efforts to protect biodiversity in a rapidly changing world.

Dark diversity offers a new theoretical framework for understanding species distribution and community formation, helping reconcile previously conflicting results and improve predictions about which species will establish under new conditions.
— Meelis Pärtel, University of Tartu
As climate change, species range shifts, and human activity reshape ecosystems, dark diversity could help conservation managers predict which invasive species will establish and guide biodiversity protection strategies.
— Meelis Pärtel, University of Tartu
A Conversa do Hearth Outra perspectiva sobre a história
Inventor

So Darwin's puzzle has been sitting unsolved for 160 years. What made it so hard to crack?

Model

The puzzle was that ecologists kept finding evidence for both sides. Sometimes newcomers succeeded by being similar to locals, sometimes by being different. It looked like a contradiction. But the real issue was that they were looking at the wrong thing—just counting the species that were there, not thinking about the ones that could be there.

Inventor

And that's where dark diversity comes in. But how do you study something you can't see?

Model

You infer it statistically. You look at the native species in a lake, understand what conditions they need, and then ask: what other species have those same requirements but just haven't arrived yet? It's like asking what the lake's potential is, not just what it's currently holding.

Inventor

The study found that in restrictive environments, newcomers that resembled locals did better. Why would that be?

Model

Because in a harsh or limited environment, only species with very specific traits can survive. If you're a newcomer with those same traits, you fit right in. But if you're different, you're probably not suited to those conditions either. The environment itself is the filter.

Inventor

And in more permissive environments, the opposite happened—distant relatives succeeded more often.

Model

Right. When there's room for many different kinds of species, a newcomer that's different from locals might find an empty ecological role. It's not competing directly; it's filling a gap. The lake has space for it.

Inventor

So the invisible species—the dark diversity—told you something that the visible species couldn't.

Model

Exactly. Species richness alone was a weak predictor. But once you knew how many species the lake could theoretically support and how full it already was, you could predict invasion success much more reliably. The potential mattered more than the current state.

Fale Conosco FAQ