Homoploid hybrid speciation (HHS) is the origin of a new, reproductively isolated species from hybridization between two species without a change in chromosome number. A 2006 Nature study proposed the neotropical butterfly Heliconius heurippa as a case in which a recombinant hybrid wing pattern acts as a novel mating cue, and posed four linked open questions: whether such a process is a special case within Heliconius or a widespread but undetected mechanism of animal speciation; how theoretical models of HHS change when they explicitly incorporate variation in mate preference and a hybrid phenotype as a unique mating cue; under what frequency, geographic, and ecological conditions recombinant hybrid phenotypes become established and fixed; and whether proposed candidate taxa (Heliconius pachinus, H. timareta, African cichlids, Rhagoletis flies) are true hybrid species or reflect other processes such as repeated introgression. The later literature has transformed but not resolved this agenda: strict evidentiary criteria were formulated (Schumer et al. 2014); a 2021 Author Correction withdrew the mate-choice evidence for H. heurippa; H. pachinus was argued to have a bifurcating rather than hybrid origin, and repeated adaptive introgression was invoked to explain the shared red pattern elements; new animal cases (Italian sparrow, Darwin's finch lineage, golden-crowned manakin, and Heliconius elevatus in 2024) were documented; yet the frequency of animal HHS remains unquantified and contested, and general theory with explicit mate-preference genetics remains incomplete. The open problem asks for the frequency and conditions of animal homoploid hybrid speciation, and the adjudication of the named candidate taxa under strict criteria.

Background

Speciation is usually pictured as the splitting of one lineage into two. A minority route is hybrid speciation, in which two distinct lineages contribute genes to a daughter species. In plants this commonly happens through allopolyploidy (genome doubling immediately isolates the hybrid from its parents), but there is also a homoploid form — homoploid hybrid speciation (HHS) — in which the new species forms without any change in chromosome number. HHS has long been considered extremely rare in animals, because a nascent homoploid hybrid lineage receives no automatic isolation from its parents and should usually be swamped by backcrossing or eliminated by ecological competition. The central difficulty is causal: hybridization is common between young species, so shared genes alone cannot show that hybridization created a species; one must show that the reproductive isolation itself was generated by hybridization.

The type system is the neotropical genus Heliconius. These butterflies have aposematic wing patterns — warning coloration advertising unpalatability to predators — and unrelated poisonous species converge on shared patterns under Müllerian mimicry, so wing patterns are under strong natural selection. In Heliconius the wing pattern is also a mate-recognition cue: males court females largely on the basis of color pattern, making pattern a 'magic trait', i.e. a trait under ecological selection that simultaneously causes assortative mating. Heliconius heurippa, from the eastern Andes of Colombia, has an intermediate phenotype: the yellow-barred forewing of its close relative H. cydno plus a red forewing band characteristic of H. melpomene. Laboratory crosses between H. cydno and H. melpomene can recreate the H. heurippa pattern, its genome is predominantly cydno-like, and it retains partial post-mating isolation (H. melpomene and H. cydno follow Haldane's rule: female F1 hybrids are sterile while males are fertile). Mavárez et al. (2006) reported that H. heurippa males prefer the complete hybrid pattern over either parental pattern, proposing that the recombinant pattern itself is the novel mating cue that isolates the hybrid species from both parents — a direct demonstration that a hybrid trait can cause reproductive isolation in an animal. Crucially, a 2021 Author Correction retracted the statistical support for this mate-choice claim: after correcting the likelihood analysis, there is no consistent evidence from the wing-model experiments for color-based mate preference, and the inference that the color pattern alone directly causes reproductive isolation is not supported. The evidence for the hybrid origin of the wing pattern and for partial reproductive isolation of H. heurippa remains valid.

Subsequent molecular work reframed the genetic mechanism: the red band reflects ancient adaptive introgression — a roughly 6.5 kb block near a putative kinesin gene, in the genomic region around the red-pattern regulatory gene optix, entered the H. cydno clade from H. melpomene — and whole-genome studies showed that red pattern alleles have repeatedly introgressed from H. melpomene into the clade containing H. cydno, H. timareta, and H. heurippa. In parallel, quantitative trait locus (QTL) mapping in H. cydno/H. pachinus — statistically associating trait variation with genomic regions — showed that a male mate-preference locus lies coincident with the forewing-color locus, and experiments with backcross hybrids resembling H. heurippa found that such hybrids prefer their own recombinant pattern, both of which make a preference–cue genetic coupling plausible. On the theoretical side, earlier 'recombinational speciation' models (McCarthy et al. 1995; Buerkle et al. 2000) treated hybrid speciation through the sorting of chromosomal blocks and incompatibilities but did not model mate preference; a 2009 spatial, individual-based, multilocus model tailored to the H. heurippa scenario (Duenez-Guzman et al.) incorporated mating preference, predation on coloration, habitat preference, and genetic incompatibilities, and found hybrid speciation possible only under restricted conditions, most plausibly with geographic isolation. More recent general theory (Blanckaert & Bank 2018; Blanckaert, Sriram & Bank 2023) analyzes HHS via reciprocal sorting of Dobzhansky–Muller incompatibilities (epistatic gene interactions that are benign within each parent species but sterile/inviable when combined in hybrids), identifying a narrow 'Goldilocks zone' of linkage architectures in which a hybrid population can become isolated from both parents, but also substantial extinction risk — a different mechanism from the mate-preference route of the Heliconius scenario.

The empirical landscape has grown but stays thin. Schumer, Rosenthal & Andolfatto (2014) proposed the now-standard three criteria for documenting HHS — (i) the lineage has a hybrid origin, (ii) it is reproductively isolated from both parents, and (iii) the reproductive isolation was derived from hybridization — and concluded that most claimed animal cases then failed one or more criteria, with H. heurippa and three sunflower species the only taxa satisfying all three. Since then, genomically documented animal candidates have accumulated: the Italian sparrow (isolated by sorted parental sex-linked and mitonuclear incompatibilities, i.e. incompatibilities involving the sex chromosomes or arising between nuclear genes and the maternally inherited mitochondrial genome), a directly observed Darwin's finch lineage on Daphne Major that became endogamous within about three generations, the golden-crowned manakin with its novel crown ornament, and — most decisively for the Heliconius question — H. elevatus, shown in 2024 to be a hybrid species sympatric with both parents (H. pardalinus and introgression from H. melpomene), maintained by divergence islands — the small fraction of the genome (~1%) strongly differentiated from both parents — containing color pattern, wing shape, host-plant preference, sex pheromones, and mate choice. At the same time, the cichlid and Rhagoletis cases are disputed: hybridization has been proposed to fuel entire adaptive radiations (e.g. the Lake Victoria superflock) by supplying standing variation that recombines among new species rather than yielding discrete hybrid species, and Rhagoletis flies remain a contested host-shift-based case. Reviews in 2024 are split on the headline question: convincing examples 'remain rare' because the causal criterion is hard to meet (Rosser et al. 2024), yet HHS 'could be much more common and more protracted' than earlier conceptual arguments allowed, given how widespread admixture is (Long & Rieseberg 2024) — a disagreement that itself defines the open problem.

Problem Statement

The problem posed by Mavárez et al. (2006) has one overarching objective: determine whether homoploid hybrid speciation is a general mechanism of animal speciation — and the conditions under which it succeeds — with the Heliconius heurippa clade as the type system. Three jointly necessary components define completion. (1) Frequency and generality: determine whether homoploid hybrid speciation of the H. heurippa (hybrid-trait) type is a special case within Heliconius/animals or a widespread but undetected mechanism of animal speciation, resolving the currently documented disagreement between 'convincing examples remain rare' (Rosser et al. 2024) and 'could be much more common and more protracted' (Long & Rieseberg 2024). A well-evidenced resolution of this disjunction satisfies component (1); where achievable, quantified frequency estimates or bounds with an explicit, unbiased sampling frame count as particularly strong evidence toward the resolution, but numerical quantification is not itself a mandatory completion deliverable. (2) Conditions: identify, theoretically and empirically, the genetic, demographic, geographic, and ecological conditions under which a recombinant hybrid phenotype becomes established and fixed in a lineage reproductively isolated from both parental species — including how general models of homoploid hybrid speciation change when they incorporate heritable variation in mate preference and a hybrid phenotype as a novel mating cue (per Kronforst et al. 2006 and Melo et al. 2009), and the relative roles of genetic drift, frequency-dependent selection on mimicry phenotypes, and geographic isolation during establishment, for example by extending the scenario-specific model of Duenez-Guzman et al. (2009) toward a general treatment. A resolution of component (2) treats the four condition classes as the joint scope of the account — which may be theoretical, empirical, or both — with the sub-items above forming part of that scope rather than separate mandatory deliverables. (3) Candidate adjudication: for the taxa named in the source and their successors — H. pachinus, H. timareta, H. heurippa itself, African cichlids, and Rhagoletis, together with the later-documented animal cases H. elevatus, the Italian sparrow, Darwin's finch lineage, and the golden-crowned manakin — determine whether each meets the strict criteria of Schumer et al. (2014) (hybrid origin of the lineage; reproductive isolation from both parents; reproductive isolation causally derived from hybridization) or reflects alternative processes such as repeated adaptive introgression or hybridization-fueled radiation without discrete hybrid species. Answers to the three components are scientifically linked: the generality resolution (1) depends on the criteria made operational in (3), and both are grounded in the establishment conditions identified in (2); the problem is complete when all three are resolved, and each component's evidence is reviewed against the same causal standard whose necessity the 2021 correction of the type case made explicit.

References

  1. Mavárez J, Salazar CA, Bermingham E, Salcedo C, Jiggins CD, Linares M (2006). Speciation by hybridization in Heliconius butterflies. Nature 441:868-871. doi:10.1038/nature04738. https://doi.org/10.1038/nature04738
  2. Mavárez J, Salazar CA, Bermingham E, Salcedo C, Jiggins CD, Linares M (2021). Author Correction: Speciation by hybridization in Heliconius butterflies. Nature 592:E4-E5. doi:10.1038/s41586-021-03330-8. https://doi.org/10.1038/s41586-021-03330-8
  3. Schwarz D, Matta BM, Shakir-Botteri NL, McPheron BA (2005). Host shift to an invasive plant triggers rapid animal hybrid speciation. Nature 436:546-549. doi:10.1038/nature03800. https://doi.org/10.1038/nature03800
  4. Kronforst MR, Young LG, Kapan DD, McNeely C, O'Neill RJ, Gilbert LE (2006). Linkage of butterfly mate preference and wing color preference cue at the genomic location of wingless. Proceedings of the National Academy of Sciences USA 103:6575-6580. doi:10.1073/pnas.0509685103. https://doi.org/10.1073/pnas.0509685103
  5. Kronforst MR, Salazar C, Linares M, Gilbert LE (2007). No genomic mosaicism in a putative hybrid butterfly species. Proceedings of the Royal Society B 274:1255-1264. doi:10.1098/rspb.2006.0207. https://doi.org/10.1098/rspb.2006.0207
  6. Mallet J (2007). Hybrid speciation. Nature 446:279-283. doi:10.1038/nature05706. https://doi.org/10.1038/nature05706
  7. Mavárez J, Linares M (2008). Homoploid hybrid speciation in animals. Molecular Ecology 17:4181-4185. doi:10.1111/j.1365-294X.2008.03898.x. https://doi.org/10.1111/j.1365-294X.2008.03898.x
  8. Salazar C, Jiggins CD, Taylor JE, Kronforst MR, Linares M (2008). Gene flow and the genealogical history of Heliconius heurippa. BMC Evolutionary Biology 8:132. doi:10.1186/1471-2148-8-132. https://doi.org/10.1186/1471-2148-8-132
  9. Jiggins CD, Salazar C, Linares M, Mavarez J (2008). Hybrid trait speciation and Heliconius butterflies. Philosophical Transactions of the Royal Society B 363:3047-3054. doi:10.1098/rstb.2008.0065. https://doi.org/10.1098/rstb.2008.0065
  10. Melo MC, Salazar C, Jiggins CD, Linares M (2009). Assortative mating preferences among hybrids offers a route to hybrid speciation. Evolution 63:1660-1665. doi:10.1111/j.1558-5646.2009.00633.x. https://doi.org/10.1111/j.1558-5646.2009.00633.x
  11. Duenez-Guzman EA, Mavárez J, Vose MD, Gavrilets S (2009). Case studies and mathematical models of ecological speciation. 4. Hybrid speciation in butterflies in a jungle. Evolution 63:2611-2626. doi:10.1111/j.1558-5646.2009.00756.x. https://doi.org/10.1111/j.1558-5646.2009.00756.x
  12. Salazar C, Baxter SW, Pardo-Díaz C, Wu G, Surridge A, Linares M, Bermingham E, Jiggins CD (2010). Genetic evidence for hybrid trait speciation in Heliconius butterflies. PLoS Genetics 6:e1000930. doi:10.1371/journal.pgen.1000930. https://doi.org/10.1371/journal.pgen.1000930
  13. Dasmahapatra KK, Walters JR, Briscoe AD, et al. (The Heliconius Genome Consortium) (2012). Butterfly genome reveals promiscuous exchange of mimicry adaptations among species. Nature 487:94-98. doi:10.1038/nature11041. https://doi.org/10.1038/nature11041
  14. Pardo-Díaz C, Salazar C, Baxter SW, Merot C, Figueiredo-Ready W, Joron M, McMillan WO, Jiggins CD (2012). Adaptive introgression across species boundaries in Heliconius butterflies. PLoS Genetics 8:e1002752. doi:10.1371/journal.pgen.1002752. https://doi.org/10.1371/journal.pgen.1002752
  15. Abbott R, Albach D, Ansell S, et al. (2013). Hybridization and speciation. Journal of Evolutionary Biology 26:229-246. doi:10.1111/j.1420-9101.2012.02599.x. https://doi.org/10.1111/j.1420-9101.2012.02599.x
  16. Schumer M, Rosenthal GG, Andolfatto P (2014). How common is homoploid hybrid speciation? Evolution 68:1553-1560. doi:10.1111/evo.12399. https://doi.org/10.1111/evo.12399
  17. Arias CF, Salazar C, Rosales C, Kronforst MR, Linares M, Bermingham E, McMillan WO (2014). Phylogeography of Heliconius cydno and its closest relatives: disentangling their origin and diversification. Molecular Ecology 23:4137-4152. doi:10.1111/mec.12844. https://doi.org/10.1111/mec.12844
  18. Hermansen JS, Haas F, Trier CN, Bailey RI, Nederbragt AJ, Marzal A, Saetre GP (2014). Hybrid speciation through sorting of parental incompatibilities in Italian sparrows. Molecular Ecology 23:5831-5842. doi:10.1111/mec.12910. https://doi.org/10.1111/mec.12910
  19. Meier JI, Marques DA, Mwaiko S, Wagner CE, Excoffier L, Seehausen O (2017). Ancient hybridization fuels rapid cichlid fish adaptive radiations. Nature Communications 8:14363. doi:10.1038/ncomms14363. https://doi.org/10.1038/ncomms14363
  20. Blanckaert A, Bank C (2018). In search of the Goldilocks zone for hybrid speciation. PLoS Genetics 14:e1007613. doi:10.1371/journal.pgen.1007613. https://doi.org/10.1371/journal.pgen.1007613
  21. Lamichhaney S, Han F, Webster MT, Andersson L, Grant BR, Grant PR (2018). Rapid hybrid speciation in Darwin's finches. Science 359:224-228. doi:10.1126/science.aao4593. https://doi.org/10.1126/science.aao4593
  22. Barrera-Guzmán AO, Aleixo A, Shawkey MD, Weir JT (2018). Hybrid speciation leads to novel male secondary sexual ornamentation of an Amazonian bird. Proceedings of the National Academy of Sciences USA 115:E218-E225. doi:10.1073/pnas.1717319115. https://doi.org/10.1073/pnas.1717319115
  23. Blanckaert A, Sriram V, Bank C (2023). In search of the Goldilocks zone for hybrid speciation II: hard times for hybrid speciation? Evolution 77:2162-2172. doi:10.1093/evolut/qpad125. https://doi.org/10.1093/evolut/qpad125
  24. Rosser N, Seixas F, Queste LM, et al. (2024). Hybrid speciation driven by multilocus introgression of ecological traits. Nature 628:811-817. doi:10.1038/s41586-024-07263-w. https://doi.org/10.1038/s41586-024-07263-w
  25. Long Z, Rieseberg LH (2024). Documenting homoploid hybrid speciation. Molecular Ecology 34:e17412. doi:10.1111/mec.17412. https://doi.org/10.1111/mec.17412
  26. Sanders H (2025). Hybrid fertility and the rarity of homoploid hybrid speciation. AoB PLANTS 17:plaf035. doi:10.1093/aobpla/plaf035. https://doi.org/10.1093/aobpla/plaf035