An approximate likelihood method reveals ancient gene flow between human, chimpanzee and gorilla

Gene flow and incomplete lineage sorting are two distinct sources of phylogenetic conflict, i.e., gene trees that differ in topology from each other and from the species tree. Distinguishing between the two processes is a key objective of current evolutionary genomics. This is most often pursued via...

Full description

Saved in:
Bibliographic Details
Main Author: Galtier, Nicolas
Format: Article
Language:English
Published: Peer Community In 2024-01-01
Series:Peer Community Journal
Subjects:
Online Access:https://peercommunityjournal.org/articles/10.24072/pcjournal.359/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1825206344974598144
author Galtier, Nicolas
author_facet Galtier, Nicolas
author_sort Galtier, Nicolas
collection DOAJ
description Gene flow and incomplete lineage sorting are two distinct sources of phylogenetic conflict, i.e., gene trees that differ in topology from each other and from the species tree. Distinguishing between the two processes is a key objective of current evolutionary genomics. This is most often pursued via the so-called ABBA-BABA type of method, which relies on a prediction of symmetry of gene tree discordance made by the incomplete lineage sorting hypothesis. Gene flow, however, need not be asymmetric, and when it is not, ABBA-BABA approaches do not properly measure the prevalence of gene flow. I introduce Aphid, an approximate maximum-likelihood method aimed at quantifying the sources of phylogenetic conflict via topology and branch length analysis of three-species gene trees. Aphid draws information from the fact that gene trees affected by gene flow tend to have shorter branches, and gene trees affected by incomplete lineage sorting longer branches, than the average gene tree. Accounting for the among-loci variance in mutation rate and gene flow time, Aphid returns estimates of the speciation times and ancestral effective population size, and a posterior assessment of the contribution of gene flow and incomplete lineage sorting to the conflict. Simulations suggest that Aphid is reasonably robust to a wide range of conditions. Analysis of coding and non-coding data in primates illustrates the potential of the approach and reveals that a substantial fraction of the human/chimpanzee/gorilla phylogenetic conflict is due to ancient gene flow. Aphid also predicts older speciation times and a smaller estimated effective population size in this group, compared to existing analyses assuming no gene flow.
format Article
id doaj-art-1462a08c901d457286df1512f2b4ed58
institution Kabale University
issn 2804-3871
language English
publishDate 2024-01-01
publisher Peer Community In
record_format Article
series Peer Community Journal
spelling doaj-art-1462a08c901d457286df1512f2b4ed582025-02-07T10:17:19ZengPeer Community InPeer Community Journal2804-38712024-01-01410.24072/pcjournal.35910.24072/pcjournal.359An approximate likelihood method reveals ancient gene flow between human, chimpanzee and gorilla Galtier, Nicolas0Institut des Sciences de l’Evolution, Univ Montpellier — CNRS — IRD, Montpellier, FranceGene flow and incomplete lineage sorting are two distinct sources of phylogenetic conflict, i.e., gene trees that differ in topology from each other and from the species tree. Distinguishing between the two processes is a key objective of current evolutionary genomics. This is most often pursued via the so-called ABBA-BABA type of method, which relies on a prediction of symmetry of gene tree discordance made by the incomplete lineage sorting hypothesis. Gene flow, however, need not be asymmetric, and when it is not, ABBA-BABA approaches do not properly measure the prevalence of gene flow. I introduce Aphid, an approximate maximum-likelihood method aimed at quantifying the sources of phylogenetic conflict via topology and branch length analysis of three-species gene trees. Aphid draws information from the fact that gene trees affected by gene flow tend to have shorter branches, and gene trees affected by incomplete lineage sorting longer branches, than the average gene tree. Accounting for the among-loci variance in mutation rate and gene flow time, Aphid returns estimates of the speciation times and ancestral effective population size, and a posterior assessment of the contribution of gene flow and incomplete lineage sorting to the conflict. Simulations suggest that Aphid is reasonably robust to a wide range of conditions. Analysis of coding and non-coding data in primates illustrates the potential of the approach and reveals that a substantial fraction of the human/chimpanzee/gorilla phylogenetic conflict is due to ancient gene flow. Aphid also predicts older speciation times and a smaller estimated effective population size in this group, compared to existing analyses assuming no gene flow. https://peercommunityjournal.org/articles/10.24072/pcjournal.359/speciationcoalescenceABBA-BABAeffective population sizeapes
spellingShingle Galtier, Nicolas
An approximate likelihood method reveals ancient gene flow between human, chimpanzee and gorilla
Peer Community Journal
speciation
coalescence
ABBA-BABA
effective population size
apes
title An approximate likelihood method reveals ancient gene flow between human, chimpanzee and gorilla
title_full An approximate likelihood method reveals ancient gene flow between human, chimpanzee and gorilla
title_fullStr An approximate likelihood method reveals ancient gene flow between human, chimpanzee and gorilla
title_full_unstemmed An approximate likelihood method reveals ancient gene flow between human, chimpanzee and gorilla
title_short An approximate likelihood method reveals ancient gene flow between human, chimpanzee and gorilla
title_sort approximate likelihood method reveals ancient gene flow between human chimpanzee and gorilla
topic speciation
coalescence
ABBA-BABA
effective population size
apes
url https://peercommunityjournal.org/articles/10.24072/pcjournal.359/
work_keys_str_mv AT galtiernicolas anapproximatelikelihoodmethodrevealsancientgeneflowbetweenhumanchimpanzeeandgorilla
AT galtiernicolas approximatelikelihoodmethodrevealsancientgeneflowbetweenhumanchimpanzeeandgorilla