TY - JOUR
T1 - Performance of microbiome sequence inference methods in environments with varying biomass
AU - Caruso, Vincent
AU - Song, Xubo
AU - Asquith, Mark
AU - Karstens, Lisa
N1 - Funding Information:
We also thank our funders who supported this work: the Oregon BIRCWH (Building Interdisciplinary Research Careers in Women’s Health) (L.K.; U.S. National Institutes of Health [NIH] award number K12HD043488), The National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) (L.K.; NIH award number 1K01DK116706), the National Eye Institute (NEI) (L.K. and M.A.; NIH award number R01EY029266), the Rheumatology Research Foundation (L.K. and M.A.), and the Spondylitis Association of America (M.A.).
Funding Information:
We are grateful to Shannon McWeeney, Guanming Wu, and the three anonymous reviewers who provided constructive feedback to improve the manuscript. We also thank our funders who supported this work: the Oregon BIRCWH (Building Interdisciplinary Research Careers in Women?s Health) (L.K.; U.S. National Institutes of Health [NIH] award number K12HD043488), The National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) (L.K.; NIH award number 1K01DK116706), the National Eye Institute (NEI) (L.K. and M.A.; NIH award number R01EY029266), the Rheumatology Research Foundation (L.K. and M.A.), and the Spondylitis Association of America (M.A.). The content of the manuscript is solely our responsibility and does not necessarily represent the official views of the NIH or any other funding agency.
Publisher Copyright:
Copyright © 2019 Caruso et al.
PY - 2019
Y1 - 2019
N2 - Microbiome community composition plays an important role in human health, and while most research to date has focused on high-microbial-biomass communities, low-biomass communities are also important. However, contamination and technical noise make determining the true community signal difficult when biomass levels are low, and the influence of varying biomass on sequence processing methods has received little attention. Here, we benchmarked six methods that infer community composition from 16S rRNA sequence reads, using samples of varying biomass. We included two operational taxonomic unit (OTU) clustering algorithms, one entropy-based method, and three more-recent amplicon sequence variant (ASV) methods. We first compared inference results from high-biomass mock communities to assess baseline performance. We then benchmarked the methods on a dilution series made from a single mock community—samples that varied only in biomass. ASVs/OTUs inferred by each method were classified as representing expected community, technical noise, or contamination. With the high-biomass data, we found that the ASV methods had good sensitivity and precision, whereas the other methods suffered in one area or in both. Inferred contamination was present only in small proportions. With the dilution series, contamination represented an increasing proportion of the data from the inferred communities, regardless of the inference method used. However, correlation between inferred contaminants and sample biomass was strongest for the ASV methods and weakest for the OTU methods. Thus, no inference method on its own can distinguish true community sequences from contaminant sequences, but ASV methods provide the most accurate characterization of community and contaminants. IMPORTANCE Microbial communities have important ramifications for human health, but determining their impact requires accurate characterization. Current technology makes microbiome sequence data more accessible than ever. However, popular software methods for analyzing these data are based on algorithms developed alongside older sequencing technology and smaller data sets and thus may not be adequate for modern, high-throughput data sets. Additionally, samples from environments where microbes are scarce present additional challenges to community characterization relative to high-biomass environments, an issue that is often ignored. We found that a new class of microbiome sequence processing tools, called amplicon sequence variant (ASV) methods, outperformed conventional methods. In samples representing low-biomass communities, where sample contamination becomes a significant confounding factor, the improved accuracy of ASV methods may allow more-robust computational identification of contaminants.
AB - Microbiome community composition plays an important role in human health, and while most research to date has focused on high-microbial-biomass communities, low-biomass communities are also important. However, contamination and technical noise make determining the true community signal difficult when biomass levels are low, and the influence of varying biomass on sequence processing methods has received little attention. Here, we benchmarked six methods that infer community composition from 16S rRNA sequence reads, using samples of varying biomass. We included two operational taxonomic unit (OTU) clustering algorithms, one entropy-based method, and three more-recent amplicon sequence variant (ASV) methods. We first compared inference results from high-biomass mock communities to assess baseline performance. We then benchmarked the methods on a dilution series made from a single mock community—samples that varied only in biomass. ASVs/OTUs inferred by each method were classified as representing expected community, technical noise, or contamination. With the high-biomass data, we found that the ASV methods had good sensitivity and precision, whereas the other methods suffered in one area or in both. Inferred contamination was present only in small proportions. With the dilution series, contamination represented an increasing proportion of the data from the inferred communities, regardless of the inference method used. However, correlation between inferred contaminants and sample biomass was strongest for the ASV methods and weakest for the OTU methods. Thus, no inference method on its own can distinguish true community sequences from contaminant sequences, but ASV methods provide the most accurate characterization of community and contaminants. IMPORTANCE Microbial communities have important ramifications for human health, but determining their impact requires accurate characterization. Current technology makes microbiome sequence data more accessible than ever. However, popular software methods for analyzing these data are based on algorithms developed alongside older sequencing technology and smaller data sets and thus may not be adequate for modern, high-throughput data sets. Additionally, samples from environments where microbes are scarce present additional challenges to community characterization relative to high-biomass environments, an issue that is often ignored. We found that a new class of microbiome sequence processing tools, called amplicon sequence variant (ASV) methods, outperformed conventional methods. In samples representing low-biomass communities, where sample contamination becomes a significant confounding factor, the improved accuracy of ASV methods may allow more-robust computational identification of contaminants.
KW - ASV methods
KW - Bioinformatics
KW - Microbiome
KW - OTU clustering
UR - http://www.scopus.com/inward/record.url?scp=85067400488&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85067400488&partnerID=8YFLogxK
U2 - 10.1128/mSystems.00163-18
DO - 10.1128/mSystems.00163-18
M3 - Article
AN - SCOPUS:85067400488
SN - 2379-5077
VL - 4
JO - mSystems
JF - mSystems
IS - 1
M1 - e00163-18
ER -