Combining tumor genome simulation with crowdsourcing to benchmark somatic single-nucleotide-variant detection

Adam D. Ewing, Kathleen E. Houlahan, Yin Hu, Kyle Ellrott, Cristian Caloian, Takafumi N. Yamaguchi, J. Christopher Bare, Christine P'Ng, Daryl Waggott, Veronica Y. Sabelnykova, Michael R. Kellen, Thea C. Norman, David Haussler, Stephen H. Friend, Gustavo Stolovitzky, Adam A. Margolin, Joshua M. Stuart, Paul C. Boutros

Research output: Contribution to journalArticlepeer-review

205 Scopus citations


The detection of somatic mutations from cancer genome sequences is key to understanding the genetic basis of disease progression, patient survival and response to therapy. Benchmarking is needed for tool assessment and improvement but is complicated by a lack of gold standards, by extensive resource requirements and by difficulties in sharing personal genomic information. To resolve these issues, we launched the ICGC-TCGA DREAM Somatic Mutation Calling Challenge, a crowdsourced benchmark of somatic mutation detection algorithms. Here we report the BAMSurgeon tool for simulating cancer genomes and the results of 248 analyses of three in silico tumors created with it. Different algorithms exhibit characteristic error profiles, and, intriguingly, false positives show a trinucleotide profile very similar to one found in human tumors. Although the three simulated tumors differ in sequence contamination (deviation from normal cell sequence) and in subclonality, an ensemble of pipelines outperforms the best individual pipeline in all cases. BAMSurgeon is available at

Original languageEnglish (US)
Pages (from-to)623-630
Number of pages8
JournalNature Methods
Issue number7
StatePublished - Jun 30 2015

ASJC Scopus subject areas

  • Biotechnology
  • Biochemistry
  • Molecular Biology
  • Cell Biology


Dive into the research topics of 'Combining tumor genome simulation with crowdsourcing to benchmark somatic single-nucleotide-variant detection'. Together they form a unique fingerprint.

Cite this