Meta-analysis of the technical performance of an imaging procedure: Guidelines and statistical methodology

Erich P. Huang, Xiao Feng Wang, Kingshuk Roy Choudhury, Lisa M. McShane, Mithat Gönen, Jingjing Ye, Andrew J. Buckler, Paul E. Kinahan, Anthony P. Reeves, Edward F. Jackson, Alexander R. Guimaraes, Gudrun Zahlmann

Research output: Contribution to journalReview articlepeer-review

37 Scopus citations


Medical imaging serves many roles in patient care and the drug approval process, including assessing treatment response and guiding treatment decisions. These roles often involve a quantitative imaging biomarker, an objectively measured characteristic of the underlying anatomic structure or biochemical process derived from medical images. Before a quantitative imaging biomarker is accepted for use in such roles, the imaging procedure to acquire it must undergo evaluation of its technical performance, which entails assessment of performance metrics such as repeatability and reproducibility of the quantitative imaging biomarker. Ideally, this evaluation will involve quantitative summaries of results from multiple studies to overcome limitations due to the typically small sample sizes of technical performance studies and/or to include a broader range of clinical settings and patient populations. This paper is a review of meta-analysis procedures for such an evaluation, including identification of suitable studies, statistical methodology to evaluate and summarize the performance metrics, and complete and transparent reporting of the results. This review addresses challenges typical of meta-analyses of technical performance, particularly small study sizes, which often causes violations of assumptions underlying standard meta-analysis techniques. Alternative approaches to address these difficulties are also presented; simulation studies indicate that they outperform standard techniques when some studies are small. The meta-analysis procedures presented are also applied to actual [18F]-fluorodeoxyglucose positron emission tomography (FDG-PET) test-retest repeatability data for illustrative purposes.

Original languageEnglish (US)
Pages (from-to)141-174
Number of pages34
JournalStatistical methods in medical research
Issue number1
StatePublished - Feb 27 2015
Externally publishedYes


  • imaging biomarkers
  • meta-analysis
  • meta-regression
  • quantitative imaging
  • repeatability
  • reproducibility
  • systematic review
  • technical performance

ASJC Scopus subject areas

  • Epidemiology
  • Statistics and Probability
  • Health Information Management


Dive into the research topics of 'Meta-analysis of the technical performance of an imaging procedure: Guidelines and statistical methodology'. Together they form a unique fingerprint.

Cite this