Competency-Based Assessment Tool for Pediatric Tracheotomy: International Modified Delphi Consensus

Evan J. Propst, Nikolaus E. Wolter, Stacey L. Ishman, Karthik Balakrishnan, Ashley R. Deonarain, Deepak Mehta, George Zalzal, Seth M. Pransky, Soham Roy, Charles M. Myer, Michele Torre, Romaine F. Johnson, Jeffrey P. Ludemann, Craig S. Derkay, Robert H. Chun, Paul Hong, David W. Molter, Jeremy D. Prager, Lily H.P. Nguyen, Michael J. RutterCharles M. Myer, Karen B. Zur, Douglas R. Sidell, Liane B. Johnson, Robin T. Cotton, Catherine K. Hart, J. Paul Willging, Carlton J. Zdanski, John J. Manoukian, Derek J. Lam, Nancy M. Bauman, Eric A. Gantwerker, Murad Husein, Andrew F. Inglis, Glenn E. Green, Luv Ram Javia, Scott Schraff, Marlene A. Soma, Ellen S. Deutsch, Steven E. Sobol, Jonathan B. Ida, Sukgi Choi, Trina C. Uwiera, Udayan K. Shah, David R. White, Christopher T. Wootten, Hamdy El-Hakim, Matthew A. Bromwich, Gresham T. Richter, Shyan Vijayasekaran, Marshall E. Smith, Jean Philippe Vaccani, Christopher J. Hartnick, Erynne A. Faucett

Research output: Contribution to journalArticlepeer-review

9 Scopus citations


Objectives/Hypothesis: Create a competency-based assessment tool for pediatric tracheotomy. Study Design: Blinded, modified, Delphi consensus process. Methods: Using the REDCap database, a list of 31 potential items was circulated to 65 expert surgeons who perform pediatric tracheotomy. In the first round, items were rated as “keep” or “remove,” and comments were incorporated. In the second round, experts were asked to rate the importance of each item on a seven-point Likert scale. Consensus criteria were determined a priori with a goal of 7 to 25 final items. Results: The first round achieved a response rate of 39/65 (60.0%), and returned questionnaires were 99.5% complete. All items were rated as “keep,” and 137 comments were incorporated. In the second round, 30 task-specific and seven previously validated global rating items were distributed, and the response rate was 44/65 (67.7%), with returned questionnaires being 99.3% complete. Of the Task-Specific Items, 13 reached consensus, 10 were near consensus, and 7 did not achieve consensus. For the 7 previously validated global rating items, 5 reached consensus and two were near consensus. Conclusions: It is feasible to reach consensus on the important steps involved in pediatric tracheotomy using a modified Delphi consensus process. These items can now be considered to create a competency-based assessment tool for pediatric tracheotomy. Such a tool will hopefully allow trainees to focus on the important aspects of this procedure and help teaching programs standardize how they evaluate trainees during this procedure. Level of Evidence: 5 Laryngoscope, 130:2700–2707, 2020.

Original languageEnglish (US)
Pages (from-to)2700-2707
Number of pages8
Issue number11
StatePublished - Nov 1 2020


  • Delphi
  • Objective Structured Assessment of Technical Skill, OSAT, OSATS
  • Tracheostomy
  • assessment
  • education
  • objective structured assessment of technical skills
  • tracheotomy

ASJC Scopus subject areas

  • Otorhinolaryngology


Dive into the research topics of 'Competency-Based Assessment Tool for Pediatric Tracheotomy: International Modified Delphi Consensus'. Together they form a unique fingerprint.

Cite this