TY - JOUR
T1 - Diagnostic accuracy of point-of-care ultrasound with artificial intelligence-assisted assessment of left ventricular ejection fraction
AU - Motazedian, Pouya
AU - Marbach, Jeffrey A.
AU - Prosperi-Porta, Graeme
AU - Parlow, Simon
AU - Di Santo, Pietro
AU - Abdel-Razek, Omar
AU - Jung, Richard
AU - Bradford, William B.
AU - Tsang, Miranda
AU - Hyon, Michael
AU - Pacifici, Stefano
AU - Mohanty, Sharanya
AU - Ramirez, F. Daniel
AU - Huggins, Gordon S.
AU - Simard, Trevor
AU - Hon, Stephanie
AU - Hibbert, Benjamin
N1 - Publisher Copyright:
© 2023, The Author(s).
PY - 2023/12
Y1 - 2023/12
N2 - Focused cardiac ultrasound (FoCUS) is becoming standard practice in a wide spectrum of clinical settings. There is limited data evaluating the real-world use of FoCUS with artificial intelligence (AI). Our objective was to determine the accuracy of FoCUS AI-assisted left ventricular ejection fraction (LVEF) assessment and compare its accuracy between novice and experienced users. In this prospective, multicentre study, participants requiring a transthoracic echocardiogram (TTE) were recruited to have a FoCUS done by a novice or experienced user. The AI-assisted device calculated LVEF at the bedside, which was subsequently compared to TTE. 449 participants were enrolled with 424 studies included in the final analysis. The overall intraclass coefficient was 0.904, and 0.921 in the novice (n = 208) and 0.845 in the experienced (n = 216) cohorts. There was a significant bias of 0.73% towards TTE (p = 0.005) with a level of agreement of 11.2%. Categorical grading of LVEF severity had excellent agreement to TTE (weighted kappa = 0.83). The area under the curve (AUC) was 0.98 for identifying an abnormal LVEF (<50%) with a sensitivity of 92.8%, specificity of 92.3%, negative predictive value (NPV) of 0.97 and a positive predictive value (PPV) of 0.83. In identifying severe dysfunction (<30%) the AUC was 0.99 with a sensitivity of 78.1%, specificity of 98.0%, NPV of 0.98 and PPV of 0.76. Here we report that FoCUS AI-assisted LVEF assessments provide highly reproducible LVEF estimations in comparison to formal TTE. This finding was consistent among senior and novice echocardiographers suggesting applicability in a variety of clinical settings.
AB - Focused cardiac ultrasound (FoCUS) is becoming standard practice in a wide spectrum of clinical settings. There is limited data evaluating the real-world use of FoCUS with artificial intelligence (AI). Our objective was to determine the accuracy of FoCUS AI-assisted left ventricular ejection fraction (LVEF) assessment and compare its accuracy between novice and experienced users. In this prospective, multicentre study, participants requiring a transthoracic echocardiogram (TTE) were recruited to have a FoCUS done by a novice or experienced user. The AI-assisted device calculated LVEF at the bedside, which was subsequently compared to TTE. 449 participants were enrolled with 424 studies included in the final analysis. The overall intraclass coefficient was 0.904, and 0.921 in the novice (n = 208) and 0.845 in the experienced (n = 216) cohorts. There was a significant bias of 0.73% towards TTE (p = 0.005) with a level of agreement of 11.2%. Categorical grading of LVEF severity had excellent agreement to TTE (weighted kappa = 0.83). The area under the curve (AUC) was 0.98 for identifying an abnormal LVEF (<50%) with a sensitivity of 92.8%, specificity of 92.3%, negative predictive value (NPV) of 0.97 and a positive predictive value (PPV) of 0.83. In identifying severe dysfunction (<30%) the AUC was 0.99 with a sensitivity of 78.1%, specificity of 98.0%, NPV of 0.98 and PPV of 0.76. Here we report that FoCUS AI-assisted LVEF assessments provide highly reproducible LVEF estimations in comparison to formal TTE. This finding was consistent among senior and novice echocardiographers suggesting applicability in a variety of clinical settings.
UR - http://www.scopus.com/inward/record.url?scp=85175146456&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85175146456&partnerID=8YFLogxK
U2 - 10.1038/s41746-023-00945-1
DO - 10.1038/s41746-023-00945-1
M3 - Article
AN - SCOPUS:85175146456
SN - 2398-6352
VL - 6
JO - npj Digital Medicine
JF - npj Digital Medicine
IS - 1
M1 - 201
ER -