Computer-Aided Diagnosis System for the Evaluation of Thyroid Nodules on Ultrasonography: Prospective Non-Inferiority Study according to the Experience Level of Radiologists

다국어 초록 (Multilingual Abstract)

Objective: To determine whether a computer-aided diagnosis (CAD) system for the evaluation of thyroid nodules is non-inferior to radiologists with different levels of experience.
Materials and Methods: Patients with thyroid nodules with a decisive diagnosis of benign or malignant nodule were consecutively enrolled from November 2017 to September 2018. Three radiologists with different levels of experience (1 month, 4 years, and 7 years) in thyroid ultrasound (US) reviewed the thyroid US with and without using the CAD system. Statistical analyses included non-inferiority testing of the diagnostic accuracy for malignant thyroid nodules between the CAD system and the three radiologists with a non-inferiority margin of 10%, comparison of the diagnostic performance, and the added value of the CAD system to the radiologists.
Results: Altogether, 197 patients were included in the study cohort. The diagnostic accuracy of the CAD system (88.5%, 95% confidence interval [CI] = 82.7–92.5) was non-inferior to that of the radiologists with less experience (1 month and 4 year) of thyroid US (83.0%, 95% CI = 76.5–88.0; p < 0.001), whereas it was inferior to that of the experienced radiologist (7 years) (95.8%, 95% CI = 91.4–98.0; p = 0.138). The sensitivity and negative predictive value of the CAD system were significantly higher than those of the less-experienced radiologists were, whereas no significant difference was found with those of the experienced radiologist. A combination of US and the CAD system significantly improved sensitivity and negative predictive value, although the specificity and positive predictive value deteriorated for the less-experienced radiologists.
Conclusion: The CAD system may offer support for decision-making in the diagnosis of malignant thyroid nodules for operators who have less experience with thyroid US.

참고문헌 (Reference)

1 Guth S, "Very high prevalence of thyroid nodules detected by high frequency(13 MHz)ultrasound examination" 39 : 699-706, 2009

2 Nam-Goong IS, "Ultrasonography-guided fine-needle aspiration of thyroid incidentaloma: correlation with pathological findings" 60 : 21-28, 2004

3 Tan GH, "Thyroid incidentalomas : management approaches to nonpalpable nodules discovered incidentally on thyroid imaging" 126 : 226-231, 1997

4 Liu JP, "Tests for equivalence or non-inferiority for paired binary data" 21 : 231-245, 2002

5 Papini E, "Risk of malignancy in nonpalpable thyroid nodules: predictive value of ultrasound and color-Doppler features" 87 : 1941-1946, 2002

6 Kim HL, "Real-world performance of computer-aided diagnosis system for thyroid nodules using ultrasonography" 45 : 2672-2678, 2019

7 Frates MC, "Prevalence and distribution of carcinoma in patients with solitary and multiple thyroid nodules on sonography" 91 : 3411-3417, 2006

8 Park CS, "Observer variability in the sonographic evaluation of thyroid nodules" 38 : 287-293, 2010

9 김성헌, "Observer Variability and the Performance between Faculties and Residents: US Criteria for Benign and Malignant Thyroid Nodules" 대한영상의학회 11 (11): 149-155, 2010

10 Choi SH, "Interobserver and intraobserver variations in ultrasound assessment of thyroid nodules" 20 : 167-172, 2010

11 Zhao WJ, "Effectiveness evaluation of computer-aided diagnosis system for the diagnosis of thyroid nodules on ultrasound: a systematic review and meta-analysis" 98 : e16379-, 2019

12 Gao L, "Computeraided system for diagnosing thyroid nodules on ultrasound : a comparison with radiologist-based clinical assessments" 40 : 778-783, 2018

13 Yu Q, "Computeraided diagnosis of malignant or benign thyroid nodes based on ultrasound images" 274 : 2891-2897, 2017

14 Acharya UR, "Computer-aided diagnostic system for detection of Hashimoto thyroiditis on ultrasound images from a Polish population" 33 : 245-253, 2014

15 Jeong EY, "Computer-aided diagnosis system for thyroid nodules on ultrasonography : diagnostic performance and reproducibility based on the experience level of operators" 29 : 1978-1985, 2019

16 Lim KJ, "Computer-aided diagnosis for the differentiation of malignant from benign thyroid nodules on ultrasonography" 15 : 853-858, 2008

17 Chang Y, "Computer-aided diagnosis for classifying benign versus malignant thyroid nodules based on ultrasound images : a comparison with radiologist-based assessments" 43 : 554-, 2016

18 유영진, "Computer-Aided Diagnosis of Thyroid Nodules via Ultrasonography: Initial Clinical Experience" 대한영상의학회 19 (19): 665-672, 2018

19 Moon WJ, "Benign and malignant thyroid nodules : US differentiation—Multicenter retrospective study" 247 : 762-770, 2008

20 Choi YJ, "A computer-aided diagnosis system using artificial intelligence for the diagnosis and characterization of thyroid nodules on ultrasound : initial clinical assessment" 27 : 546-552, 2017

21 Gitto S, "A computer-aided diagnosis system for the assessment and characterization of low-to-high suspicion thyroid nodules on ultrasound" 124 : 118-125, 2019

22 Li LN, "A computer aided diagnosis system for thyroid disease using extreme learning machine" 36 : 3327-3337, 2012

23 Haugen BR, "2015 American Thyroid Association Management Guidelines for adult patients with thyroid nodules and differentiated thyroid cancer: the American Thyroid Association Guidelines task force on thyroid nodules and differentiated thyroid cancer" 26 : 1-133, 2016