Abstract
Objectives
The machine learning ischemia risk score (ML-IRS) is a machine learning–based algorithm designed to identify hemodynamically significant coronary disease using quantitative coronary computed tomography angiography (CCTA). The purpose of this study was to examine whether the ML-IRS can predict revascularization in patients referred for invasive coronary angiography (ICA) after CCTA.
Methods
This study was a post hoc analysis of a prospective dual-center registry of sequential patients undergoing CCTA followed by ICA within 3 months, referred from inpatient, outpatient, and emergency department settings (n = 352, age 63 ± 10 years, 68% male). The primary outcome was revascularization by either percutaneous coronary revascularization or coronary artery bypass grafting. Blinded readers performed semi-automated quantitative coronary plaque analysis. The ML-IRS was automatically computed. Relationships between clinical risk factors, coronary plaque features, and ML-IRS with revascularization were examined.
Results
The study cohort consisted of 352 subjects with 1056 analyzable vessels. The ML-IRS ranged between 0 and 81% with a median of 18.7% (6.4–34.8). Revascularization was performed in 26% of vessels. Vessels receiving revascularization had higher ML-IRS (33.6% (21.1–55.0) versus 13.0% (4.5–29.1), p < 0.0001), as well as higher contrast density difference, and total, non-calcified, calcified, and low-density plaque burden. ML-IRS, when added to a traditional risk model based on clinical data and stenosis to predict revascularization, resulted in increased area under the curve from 0.69 (95% CI: 0.65–0.72) to 0.78 (95% CI: 0.75–0.81) (p < 0.0001), with an overall continuous net reclassification improvement of 0.636 (95% CI: 0.503–0.769; p < 0.0001).
Conclusions
ML-IRS from quantitative coronary CT angiography improved the prediction of future revascularization and can potentially identify patients likely to receive revascularization if referred to cardiac catheterization.
Key Points
• Machine learning ischemia risk from quantitative coronary CT angiography was significantly higher in patients who received revascularization versus those who did not receive revascularization.
• The machine learning ischemia risk score was significantly higher in patients with invasive fractional flow ≤ 0.8 versus those with > 0.8.
• The machine learning ischemia risk score improved the prediction of future revascularization significantly when added to a standard prediction model including stenosis.
Similar content being viewed by others
Abbreviations
- BMI:
-
Body mass index
- CAD:
-
Coronary artery disease
- CCS:
-
Coronary calcium score
- CCTA:
-
Coronary CT angiography
- CDD:
-
Contrast density difference
- FFR:
-
Fractional flow reserve
- ICA:
-
Invasive coronary angiography
- ML-IRS:
-
Machine learning ischemia risk score
- NRI:
-
Continuous net reclassification improvement
References
Patel MR, Peterson ED, Dai D et al (2010) Low diagnostic yield of elective coronary angiography. N Engl J Med 362:886–895
SCOT-HEART Investigators, Newby DE, Adamson PD et al (2018) Coronary CT angiography and 5-year risk of myocardial infarction. N Engl J Med 379:924–933
Shaw LJ, Hausleiter J, Achenbach S et al (2012) Coronary computed tomographic angiography as a gatekeeper to invasive diagnostic and surgical procedures: results from the multicenter CONFIRM (Coronary CT Angiography Evaluation for Clinical Outcomes: an International Multicenter) registry. J Am Coll Cardiol 60:2103–2114
Douglas PS, Hoffmann U, Patel MR et al (2015) Outcomes of anatomical versus functional testing for coronary artery disease. N Engl J Med 372:1291–1300
Dey D, Gaur S, Ovrehus KA et al (2018) Integrated prediction of lesion-specific ischaemia from quantitative coronary CT angiography using machine learning: a multicentre study. Eur Radiol 28:2655–2664
Cheng VY, Berman DS, Rozanski A et al (2011) Performance of the traditional age, sex, and angina typicality–based approach for estimating pretest probability of angiographically significant coronary artery disease in patients undergoing coronary computed tomographic angiography: results from the Multinational Coronary CT Angiography Evaluation for Clinical Outcomes: An International Multicenter Registry (CONFIRM). Circulation 124:2423–2432
Greiner M, Sohr D, Göbel P (1995) A modified ROC analysis for the selection of cut-off values and the definition of intermediate results of serodiagnostic tests. J Immunol Methods 185:123–132
Pencina MJ, D’Agostino RB Sr, Steyerberg EW (2011) Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med 30:11–21
Pencina MJ, D’agostino RB, Pencina KM, Janssens ACJ, Greenland P (2012) Interpreting incremental value of markers added to risk prediction models. Am J Epidemiol 176:473–481
Koo B-K, Erglis A, Doh J-H et al (2011) Diagnosis of ischemia-causing coronary stenoses by noninvasive fractional flow reserve computed from coronary computed tomographic angiograms: results from the prospective multicenter DISCOVER-FLOW (Diagnosis of Ischemia-Causing Stenoses Obtained Via Noninvasive Fractional Flow Reserve) study. J Am Coll Cardiol 58:1989–1997
Douglas PS, Pontone G, Hlatky MA et al (2015) Clinical outcomes of fractional flow reserve by computed tomographic angiography-guided diagnostic strategies vs. usual care in patients with suspected coronary artery disease: the prospective longitudinal trial of FFRCT: outcome and resource impacts study. Eur Heart J 36:3359–3367
Fearon WF, Achenbach S, Engstrom T et al (2019) Accuracy of fractional flow reserve derived from coronary angiography. Circulation 139:477–484
Zreik M, Lessmann N, van Hamersvelt RW et al (2018) Deep learning analysis of the myocardium in coronary CT angiography for identification of patients with functionally significant coronary artery stenosis. Med Image Anal 44:72–85
Tesche C, De Cecco CN, Baumann S et al (2018) Coronary CT angiography–derived fractional flow reserve: machine learning algorithm versus computational fluid dynamics modeling. Radiology 288:64–72
Pontone G, Rabbat MG (2017) The new era of computational fluid dynamics in CT angiography: far beyond the FFR number. J Am Coll Cardiol Img 10:674–676
Hell MM, Motwani M, Otaki Y et al (2017) Quantitative global plaque characteristics from coronary CT Angiography for the prediction of future cardiac death during 5 years of follow-up. Eur Heart J Cardiovasc Imaging 18:1331–1339
Gaur S, Øvrehus KA, Dey D et al (2016) Coronary plaque quantification and fractional flow reserve by coronary computed tomography angiography identify ischaemia-causing lesions. Eur Heart J 37:1220–1227
Dey D, Diaz Zamudio M, Schuhbaeck A et al (2015) Relationship between quantitative adverse plaque features from coronary computed tomography angiography and downstream impaired myocardial flow reserve by 13 N-ammonia positron emission tomography: a pilot study. Circ Cardiovasc Imaging 8:e003255
Xiong G, Kola D, Heo R, Elmore K, Cho I, Min JK (2015) Myocardial perfusion analysis in cardiac computed tomography angiographic images at rest. Med Image Anal 24:77–89
Coenen A, Kim Y-H, Kruk M et al (2018) Diagnostic accuracy of a machine-learning approach to coronary computed tomographic angiography–based fractional flow reserve: result from the MACHINE consortium. Circ Cardiovasc Imaging 11:e007217
Parikh RV, Liu G, Plomondon ME et al (2020) Utilization and outcomes of measuring fractional flow reserve in patients with stable ischemic heart disease. J Am Coll Cardiol 75:409–419
Acknowledgments
Alan Kwan acknowledges funding support provided by the National Institutes of Health (Grant T32HL116273).
Damini Dey acknowledges funding support provided by the National Institutes of Health (Grants 1R01HL148787-01A1 and 1R01HL133616).
Funding
The authors state that this work has received funding from 1R01HL148787-01A1.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Guarantor
The scientific guarantor of this publication is Damini Dey.
Conflict of interest
Sebastien Cadet, Piotr J. Slomka, Daniel S. Berman, and Damini Dey may receive software royalties from Cedars-Sinai Medical Center. Piotr J. Slomka, Daniel S. Berman, and Damini Dey hold a patent related to the plaque characterization.
Alan C. Kwan, Priscilla A. McElhinney, Balaji K. Tamarappoo, Cecilia Hurtado, Robert J.H. Miller, Donghee Han, Yuka Otaki, Evann Eisenberg, Joseph E. Ebinger, and Victor Y. Cheng declare no relationships with any companies, whose products or services may be related to the subject matter of the article.
Statistics and biometry
No complex statistical methods were necessary for this paper.
Informed consent
Written informed consent was obtained from all subjects (patients) in this study.
Ethical approval
Institutional Review Board approval was obtained.
Methodology
• Post hoc analysis of a multicenter registry
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Kwan, A.C., McElhinney, P.A., Tamarappoo, B.K. et al. Prediction of revascularization by coronary CT angiography using a machine learning ischemia risk score. Eur Radiol 31, 1227–1235 (2021). https://doi.org/10.1007/s00330-020-07142-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00330-020-07142-8