The power-integrated discriminant improvement: An accurate measure of the incremental predictive value of additional biomarkers

Kenichi Hayashi, Shinto Eguchi

Research output: Contribution to journalArticle

Abstract

The predictive performance of biomarkers is a central concern in biomedical research. This is often evaluated by comparing two statistical models: a “new” model incorporating additional biomarkers and an “old” model without them. In 2008, the integrated discrimination improvement (IDI) was proposed for cases when the response variable is binary, and it is now widely applied as a promising alternative to conventional measures, such as the difference of the area under the receiver operating characteristic curve. However, the IDI can erroneously identify a significant improvement in the new model even if no additional information has been provided by new biomarkers. In order to overcome problems with existing measures, in this study, we propose the power-IDI as a measure of incremental predictive value. Our study explains why the IDI cannot avoid false detection of apparent improvements in a new model and we show that our proposed measure is better able to capture improvements in prediction. Numerical simulations and examples using real empirical data reveal that the power-IDI is not only more powerful but also incurs fewer false detections of improvement.

Original languageEnglish
Pages (from-to)2589-2604
Number of pages16
JournalStatistics in Medicine
Volume38
Issue number14
DOIs
Publication statusPublished - 2019 Jun 30

Keywords

  • Bayes-risk consistency
  • area under the ROC curve
  • fisher consistency
  • integrated discrimination improvement
  • logistic regression
  • net reclassification index

ASJC Scopus subject areas

  • Epidemiology
  • Statistics and Probability

Fingerprint Dive into the research topics of 'The power-integrated discriminant improvement: An accurate measure of the incremental predictive value of additional biomarkers'. Together they form a unique fingerprint.

  • Cite this