Accepted for Publication: December 1, 2022.
Published Online: February 1, 2023. doi:10.1001/jamacardio.2022.5279
Corresponding Author: Lee-Jen Wei, PhD, Department of Biostatistics, Harvard T.H. Chan School of Public Health, Harvard University, 655 Huntington Ave, Boston, MA 02115 (firstname.lastname@example.org).
Author Contributions: Drs Wang and Claggett had full access to the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Drs Wang and Claggett contributed equally as co–first authors.
Concept and design: Wang, Claggett, Tian, Pfeffer, Wei.
Acquisition, analysis, or interpretation of data: Wang, Claggett, Malachias, Wei.
Drafting of the manuscript: Wang, Claggett, Tian, Wei.
Critical revision of the manuscript for important intellectual content: Wang, Claggett, Malachias, Pfeffer, Wei.
Statistical analysis: Wang, Claggett, Tian, Malachias, Wei.
Administrative, technical, or material support: Wang, Wei.
Conflict of Interest Disclosures: Dr Claggett reported receiving consulting fees from Cardurion, Corvia, and Novartis outside the submitted work. Dr Malachias reported receiving lecture fees from Bayer, Boehringer Ingelheim, Novo Nordisk, Daiichi-Sankyo, Novartis, and Libbs outside the submitted work. Dr Pfeffer reported receiving grants from Novartis; personal fees from Alnylam, AstraZeneca, Boehringer Ingelheim, Eli Lilly Alliance, Corvidia, DalCor, GlaxoSmithKline, Lexicon, the National Heart, Lung, and Blood Institute’s Collaborating Network of Networks for Evaluating COVID-19 and Therapeutic Strategies (CONNECTS), Novartis, Novo Nordisk, Peerbridge, and Sanofi; and stock options from DalCor outside the submitted work. Dr Wei did not receive consulting fees for this research project. No other disclosures were reported.
Funding/Support: This research was partially supported by grant R01HL089778 from the US National Institutes of Health (Dr Tian).
Role of the Funder/Sponsor: The funder had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Additional Contributions: We thank Robert O. Bonow, MD, Editor, JAMA Cardiology, and Michael J. Pencina, PhD, Deputy Editor for Statistics, JAMA Cardiology, and reviewers for their insightful, extensive comments/suggestions on the manuscript. No one was financially compensated for their contribution.
N , Cozzi
B , Gao
et al. Prospective and external evaluation of a machine learning model to predict in-hospital mortality of adults at time of admission. JAMA Netw Open
. 2020;3(2):e1920733.PubMedGoogle Scholar
MVB , Jhund
PS , Claggett
et al. NT-proBNP by itself predicts death and cardiovascular events in high-risk patients with type 2 diabetes mellitus. J Am Heart Assoc
. 2020;9(19):e017462.PubMedGoogle Scholar
B , Sørensen
AL , Scheike
T , Torp-Pedersen
C , Gerds
TA . riskRegression: predicting the risk of an event using Cox regression models. R J
. 2017;9(2):440-460.Google ScholarCrossref
H , Tian
L , Cai
T , Kohane
IS , Wei
LJ . A unified inference procedure for a class of measures to assess improvement in risk prediction systems with survival data. Stat Med
. 2013;32(14):2430-2442.PubMedGoogle ScholarCrossref
GS , de Groot
JA , Dutton
et al. External validation of multivariable prediction models: a systematic review of methodological conduct and reporting. BMC Med Res Methodol
. 2014;14:40.PubMedGoogle ScholarCrossref
MJ , D’Agostino
RB . Overall C as a measure of discrimination in survival analysis: model specific population value and confidence interval estimation. Stat Med
. 2004;23(13):2109-2123. doi:10.1002/sim.1802PubMedGoogle Scholar
H , Cai
T , Pencina
MJ , D’Agostino
RB , Wei
LJ . On the C statistics for evaluating overall adequacy of risk prediction procedures with censored survival data. Stat Med
. 2011;30(10):1105-1117. doi:10.1002/sim.4154PubMedGoogle Scholar
L , Cai
T , Goetghebeur
E , Wei
LJ . Model evaluation based on the sampling distribution of estimated absolute prediction error. Biometrika
. 2007;94(2):297-311. doi:10.1093/biomet/asm036Google Scholar
FH , Tian
L , Yu
S , Cai
T , Wei
LJ . Optimal stratification in outcome prediction using baseline information. Biometrika
. 2016;103(4):817-828.PubMedGoogle Scholar
RB , Nam
BH . Evaluation of the performance of survival analysis models: discrimination and calibration measures. In: Balakrishnan
N , Rao
CR , eds. Advances in Survival Analysis. Elsevier; 2003:1-25.
K , Uno
H , Kim
et al. Interpretability of cancer clinical trial results using restricted mean survival time as an alternative to the hazard ratio. JAMA Oncol
. 2017;3(12):1692-1696. doi:10.1001/jamaoncol.2017.2797PubMedGoogle Scholar
A , Heagerty
PJ . A tutorial on evaluating the time-varying discrimination accuracy of survival models used in dynamic decision-making. Med Decis Making
. 2018;38(8):904-916. doi:10.1177/0272989X18801312PubMedGoogle Scholar