Performance of models rebuilt without deviations
Study | Validation performance—reported from study | Validation performance—NYU retrained (95% CI) | Performance difference between study validation performance and NYU retrained validation performance |
Levy et al10 | * | AUROC=0.80 (0.75 to 0.84) | * |
Carr et al11 | AUROC=0.73 | AUROC=0.74 (0.71 to 0.78) | AUROC difference=0.01 |
Mean AUROC=0.73 | Mean AUROC=0.77 | Mean AUROC difference=0.01 |
*Value unavailable because authors did not provide an AUROC value when reporting validation performance.
AUROC, area under the receiver–operator curve; NYU, New York University.