Rxivist logo

Trends in the conduct and reporting of clinical prediction model development and validation: a systematic review

By Cynthia Yang, Jan A. Kors, Solomon Ioannou, Luis H. John, Aniek F. Markus, Alexandros Rekkas, Maria A.J. de Ridder, Tom M Seinen, Ross D. Williams, Peter R. Rijnbeek

Posted 25 Oct 2021
medRxiv DOI: 10.1101/2021.10.22.21265374

Objectives This systematic review aims to provide further insights into the conduct and reporting of clinical prediction model development and validation over time. We focus on assessing the reporting of information necessary to enable external validation by other investigators. Materials and Methods We searched Embase, Medline, Web-of-Science, Cochrane Library and Google Scholar to identify studies that developed one or more multivariable prognostic prediction models using electronic health record (EHR) data published in the period 2009-2019. Results We identified 422 studies that developed a total of 579 clinical prediction models using EHR data. We observed a steep increase over the years in the number of developed models. The percentage of models externally validated in the same paper remained at around 10%. Throughout 2009-2019, for both the target population and the outcome definitions, code lists were provided for less than 20% of the models. For about half of the models that were developed using regression analysis, the final model was not completely presented. Discussion Overall, we observed limited improvement over time in the conduct and reporting of clinical prediction model development and validation. In particular, the prediction problem definition was often not clearly reported, and the final model was often not completely presented. Conclusion Improvement in the reporting of information necessary to enable external validation by other investigators is still urgently needed to increase clinical adoption of developed models.

Download data

  • Downloaded 156 times
  • Download rankings, all-time:
    • Site-wide: 191,388
    • In health informatics: 893
  • Year to date:
    • Site-wide: 155,970
  • Since beginning of last month:
    • Site-wide: 198,277

Altmetric data


Downloads over time

Distribution of downloads per paper, site-wide


PanLingua

News