EXTERNAL VALIDATION OF THE IMPROVING PARTIAL RISK ADJUSTMENT IN SURGERY (PRAIS2) MODEL FOR 30-DAY MORTALITY AFTER PEDIATRIC CARDIAC SURGERY
ObjectiveRisk stratification in paediatric patients undergoing heart surgery remains a challenge. The improving partial risk adjustment in surgery (PRAIS2) is a risk model predicting 30-day mortality which has been recently developed and validated using a UK-based cohort from April 2009-March 2015. We aimed to perform an independent temporal external validation to explore its generalisability and clinical utility. MethodsPRAIS2 validation was carried out using a single centre (Bristol, UK) cohort from April 2004 to March 2009 and April 2015 to July 2019. For each subject PRAIS2 score was calculated according to the original formula. PRAIS2 performance was assessed in terms of discrimination by means of ROC curve analysis and calibration by using the calibration belt method. ResultsA total of 1330 (2004-2009) and 1187 (2015-2019) paediatric cardiac surgical procedures were included in the first and second independent validation, respectively (median age at the procedure 6.0 and 6.9 months). PRAIS2 score showed excellent discrimination for both independent validations (AUC 0.72 (95%CI: 0.65 to 0.80) and 0.87 (95%CI: 0.82 to 0.93), respectively). While PRAIS2 was only marginally calibrated in the first validation, with a tendency to underestimate risk P-value = 0.051), the second validation showed good calibration with 95% confidence belt containing the bisector for predicted mortality (P-value = 0.15); We also observed good performance in the subgroup of patients undergoing non-elective procedures (N = 482; AUC 0.78 (95%CI 0.68 to 0.87); Calibration belt containing the bisector (P-value=0.61). ConclusionsIn a single centre UK-based cohort, PRAIS2 showed excellent discrimination and calibration in predicting 30-day mortality in paediatric cardiac surgery including in those undergoing non-elective procedures. Our results support a wider adoption of PRAIS2 score in the clinical practice. Strengths and limitations of this studyO_LIA strength of the present study is that data were prospectively collected as part of the UK National Congenital Heart Disease Audit and as such they undergo continuous and inclusive systematic validation that includes the review of a sample of case notes by external auditors to ensure coding accuracy. C_LIO_LIWe used a recently proposed method (calibration belt) which does not require patients to be categorised according to risk percentile but rather provides a risk function across all risk value with relative uncertainty measure (95% CI) C_LIO_LIA key limitation of this study is that the sample size is relatively small and considerably smaller than the cohort used to develop PRAIS2 C_LI Key questionsO_LIWhat is already known about this subject? The improving partial risk adjustment in surgery (PRAIS2) is a risk model predicting 30-day mortality which has been recently developed and validated using a UK-wide cohort. C_LIO_LIWhat does this study add? The present study reported the first independent external validation of the PRAIS2 using a single centre cohort which confirmed excellent performance of the model and for the first time showed that it also accurately predicts mortality in patients undergoing non-elective procedures C_LIO_LIHow might this impact on clinical practice? Our results support a wider adoption of the PRAIS2 in the clinical practice. C_LI
- Downloaded 207 times
- Download rankings, all-time:
- Site-wide: 131,762
- In cardiovascular medicine: 348
- Year to date:
- Site-wide: 124,424
- Since beginning of last month:
- Site-wide: 83,071
Downloads over time
Distribution of downloads per paper, site-wide
- 27 Nov 2020: The website and API now include results pulled from medRxiv as well as bioRxiv.
- 18 Dec 2019: We're pleased to announce PanLingua, a new tool that enables you to search for machine-translated bioRxiv preprints using more than 100 different languages.
- 21 May 2019: PLOS Biology has published a community page about Rxivist.org and its design.
- 10 May 2019: The paper analyzing the Rxivist dataset has been published at eLife.
- 1 Mar 2019: We now have summary statistics about bioRxiv downloads and submissions.
- 8 Feb 2019: Data from Altmetric is now available on the Rxivist details page for every preprint. Look for the "donut" under the download metrics.
- 30 Jan 2019: preLights has featured the Rxivist preprint and written about our findings.
- 22 Jan 2019: Nature just published an article about Rxivist and our data.
- 13 Jan 2019: The Rxivist preprint is live!