Journal article
Can the American College of Surgeons NSQIP surgical risk calculator identify patients at risk of complications following microsurgical breast reconstruction?
- O'Neill AC Division of Plastic Surgery, University Health Network, University of Toronto, Toronto, Canada. Electronic address: Anne.O'Neill@uhn.ca.
- Bagher S Division of Plastic Surgery, University Health Network, University of Toronto, Toronto, Canada.
- Barandun M Division of Plastic Surgery, University Health Network, University of Toronto, Toronto, Canada; Department of Plastic Surgery, University Hospital of Basel, Basel, Switzerland.
- Hofer SO Division of Plastic Surgery, University Health Network, University of Toronto, Toronto, Canada.
- Zhong T Division of Plastic Surgery, University Health Network, University of Toronto, Toronto, Canada.
- 2016-06-22
Published in:
- Journal of plastic, reconstructive & aesthetic surgery : JPRAS. - 2016
ACS-NSQIP surgical risk calculator
Breast reconstruction
Microsurgery
Area Under Curve
Breast
Female
Humans
Mammaplasty
Microsurgery
Microvessels
Middle Aged
Postoperative Complications
Prognosis
Reproducibility of Results
Research Design
Retrospective Studies
Risk Assessment
Risk Factors
Switzerland
English
INTRODUCTION
The American College of Surgeons National Surgery Quality Improvement Program (ACS NSQIP) Surgical Risk Calculator is an open access online tool that estimates the risk of adverse post-operative events for a wide range of surgical procedures. This study evaluates the predictive value of the ACS NSQIP calculator in patients undergoing microvascular breast reconstruction.
STUDY DESIGN
Details of 759 microvascular breast reconstructions in 515 patients were entered into the online calculator. The predicted rates of post-operative complications were recorded and compared to observed complications identified on chart review. The calculator was validated using three statistical measures described in the original development of the ACS NSQIP model.
RESULTS
The calculator predicted that complications would occur in 11.1% of breast reconstructions while the observed rate was 10.5%. Hosmer-Lemeshow test did not find any statistical difference between these rates (p = 0.69) indicating that the calculator accurately measured what is was intended to measure. The area under the receiver operating curve or c-statistic (measure of discrimination) was found to be low at 0.548, indicating the model has random performance in this patient population. The Brier score was higher than that reported in the original ACS calculator development (0.094 vs 0.069) demonstrating poor correlation between predicted probability and actual probability.
CONCLUSIONS
This study demonstrates that while the ACS NSQIP Universal risk calculator can predict the proportion of patients that will develop complications it cannot effectively discriminate between patients who are at risk of complications and those who are not.
The American College of Surgeons National Surgery Quality Improvement Program (ACS NSQIP) Surgical Risk Calculator is an open access online tool that estimates the risk of adverse post-operative events for a wide range of surgical procedures. This study evaluates the predictive value of the ACS NSQIP calculator in patients undergoing microvascular breast reconstruction.
STUDY DESIGN
Details of 759 microvascular breast reconstructions in 515 patients were entered into the online calculator. The predicted rates of post-operative complications were recorded and compared to observed complications identified on chart review. The calculator was validated using three statistical measures described in the original development of the ACS NSQIP model.
RESULTS
The calculator predicted that complications would occur in 11.1% of breast reconstructions while the observed rate was 10.5%. Hosmer-Lemeshow test did not find any statistical difference between these rates (p = 0.69) indicating that the calculator accurately measured what is was intended to measure. The area under the receiver operating curve or c-statistic (measure of discrimination) was found to be low at 0.548, indicating the model has random performance in this patient population. The Brier score was higher than that reported in the original ACS calculator development (0.094 vs 0.069) demonstrating poor correlation between predicted probability and actual probability.
CONCLUSIONS
This study demonstrates that while the ACS NSQIP Universal risk calculator can predict the proportion of patients that will develop complications it cannot effectively discriminate between patients who are at risk of complications and those who are not.
- Language
-
- English
- Open access status
- closed
- Identifiers
-
- DOI 10.1016/j.bjps.2016.05.021
- PMID 27325513
- Persistent URL
- https://folia.unifr.ch/global/documents/17599
Statistics
Document views: 18
File downloads: