Development and Evaluation of the Universal ACS NSQIP Surgical Risk Calculator: A Decision Aide and Informed Consent Tool for Patients and Surgeons

By K. Bilimoria, Yaoming Liu, J. Paruch, Lynn Zhou, T. Kmiecik, C. Ko, Mark E. Cohen. Journal of the American College of Surgeons, 2013

1,779 citations recorded by the source corpus.

BACKGROUND Accurately estimating surgical risks is critical for shared decision making and informed consent. The Centers for Medicare and Medicaid Services may soon put forth a measure requiring surgeons to provide patients with patient-specific, empirically-derived estimates of postoperative complications. Our objectives were (1) to develop a universal surgical risk estimation tool, (2) to compare performance of the universal vs. prior procedure-specific Surgical Risk Calculators, and (3) to allow surgeons to empirically adjust the estimates of risk. STUDY DESIGN Using standardized clinical data from 393 ACS NSQIP hospitals, a web-based tool was developed to allow surgeons to easily enter 21 preoperative factors (demographics, comorbidities, procedure). Regression models were developed to predict 8 outcomes based on the preoperative risk factors. The universal model was compared to procedure-specific models. To incorporate surgeon input, a subjective Surgeon Adjustment Score, allowing risk estimates to vary within the estimate's confidence interval, was introduced and tested with 80 surgeons using 10 case scenarios. RESULTS Based on 1,414,006 patients encompassing 1,557 unique CPT codes, a universal Surgical Risk Calculator model was developed which had excellent performance for mortality (c-statistic=0.944; Brier=0.011[ where scores approaching zero are better]), morbidity (c-statistic=0.816, Brier=0.069), and 6 additional complications (c-statistics>0.8). Predictions were similarly robust for the universal calculator vs. procedure-specific calculators (e.g., colorectal). Surgeons demonstrated considerable agreement on the case scenario scoring (80-100% agreement), suggesting reliable score assignment between surgeons. CONCLUSIONS The ACS NSQIP Surgical Risk Calculator is a decision-support tool based on reliable multi-institutional clinical data which can be used to estimate the risks of most operations. The ACS NSQIP Surgical Risk Calculator will allow clinicians and patients to make decisions using empirically derived, patient-specific postoperative risks.

Subfields: Cardiology and Cardiovascular Medicine, Emergency Medical Services, Pulmonary and Respiratory Medicine

View Paper: https://www.semanticscholar.org/paper/270bbd30b74597c9645524fef6913469e0f3d880

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cardiology and Cardiovascular Medicine

  1. Joshua A. Beckman
  2. L. Fleisher
  3. Judith Hochman
  4. Annemarie Thompson

In Pulmonary and Respiratory Medicine

  1. Joshua A. Beckman

Citations in the corpus