Explanation of Machine Learning Models Using Shapley Additive Explanation and Application for Real Data in Hospital

By Yasunobu Nohara, Koutarou Matsumoto, Hidehisa Soejima, N. Nakashima. Comput. Methods Programs Biomed., 2021

875 citations recorded by the source corpus.

BACKGROUND AND OBJECTIVE When using machine learning techniques in decision-making processes, the interpretability of the models is important. In the present paper, we adopted the Shapley additive explanation (SHAP), which is based on fair profit allocation among many stakeholders depending on their contribution, for interpreting a gradient-boosting decision tree model using hospital data. METHODS For better interpretability, we propose two novel techniques as follows: (1) a new metric of feature importance using SHAP and (2) a technique termed feature packing, which packs multiple similar features into one grouped feature to allow an easier understanding of the model without reconstruction of the model. We then compared the explanation results between the SHAP framework and existing methods using cerebral infarction data from our hospital. RESULTS The interpretation by SHAP was mostly consistent with that by the existing methods. We showed how the A/G ratio works as an important prognostic factor for cerebral infarction using proposed techniques. CONCLUSION Our techniques are useful for interpreting machine learning models and can uncover the underlying relationships between features and outcome.

Subfields: Artificial Intelligence

View Paper: https://www.semanticscholar.org/paper/a11cdeaf08ffae53c6cf4c79c367709f71699660

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohamad Forouzanfar
  2. Shiva Maleki Varnosfaderani

Citations in the corpus