The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation

By Davide Chicco, Giuseppe Jurman. BMC Genomics, 2020

5,423 citations recorded by the source corpus.

To evaluate binary classifications and their confusion matrices, scientific researchers can employ several statistical rates, accordingly to the goal of the experiment they are investigating. Despite being a crucial issue in machine learning, no widespread consensus has been reached on a unified elective chosen measure yet. Accuracy and F1 score computed on confusion matrices have been (and still are) among the most popular adopted metrics in binary classification tasks. However, these statistical measures can dangerously show overoptimistic inflated results, especially on imbalanced datasets. The Matthews correlation coefficient (MCC), instead, is a more reliable statistical rate which produces a high score only if the prediction obtained good results in all of the four confusion matrix categories (true positives, false negatives, true negatives, and false positives), proportionally both to the size of positive elements and the size of negative elements in the dataset. In this article, we show how MCC produces a more informative and truthful score in evaluating binary classifications than accuracy and F1 score, by first explaining the mathematical properties, and then the asset of MCC in six synthetic use cases and in a real genomics scenario. We believe that the Matthews correlation coefficient should be preferred to accuracy and F1 score in evaluating binary classification tasks by all scientific communities.

Subfields: Artificial Intelligence, Information Systems

View Paper: https://www.semanticscholar.org/paper/44858b662822d291a5e1e9e3501ad19a9f1572c2

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Oguzhan Gencoglu
  2. Davide Chicco
  3. Giuseppe Jurman
  4. Matthijs J. Warrens
  5. Wing Yiu Choy
  6. Margherita Grandini
  7. Giorgio Visani
  8. Enrico Bagli

In Information Systems

  1. Oguzhan Gencoglu
  2. Giuseppe Jurman
  3. Davide Chicco
  4. Matthijs J. Warrens
  5. Wing Yiu Choy
  6. Margherita Grandini
  7. Giorgio Visani
  8. Enrico Bagli

Citations in the corpus