Boosting methods for multi-class imbalanced data classification: an experimental review
By Jafar Tanha, Yousef Abdi, Negin Samadi, Nazila Razzaghi, Mohammad Asadpour. Journal of Big Data, 2020
422 citations recorded by the source corpus.
Since canonical machine learning algorithms assume that the dataset has equal number of samples in each class, binary classification became a very challenging task to discriminate the minority class samples efficiently in imbalanced datasets. For this reason, researchers have been paid attention and have proposed many methods to deal with this problem, which can be broadly categorized into data level and algorithm level. Besides, multi-class imbalanced learning is much harder than binary one and is still an open problem. Boosting algorithms are a class of ensemble learning methods in machine learning that improves the performance of separate base learners by combining them into a composite whole. This paper’s aim is to review the most significant published boosting techniques on multi-class imbalanced datasets. A thorough empirical comparison is conducted to analyze the performance of binary and multi-class boosting algorithms on various multi-class imbalanced datasets. In addition, based on the obtained results for performance evaluation metrics and a recently proposed criteria for comparing metrics, the selected metrics are compared to determine a suitable performance metric for multi-class imbalanced datasets. The experimental studies show that the CatBoost and LogitBoost algorithms are superior to other boosting algorithms on multi-class imbalanced conventional and big datasets, respectively. Furthermore, the MMCC is a better evaluation metric than the MAUC and G-mean in multi-class imbalanced data domains.
Subfields: Artificial Intelligence, Electrical and Electronic Engineering
View Paper: https://www.semanticscholar.org/paper/d5db5bea38363c0d5cdee5800d4ad8f8ace7e223
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
In Electrical and Electronic Engineering
Citations in the corpus
- A Survey of Ensemble Learning: Concepts, Algorithms, Applications, and Prospects (2022, methodology): “Therefore, in order to estimate the gradient of 559 each example at every boosting iteration, the CatBoost algo-560 rithm omits that example from being used to train the current 561 model [100].”
- A Survey of Machine Unlearning (2022, neutral): “However, partitioning data by class itself does not help the model’s training in the first place, as learning the differences between classes is the core of many learning algorithms [146].”