Investigating the impact of data normalization on classification performance

By Dalwinder Singh, Birmohan Singh. Applied Soft Computing, 2020

1,571 citations recorded by the source corpus.

Abstract Data normalization is one of the pre-processing approaches where the data is either scaled or transformed to make an equal contribution of each feature. The success of machine learning algorithms depends upon the quality of the data to obtain a generalized predictive model of the classification problem. The importance of data normalization for improving data quality and subsequently the performance of machine learning algorithms has been presented in many studies. But, the work lacks for the feature selection and feature weighting approaches, a current research trend in machine learning for improving performance. Therefore, this study aims to investigate the impact of fourteen data normalization methods on classification performance considering full feature set, feature selection, and feature weighting. In this paper, we also present a modified Ant Lion optimization that search feature subsets and the best feature weights along with the parameter of Nearest Neighbor Classifier. Experiments are performed on 21 publicly available real and synthetic datasets, and results are analyzed based on the accuracy, the percentage of feature reduced and runtime. It has been observed from the results that no single method outperforms others. Therefore, we have suggested a set of the best and the worst methods combining the normalization procedure and empirical analysis of results. The better performers are z -Score and Pareto Scaling for the full feature set and feature selection, and tanh and its variant for feature weighting. The worst performers are Mean Centered, Variable Stability Scaling and Median and Median Absolute Deviation methods along with un-normalized data.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Statistics and Probability

View Paper: https://www.semanticscholar.org/paper/6ebae63a531cec4cea7c2cbb05395858ebff1ea3

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

In Computer Vision and Pattern Recognition

In Statistics and Probability

Citations in the corpus

The choice of scaling technique matters for classification performance (2022, methodology): “[1] 2020 14 techniques: Z-score, Min-max (2 variants), Mean centering, Pareto scaling, Variable stability scaling, Power Transform, Max abs scaler, Decimal scaling, Median and Median Abs Deviation Normalization, Tanh normalization (2 variants), Logistic sigmoid, Hiperb.”
Metric3D v2: A Versatile Monocular Geometric Foundation Model for Zero-Shot Metric Depth and Surface Normal Estimation (2024, positive): “Then we employ the median absolute deviation normalization [91] for paired patches.”
Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Image (2023, methodology): “Then we employ the median absolute deviation normalization [48] for paired patches.”