Predictive model assessment in PLS-SEM: guidelines for using PLSpredict
By Galit Shmueli, Marko Sarstedt, Joseph F. Hair, Jun-Hwa (Jacky) Cheah, Hiram Ting, Santha Vaithilingam, Christian M. Ringle. European Journal of Marketing, 2019
3,378 citations recorded by the source corpus.
Purpose Partial least squares (PLS) has been introduced as a “causal-predictive” approach to structural equation modeling (SEM), designed to overcome the apparent dichotomy between explanation and prediction. However, while researchers using PLS-SEM routinely stress the predictive nature of their analyses, model evaluation assessment relies exclusively on metrics designed to assess the path model’s explanatory power. Recent research has proposed PLSpredict, a holdout sample-based procedure that generates case-level predictions on an item or a construct level. This paper offers guidelines for applying PLSpredict and explains the key choices researchers need to make using the procedure. Design/methodology/approach The authors discuss the need for prediction-oriented model evaluations in PLS-SEM and conceptually explain and further advance the PLSpredict method. In addition, they illustrate the PLSpredict procedure’s use with a tourism marketing model and provide recommendations on how the results should be interpreted. While the focus of the paper is on the PLSpredict procedure, the overarching aim is to encourage the routine prediction-oriented assessment in PLS-SEM analyses. Findings The paper advances PLSpredict and offers guidance on how to use this prediction-oriented model evaluation approach. Researchers should routinely consider the assessment of the predictive power of their PLS path models. PLSpredict is a useful and straightforward approach to evaluate the out-of-sample predictive capabilities of PLS path models that researchers can apply in their studies. Research limitations/implications Future research should seek to extend PLSpredict’s capabilities, for example, by developing more benchmarks for comparing PLS-SEM results and empirically contrasting the earliest antecedent and the direct antecedent approaches to predictive power assessment. Practical implications This paper offers clear guidelines for using PLSpredict, which researchers and practitioners should routinely apply as part of their PLS-SEM analyses. Originality/value This research substantiates the use of PLSpredict. It provides marketing researchers and practitioners with the knowledge they need to properly assess, report and interpret PLS-SEM results. Thereby, this research contributes to safeguarding the rigor of marketing studies using PLS-SEM.
Subfields: Information Systems and Management, Organizational Behavior and Human Resource Management, Tourism, Leisure and Hospitality Management
View Paper: https://www.semanticscholar.org/paper/caa014b3260f97169c5e4f44c5d0c645a8c26f02
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Information Systems and Management
- Marko Sarstedt
- Joseph F. Hair
- Christian M. Ringle
- Jun-Hwa (Jacky) Cheah
- Hiram Ting
- Christian Nitzl
- O. Moisescu
- Lăcrămioara Radomir
In Organizational Behavior and Human Resource Management
- Marko Sarstedt
- Christian M. Ringle
- Joseph F. Hair
- Hiram Ting
- Jun-Hwa (Jacky) Cheah
- Christian Nitzl
- Matt C. Howard
- Jörg Henseler
In Tourism, Leisure and Hospitality Management
- Joseph F. Hair
- Marko Sarstedt
- Christian M. Ringle
- Jun-Hwa (Jacky) Cheah
- Hiram Ting
- Christian Nitzl
- Jörg Henseler
- Jan-Michael Becker
Citations in the corpus
- Examining the Predictors of Resilience and Work Engagement during the COVID-19 Pandemic (2021, methodology): “[88], we compared the root-mean-squared error values of the PLS model with the linear regression (LM) model benchmark.”
- Factors versus Composites: Guidelines for Choosing the Right Structural Equation Modeling Method (2019, background): “Finally, PLS-SEM and GSCA’s emphasis on prediction in estimating statistical models whose structures are designed to provide causal explanations (Shmueli et al., 2019) makes them fit perfectly in today’s research landscape.”
- When to use and how to report the results of PLS-SEM (2019, methodology): “When comparing the RMSE (or MAE) values with the LM values, the following guidelines apply (Shmueli et al., 2019): If the PLS-SEM analysis, compared to the naïve LM benchmark, yields higher prediction errors in terms of RMSE (or MAE) for all indicators, this indicates that the model lacks…”
- Beyond a tandem analysis of SEM and PROCESS: Use of PLS-SEM for mediation analyses! (2020, background): “Future research should further explore these procedures, particularly in the context of out-ofsample predictive power assessment (Shmueli et al., 2019).”
- Structural model robustness checks in PLS-SEM (2020, methodology): “Shmueli et al. (2018) use this model and a subset of the data to illustrate Shmueli et al.’s (2016) PLSpredict procedure.”
- Multigroup Analysis using SmartPLS: Step-by-Step Guidelines for Business Research (2020, neutral): “SmartPLS 3.3.2 was used to illustrate the MGA assessment (Ringle et al., 2015; Sarstedt and Cheah, 2019).”
- Assessing measurement model quality in PLS-SEM using confirmatory composite analysis (2020, methodology): “The following guidelines should be applied (Hair, Risher, et al., 2019; Shmueli et al., 2019):”