Metalearners for estimating heterogeneous treatment effects using machine learning
By Sören R. Künzel, Jasjeet S. Sekhon, Peter J. Bickel, Bin Yu. 2017
1,291 citations recorded by the source corpus.
Significance Estimating and analyzing heterogeneous treatment effects is timely, yet challenging. We introduce a unifying framework for many conditional average treatment effect estimators, and we propose a metalearner, the X-learner, which can adapt to structural properties, such as the smoothness and sparsity of the underlying treatment effect. We present its favorable properties, using theory and simulations. We apply it, using random forests, to two field experiments in political science, where it is shown to be easy to use and to produce results that are interpretable. There is growing interest in estimating and analyzing heterogeneous treatment effects in experimental and observational studies. We describe a number of metaalgorithms that can take advantage of any supervised learning or regression method in machine learning and statistics to estimate the conditional average treatment effect (CATE) function. Metaalgorithms build on base algorithms—such as random forests (RFs), Bayesian additive regression trees (BARTs), or neural networks—to estimate the CATE, a function that the base algorithms are not designed to estimate directly. We introduce a metaalgorithm, the X-learner, that is provably efficient when the number of units in one treatment group is much larger than in the other and can exploit structural properties of the CATE function. For example, if the CATE function is linear and the response functions in treatment and control are Lipschitz-continuous, the X-learner can still achieve the parametric rate under regularity conditions. We then introduce versions of the X-learner that use RF and BART as base learners. In extensive simulation studies, the X-learner performs favorably, although none of the metalearners is uniformly the best. In two persuasion field experiments from political science, we demonstrate how our X-learner can be used to target treatment regimes and to shed light on underlying mechanisms. A software package is provided that implements our methods.
Subfields: Political Science and International Relations, Statistics and Probability, Causal Inference & Discovery
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Political Science and International Relations
In Statistics and Probability
- Stefan Wager
- Susan Athey
- E.J. Candes
- Lihua Lei
- Xinkun Nie
- Edward H. Kennedy
- Julie Tibshirani
- Rina Friedberg
In Causal Inference & Discovery
- Stefan Wager
- Susan Athey
- Edward H. Kennedy
- E.J. Candes
- Julie Tibshirani
- Lihua Lei
- Xinkun Nie
- Sheng Li
Citations in the corpus
- Local Linear Forests (2018, methodology): “Evaluating errors empirically, however, is difficult, so we supplement that with a simulation also used by Wager and Athey (2018) in evaluating causal forests and Künzel et al. (2019), used to evaluate their meta-learner called the X-learner.”
- Quasi-oracle estimation of heterogeneous treatment effects (2017, methodology): “We follow the nomenclature of Künzel et al. (2019) and consider the following methods for heterogeneous treatment effect estimation as baselines.”
- Conformal inference of counterfactuals and individual treatment effects (2020, methodology): “• X-learner [Künzel et al., 2019] uses the bootstrap to estimate the variance of CATE estimators.”
- Causal machine learning for predicting treatment outcomes (2024, neutral): “23,27,49,53,54,61,98,99).”
- A Practical Guide to Counterfactual Estimators for Causal Inference with Time-Series Cross-Sectional Data (2020, methodology): “This perspective has motivated a series of studies that try to predict the counterfactual in cross-sectional studies using various methods, such as regression (Lin 2013), the OaxacaBlinder estimator (Kline 2011), and machine learning algorithms (Künzel et al. 2019). The synthetic control method (SCM”
- Towards optimal doubly robust estimation of heterogeneous causal effects (2020, background): “…on nonpara-metrics and incorporating machine learning [Athey and Imbens, 2016, Foster and Syrgkanis, 2019, Foster et al., 2011, Hahn et al., 2020, Imai and Ratkovic, 2013, Künzel et al., 2019, Nie and Wager, 2021, Semenova and Chernozhukov, 2017, Shalit et al., 2017, Wager and Athey, 2018].”
- Bayesian Regression Tree Models for Causal Inference: Regularization, Confounding, and Heterogeneous Effects (with Discussion) (2020, neutral): “(See Künzel et al. (2019) for a related discussion comparing these two approaches in a non-model-based setting.)”
- A Survey on Causal Inference (2020, methodology): “are extremely unbalanced (i.e., the number of one group is much larger than the other), the performance of the base model trained on the small group would be poor. To overcome this problem, X-learner [70] is proposed, which adopts information from the control group to give a better estimator on the ”