Subgroup identification from randomized clinical trial data
By Jared C. Foster, J. M. Taylor, S. Ruberg. 2011
628 citations recorded by the source corpus.
We consider the problem of identifying a subgroup of patients who may have an enhanced treatment effect in a randomized clinical trial, and it is desirable that the subgroup be defined by a limited number of covariates. For this problem, the development of a standard, pre‐determined strategy may help to avoid the well‐known dangers of subgroup analysis. We present a method developed to find subgroups of enhanced treatment effect. This method, referred to as ‘Virtual Twins’, involves predicting response probabilities for treatment and control ‘twins’ for each subject. The difference in these probabilities is then used as the outcome in a classification or regression tree, which can potentially include any set of the covariates. We define a measure Q(Â) to be the difference between the treatment effect in estimated subgroup  and the marginal treatment effect. We present several methods developed to obtain an estimate of Q(Â) , including estimation of Q(Â) using estimated probabilities in the original data, using estimated probabilities in newly simulated data, two cross‐validation‐based approaches, and a bootstrap‐based bias‐corrected approach. Results of a simulation study indicate that the Virtual Twins method noticeably outperforms logistic regression with forward selection when a true subgroup of enhanced treatment effect exists. Generally, large sample sizes or strong enhanced treatment effects are needed for subgroup estimation. As an illustration, we apply the proposed methods to data from a randomized clinical trial. Copyright © 2011 John Wiley & Sons, Ltd.
Subfields: Statistics and Probability, Causal Inference & Discovery, Medical & Health AI
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Statistics and Probability
- Mihaela van der Schaar
- Ahmed M. Alaa
- Susan Athey
- Cynthia Rudin
- Ioana Bica
- Guido W. Imbens
- Edward H. Kennedy
- Stefan Wager
In Causal Inference & Discovery
- Mihaela van der Schaar
- Ahmed M. Alaa
- Susan Athey
- Cynthia Rudin
- Guido W. Imbens
- Alex Peysakhovich
- Akos Lada
- Fulton Wang
In Medical & Health AI
- Ahmed M. Alaa
- Mihaela van der Schaar
- Susan Athey
- Guido W. Imbens
- Suchi Saria
- Edward H. Kennedy
- Xuming He
- Juan Shen
Citations in the corpus
- The State of Applied Econometrics - Causality and Policy Evaluation (2016, neutral): “Subgroup analysis has long been used in medical studies ([Foster et al., 2011]), but it is often subject to criticism due to concerns of multiple testing ([Assmann et al., 2000]).”
- Recursive partitioning for heterogeneous causal effects (2015, positive): “(24) estimate μðw, xÞ=E1⁄2YiðwÞjXi = x for w= 0,1 using random forests, then calculate τ̂i = μ̂ð1,XiÞ− μ̂ð0,XiÞ.”
- Causal Falling Rule Lists (2015, background): “…of differential treatment effect has been of recent interest in social science, medical, and marketing domains (Brodersen et al. 2015; Sun et al. 2014; Cai et al. 2011; Foster, Taylor, and Ruberg 2011; Taddy et al. 2014), precisely so that the relevant subgroups can be given priority treatment.”
- Subgroup Identification and Variable Selection from Randomized Clinical Trial Data. (2013, methodology): “12 proach of Friedman and Tibshirani [1984], and the kernel-based approach of Mukerjee [1988] and Mammen [1991].”
- Estimating Individual Treatment Effect in Observational Data Using Random Forest Methods (2017, methodology): “Virtual twins is the original method proposed by Foster, Taylor, and Ruberg (2011) mentioned earlier.”
- Combining observational and experimental data to find heterogeneous treatment effects (2016, background): “Keywords Heterogeneous treatment effects; Personalization”
- Learning Cost-Effective and Interpretable Treatment Regimes (2017, neutral): “This problem has been well studied [30, 8, 19, 3, 9, 34].”
- Towards optimal doubly robust estimation of heterogeneous causal effects (2020, background): “…5–10 years has seen even more emphasis on nonpara-metrics and incorporating machine learning [Athey and Imbens, 2016, Foster and Syrgkanis, 2019, Foster et al., 2011, Hahn et al., 2020, Imai and Ratkovic, 2013, Künzel et al., 2019, Nie and Wager, 2021, Semenova and Chernozhukov, 2017, Shalit et…”
- Bayesian Inference of Individualized Treatment Effects using Multi-task Gaussian Processes (2017, background): “Moreover, due to the difficulty of patient recruitment, randomized controlled trials often exhibit small sample sizes, which hinders the discovery of heterogeneous therapeutic effects across different patient subgroups [2].”
- Limits of Estimating Heterogeneous Treatment Effects: Guidelines for Practical Algorithm Design (2018, background): “However, if D n is small, which is typical in post-hoc analyses of clinical trials (Foster et al., 2011), then one should make the design choices that would optimize the small-sample performance.”
- A Nonparametric Bayesian Analysis of Heterogenous Treatment Effects in Digital Experimentation (2014, methodology): “Recently published applications of regression trees in HTE prediction include Foster, Taylor, and Ruberg (2011) for medical clinical trials and Dud´ık, Langford, and Li (2011) for user browsing behavior, and we have observed that CART is commonly employed in industry for the segmentation of…”
- Inference for Subgroup Analysis With a Structured Logistic-Normal Mixture Model (2015, methodology): “Foster, Taylor, and Ruberg (2011) proposed the “virtual twins” method to identify a subgroup from randomized clinical trial data where the response is binary.”