Measurement error in Lasso: impact and likelihood bias correction
By Oystein Sorensen, Arnoldo Frigessi, Magne Thoresen. 2012
65 citations recorded by the source corpus.
Regression with the lasso penalty is a popular tool for performing dimension reduction when the number of covariates is large. In many applications of the lasso, like in genomics, covariates are subject to measurement error. We study the impact of measurement error on linear regression with the lasso penalty, both analytically and in simulation experiments. A simple method of correction for measurement error in the lasso is then considered. In the large sample limit, the corrected lasso yields sign consistent covariate selection under conditions very similar to the lasso with perfect measurements, whereas the uncorrected lasso requires much more stringent conditions on the covariance structure of the data. Finally, we suggest methods to correct for measurement error in generalized linear models with the lasso penalty, which we study empirically in simulation experiments with logistic regression, and also apply to a classification problem with microarray data. We see that the corrected lasso selects less false positives than the standard lasso, at a similar level of true positives. The corrected lasso can therefore be used to obtain more conservative covariate selection in genomic analysis.
Subfields: Economics and Econometrics, Statistics and Probability
View Paper: https://www.semanticscholar.org/paper/39230dbf48b10948bedb49069ec188f928df3e4d
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Economics and Econometrics
- Alexandre B. Tsybakov
- Alexandre Belloni
- Mathieu Rosenbaum
- Omar El Euch
- Eduardo Abi Jaber
- Victor Chernozhukov
- Stefan Wager
- Jim Gatheral
In Statistics and Probability
- Alexandre Belloni
- Victor Chernozhukov
- Mathieu Rosenbaum
- Alexandre B. Tsybakov
- Kengo Kato
- Christian Hansen
- D. Chetverikov
- Martin J. Wainwright
Citations in the corpus
- Linear and conic programming estimators in high dimensional errors‐in‐variables models (2014, background): “θˆ′ satisfies |θˆ′ −θ∗| 2 ≤ C(θ∗)s1/2 r logp n (|θ∗|2 +1), (6) with probability close to 1, where C(θ∗) > 0 depends on θ∗ in a non-specified way. Related covariates selection results are reported in [16]. In [4, 5], the authors propose yet another method of estimation of θ∗, based on orthogonal mat”