Multicollinearity and Model Misspecification

By Christopher Winship, Bruce Western. 2016

75 citations recorded by the source corpus.

Multicollinearity in linear regression is typically thought of as a problem of large standard errors due to near-linear dependencies among independent variables. This problem can be solved by more informative data, possibly in the form of a larger sample. We argue that this understanding of multicollinearity is only partly correct. The near collinearity of independent variables can also increase the sensitivity of regression estimates to small errors in the model misspecification. We examine the classical assumption that independent variables are uncorrelated with the errors. With collinearity, small deviations from this assumption can lead to large changes in estimates. We present a Bayesian estimator that specifies a prior distribution for the covariance between the independent variables and the error term. This estimator can be used to calculate confidence intervals that reflect sampling error and uncertainty about the model specification. A Monte Carlo experiment indicates that the Bayesian estimator has good frequentist properties in the presence of specification errors. We illustrate the new method by estimating a model of the black-white gap in earnings.

Subfields: Statistics and Probability

View Paper: https://www.semanticscholar.org/paper/b2e955a3a61840cf0a8350a3461676e9f749adcd

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Statistics and Probability

  1. Vladimir Mikulik
  2. Yee Whye Teh
  3. Yarin Gal
  4. John Salvatier

Citations in the corpus