Endogenous post-stratification in surveys: Classifying with a sample-fitted model

By F. J. Breidt, Jean D. Opsomer. 2008

69 citations recorded by the source corpus.

Post-stratification is frequently used to improve the precision of survey estimators when categorical auxiliary information is available from sources outside the survey. In natural resource surveys, such information is often obtained from remote sensing data, classified into categories and displayed as pixel-based maps. These maps may be constructed based on classification models fitted to the sample data. Post-stratification of the sample data based on categories derived from the sample data ("endogenous post-stratification") violates the standard post-stratification assumptions that observations are classified without error into post-strata, and post-stratum population counts are known. Properties of the endogenous post-stratification estimator are derived for the case of a sample-fitted generalized linear model, from which the post-strata are constructed by dividing the range of the model predictions into predetermined intervals. Design consistency of the endogenous post-stratification estimator is established under mild conditions. Under a super-population model, consistency and asymptotic normality of the endogenous post-stratification estimator are established, showing that it has the same asymptotic variance as the traditional post-stratified estimator with fixed strata. Simulation experiments demonstrate that the practical effect of first fitting a model to the survey data before post-stratifying is small, even for relatively small sample sizes.

Subfields: Artificial Intelligence, Environmental Engineering, Statistics and Probability

View Paper: https://www.semanticscholar.org/paper/43c33be286c101f6861d1f0b569ff9c38559dd45

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

In Environmental Engineering

In Statistics and Probability

Citations in the corpus

Horvitz--Thompson estimators for functional data: asymptotic confidence bands and optimal allocation for stratified sampling (2009, methodology): “Borrowing ideas from Breidt & Opsomer (2008), one possible strategy is to perform clustering on the observed sample and then try to predict to which stratum the units that are not in the sample belong using auxiliary information and supervised classification.”
Inference for lidar-assisted estimation of forest growing stock volume (2013, methodology): “Breidt and Opsomer (2008) coined the term endogenous post-stratification to describe this approach and demonstrated that when strata are constructed by dividing the range of predictions obtained from a linearmodel calibrated using the response variable observations, the detrimental effects of…”