Rarefaction and extrapolation with Hill numbers: a framework for sampling and estimation in species diversity studies
By A. Chao, Nicholas Gotelli, T. Hsieh, Elizabeth L. Sander, K. Ma, Robert K. Colwell, Aaron M. Ellison. 2014
3,858 citations recorded by the source corpus.
Quantifying and assessing changes in biological diversity are central aspects of many ecological studies, yet accurate methods of estimating biological diversity from sampling data have been elusive. Hill numbers, or the effective number of species, are increasingly used to characterize the taxonomic, phylogenetic, or functional diversity of an assemblage. However, empirical estimates of Hill numbers, including species richness, tend to be an increasing function of sampling effort and, thus, tend to increase with sample completeness. Integrated curves based on sampling theory that smoothly link rarefaction (interpolation) and prediction (extrapolation) standardize samples on the basis of sample size or sample completeness and facilitate the comparison of biodiversity data. Here we extended previous rarefaction and extrapolation models for species richness (Hill number q D, where q ¼ 0) to measures of taxon diversity incorporating relative abundance (i.e., for any Hill number q D, q . 0) and present a unified approach for both individual-based (abundance) data and sample- based (incidence) data. Using this unified sampling framework, we derive both theoretical formulas and analytic estimators for seamless rarefaction and extrapolation based on Hill numbers. Detailed examples are provided for the first three Hill numbers: q ¼ 0 (species richness), q ¼ 1 (the exponential of Shannon's entropy index), and q ¼ 2 (the inverse of Simpson's concentration index). We developed a bootstrap method for constructing confidence intervals around Hill numbers, facilitating the comparison of multiple assemblages of both rarefied and extrapolated samples. The proposed estimators are accurate for both rarefaction and short-range extrapolation. For long-range extrapolation, the performance of the estimators depends on both the value of q and on the extrapolation range. We tested our methods on simulated data generated from species abundance models and on data from large species inventories. We also illustrate the formulas and estimators using empirical data sets from biodiversity surveys of temperate forest spiders and tropical ants.
Subfields: Ecological Modeling, Ecology, Evolution, Behavior and Systematics, Nature and Landscape Conservation
View Paper: https://www.semanticscholar.org/paper/4f36e18f2c49b908fe9c2f7c89f5db50ecb7645e
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Ecological Modeling
- A. Chao
- Chun‐Huo Chiu
- Robert K. Colwell
- L. Jost
- Pedro Jordano
- John‐Arvid Grytnes
- T. Gardner
- M. Dornelas
In Ecology, Evolution, Behavior and Systematics
- A. Chao
- Chun‐Huo Chiu
- Robert K. Colwell
- Pedro Jordano
- I. Leal
- L. Jost
- I. Steffan‐Dewenter
- M. Tabarelli
In Nature and Landscape Conservation
- A. Chao
- Chun‐Huo Chiu
- Robert K. Colwell
- I. Leal
- L. Jost
- M. Tabarelli
- Pedro Jordano
- Harry John Betteley Birks
Citations in the corpus
- Temporal variation in plant–pollinator networks from seasonal tropical environments: Higher specialization when resources are scarce (2018, background): “Despite a clear appreciation of the temporally dynamic nature of populations and communities (e.g. Chesson & Huntly, 1989; Clements, 1936; Cowles, 1899), interaction networks are often treated as temporally static entities (Poisot, Stouffer, & Gravel, 2015).”
- Thirty years of progeny from Chao’s inequality: Estimating and comparing richness with incidence data and incomplete sampling (2017, methodology): “Also, replicated incidence data support statistical approaches to richness estimation that are just as powerful as corresponding abundance-based approaches (Chao et al., 2014b).”
- Biodiversity consequences of land-use change and forest disturbance in the Amazon:a multi-scale assessment using ant communities (2016, methodology): “Extrapolations were done considering presence/absence data (Hill numbers of order 0) and incidence data (Hill numbers of order 1), thus reducing a potential bias caused by rarely sampled species (Chao et al. 2014).”
- Effective monitoring of freshwater fish (2019, background): “A recent innovation is to extrapolate to the largest sample size rather than rarefy to the smallest one (Chao et al., 2014; Hsieh et al., 2016).”
- The impacts of habitat disturbance on adult and larval dragonflies (Odonata) in rainforest streams in Sabah, Malaysian Borneo (2017, methodology): “We used the ‘iNEXT’ package (Chao et al., 2014; Hsieh, Ma & Chao, 2014) to plot individual-based species accumulation curves for adult dragonflies in each of the broad habitat types (old growth forest, OG; logged forest, LF; oil palm with buffer, OPB and oil palm without buffer, OP) to assess the co”
- Deciphering the associations between soil microbial diversity and ecosystem multifunctionality driven by long‐term fertilization management (2018, result): “…2012) and sample- size- based rarefaction in r statistical software with the “iNEXT” package (Hsieh, Ma, & Chao, 2013), and they produced qualitatively similar results through statistical comparison (Figure S2; Chao et al., 2014; Hsieh, Ma, & Chao, 2016; Zheng, Hu, Guo, Anderson, & Powell, 2017).”
- Estimating diversity and entropy profiles via discovery rates of new species (2015, methodology): “For this reason, Hill (1973), T othm er esz (1995), Gotelli & Chao (2013), Chao et al. (2014) and others suggested that biologists should instead use all the information contained in their data, by plotting the complexity measure as a continuous function of q.”
- Patterns of pollinator turnover and increasing diversity associated with urban habitats (2017, methodology): “We began by calculating rarefied bee species richness for each site using the methods described by Chao et al. (2014).”
- A Phytogeographical Metaanalysis of the Semiarid Caatinga Domain in Brazil (2016, methodology): “We then used rarefaction (interpolation) and extrapolation to build the species accumulation curve for each plant assemblage with 95 % confidence intervals using EstimateS software (Chao et al., 2014; Colwell, 2009; Colwell et al., 2012, 2004; Gotelli & Colwell, 2011).”
- Deadwood enrichment in European forests – Which tree species should be used to promote saproxylic beetle diversity? (2016, positive): “To analyze ourdata we used recently developedmethods for sample size-and coverage-based rarefaction and extrapolation to be able to compare gamma-diversity for Hill-numbers 0 D (species richness), 1 D (Shannon diversity) and 2 D (Simpson diversity; Chao et al., 2014; Jost, 2006).”
- Measuring temporal change in alpha diversity: A framework integrating taxonomic, phylogenetic and functional diversity and the iNEXT.3D standardization (2021, methodology): “For the measure q = 0, the size can be extrapolated, at most, to no more than double the reference sample size (Chao et al., 2014).”
- Precipitation mediates the effect of human disturbance on the Brazilian Caatinga vegetation (2017, result): “%) in all sites (Table S1, Supporting Information), indicating that our sampling effort was adequate, and that our diversity estimates were not biased by differences in sample coverage among sites (Chao & Jost 2012; Chao et al. 2014).”
- The impact of even‐aged and uneven‐aged forest management on regional biodiversity of multiple taxa in European beech forests (2018, methodology): “0 (Chao et al., 2014), for β- diversity the function F IGURE 3 Abundance (a, e, i) and α- (b, f, j), β- (c, g, k) and γ- (d, h, l) diversity of even- aged and uneven- aged forest management systems for 15 taxonomic groups.”
- iNEXT: an R package for rarefaction and extrapolation of species diversity (Hill numbers) (2016, methodology): “For q = 1, eqn 1 is undefined, but its limit as q tends to 1 is the exponential of the familiar Shannon index, referred to as Shannon diversity (Chao et al. 2014):”