Score Reliability: Contemporary Thinking on Reliability Issues

By B. Thompson. 2002

259 citations recorded by the source corpus.

View Paper: https://www.semanticscholar.org/paper/18693e9b0d0a611e46d15fd12048676ccc8623e1

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Citations in the corpus

Refinement of a Chemistry Attitude Measure for College Students. (2011, background): “If the scores are not reliable, they cannot be considered to be valid unless the instrument is designed to measure nothing (Bruce Thompson, 2003).”
Meta-analysis of Cohen’s kappa (2011, background): “Reliability is an unobserved property of scores obtained from a sample on a particular test, not an inherent property of the test (Thompson 2002; Thompson and Vacha-Hasse 2000; Vacha-Hasse 1998; Vacha-Hasse et al. 2002).”
How to Estimate and Interpret Various Effect Sizes (2004, background): “5), even though alpha is also inherently in a squared variance-accounted-for metric (Thompson, 2003).”
Two Approaches for Correcting Correlation Attenuation Caused by Measurement Error: Implications for Research Practice (2003, background): “The variance of the compositeσ X 2 is simply the sum of item variances (Σσ i 2 ) and the sum of item covariances (2Σσij): σ σ σX i ij 2 2 2= +Σ Σ (4) Thompson (2002) provides more details on the theory underlying this estimation.”
Do Differing Types of Field Experiences Make a Difference in Teacher Candidates' Perceived Level of Competence? (2010, methodology): “Because all analyses are correlational and attenuated by reliability, it is important to examine the obtained reliability (Thompson, 2002, 2003).”
Understanding Correlation: Factors That Affect the Size of r (2006, background): “In classical test theory, reliability is defined as the ratio of true-score variance to observed-score variance (Hopkins, 1998; Thompson, 2003).”
Standardized Conditional SEM: A Case for Conditional Reliability (2007, background): “Another concept that plays a very important role in classical test theory (CTT) is the overall estimate of reliability for a group of examinees on a particular test (ρxxÞ, also known as ‘‘score reliability’’ (Thompson, 2003, p. 3).”
Evaluating the Quality of Evidence from Correlational Research for Evidence-Based Practice (2005, methodology): “%) of the time, and these confidence statements are not about single intervals (Thompson, 2002b).”
The Balanced Inventory of Desirable Responding (BIDR) (2007, background): “When a test yields low score reliability, it is often an indication that the test’s scores are plagued by random errors and not reflective of the construct intended to be measured (Thompson, 2003).”
Score Reliability: A Retrospective Look Back at 12 Years of Reliability Generalization Studies (2011, background): “Scores from measures with more items tend to be more reliable, especially when more items result in more dispersed total test scores, because total test score dispersion drives score reliability so strongly (Reinhardt, 1996; Thompson, 2003).”
A Demonstration of a Systematic Item-Reduction Approach Using Structural Equation Modeling (2012, methodology): “These analyses, conducted on the ordinal responses, revealed acceptably high levels of reliability (Thompson, 2003, p. 256) for each instrument, with an α = .917 on the 14 items of the CSSE inventory, and an α = .917 on the 23 items of the STARS-1 inventory.”
Reliability Generalization: Moving toward Improved Understanding and Use of Score Reliability (2002, methodology): “As emphasized by Thompson and Vacha-Haase (2000) and Thompson (2002), RG is anything but monolithic regarding analytic choices. We take this opportunity to illustrate the potential for creativity in RG analysis and result presentation. Figure 1 presents Excel spreadsheet commands to compute confiden”
Rethinking Internal Consistency in Cronbach's Alpha (2017, background): “A negative correlation, however, can also occur when respondents‟ answer inconsistently (Thompson, 2003).”
Essentials of Psychological Testing (2005, methodology): “This procedure, known as absolute scaling , was developed by Thurstone (1925). It allows for the difficulty of items to be placed on a uniform numerical scale for samples of test takers at different ability levels, such as students in various school grades.”
Treating Cronbach’s Alpha Reliability Coefficients as Data in Counseling Research (2006, background): “These primers use readily understandable terminology (e.g., Cortina, 1993; Onwuegbuzie & Daniel, 2002; Streiner, 2003b; Thompson, 2003).”