Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research
By Nicole Gray Weiskopf, Chunhua Weng. 2013
1,129 citations recorded by the source corpus.
Objective To review the methods and dimensions of data quality assessment in the context of electronic health record (EHR) data reuse for research. Materials and methods A review of the clinical research literature discussing data quality assessment methodology for EHR data was performed. Using an iterative process, the aspects of data quality being measured were abstracted and categorized, as well as the methods of assessment used. Results Five dimensions of data quality were identified, which are completeness, correctness, concordance, plausibility, and currency, and seven broad categories of data quality assessment methods: comparison with gold standards, data element agreement, data source agreement, distribution comparison, validity checks, log review, and element presence. Discussion Examination of the methods by which clinical researchers have investigated the quality and suitability of EHR data for research shows that there are fundamental features of data quality, which may be difficult to measure, as well as proxy dimensions. Researchers interested in the reuse of EHR data for clinical research are recommended to consider the adoption of a consistent taxonomy of EHR data quality, to remain aware of the task-dependence of data quality, to integrate work on data quality assessment from other fields, and to adopt systematic, empirically driven, statistically based methods of data quality assessment. Conclusion There is currently little consistency or potential generalizability in the methods used to assess EHR data quality. If the reuse of EHR data for clinical research is to become accepted, researchers should adopt validated, systematic methods of EHR data quality assessment.
Subfields: Health Information Management, Issues, ethics and legal aspects, Management Science and Operations Research
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Health Information Management
- George Hripcsak
- Joel T. Dudley
- William R. Hersh
- Riccardo Miotto
- Li Li
- Brian A. Kidd
- H. Sørensen
- Jimeng Sun
In Management Science and Operations Research
- Zhiyong Lu
- William R. Hersh
- Joel T. Dudley
- Brett K. Beaulieu-Jones
- Griffin M. Weber
- Justin Guinney
- Chunhua Weng
- Yanjun Qi
Citations in the corpus
- Opportunities and obstacles for deep learning in biology and medicine (2017, background): “literature around EHR data quality and the impact on research [98], we focus on three types of challenges: local bias, wider standards, and legal issues.”
- Deep Patient: An Unsupervised Representation to Predict the Future of Patients from the Electronic Health Records (2016, background): “EHR data is challenging to represent and model due to its high dimensionality, noise, heterogeneity, sparseness, incompleteness, random errors, and systematic biases 7,10,11 .”
- Next-generation phenotyping of electronic health records (2012, neutral): “CHALLENGES Unfortunately, the EHR carries many challenges.(2)”
- Using electronic health records for clinical research: The case of the EHR4CR project (2015, neutral): “$ 8 4D 0 3 4 56 5 7 !”
- The National COVID Cohort Collaborative (N3C): Rationale, design, infrastructure, and deployment (2020, methodology): “73,74 77 For N3C, we developed an approach to DQ that addresses the downstream application of the data for machine learning and statistical analytics.”
- The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) Statement (2015, methodology): “The description of data cleaning methods at different stages of the study should include those used to screen for erroneous and missing data, including range checks, checks for duplicate records, and handling of repeated measures [47,48].”
- Defining and measuring completeness of electronic health records for secondary use (2013, neutral): “Completeness was the most commonly assessed dimension of data quality in the set of articles we reviewed [3].”
- Caveats for the Use of Operational Electronic Health Record Data in Comparative Effectiveness Research (2013, positive): “A review of the literature of studies evaluating the data quality of EHRs for clinical research identified 5 dimensions of data quality assessed: completeness, correctness, concordance, plausibility, and currency.(26) The authors identified many studies with a wide variety of techniques to assess th”
- Electronic health records to facilitate clinical research (2016, background): “and completeness have not yet been adopted [46], but validation is a critical factor for the regulatory acceptance of EHR data.”
- A Harmonized Data Quality Assessment Terminology and Framework for the Secondary Use of Electronic Health Record Data (2016, methodology): “45 Other approaches, such as the ontological methods by Liaw 46 and Johnson, 51 have been used to develop alternative DQ terms.”