Cognitive and usability engineering methods for the evaluation of clinical information systems
By Andre W. Kushniruk, Vimla L. Patel. Journal of Biomedical Informatics, 2004
776 citations recorded by the source corpus.
Increasingly healthcare policy and decision makers are demanding evidence to justify investments in health information systems. This demand requires an adequate evaluation of these systems. A wide variety of approaches and methodologies have been applied in assessing the impact of information systems in health care, ranging from controlled clinical trials to use of questionnaires and interviews with users. In this paper we describe methodological approaches which we have applied and refined for the past 10 years for the evaluation of health information systems. The approaches are strongly rooted in theories and methods from cognitive science and the emerging field of usability engineering. The focus is on assessing human computer interaction and in particular, the usability of computer systems in both laboratory and naturalistic settings. The methods described can be a part of the formative evaluation of systems during their iterative development, and can also complement more traditional assessment methods used in summative system evaluation of completed systems. The paper provides a review of the general area of systems evaluation with the motivation and rationale for methodological approaches underlying usability engineering and cognitive task analysis as applied to health information systems. This is followed by a detailed description of the methods we have applied in a variety of settings in conducting usability testing and usability inspection of systems such as computer-based patient records. Emerging trends in the evaluation of complex information systems are discussed.
Subfields: General Health Professions, Health Information Management, Sociology and Political Science
View Paper: https://www.semanticscholar.org/paper/34ff0fbcce6ab023a86e7a83e0775f0a61567a00
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In General Health Professions
In Health Information Management
In Sociology and Political Science
Citations in the corpus
- Patient Portals and Patient Engagement: A State of the Science Review (2015, background): “Utility and usability are equally important and together determine whether something is useful [99]; 76 studies focused in some way on patient portal utility [5,12,13,15,19,22,23,25-27, 30, 34, 37, 41,”
- Review of health information technology usability study methodologies (2011, neutral): “Kushniruk and Patel 8 provided a methodological review for cognitive and usability engineering methods.”
- TURF: Toward a unified framework of EHR usability (2011, background): “The cognitive challenge is mainly concerned with usability issues, which did not receive significant attention in the EHR community until recently [11–21].”