Are We There Yet? Human Factors Knowledge and Health Information Technology – the Challenges of Implementation and Impact

 

 Permissions and Reprints

Summary

Objective: To review the developments in human factors (HF) research on the challenges of health information technology (HIT) implementation and impact given the continuing incidence of usability problems and unintended consequences from HIT development and use.

Methods: A search of PubMed/Medline and Web of Science® identified HF research published in 2015 and 2016. Electronic health records (EHRs) and patient-centred HIT emerged as significant foci of recent HF research. The authors selected prominent papers highlighting ongoing HF and usability challenges in these areas. This selective rather than systematic review of recent HF research highlights these key challenges and reflects on their implications on the future impact of HF research on HIT.

Results: Research provides evidence of continued poor design, implementation, and usability of HIT, as well as technology-induced errors and unintended consequences. The paper highlights support for: (i) strengthening the evidence base on the benefits of HF approaches; (ii) improving knowledge translation in the implementation of HF approaches during HIT design, implementation, and evaluation; (iii) increasing transparency, governance, and enforcement of HF best practices at all stages of the HIT system development life cycle.

Discussion and Conclusion: HF and usability approaches are yet to become embedded as integral components of HIT development, implementation, and impact assessment. As HIT becomes ever-more pervasive including with patients as end-users, there is a need to expand our conceptualisation of the problems to be addressed and the suite of tactics and strategies to be used to calibrate our pro-active involvement in its improvement.

• References

• 1 Park HA. Are We Ready for the Fourth Industrial Revolution?. Yearb Med Inform 2016; 1-3.
  PubMedGoogle Scholar
• 2 Sankar PL, Parker LS. The Precision Medicine Initiative’s All of Us Research Program: an agenda for research on its ethical, legal, and social issues. Genet Medicine. 2016 Dec 8..
  PubMedGoogle Scholar
• 3 Coiera E, Ash J, Berg M. The Unintended Consequences of Health Information Technology Revisited. Yearb Med Inform 2016; 163-9.
  PubMedGoogle Scholar
• 4 Yardley L, Choudhury T, Patirck K, Michie S. Current Issues and Future Directions for Research Into Digital Behavior Change Interventions. Am J Prev Med 2016; 51 (05) 814-5.
  PubMedGoogle Scholar
• 5 Chapanis A, Safrin MA. Of misses and medicines. J Chronic Dis 1960; 12 (04) 403-8.
  PubMedGoogle Scholar
• 6 Weizenbaum J. Computer Power and Human Reason: From Judgment to Calculation. W.H. Freeman and Co; 1976
  Google Scholar
• 7 Perrow C. Normal Accidents: Living With High Risk Technologies. Basic Books; 1984
  Google Scholar
• 8 Burnum JF. The misinformation era: the fall of the medical record. Ann Intern Med 1989; Mar 15: 110 (06) 482-4.
  PubMedGoogle Scholar
• 9 Klatzky RL, Kober N, Mavor A. editors. Safe, Comfortable, Attractive, and Easy to Use: Improving the Usability of Home Medical Devices. National Research Council (US) Committee on Human Factors; 1996
  Google Scholar
• 10 Berg M. Medical work and the computer-based patient record: a sociological perspective. Methods Inf Med 1998; 37: 294-301.
  PubMedGoogle Scholar
• 11 Carayon P, Kianfar S, Li YQ, Xie AP, Alyousef B, Wooldridge A. A systematic review of mixed methods research on human factors and ergonomics in health care. Appl Ergon 2015; 51: 291-321.
  PubMedGoogle Scholar
• 12 Meeks DW, Smith MW, Taylor L, Sittig DF, Scott JM, Singh H. An analysis of electronic health record-related patient safety concerns. J Am Med Inform Assoc 2014; Nov-Dec; 21 (06) 1053-9.
  PubMedGoogle Scholar
• 13 Ammenwerth E. Evidence-based Health Informatics: How Do We Know What We Know?. Methods Inf Med 2015; 54 (04) 298-307.
  PubMedGoogle Scholar
• 14 Kannampallil TG, Schauer GF, Cohen T, Patel VL. Considering complexity in healthcare systems. J Biomed Inform 2011; Dec; 44 (06) 943-7.
  PubMedGoogle Scholar
• 15 Sawyer S, Jarrahi M. Sociotechnical approaches to the study of information systems. In Tucker A. editors: Computing Handbook: Information Systems and Information Technology. 3rd ed.. V2 CRC Boca Raton, FL: Chapman and Hall; 2014
  Google Scholar
• 16 Kaplan B. Evaluation of People, Social, and Organizational Issues - Sociotechnical Ethnographic Evaluation Evidence-Based Health Informatics. Ammenwerth E, Rigby M. editors IOS Press; 2016
  Google Scholar
• 17 Berg M, Langenberg C, Berg IVD, Kwakkernaat J. Considerations for sociotechnical design: experiences with an electronic patient record in a clinical context. Int J Med Inform 1998; 52: 243-51.
  CrossrefPubMedGoogle Scholar
• 18 Berg M. Patient care information systems and health care work: a sociotechnical approach. Int J Med Inform 1999; 55: 87-101.
  PubMedGoogle Scholar
• 19 Sittig DF, Singh H. A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Qual Saf Health Care 2010; Oct 19 (Suppl 3): i68-74.
  PubMedGoogle Scholar
• 20 Brown CL, Mulcaster HL, Triffitt KL, Sittig DF, Ash JS, Reygate K. et al. A systematic review of the types and causes of prescribing errors generated from using computerized provider order entry systems in primary and secondary care. J Am Med Inform Assoc 2017; Mar 1; 24 (02) 432-40.
  CrossrefPubMedGoogle Scholar
• 21 Gephart S, Carrington JM, Finley BA. Systematic Review of Nurses’ Experiences With Unintended Consequences When Using the Electronic Health Record. Nurs Adm Q 2015; Oct-Dec; 39 (04) 345-56.
  PubMedGoogle Scholar
• 22 Ratwani RM, Fairbanks RJ, Hettinger AZ, Benda N. Electronic Health Record Usability: Analysis of the User Centered Design Processes of Eleven Electronic Health Record Vendors. J Am Med Inform Assoc 2015; November 11; 22 (06) 1179-82.
  CrossrefPubMedGoogle Scholar
• 23 McCray AT, Glaser J, Koppel R, Langlotz CP, Silverstein J. Health IT vendors and the academic community: The 2014 ACMI debate. J Biomed Inform 2016; Apr; 60: 365-75.
  PubMedGoogle Scholar
• 24 Koppel R, Lehmann CU. Implications of an emerging EHR monoculture for hospitals and healthcare systems. J Am Med Inform Assoc 2015; Mar; 22 (02) 465-71.
  CrossrefPubMedGoogle Scholar
• 25 Sinsky CA, Hess J, Karsh B, Keller JP, Koppel R. Comparative user experiences of health IT products: how user experiences would be reported and used. Institute of Medicine; 2012
  Google Scholar
• 26 Miliard M. Frustrations linger around electronic health records and user-centered design. Mar 10, 2016 http://www.healthcareitnews.com/news/frustrations-linger-around-electronic-health-records-and-user-centered-design.
  PubMedGoogle Scholar
• 27 McCann E. How satisfied are you with your EHR?. 2015 Satisfaction Survey results. Sept 18, 2015 http://www.healthcareitnews.com/ news/2015-ehr-satisfaction-survey.
  PubMedGoogle Scholar
• 28 Off ice of the National Coordinator. Safer guides will help optimize safety. Jan 14, 2014 https://www.healthit.gov/buzzblog/electron-ic-health-and-medical-records/safer-guides-optimize-safety/.
  PubMedGoogle Scholar
• 29 Shanafelt TD, Hasan O, Dyrbye LN, Sinsky C, Satele D, Sloan J. et al. Changes in Burnout and Satisfaction With Work-Life Balance in Physicians and the General US Working Population Between 2011 and 2014. Mayo Clin Proc December 2015; 90 (12) 1600-13.
  PubMedGoogle Scholar
• 30 Wildenbos GA, Peute LW, Jaspers MWM. Impact of Patient-centered eHealth Applications on Patient Outcomes: A Review on the Mediating Influence of Human Factor Issues. Yearb Med Inform 2016; 113-9.
  PubMedGoogle Scholar
• 31 Baysari MT, Westbrook J. Mobile Applications for Patient-centered Care Coordination: A Review of Human Factors Methods Applied to their Design, Development, and Evaluation. Yearb Med Inform 2015; 10: 47-54.
  PubMedGoogle Scholar
• 32 Purkayastha S, Price A, Biswas R, Jai AUGanesh, Otero P. From Dyadic Ties to Information Infrastructures: Care-Coordination between Patients, Providers, Students and Researchers Contribution of the Health Informatics Education Working Group. Yearb Med Inform 2015; 10: 68-74.
  PubMedGoogle Scholar
• 33 Sawesi S, Rashrash M, Phalakornkule K, Carpenter JS, Jones JF. The Impact of Information Technology on Patient Engagement and Health Behavior Change: A Systematic Review of the Literature. JMIR Med Inform 2016; Jan 21; 04 (01) e1.
  CrossrefPubMedGoogle Scholar
• 34 International Ergonomics Association (IEA). Defnition & Domains of Ergonomics. http://www.iea.cc/whats/index.html.
  PubMedGoogle Scholar
• 35 Carayon P. Human Factors and ergonomics in healthcare and patient safety. In; Carayon P. 2011
  Google Scholar
• 36 Patel VL, Kannampallil TG. Human factors and health information technology: current challenges and future directions. Yearb Med Inform 2014; 58-66.
  PubMedGoogle Scholar
• 37 Kushniruk A, Nohr C, Borycki E. Human Factors for more usable and safer information technology: where are we now and Where do we go from here?. Yearb Med Inform 2016; Nov 10: 120-5.
  PubMedGoogle Scholar
• 38 Beuscart-Zephir MC, Elkin P, Pelayo S, Beuscart R. The Human Factors Engineering Approach to biomedical Informatics projects: State of the Art, Results, Benefits and Challenges. Yearb Med Inform 2007; 109-27.
  PubMedGoogle Scholar
• 39 Beuscart-Zephir MC, Borycki E, Jaspers MWM, Pelayo S. Evolution of Human Factors research and Studies of Health Information Technologies: The role of patient Safety. Yearb Med Inform 2013; 67-77.
  PubMedGoogle Scholar
• 40 Ratwani RM, Fairbanks T, Savage E, Adams K, Wittie M, Boone E. et al. Mind the Gap: A systematic review to identify usability and safety challenges and practices during electronic health record implementation. Appl Clin Inform 2016; Nov 16; 07 (04) 1069-87.
  PubMedGoogle Scholar
• 41 Ratwani RM, Benda NC, Hettinger A, Fairbanks R. Electronic health record vendor adherence to usability certification requirements and testing standards. JAMA 2015; Sep 8; 314 (10) 1070-1.
  PubMedGoogle Scholar
• 42 Babbott S, Manwell LB, Brown R, Montague E, Williams E, Schwartz M. et al. Electronic medical records and physician stress in primary care: results from the MEMO Study. J Am Med Inform Assoc 2014; Feb;21 (e1): e100-106.
  PubMedGoogle Scholar
• 43 Friedman A, Crosson JC, Howard J, Clark EC, Pellerano M, Karsh BT. et al. A typology of electronic health record workarounds in small-to-medium size primary care practices. J Am Med Inform Assoc 2014; 21: e78-e83.
  PubMedGoogle Scholar
• 44 Graber ML, Siegal D, Riah H, Johnston D, Kenyon K. Electronic health record-related events in medical malpractice claims. J Patient Saf. 2015 Nov 6
  PubMedGoogle Scholar
• 45 Ellsworth MA, Dziadzko M, O’Horo JC, Farrell AM, Zhang J, Herasevich V. An appraisal of published usability evaluations of electronic health records via systematic review. J Am Med Inform Assoc 2017; Jan; 24 (01) 218-26.
  PubMedGoogle Scholar
• 46 Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K. et al. Understanding and Promoting Effective Engagement with Digital Behavior Change Interventions. Am J Prev Med 2016; Nov 51 (05) 833-42.
  PubMedGoogle Scholar
• 47 Kayser L, Kushniruk A, Osborne RH, Norgaard O, Turner P. Enhancing the Effectiveness of Consumer-Focused Health Information Technology Systems Through eHealth Literacy: A Framework for Understanding Users’ Needs. JMIR Hum Factors 2015; May 20, 02 (01) e9.
  PubMedGoogle Scholar
• 48 Ammenwerth E, Rigby M. editors. Evidence-Based Health Informatics - Promoting Safety Efficiency Through Scientific Methods Ethical Policy. 2016. Vol 222 Studies in Health Technology & Informatics..
  Google Scholar
• 49 Singh H, Sittig DF. Measuring and improving patient safety through health information technology: The Health IT Safety Framework. BMJ Qual Saf 2016; Apr; 25 (04) 226-32.
  CrossrefPubMedGoogle Scholar
• 50 Koppel R. The health information technology safety framework: building great structures on vast voids. BMJ Qual Saf 2016; Apr; 25 (04) 218-20.
  PubMedGoogle Scholar
• 51 Coiera E. A New Informatics Geography, Yearb Med Inform. 2016; 251-5.
  PubMedGoogle Scholar
• 52 HIMSS EHR Usability Task Force. “Defining and Testing EMR Usability: Principles and Proposed Methods of EMR Usability Evaluation and Rating.”. June 2009
  PubMedGoogle Scholar
• 53 Riskin L, Koppel R, Riskin D. Re-examining health IT policy: what will it take to derive value from our investment?. J Am Med Inform Assoc 2015; Mar; 22 (02) 459-64.
  PubMedGoogle Scholar
• 54 Kellermann AL, Jones SS. What it will take to achieve the as-yet-unfulfilled promises of health information technology. Health Aff (Millwood) 2013; Jan 1; 32 (01) 63-8.
  PubMedGoogle Scholar
• 55 Medical Device Directive MDD93/42/EEC. http:// www.mdss.com/download/download_station.htm accessed December 21, 2016..
  PubMed
• 56 ONC Meaningful Use and Usability Testing. http:// www.healthcareusability.com/article/onc-meaningful-use-and-usabilitytesting accessed September 20, 2016..
  PubMed
• 57 Middleton B, Bloomrosen M, Dente MA, Hashmat B, Koppel R, Overhage JM. et al. Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA. J Am Med Inform Assoc 2013; Jun 1; 20 (e1): e2-8.
  CrossrefPubMedGoogle Scholar
• 58 Magrabi F, Baker M, Sinha I, Ong MS, Harrison S, Kidd MR. et al. Clinical safety of England’s national programme for IT: A retrospective analysis of all reported safety events 2005 to 2011. Int J Med Inform 2015; Mar; 84 (03) 198-206.
  CrossrefPubMedGoogle Scholar
• 59 Magrabi F, Liaw ST, Arachi D, Runciman W, Coiera E, Kidd MR. Identifying patient safety problems associated with information technology in general practice: an analysis of incident reports. BMJ Qual Saf 2016; 25 (11) 870-80.
  PubMedGoogle Scholar
• 60 Marcilly R, Ammenwerth E, Roehrer E, Pelayo S, Vasseur F, Beuscart-Zéphir MC. Usability Flaws in Medication Alerting Systems: Impact on Usage and Work System. Yearb Med Inform 2015; 55-67.
  PubMedGoogle Scholar
• 61 Schiff G, Amato M, Eguale T, Boehne JJ, Wright A, Koppel R. et al. Computerised physician order entry-related medication errors: analysis of reported errors and vulnerability testing of current systems. BMJ Qual Saf 2015; Apr; 24 (04) 264-71.
  PubMedGoogle Scholar
• 62 Castro GM, Buczkowski L, Hafner JM. The Contribution of Sociotechnical Factors to Health Information Technology-Related Sentinel Events. Jt Comm J Qual Patient Saf 2016; Feb; 42 (02) 70-6.
  PubMedGoogle Scholar
• 63 Brenner SK, Kaushal R, Grinspan Z, Joyce C, Kim I, Allard RJ. et al. Effects of health information technology on patient outcomes: a systematic review. J Am Med Inform Assoc 2016; Sep; 23 (05) 1016-36.
  PubMedGoogle Scholar
• 64 Guise V, Anderson J, Wiig S. Patient safety risks associated with telecare: a systematic review and narrative synthesis of the literature. BMC Health Serv Res 2014; Nov 25; 14: 588.
  PubMedGoogle Scholar
• 65 Matthew-Maich N, Harris L, Ploeg J, Markle-Reid M, Valaitis R, Ibrahim S. et al. Designing, Implementing, and Evaluating Mobile Health Technologies for Managing Chronic Conditions in Older Adults: A Scoping Review. JMIR mHealth & uHealth 2016; 04 (02) 164-81.
  PubMedGoogle Scholar
• 66 Zapata BC, Fernandez-Aleman JL, Idri A, Toval A. Empirical Studies on Usability of mHealth Apps: A Systematic Literature Review. J Med Syst 2015; 39 (02) 1.
  PubMedGoogle Scholar
• 67 Queiros A, Silva A, Alvarelhao J, Rocha NP, Teixeira A. Usability, accessibility and ambient-assisted living: a systematic literature review. Universal Access in the Information Society 2015; 14 (01) SI57-66.
  PubMedGoogle Scholar
• 68 Sheikh A, Sood HS, Bates DW. Leveraging health information technology to achieve the “triple aim” of healthcare reform. J Am Med Inform Assoc 2015; Jul; 22 (04) 849-56.
  PubMedGoogle Scholar
• 69 National Patient Safety Foundation. Free from Harm: Accelerating Patient Safety Improvement Fifteen Years after To Err Is Human. Boston, MA: http://www.npsf.org/ 2015
  PubMedGoogle Scholar
• 70 Zhang J, Muhammad W. editors. Better EHR: Usability, Workflow and Cognitive Support in Electronic Health Records. National Center for Cognitive Informatics & Decision Making in Healthcare. 2014 https://sbmi.uth.edu/nccd/ better-ehr/.
  PubMedGoogle Scholar
• 71 National Institute of Standards and Technology Health IT Usability. http://www.nist.gov/healthcare/usability (Accessed January 5, 2017)
  PubMedGoogle Scholar
• 72 Agency for Healthcare Research and Quality, Developing Evidence-Based, User-Centered Design and Implementation Guidelines to Improve Health Information Technology Usability (Maryland). (Accessed January 5, 2017) https:// healthit.ahrq.gov/ahrq-funded-projects/develop-ing-evidence-based-user-centered-design-and-implementation-guidelines.
  PubMedGoogle Scholar
• 73 Office of the National Coordinator. Safer guides will help optimize safety. 2014 https://www. healthit.gov/safer/safer-guides (Accessed January 5, 2017)
  PubMedGoogle Scholar
• 74 Kaipio J, Lääveri T, Hyppönen H, Vainiomäki S, Reponen J, Kushniruk A. et al. Usability problems do not heal by themselves: National survey on physicians’ experiences with EHRs in Finland. Int J Med Inform 2017; Jan 97: 266-81.
  PubMedGoogle Scholar
• 75 Jensen S, Rasmussen SL, Lyng KM. Use of clinical simulation for assessment in EHR-procurement: design of method. Stud Health Technol Inform 2013; 192: 576-80.
  PubMedGoogle Scholar
• 76 Marcilly R, Peute L, Beuscart-Zephir MC. From Usability Engineering to Evidence-based Usability in Health IT. Stud Health Technol Inform 2016; 222: 126-38.
  PubMedGoogle Scholar
• 77 Lyon AR, Lewis CC, Melvin A, Boyd M, Nicodimos S, Liu FF. et al. Health Information Technologies—Academic and Commercial Evaluation (HIT-ACE) methodology: description and application to clinical feedback systems. Implement Sci 2016; Sep 22; 11 (01) 128.
  PubMedGoogle Scholar
• 78 Australian Commission on Safety and Quality in Health Care (ACSQHC). National Guidelines for On-Screen Display of Clinical Medicines Information, Sydney, New South Wales, Commonwealth of Australia. 2016 http://www.safetyandquality.gov.au/ our-work/medication-safety/electronic-medication-management-systems/.
  PubMedGoogle Scholar
• 79 Kushniruk AW, Borycki EM. Low-cost rapid usability testing: Its application in both product development and system implementation. Stud Health Technol Inform 2017; 234: 195-200.
  PubMedGoogle Scholar
• 80 Martin SA, Sinsky CA. The map is not the territory: medical records and 21st century practice. Lancet 2016; Oct 22; 388 (10055): 2053-6.
  PubMedGoogle Scholar