Perspective

Balancing act: the complex role of artificial intelligence in addressing burnout and healthcare workforce dynamics

Abstract

Burnout and workforce attrition present pressing global challenges in healthcare, severely impacting the quality of patient care and the sustainability of health systems worldwide. Artificial intelligence (AI) has immense potential to reduce the administrative and cognitive burdens that contribute to burnout through innovative solutions such as digital scribes, automated billing and advanced data management systems. However, these innovations also carry significant risks, including potential job displacement, increased complexity of medical information and cases, and the danger of diminishing clinical skills. To fully leverage AI’s potential in healthcare, it is essential to prioritise AI technologies that align with stakeholder values and emphasise efforts to re-humanise medical practice. By doing so, AI can contribute to restoring a sense of purpose, fulfilment and efficacy among healthcare workers, reinforcing their essential role as caregivers, rather than distancing them from these core professional attributes.

Introduction

The WHO classifies burnout as an ‘occupational phenomenon’, with the 11th Revision of the International Classification of Disease (ICD-11) defining it as a ‘syndrome conceptualized as resulting from chronic workplace stress that has not been successfully managed. It is characterized by three dimensions: feelings of energy depletion or exhaustion; increased mental distance from one’s job, or feelings of negativism or cynicism related to one’s job; and reduced professional efficacy …’.1 It can manifest as a sense of detachment from patients, a depletion of emotional resources and a diminished sense of personal fulfilment. Such a state compromises the quality of patient care, precipitating medical errors2 and a decline in physician productivity and career satisfaction.3 Burnout has become so ubiquitous among physicians, nurses and staff workers that it is now markedly impairing the healthcare workforce. In McKinsey’s most recent nursing survey, 31% of nurses indicated their intent to leave direct patient care jobs4 and a report from Mercer’s US healthcare labour market projects that 1.1 million registered nurses will be needed by 2026.5 In 2021, the Association of American Medical College estimated that the USA could see a shortage of 37 800 and 124 000 physicians by 2034.6 Overall, the Mercer report projects a shortage of more than 3 million healthcare workers (HCWs) by 2026.5 Health systems have yet to adapt to this large-scale workforce attrition, leading to disruptions in care delivery, worsening access to care issues and prolonging wait times.

The rapid evolution of artificial intelligence (AI) in healthcare presents an unparalleled opportunity to address burnout workforce shortages among HCWs.7 In recent years, the capabilities of AI in healthcare have seen exponential growth, spurred by significant advances in machine learning (ML) algorithms, the proliferation of generative AI and the widespread application of deep neural networks.8 These technological advances have resulted in the creation of more accurate predictive models, sophisticated data analysis tools and advanced systems for automating clinical and administrative tasks. Innovations in natural language processing (NLP) are transforming electronic health records (EHRs), making them more intuitive and efficient, while AI-driven diagnostic tools are significantly enhancing the accuracy and speed of patient care. Moreover, the use of generative AI to synthesise medical literature and aid in decision-making is adding a new layer of depth to personalised patient treatment plans. However, these advancements are not without significant risks. The integration of AI could lead to potential job displacement as tasks once performed by humans are automated.9 There is also an increased complexity in medical information and cases, which could overwhelm providers who are not adequately trained to leverage these new tools10 Additionally, there is a risk that the reliance on AI may diminish clinical skills,11 as continuous practice and hands-on experience are crucial for maintaining proficiency. Below, we explore the various challenges and potential AI innovations that could prove beneficial in addressing the critical issue of burnout among healthcare professionals. This discussion aims to strike a balance between leveraging the advantages of AI and mitigating its potential risks to ensure that it serves as a supportive tool rather than a disruptive force in healthcare (see figure 1).

Figure 1
Figure 1

Balancing the Impact of artificial intelligence (AI) on healthcare workforce dynamics. This figure illustrates the dual nature of AI integration in healthcare, highlighting both the benefits and potential risks.

Enhancing workflow with AI: streamlining administrative and documentation processes

In the effort to leverage AI technologies for enhancing workplace efficiency and mitigating clinician burnout, the burden of administrative tasks and clinical documentation in EHRs must be a central focus. In the current era of EHRs and heightened regulatory demands, clinicians now allocate almost half of their workday to documentation and other administrative responsibilities.12 This significant burden of administrative and clerical time diminishes the time available for direct patient interaction, establishing trust, imparting patient education and attending to the comprehensive physical, emotional and psychological needs of patients. Such a shift can lead to a disconnection from the core mission of healthcare and create misaligned incentives, thereby heightening the likelihood of burnout among medical professionals. To realign healthcare with its foundational goals and alleviate the strain on medical professionals, AI presents several innovative opportunities. These include digital scribes for easing documentation load, chatbots and AI tools for enhancing healthcare communication, and automated systems for streamlining billing processes.

Digital scribes

Digital scribes are rapidly evolving as a potential solution to reduce the burden of clinical documentation. Digital scribe is an AI technology that integrates speech recognition with NLP to synthesise provider–patient interaction, summarise it in the EHR,13 populate diagnostic fields and create billing codes. There has been an increase in private healthcare-informational technology companies that are developing and perfecting this technology.14 Early studies have shown the promise of digital scribes in improving documentation efficiency by almost 2.7-fold,15 but the clinical validity and usability of this AI-based technology is still in its infancy.

This automation not only streamlines the record-keeping process but also enhances data accuracy and accessibility. In a retrospective analysis of documented notes, Steinkamp et al showed that 50.1% of total text in patients’ notes was copied forward from prior notes.16 The redundancy in clinical documentation inundates clinicians with copious amounts of duplicated data, leading to wasted time in chart review and contributing to burnout.

Further comprehensive research is required to evaluate the impact of AI-based documentation technologies on clinician burnout reduction over the long term. For example, Nguyen et al conducted a study where digital scribes were implemented in a cancer centre. The findings indicated that the adoption of digital scribes was deemed marginally acceptable and appropriate, as well as marginally usable by oncologists. However, the study did not demonstrate a reduction in clinician burnout. Moreover, the study was constrained by a small participant pool, and it did not investigate the long-term effects of digital scribes on clinician burnout.17 As healthcare institutions grapple with increasing workplace efficiency, the impact of these technologies on reducing HCWs burnout must be a central focus. Additionally, increased workplace efficiency may have a perverse and unintentionally effect on morale as health systems push HCWs to see more patients to optimise profit margins. Developing a regulatory framework that monitors efficiency measures with HCWs well-being and patients’ outcomes will be necessary to mitigate this potential downstream effect.

Inbox management and digital health communication

Another facet of the administrative burden is the time clinicians spend responding to inbox messages and other digital forms of healthcare-related communication. The electronic inbox has become an overwhelming aspect of medical practice. Historically, managing administrative tasks was an implicit part of the job for physicians, interacting with regulators, payors and vendors. However, the shift to a digital platform has led to an unchecked increase in volume. Several factors contribute to this surge:

  1. Federal regulations, such as the mandate from the Department of Health and Human Services for immediate release of test results, have doubled patient inquiries via patient portals, often about sensitive information.

  2. The financial structures of healthcare, including the preference for copays during in-person visits over patient portal interactions, have encouraged more portal use for patients. The bureaucracy of prior authorisations and equipment renewals adds to the workload without additional pay.

  3. Healthcare delivery organisations have shifted tasks previously handled by support staff to physicians, under the guise of ‘free’ physician time. This results in physicians burdened by tasks inconsistent with their qualification level, such as clerical work and minor clinical queries.

  4. Commercial pharmacies, through automated systems designed to reduce their costs, flood inboxes with unnecessary prescription renewal requests.

Prepandemic data showed that family physicians spend 1.5 hours daily on inbox management.12 US clinicians receive almost triple the inbox messages compared with their international counterparts, with over a third being system-generated and of low value. Patient messages, while constituting only 3% of the total, demand more time and careful handling. These have increased by 157% since the pandemic’s onset and have remained high. Patients now expect immediate, real-time access to their physicians for non-urgent matters, a service that some institutions promote as a competitive advantage. Yet, the healthcare system lacks the supportive care teams and compensation models to effectively provide this service. Additionally, with increasing patient portal registrations, patients are messaging clinicians more often, thus increasing the time clinicians spend in EHRs dramatically.18

Services such as Generative AI and Co-Pilot offer promising avenues to address the issues of inbox management and digital healthcare communication. Autocompletion of text while typing or templating/drafting responses to the deluge of messages has the potential to accelerate response times and inbox clearance.19 These advanced tools leverage NLP and ML algorithms to categorise, prioritise and respond to a high volume of patient inquiries, appointment requests and other routine communications. By automating repetitive tasks, healthcare professionals can focus more on patient care, reducing response times and improving the overall efficiency of healthcare services. Furthermore, these AI systems can be trained to recognise urgent requests, ensuring critical health issues are addressed promptly, thereby enhancing patient safety and satisfaction. While the research on this subject is still emerging, a study by Ayers et al demonstrated that AI chatbot responses to patient questions are a possible solution. Ayers et al performed a cross-sectional study with 195 randomly selected patient questions from a social media forum and showed that chatbots can generate higher quality and more empathetic responses to patient questions than physicians could.20

Automated billing and coding

Implementing AI in medical billing and coding could substantially lighten the administrative burden on doctors. Medical professionals currently dedicate a significant amount of their time to billing tasks, which takes away from patient-focused activities.21 This process is multifaceted, encompassing coding, insurance claims and addressing denials, all within a tightly regulated industry. Keeping pace with regulatory changes demands ongoing education and adaptability, adding to the stress of the job. Accurate and prompt billing is critical to a practice’s revenue, and mistakes can result in significant financial repercussions. Interactions with insurers can be complex and contentious, often leading to extra work and tension. Despite the intention behind EHRs and billing systems to make the process smoother, they can at times be unwieldy and error prone.

By ensuring accuracy of billing codes and congruency between physician and nursing notes, AI can reduce chart errors, improving billing revenue cycle and the time physicians spend correcting charts. In a retrospective cohort study, Kim et al showed that NLP in combination with ML predictive modelling using Random Forest, had an 87% accuracy with the CPT billing codes generated by their billing department for elective spine surgeries.22 Emerging AI technologies like Iodine’s AwareCDI Suite have shown that they can help hospitals with better utilisation management, optimise coding and improve revenue.23 Though we are in the infancy of automation for billing practices, a potential exists for large-scale administrative savings lies ahead and health systems must balance the cost of buying AI venture-based medical coding software with the potential long-term administrative cost savings. As healthcare institutions grapple with workplace efficiency, they must invest in research and prioritisation of AI technologies that aid in reducing clinicians’ documentation, medical coding burdens and bring the HCWs back-to-the bedside.

AI to reduce cognitive load

AI presents a transformative approach to mitigating the complex, decision-based cognitive load on healthcare providers, which is a significant factor contributing to workplace stress. The implementation of EHRs has led to a massive data deluge and fragmented landscape of data sources, creating inefficiencies,24 consuming resources and leading to care delays that inflate healthcare costs. Despite industry efforts to streamline data ecosystems, health information remains chaotic and HCWs are burdened with sifting through massive quantities of data to find relevant information for a particular encounter. As digital data proliferates, there is a pressing need for integrated AI and human intelligence solutions to effectively organise medical data, which would substantially decrease the time clinicians invest in compiling medical histories, reduce healthcare costs, enhance patient care efficiency and address access to care issues.

Reducing cognitive load through information synthesis

AI excels in synthesising vast amounts of healthcare data into coherent summaries and intuitive visualisations, enhancing comprehension and decision-making for healthcare providers. It can aggregate and interpret complex medical information from various sources, presenting it in a simplified format that highlights key insights. While preliminary studies show promise, research by Ando et al brings to light the current gaps—particularly, AI’s struggle to emulate the nuanced, tacit knowledge that physicians possess, often leading to summaries that may lack the depth of human-infused clinical reasoning.25 Though the authors note that AI output editing by a clinician can bridge this gap, discharge summaries independent of this factor would be far more advantageous.

Private tech companies such as DigitalOwl, Wisedocs offer AI-digital solutions to structure medical data and provide summaries with relevant variables such as patient diagnoses, treatments, medications among other significant findings, but large-scale adaptation of these technologies with proven results has yet to be a reality. Once realised, these summaries of medical records can be traded through directed exchange or query-based exchange across health systems.

Medication pop-up alerts for allergies or drug–drug interactions have inundated clinicians with copious, with at times, irrelevant information. Liu et al studied that AI techniques could be used to have more relevant medication alerts which can reduce alert volumes by 54%,26 thus reducing the cognitive burden on clinicians. Remote monitoring devices is another example where clinicians must sift through copious information for relevant data points. AI can help swift through this data to identify relevant data points or changes in patients’ clinical status.7 If these AI-based solutions are realised, it would reduce physician’s burden to integrate various data systems, filter through unstructured medical data, reduce time spent writing discharge summaries and decrease pop-up alert fatigue, thus reducing cognitive burden and bring HCWs back to the bedside. More investment to develop and perfect this technology can result in untold gains.

Reduced cognitive burden through AI-enhanced diagnostics

AI’s role in diagnostic support also has the potential to reduce cognitive load on HCW in the realm of diagnosis and problem solving. Numerous studies highlight reduced cognitive burden through AI-enhanced diagnostics. In dermatology, AI-based technologies have diagnosed skin pathologies at nearly the same level as dermatologists for some conditions.27 Early studies in pathology indicate that a synergistic approach with AI-based technologies and human intelligence results in a far more efficient and accurate diagnostics.28 By leveraging vast datasets to analyse images, lab results and patient histories, AI algorithms can identify patterns and anomalies that may elude human detection. This support not only accelerates the diagnostic process but also elevates diagnostic accuracy, potentially leading to early detection and treatment of conditions. When health systems integrate these AI technologies into clinical workflows, there potential for increased workplace efficiency, clinical accuracy and overall reduced cognitive burden on HCWs and reduction in the stress associated with medical error.

Forecasting

Predictive analytics powered by AI can forecast patient deteriorations and improve hospital operations by being proactive instead of reactive. Winslow et al’s study on ML model for early warning for clinical deterioration has shown a decrease in-hospital mortality as it resulted in early recognition and transfer to intensive care units of sick patients.29 For physicians, the ability to anticipate and mitigate health issues before they escalate can reduce the stress and unpredictability associated with emergency interventions. This prediction goes beyond clinician burnout. In addition, AI has shown promise in anticipating patient utilisation of healthcare resources. Scheduling, registration, transporters are just a few additional examples where workflow optimisation can be found through intelligent scheduling of outpatient appointments, predicting no-shows, allocating transporters in the hospital, enhancing bed turnover and anticipating emergent use of healthcare resources.

Challenges and risks of AI in healthcare

While the integration of AI in healthcare offers numerous benefits, it is equally important to recognise and address the potential challenges and drawbacks that may emerge. This section presents a counterpoint perspective, highlighting some critical concerns and the necessity of appropriate values alignment.

Deskilling and over-reliance

A crucial issue at the intersection of healthcare and technology is the potential deskilling and overreliance on AI technologies, such as Large Language Models. As clinicians increasingly depend on AI for diagnostics and treatment recommendations, there is a tangible risk that their clinical skills may deteriorate.30 This dependency could impair physicians’ abilities to make independent, critical decisions, especially in situations where AI systems are unavailable, malfunction or yield erroneous results. Moreover, the dynamic nature of healthcare employment, where professionals often transition between diverse clinical settings, exacerbates this risk.31 This variability across workplaces underscores the urgency of sustaining and enhancing clinical skills in tandem with AI utilisation. The introduction of AI could also hinder the acquisition of essential skills by medical trainees. Overreliance on AI for decision-making might prevent trainees from developing the critical thinking and problem-solving abilities necessary for independent practice.32 This could result in increased anxiety and cognitive load if AI systems are not available, particularly in emergency situations.

Changing cognitive demands

The integration of AI in healthcare not only alters the types of tasks performed by physicians but also shifts the cognitive demands placed on them.33 While AI is adept at handling routine tasks efficiently, it often leaves physicians to manage more complex and challenging cases. While this shift has the potential to offer intellectual stimulation by engaging healthcare providers with high-level medical problems, the continual exposure to such high-stress scenarios without the balance of less demanding tasks could inadvertently exacerbate burnout.34 The constant demand to tackle only complex cases might also diminish job satisfaction and long-term engagement, as the variation in task difficulty—often linked to career longevity—is reduced. In addition, issues around the explainability of AI systems can exacerbate these tendencies, hindering HCWs ability to communicate effectively with patients and make informed decisions.35

Exacerbation of feelings of patient-healthcare worker alienation

Widespread integration of AI in healthcare could intensify feelings of alienation between patients and healthcare workers. As AI assumes greater responsibilities, the essential human touch in patient care might become less prevalent, potentially diminishing patient satisfaction and trust.36 Additionally, healthcare workers may feel marginalised by AI technology, concerned about job displacement or the devaluation of their professional skills. This concern is underscored by developments such as generative AI nurses, which operate at significantly lower costs compared with human nurses.37 Such cost efficiencies may pressure healthcare systems to view human workers as replaceable elements within AI-driven workflows. This is just one of many concerns that the deployment of AI could lead healthcare providers and institutions to prioritise financial efficiencies at the expense of meaningful improvements in patient care (ie, the pressure to streamline operations, reduce costs, and boost revenues might overshadow the potential of these technologies to enhance care quality or improve patient outcomes).

Equity concerns in AI integration into healthcare

The integration of AI in healthcare surfaces significant equity concerns, as it could perpetuate and even exacerbate existing health inequities on personal, systemic and structural levels. AI systems are typically trained on existing data, which mirrors the biases and disparities found in current healthcare practices.38 Consequently, AI algorithms might unintentionally reinforce these inequities, resulting in diagnostic and treatment recommendations that could disproportionately disadvantage marginalised populations. Moreover, the adoption and distribution of AI technologies across healthcare systems underscore additional equity issues. Advanced AI systems are more likely to be implemented in financially robust, urban academic hospitals, enhancing their healthcare services and efficiency.39 In contrast, rural healthcare systems and those serving historically marginalised communities may lack the resources to adopt these technologies, potentially widening the health service quality gap between urban and rural areas.

The commercial nature of AI development further complicates these equity issues. Often, the drive for profitability outweighs social responsibility, leading companies to prioritise marketability and cost-efficiency over the identification and correction of biases in AI models. This approach differs markedly from the motivations of independent researchers focused on ethical considerations and public health outcomes, who are more likely to address these biases.

Mitigation strategies

To address the challenges AI introduces to healthcare workforce dynamics, it is crucial for systems to implement continuous education programmes that evolve with technological advancements, emphasising the development of diagnostic and decision-making skills. HCWs must balance the efficiency benefits of AI with vigilant oversight of its outputs, fostering a culture of critical engagement to enhance capabilities without compromising care standards. Transparency is additionally key and involving healthcare workers in the design and implementation phases can align AI technologies with user needs, improving effectiveness and confidence in clinical settings. Moreover, creating an environment where AI supplements rather than replaces human capabilities is essential, ensuring fair compensation and recognising healthcare workers to help mitigate AI’s perceived threats. Finally, stringent regulatory oversight and proactive bias correction in AI applications are necessary to prevent potential inequities, ensuring AI technologies promote health equity and access, enhancing patient care and supporting healthcare workforce dynamics effectively.

In conclusion, while AI has the potential to transform healthcare by reducing administrative burdens and enhancing diagnostic capabilities, it is imperative to remain cautious and address the accompanying risks. Ensuring continuous training, balancing financial considerations and maintaining the human element in patient care are essential steps to mitigate the negative impacts of AI integration. By taking a measured approach, healthcare systems can harness the benefits of AI while safeguarding against its potential drawbacks.