








key: cord-340930-5cavkdde
authors: Cheung, Victor Kai-Lam; So, Eric Hang-Kwong; Ng, George Wing-Yiu; So, CC Sze-Sze; Hung, Jeff Leung-Kit; Chia, Nam-Hung
title: Investigating effects of healthcare simulation on personal strengths and organizational impacts for healthcare workers during COVID-19 pandemic: A cross-sectional study
date: 2020-07-16
journal: Integr Med Res
DOI: 10.1016/j.imr.2020.100476
sha: 
doc_id: 340930
cord_uid: 5cavkdde

INTRODUCTION: This cross-sectional study aimed at evaluating impacts of healthcare simulation training, either in-situ or lab-based, on personal strengths of healthcare workers (HCWs) and organizational outcomes during the COVID-19 pandemic. METHODS: COVID-19 Taskforce was established to formulate standardized scenario-based simulation training materials in late-January 2020. Post-training questionnaires made up of 5-point Likert scales were distributed to all participants to evaluate their personal strengths, in terms of i) assertiveness, ii) mental preparedness, iii) self-efficacy, iv) internal locus of control, and v) internal locus of responsibility. Independent sample t-tests were used to analyze between-group difference in “In-situ” and “Lab-based” group; and one-sample t-tests were used to compare change in personal strengths with reference point of 3 (Neutral). Kirkpatrick’s Model served as the analytical framework for overall training effects. RESULTS: Between 05 February and 18 March 2020, 101 sessions of simulation training were conducted in “In-Situ” at either Accident & Emergency Department (20, 20%) or Intensive Care Unit (15, 14%) and “Lab-based” for Isolation (30, 30%) and General Wards (36, 36%). 1,415 hospital staff members, including 1,167 nurses (82%), 163 doctors (12%) and 85 patient care assistants (6%), were trained. All domains of personal strengths were scored 4.24 or above and statistically significantly increased when comparing with reference population (p < .001). However, no significant differences between in-situ and lab-based simulation were found (p > .05), for all domains of personal strengths. CONCLUSION: Healthcare simulation training enhanced healthcare workers’ personal strengths critical to operational and clinical outcomes during the COVID-19 pandemic.

2 1. Introduction

A novel coronavirus (aka "COVID-19" or "SARS-CoV-2"), initially emerged in Wuhan Hubei Province in December 2019. At the end of the year, the Wuhan Municipal Health Commission reported that 27 unknown pneumonia cases had exposure to the Huanan Seafood Wholesales Market. On 20 January 2020, Prof. Zhong Nanshan, head of the Health Commission, affirmed that two pneumonia cases in Gongdong were infected through human-to-human transmission. On 23 January 2020, the first imported case from the mainland China was admitted to Queen Elizabeth Hospital (QEH) in Hong Kong Special Administrative Region (HKSAR).

Flashbacks of Severe Acute Respiratory Syndrome (SARS) were still vivid.

HKSAR occupied over 1-fifth of SARS cases (1755/8096), with 0.77 increased risk ratio of Case Fatality Rate (CFR) among 29 countries in 2003. 1, 2 Of 386 local Healthcare workers (HCWs) infected, 3 public and 2 private hospital medical officers, 1 nurse and 3 healthcare assistants have sacrificed their lives to safeguard public safety of Hong Kong during the epidemic. 3, 4 In the concurrent battle with COVID-19, local HCWs' safety and health conditions, physically and mentally, have been taken into consideration. Except more stringent infection control measures within hospital compounds, simulation training could be a hope for filling the knowledge gap and safeguarding psychological health and safety of HCWs. 5-9

Healthcare simulation training replicates any clinical scenarios in a safe environment, bridging between immersive experience, acquired skills, and insights from the training and clinical practice. 5 Not only had technical (e.g., cognitive and psychomotor skills in donning and doffing procedures of Personal Protective Equipment (PPE) in designated clean and dirty zone with buddy system) and non-technical skills (e.g., teamwork, leadership and communication among HCWs) enhanced, 7, 8, 10 simulation training, either "Lab-based" in simulation training center or "In-situ" in genuine clinical environment with highest environmental fidelity, could strengthen personal qualities critical in healthcare industries. 3, 6, 10, 11

Li and colleagues, 12 through a recent British Medical Journal (BMJ) editorial paper, highlighted escalating needs of exploring simulation training effects on healthcare providers themselves rather than existing findings over-emphasizing scientific values of clinical, epidemiological, and laboratory characteristics, infection and transmission dynamics, and effect of pharmacological interventions. Through the lens of positive psychology, we explored specific personal strengths of HCWs associated with personal, organizational, and community safety, including:

(1) Assertiveness ---speak-up behavior, 13 (2) Mental preparedness ---psychological capacity to response in high risk conditions towards resilience, 14 (3) Self-efficacy ---capacity to execute task-oriented behavior with self-confidence, 15 (4) Internal locus of control ---belief of clinical outcomes influenced by their action, not by chance 16 (5) Internal locus of responsibility ---self-motivated morality for patient care. 17 This crisis served as a precious opportunity for our center to explore i) whether in-situ simulation would J o u r n a l P r e -p r o o f 3 outweigh lab-based simulation in rating of personal strengths and ii) how simulation training brought prosperity to the society in Hong Kong. Recommendations regarding effective management approach of simulation training will be discussed as a wrap-up of this article.

Multi-disciplinary Simulation and Skills Centre (MDSSC), based in QEH, has been continuously improving quality and safety of hospital service through healthcare simulation. Fully accredited by the Society of Simulation in Healthcare (SSiH), our center is dedicated to facilitating innovations and exploring new frontiers in simulation-based learning and research.

Back in the late-January 2020, COVID-19 Taskforce was established under the leadership of high management and well-rounded support from administrative and clinical departments for the strategic direction and curriculum design on infection control training. The aim of this taskforce was to, through simulation training, unify and standardize hospital-wide practice and procedures to minimize contamination by and exposure to highly contagious COVID-19 pathogens during high risk procedures, such as Aerosol Generating Procedure (AGP) and endotracheal intubation. After a trial finalizing training materials and scenario setting, the first training class titled "Infectious Disease Practice Drill and Refresher Training (Novel Coronavirus)" was organized in early February 2020 (see Supplement 1).

To comply with infection control guidelines of Hospital Authority, Healthcare Workers (HCWs) in high-risk areas for suspected or confirmed cases of COVID-19 was required to attend this training. Target participants included anesthesiologists, Accident and Emergency (A&E) physicians and nurses, intensivists, medical physicians, surgeons, nurses and healthcare assistants from isolation wards, A&E, Intensive Care Unit (ICU), and general surgical and medical wards.

Any projects initiated by high management of Hospital Authority for education purposes are waived from ethical approval by the Research Ethics Committee (REC) of the Hospital Authority in Hong Kong. Therefore, ethical approval was not required for this study. In line with the MDSSC Standard Operation Procedures (SOP), all participants were required to complete a written informed consent on confidentiality issues and use of data, including but not limited to course evaluation, questionnaire, formal and informal feedback in written or verbal format, formative or summative assessment approved by respective steering committee, and audio-visual recording, for internal audit, education and research purposes prior to commencement of training sessions.

By the end of training sessions, one set of validated questionnaires was distributed to each participant to evaluate training effect. 18 Each item was measured on a 5-point Likert scale ranging from 1 "Strongly disagree" to 5 "Strongly agree". The questionnaire, with excellent inter-item reliability (Cronbach's α = .96), was categorized into 5 domains of personal strengths: i) assertiveness, ii) mental preparedness, iii) self-efficacy, iv) J o u r n a l P r e -p r o o f 4 internal locus of control, and v) internal locus of responsibility.

To examine the study hypothesis, participants were stratified into two groups: i) in-situ and ii) lab-based.

Independent sample t-tests were used for between-group comparison of population means of different pairs of personal strengths. One-sample t-tests were used to compare overall score of personal strengths with reference point of 3 for the general population of HCWs. All levels of alpha were set at .05 (two-tailed). The data were analyzed using IBM SPSS Statistics (Version 25.0, IBM Corp., 2017).

Kirkpatrick's model has been widely adopted to evaluate training processes and effects at different levels in healthcare and business setting. 19 With further advancement by Philips, 20 

Of 101 sessions carried out from 05 February 2020 to 18 March 2020, 1-third of simulation classes was held in-situ at respective departments (NAED = 20; NICU = 14) and 2-thirds was operated in our Simulation lab (NIsolation_ward = 30; NGeneral_ward = 36). Within this period under intense time and resources constraint, 1,415 hospital staff members, including 1,167 nurses (82%), 163 doctors (12%) and 85 patient care assistants (6%), were trained (see Table 1 ). Retrieved from training record, we acknowledged that participants were largely satisfied with the training program and learning objectives were met (see Fig. 1 

On volunteer basis, 1,200 out of 1,415 participants completed the questionnaire (Response rate = 85%). All domains of personal strengths, in terms of assertiveness, mental preparedness, self-efficacy, internal locus of control and responsibility, were scored 4.24 or above out of 5 (Excellent). Equal variance assumptions were examined and confirmed (p>.05, for all domains) by Levene's tests before data processing with t-tests.

Regarding between-group comparison of In-situ and Lab-based results, no significant differences were found (p>.05) for all domains. To compare participants' post-training scores with reference point, statistically significant differences were found (p<.001) for all domains (see Table 2 ). Figure 1 

In summary, this cross-sectional study showed that COVID-19 specific healthcare simulation training programs, both in-situ and lab-based, enhanced personal strengths of HCWs, in terms of assertiveness, mental preparedness, self-efficacy, internal locus of control and internal locus of responsibility, to a large extent. Since there were lacking in scientific investigation into relevant aspects of COVID-19 for the time being, we expand our discussion to clinical and organization impacts and strategic management approaches we used aligned with evidence-based medicine.

The lessons we learned from SARS strengthened HCWs' resilience and preparedness of the COVID-19 pandemic. Dr. Nguyen and colleagues 21 from Massachusetts General Hospital and Harvard Medical School reported that multivariate-adjusted Hazard Ratio (aHR) of COVID-19 was 11.5 times higher in HCWs in the UK; increased 4.45 times than those in the USA; and additively increased by 400% for those managing confirmed patients of COVID-19. 21 As of 10 June 2020, no HCW was infected with COVID-19; 1,054 out of 1,107 infected patients were discharged from local public hospitals in Hong Kong. Such magnificent figures reflected painstaking efforts of all stakeholders in local healthcare industry during the unprecedented crisis.

Assertiveness is one of the non-technical elements in Crew Resources Management (CRM) which has been embedded into our scenario-based training. 7, 8, 10 The training provided participants with immersive experience in revisiting proper donning/ doffing procedures of PPE and team-based management of AGP with clear role delineation. Throughout the training, "speak-up" culture formed in error-provoking environment could literally speed up participants' learning process, resulting in readiness and self-confidence to handle suspected and confirmed cases of COVID-19 in clinical setting. 5, 8 Uncertainty of the pathogens and fear of infection and death were detrimental to occupational health conditions of HCWs. 6, 14, 21 In addition to placebo-effect, debriefing sessions helped HCWs consolidate their understanding of the pathogens and pertaining practice with "take-home message" as trump card for maximizing HCWs' sense of control and responsibility for patient care in the COVID-19 pandemic. 8

Effective management strategies and validation of training materials are essential drivers of successful healthcare simulation training programs:

(1) Doctor-nurse ratio ≤ 1:5, addressing that nurses had greater training needs and were relatively prone to stress and fatigue 22 (2) Prioritizing training needs by" High-risk area first" policy (Isolation ward first, general ward the next) ICU staff, in-situ simulation could achieve the highest degree of environmental fidelity and provide optimal flexibility for trainers and trainees based on their availability. 23 For training of general ward and isolation ward, simulation training center would be much more appropriate for a balance between risk of infection control and occupancy of clinical operation. There was no evidence showing that levels of fidelity in simulation matter in this study. Regardless of training setting (in-situ or lab-based simulation), observers involved in scenario-based simulation and subsequent debriefing sessions have gained insights from the scenario and enhanced personal strengths as much as their counterparts who participated directly in the scenarios. 5, 8 Moreover, all training materials were reviewed by the Taskforce members in multidisciplinary manner; in particular specialists from Intensive Care Team (ICT) and Quality & Safety (Q&S) department, to ensure that all training components were aligned with hospital policy, algorithm for standard workflow, and international standards of practice (CDC guideline 24 ; AHA BLS guideline regarding COVID-19 for A&E Basic Life Support training 25 ).

The study showed promising evidence of how incorporating scenario-based simulation into infection control measures enhanced skills and knowledge acquisition and personal strengths of HCWs. Strengthened assertiveness on team collaboration, mental preparedness, self-efficacy under limited resources, internal locus of control and responsibility on designated clinical duty would probably lead to satisfactory clinical and organization outcomes. Limited empirical studies in related areas have necessitated researchers further investigating inter-factorial association and their long-term impacts on organization across healthcare disciplines.

We expect that person-centered principles and strategic approaches we recommend can be translational worldwide, expediting the return to normalcy in near future. 

Summary of probable SARS cases with onset of illness from

Epidemiology of SARS in the 2003 Hong Kong epidemic

Factors associated with mental health outcomes among health care workers exposed to coronavirus disease 2019

Chronology of the SARS Epidemic in Hong Kong

The use of simulation to prepare and improve responses to infectious disease outbreaks like COVID-19: Practical tips and resources from Norway, Denmark, and the UK

Psychological symptoms among frontline healthcare workers during COVID-19 outbreak in Wuhan

Covid-19: Using simulation and technology-enhanced learning to negotiate and adapt to the ongoing challenges in UK healthcare education

Anaesthesia simulation training during coronavirus pandemic: an 8

Precautions for Operating Room Team Members During the COVID-19 Pandemic

A comparative epidemiologic analysis of SARS in Hong Kong, Beijing and Taiwan

Preparing and responding to 2019 novel coronavirus with simulation and technology-enhanced learning for healthcare professionals: Challenges and opportunities in China

Evaluating the impact of an assertiveness communication training programme for Japanese nursing students: A quasi-experimental study

Psychological preparedness for the COVID-19 pandemic, perspectives from India

Health-specific self-efficacy scales

Locus of Control and COVID-19: The benefits of shifting our internal narrative in times of crisis

Individual Differences and Intelligence

Reinforcing assessment quality with professional standards in Sim-training center of public hospital

Kirkpatrick's four levels of training evaluation

Return on Investment in Training and Performance Improvement Programs

Risk of COVID-19 among frontline healthcare workers

Psychological responses to the SARS outbreak in healthcare students in Hong Kong

Preparedness for COVID-19: in situ simulation to enhance infection control systems in the intensive care unit

Interim infection prevention and control recommendations for patients with suspected or confirmed coronavirus disease 2019 (COVID-19) in Healthcare Settings

We would like to express our gratitude to the Hospital Authority Head Office (HAHO) and Queen Elizabeth Hospital (QEH) high management for their operational support to our simulation training; QEH Quality & Safety (Q&S) Department for their initiation for workforce establishment; Infection Control Teams 

The authors declared no conflict of interest.

The data of this study are available from the corresponding author on reasonable request. PCA 10 (4) 

