Abstract Title
Measuring Cognitive Load in Hybrid Simulations of Venous Catheter Insertion

Authors

Cavalcanti
Rodrigo B; Devine
Luke; Lee
Christie; Stroud
Lynfa

Theme

Simulation

INSTITUTION

University of Toronto

Background

Simulation is an effective platform for teaching procedural skills.  In particular, hybrid simulation (HS) is useful in training for complex procedural skills, especially for intermediate to advanced learners. Cognitive load measure can help tailor scenarios to an individual's level of expertise.  However, data is lacking on how to assess cognitive load in hybrid simulation. We aimed to test the utility of the NASA-TLX measure of workload in assessing HS scenario difficulty.

 

 

 

 

 

Summary of Work

Ten senior residents in General Internal Medicine participated in two HS scenarios in ultrasound-guided (US) central venous catheter (CVC) insertion. Simulations required insertion of a CVC into a rubber part task trainer affixed to a standardized patient (SP), while interacting with the SP and a standardized nurse, and monitoring the patient’s clinical status and ECG.  Two scenarios with increasing complexity were designed.  Scenario 1 included a minor arrhythmia during CVC insertion.  Scenario 2 required addressing severe hypotension and an arrhythmia.  Workload was measured with the NASA-TLX tool, and clinical performance was graded using validated checklists. 

References

1. Nestel, D., Groom, J., Eikeland-Husebø, S. & O?Donnell, J. M. Simulation for Learning and Teaching Procedural Skills. Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare 6, S10–S13 (2011).

2. Ziv, A., Wolpe, P. R., Small, S. D. & Glick, S. Simulation?Based Medical Education: An Ethical Imperative. Academic Medicine 78, 783 (2003).

3. van Merrienboer, J. J. G. & Sweller, J. Cognitive load theory in health professional education: design principles and strategies. Med Educ 44, 85–93 (2010).

4. Hart, S. G. Nasa-Task Load Index (NASA-TLX); 20 Years Later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50, 904–908 (2006).

5. Stroud, L. & Cavalcanti, R. B. Hybrid Simulation for Knee Arthrocentesis: Improving Fidelity in Procedures Training. J Gen Intern Med (2013). 

Acknowledgement

We wish to thank Karen Delaney Laupacis - Standardized Patient Program, and Lisa Satterthwaite - Surgical Skills Lab, both at the University of Toronto, for their invaluable assistance in this project.

Summary of Results

 

 

 

 

 

The figure indicates the reported total worload per scenario for alll 10 participants.  NASA-TLX workload results ranged from 27-87 (from possible 6 -120), increasing on average 16 points (range 5-35) between scenarios 1and 2.  Differences were similar regardless of scenario sequence. However three trainees (Res 5, 6 and 9) experienced technical difficulties with Scenario 1 resulting in higher workload.  Major sources of workload were  temporal demand, frustration, mental and physical demand. As in prior studies, NASA TLX workload and procedural performance did not correlate (r=-0.03). 

Conclusion

NASA-TLX workload was correlated with scenario difficulty.  Sources of workload include both physical and mental measures.  This is similar to previous clinical studies using NASA TLX.  In conclusion, Retrospective analysis of workload using NASA TLX correlates with scenario complexity in this hybrid simulation exercise.

 

 

Take-home Messages

Measuring CL can help tailor simulation exercises, by adjusting scenario difficulty to individual trainees’ proficiency. NASA-TLX domains appear to capture CL appropriately in hybrid simulation.

 

Determining cognitive load during simulation scenarios with the TLX tool may thus enhance learning.

Background

 

Simulation-based teaching for procedural skills is useful in facilitating the application of knowledge and practice of psychomotor skills in a safe environment.[1]  By allowing the acquisition of expertise through deliberate practice, procedural simulation also improves patient safety.[2]  

Bench top models are useful in helping novice learners acquire adequate psychomotor skills to perform a procedure correctly and safely. However, there is a need for simulation to provide more experienced trainees with appropriate challenges and enhance their expertise. By identifying a trainee’s level of expertise one is able to aim at the zone of proximal development and enhance their acquisition of new skills. Cognitive load theory [3] can be used as a framework to understand to what degree a particular simulation exercise challenges an individual trainee.

Hybrid simulation (HS) combines the use of benchtop models and simulated patients, and is useful in training for complex procedural skills.  In particular, it can help enhance the communication skills –with both patients and other health professionals- required for successful procedures. In order to understand individual trainees experiences to a HS exercise, we investigated the utility of measuring workload using the NASA-TLX instrument. 

 

 

Summary of Work

We developed a hybrid simulation platform for ultrasound-guided (US) central venous catheter (CVC) insertion. The exercise required insertion of a CVC into a rubber part task trainer affixed to a standardized patient (SP), while interacting with the SP and a standardized nurse, and responding to the patient’s clinical status and ECG-monitoring. 

Two scenarios with increasing levels of difficulty were developed by three clinicians: In scenario 1, halfway through the CVC insertion (when the guide wire was threaded into the vein) the ECG monitor alarm would indicate frequent premature ventricular beats (PVCs). Trainees were expected to interact with the ‘standardized nurse’ and withdraw the guidewire slightly, thus eliminating the PVCs.  In scenario 2, halfway through the CVC insertion the monitor would indicate a decrease in blood pressure to 70/50 mmHg.  The trainee was then required to intervene with intravenous fluids or vasopressors to improve the blood pressure while completing the CVC insertion. Scenario 2 was felt to be of higher difficulty, as inserting the CVC is an important step in treating the patients low blood pressure, thus making successful placement of the catheter a more pressing need. 

After informed consent, ten senior internal medicine trainees (postgraduate year 4) were randomized to go through both scenarios in either sequence (Sc 1 followed by Sc2 or Sc2 followed by Sc1).  After completing each scenario, trainees were given feedback and then asked to complete a NASA-TLX instrument (Fig 1).[4]  

References
Acknowledgement
Summary of Results
Conclusion

We found that NASA-TLX measures of total workload correlated with scenario difficulty as designed.  Significant variability was seen between residents.  The components of NASA-TLX showing greatest variability This suggests  NASA-TLX provides a useful quantitative anchor of scenario difficulty not captured by checklist performance.  Workload measures such as the NASA-TLX may allow improved learning through modulation of scenario difficulty and cognitive load.  Our future work will aim at appropriately increasing scenario difficulty based on initial workload measures.

Take-home Messages
Send ePoster Link