"Never doubt that a small group of thoughtful, committed citizens can change the world. Indeed, it is the only thing that ever has."

Margaret Mead
Original article
peer-reviewed

Prompting Paramedics: The Effect of Simulation on Paramedics’ Identification of Learning Objectives



Abstract

Introduction: Simulation has emerged as a useful educational tool for the continued training of paramedics. Practicing paramedics are thought to learn through reflecting on their own actions in practice, and it is hoped that simulation could spur similar reflection, which could then lead to practice change. Despite this, there is limited data on how these practitioners use simulated experiences to set learning objectives. This study aimed to explore how simulation training affects self-identification of learning objectives in emergency medical services (EMS) providers (a.k.a. paramedics).

Methods: Paramedics (primary care and advanced care) participated in a 30-minute simulated learning session. All participants filled out pre-post surveys identifying their own learning objectives immediately before and after the simulation. An inductive qualitative analysis of these responses were conducted by two authors (EJ, TC) using an interpretive description approach, yielding a list of key themes commonly found in the learning objectives. Pre-post learning objectives were individually compared by the level of specificity as determined by the authorship team. Simple descriptive statistics were generated to describe the number of times that the paramedics’ learning objectives became more or less specific, different, or same.

Results: Thirty-five paramedics who completed the simulation and survey were included. Four major themes emerged in the learning objectives: 1) assessment and diagnostic; 2) communication and collaboration; 3) integration of knowledge; and 4) treatment and management. After simulation, the learning objectives became more specific in 6 (17.1%), less specific in 3 (8.6%), different in 22 (62.9%), and remained same in 4 (11.4%).

Conclusion: Simulation training shows promise in refining perceived learning needs. The results from this study offer insight into paramedics’ self-identification of learning objectives and gaps pre-post simulation experiences. Understanding the underlying psychology of paramedics participating in simulation may help educators better understand how to guide reflection and continuous improvement.

Introduction

Continuing professional development (CPD) is an integral part of lifelong learning that healthcare providers are taught to practice. CPD allows for the enhancement of knowledge and skills, which ultimately improve clinical performance and patient outcomes. Current state of CPD however, is largely characterized by traditional didactic lectures which have been shown to be ineffective in producing changes in practice [1]. Interventions using interaction-based educational methods have shown to be more effective in improving learning than those using didactic methods [2-3]. Other interventions, such as clinical practice feedback, has been met previously with resistance - since feedback about real cases can be perceived as unsafe and possibly threatening [4]. Understanding what continuing medical education (CME) tools are most effective in fostering knowledge retention and application is therefore critical in improving clinical outcomes.

The use of simulation has emerged as a valuable tool in the continued medical training of paramedics and remains a widespread topic of research contributing to CME improvement [5,6-10]. Simulation is often considered a ‘safe space’ in which professionals or trainees can seek to maintain their skills [11-12]. In particular, simulation-based training has been specifically recommended for training in emergency medicine [13] or paramedicine [5]. Simulation-based learning environments provide learners with opportunities to practice their skills and develop clinical confidence in a controlled environment [14]. In simulation scenarios where the cases and goals are known in advance, participants are encouraged to set objectives as a guiding tool to determine if their learning goals have been achieved following the completion of the simulation experience [15]. Simulation, along with the subsequent debriefing and feedback, is rooted in the learning theories of experiential learning and self-reflection. Effective simulation activities are designed from the ground up to promote self reflection. Simulation, therefore, provides a fertile ground for stimulating self-reflection and guided improvement.

Despite the prevalence of simulation in continuing education, there is limited research on how simulated experiences affect the setting of learning objectives and goals. The primary aim of this study was to determine if short simulated experiences could prompt paramedics to modify their self-identified learning objectives. The secondary aim of this study was to identify common themes in the learning objectives set out by paramedics participating in simulated experiences.

Materials & Methods

Participants

Participants of this study consisted of EMS providers undergoing simulation training at a Canadian university as part of the Centre for Paramedic Education (CPER) Annual Practice Review (APR) course. This APR course is an annual event, and all participants had previous experience with simulation either as a paramedic trainee or as part of their ongoing CPD. Participation in the study was voluntary and written informed consent was obtained from all participants. This study was approved by the Hamilton Integrated Research Ethics Board. 

Study design

All participants completed a two-part survey as part of this study. A baseline pre-simulation survey was administered immediately prior to the simulation training, and a post-simulation survey was given immediately following the simulation training. The pre-simulation survey was completed while the participant paramedics were awaiting their annual simulation training event. This pre-simulation survey included questions regarding participant demographics, self-assessment of perceived knowledge/skills, and self-identification of learning objectives pertaining to the targeted simulation training scenario. The post-simulation survey consisted of the same questions as the pre-simulation survey, with additional questions to determine if they felt their own learning objectives were achieved after completing the simulation training.

Data analysis

Survey responses were de-identified then recorded onto a Microsoft Excel spreadsheet. De-identified survey responses were reviewed by the investigatory team members (TC, EJ) to identify themes in the participants’ learning objectives. Based on the theme of each learning objective from pre-simulation to post-simulation, participants were categorized into one of four groups describing the change in specificity of the learning objectives: “more specific”, “less specific”, “same” or “different”. Learning objectives were considered to have become “more specific” if the post-simulation learning objectives themes remained the same as the pre-simulation, but modified with more granular descriptions (e.g., talked about a smaller portion of a broader topic). Learning objectives were considered to have become less specific if the post-simulation learning objectives themes remained the same as the pre-simulation, but modified with more general descriptions or specifications. Learning objectives were considered to be “same” if post-simulation learning objectives remained unchanged from the pre-simulation learning objectives. If the post-simulation learning objectives themes were different than the pre-simulation learning objectives, they were classified under “different”. Simple descriptive statistics were used to describe the participant demographics and the changes in participants' learning objectives from pre-simulation to post-simulation.

Results

A total of 44 paramedics participated in the simulation training. Nine participants did not complete the survey and were lost to follow-up, resulting in a study sample of 35. The demographics of the study participants are described in Table 1.

Demographic Descriptor Value
Mean age (SD) 36.8 (9.1)
Gender (% female) 59 (41%)
Level of training (n) ACP (10), PCP (34)
Mean number of years of service (SD) 10.7 (7.7)
Mean number of years of simulation training experience (SD) 10.7 (6.7)

There were four major themes that were identified in the learning objectives, which included assessment and diagnostic, communication and collaboration, integration of knowledge, and treatment and management. The frequency of each theme in the pre and post-simulation learning objectives is reported in Table 2.

  Overall frequency out of 35 respondents (%) Example Quotes
Theme Pre-simulation Post-simulation
Assessment and Diagnostic 34.3 (12) 42.9 (15) “Familiarization with patient presentation, learning algorithms, and drug dosages.”   “Doing a thorough assessment of patient medications and how they contribute to illness or injury.”
Communication and Collaboration 8.6 (3) 8.6 (3) “[Participate in] interactive group learning review.”   “Better teamwork.”
Integration of Knowledge 42.9 (15) 28.6 (10) “Practice in a controlled environment of information reviewed today.”   “To practice skills and [improve] comfort level.”
Treatment and Management 14.3 (5) 20 (7) “Recognition of med overdose, hyperkalemia treatment, and management of the altered patient.”   “Management of trauma in the elderly and management of unstable patients.”

After the completion of the simulated training, 63% of the learning objectives became “different”, 17% became “more specific”, 11% became “less specific”, and 9% remained the same. The changes in the specificity of learning objectives from pre to post-simulation is shown in Figure 1.

Discussion

Simulation is becoming an increasingly common tool for paramedics and emergency medicine trainees to maintain and enhance their skills. Simulation acts to bridge the gap between knowledge acquisition and clinical practice, and actively engages the learner in cognitive, behavioural, and emotional dimensions.

In this study, we investigated how simulation training affects self-identification of learning objectives in EMS providers. Results demonstrated that 89% of participants refined or changed their learning objectives after a simulated learning experience, as indicated by learning objectives which became more specific, less specific, or different. This suggests that simulation training was effective in generating self-reflection. Interestingly, a change in the specificity of learning objective from pre-simulation to post-simulation was observed in 63% of the participants. A possible explanation for this finding is that many participants were unable to set relevant or realistic learning objectives prior to the simulation training, resulting in a change in the learning objective theme. Overall, this suggests that not only does simulation training effectively prompt learners to engage in self-reflection, but also provide insight into the poor baseline ability of professionals to self-assess accurately, as demonstrated in the literature [16].

The secondary aim of this study was to identify major themes in the learning objectives set out by the paramedics before and after the simulated scenario. Participants of simulation training are encouraged to set and define relevant learning objectives that thematically complement the competencies that they desire to improve prior to participating in the simulated scenario. Throughout simulation, participants self-generate feedback which allow them to refine their previous learning objectives so that they can become more relevant for future learning experiences [15]. In this current study, the major themes identified in the learning objectives were: 1) assessment and diagnostic; 2) communication and collaboration; 3) integration of knowledge; and 4) treatment and management.

Prior to the simulation training, integration of knowledge was the most commonly identified competency theme comprising of 42.9% of total participants, followed by assessment and diagnostic (34.3%). After the simulation training, the most common learning objective theme was assessment and diagnostic (42.9%) followed by integration of knowledge (28.6%). This may suggest that a substantial number of participants initially hoped to use the simulation training experience primarily as a means to integrate and apply their knowledge, rather than to acquire knowledge on assessment, diagnosis, and management of the patient. However, during the simulation, it may have been that the experience revealed new knowledge gaps that prompted them to reflect and refine their learning objectives after the simulation.

Findings from this study show promise that simulation training can provide paramedics with improved guidance for self-assessment as well as transfer of learned skills to practice. Learners should be aware that learning objectives identified before simulation training may change post-simulation. Studies show that simulation participants who were better at assessing their own learning were able to retain more information post-simulation and ultimately better equipped to transfer what they learned into another representation [17-18]. Participants should ensure that they use simulation to identify new gaps in their knowledge and understanding.

For educators facilitating simulation training sessions, they should encourage participants to actively reflect by setting learning goals both before and after simulation experiences. Educators may also consider facilitating debriefing sessions to help guide goal setting. Doing so would encourage commitment to change in learners, as suggested in prior studies in the CPD and CME literature [17-18]. It may also be beneficial for simulation curriculum designers to consider how they might cycle back to these post-simulation objectives. Effective curricular integration via targeted spaced repetition [19] may allow simulation educators to harness the true power of simulation for mastery learning [20]. Educators could use the refined, post-simulation learning objectives to redefine the next simulation objective with that same participant. This type of educational practice might help with converting one-off simulations into a form of continuously, personal quality improvement.

Conclusions

This study suggests that simulation can be a valuable tool for facilitating objective-setting for practicing paramedics, especially when incorporated into a continuing professional development opportunity. Our results show promise that goal setting and identification after simulation can facilitate objectives setting for future practice change. Educators should consider facilitating debriefing sessions, as well as prompting learners to actively set learning goals to encourage commitment to change.


References

  1. Forsetlund L, Bjørndal A, Rashidian A, et al.: Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2009, 10.1002/14651858.cd003030.pub2
  2. Mansouri M, Lockyer J: Effect of a performance improvement CME activity on medical education effectiveness. J Contin Educ Health Prof. 2015, 33:155-163.
  3. Marinopoulos SS, Dorman T, Ratanawongsa N, et al.: Effectiveness of Continuing Medical Education. AHRQ Publication, 2007.
  4. Morrison L, Cassidy L, Welsford M, Chan TM: Clinical performance feedback to paramedics: what they receive and what they need. AEM Educ Train. 2017, 1:87-97. 10.1002/aet2.10028
  5. McKenna KD, Carhart E, Bercher D, Spain A, Todaro J, Freel J: Simulation use in paramedic education research (super): a descriptive study. Prehospital Emerg Care. 2015, 19:432-440. 10.3109/10903127.2014.995845
  6. Takayesu JK, Nadel ES, Bhatia K, Walls RM: Incorporating simulation into a residency curriculum. Can J Emerg Med. 2010, 12:349-353. 10.1017/S1481803500012458
  7. Meguerdichian DA, Heiner JD, Younggren BN: Emergency medicine simulation: a resident’s perspective. Ann Emerg Med. 2012, 60:121-126. 10.1016/j.annemergmed.2011.08.011
  8. von Wyl T, Zuercher M, Amsler F, Walter B, Ummenhofer W: Technical and non-technical skills can be reliably assessed during paramedic simulation training. Acta Anaesthesiol Scand. 2009, 53:121-127. 10.1111/j.1399-6576.2008.01797.x
  9. Shah MI, Carey JM, Rapp SE, et al.: Impact of high-fidelity pediatric simulation on paramedic seizure management. Prehospital Emerg Care. 2016, 20:499-507. 10.3109/10903127.2016.1139217
  10. Dyson K, Bray JE, Smith K, Bernard S, Straney L, Finn J: Paramedic resuscitation competency: a survey of Australian and New Zealand emergency medical services. Emerg Med Australas. 2017, 29:217-222. 10.1111/1742-6723.12715
  11. Rudolph JW, Raemer DB, Simon R: Establishing a safe container for learning in simulation the role of the presimulation briefing. Simul Healthc. 2014, 9:339-349. 10.1097/SIH.0000000000000047
  12. Jimoyiannis A, Tsiotakis P, Roussinos D, Siorenta A: Preparing teachers to integrate Web 2.0 in school practice: toward a framework for Pedagogy 2.0. Australasian Journal of Educational Technology. 2013, 29:248-267.
  13. Bond WF, Lammers RL, Spillane LL, et al.: The use of simulation in emergency medicine: a research agenda. Acad Emerg Med. 2007, 14:353-363. 10.1197/j.aem.2006.11.021
  14. Gaba DM: The future vision of simulation in healthcare. Simul Healthc. 2007, 2:126-135. 10.1097/01.SIH.0000258411.38212.32
  15. Rosen M, Salas E, Silvestri S, Wu T, Lazzara E: A measurement tool for simulation-based training in emergency medicine: the simulation module for assessment of resident targeted event responses (SMARTER) approach. Simul Healthc. 2008, 3:170-179. 10.1097/SIH.0b013e318173038d
  16. Eva K, Regehr G: “I’ll never play professional football” and other fallacies of self-assessment. J Contin Educ Health Prof. 2008, 28:14-19. 10.1002/chp.150
  17. Wakefield J, Herbert CP, Maclure M, et al.: Commitment to change statements can predict actual change in practice. J Contin Educ Health Prof. 2005, 23:81-92. 10.1002/chp.1340230205
  18. Wakefield JG: Commitment to change: exploring its role in changing physician behavior through continuing education. J Contin Educ Health Prof. 2004, 24:197-204. 10.1002/chp.1340240403
  19. Kang SHK: Spaced repetition promotes efficient and effective learning: policy implications for instruction. PIBBS. 2016, 3:12-19. 10.1177/2372732215624708
  20. McGaghie WC: Mastery learning: It is time for medical education to join the 21st century. Acad Med. 2015, 90:1438-1441. 10.1097/ACM.0000000000000911
Original article
peer-reviewed

Prompting Paramedics: The Effect of Simulation on Paramedics’ Identification of Learning Objectives


Author Information

Jeremy Hernandez

Emergency Medicine, William Osler Health Sciences Centre, Mcmaster University, Brampton, CAN

Eric S. Jeong

Emergency Medicine, Schulich School of Medicine and Dentistry, University of Western Ontario, London, CAN

Teresa M. Chan Corresponding Author

Emergency Medicine, McMaster University, Hamilton, CAN


Ethics Statement and Conflict of Interest Disclosures

Human subjects: Consent was obtained by all participants in this study. Hamilton Integrated Research Ethics Board issued approval 2015-0276-GRA. We received research ethics approval (2015-0276-GRA) for this study.
. Animal subjects: All authors have confirmed that this study did not involve animal subjects or tissue. Conflicts of interest: In compliance with the ICMJE uniform disclosure form, all authors declare the following: Payment/services info: All authors have declared that no financial support was received from any organization for the submitted work. Financial relationships: Dr. Teresa Chan declare(s) employment from Hamilton Health Sciences Centre for Paramedic Education and Research. Salary as a base-hospital physician. Dr. Teresa Chan declare(s) a grant from Physician Services Incorporated Foundation. For unrelated research. Dr. Teresa Chan declare(s) a grant from McMaster University. Internal career and project grants for other unrelated research. Drs. Jeremy Hernandez and Teresa Chan declare(s) employment from McMaster University. Receive salary from McMaster University. Other relationships: All authors have declared that there are no other relationships or activities that could appear to have influenced the submitted work.

Acknowledgements

The authorship team would like to thank the students and paramedics who contributed to this research.


Original article
peer-reviewed

Prompting Paramedics: The Effect of Simulation on Paramedics’ Identification of Learning Objectives


Figures etc.

SIQ
-
RATED BY 0 READERS
CONTRIBUTE RATING

Scholary Impact Quotient™ (SIQ™) is our unique post-publication peer review rating process. Learn more here.