Abstract
Evidence has demonstrated that the use of dynamic ultrasound guidance (USG) for central venous catheter (CVC) significantly decreases attempts, failures, and complication rates. Despite national organizations recommending the use of USG and its increasing availability, USG is used inconsistently and non-uniformly. We sought to determine if an online training module for CVC insertion with ultrasound guidance will improve acquisition and long-term retention of knowledge and skills for attending physicians. Participants were tested for declarative knowledge and skills on a simulator (pre-test) for ultrasound-guided CVC insertion at baseline. They then completed an online learning module followed by an immediate post-test and a six-month retention test. There were 16 attending physicians who participated in the study. The CVC training module increased declarative knowledge acquisition and retention. No significant difference in simulated CVC performance was found over the three time points.
Introduction
Central venous catheters (CVC) are inserted by multiple medical practitioners both electively and urgently [1]. Traditionally, CVCs have been inserted using a technique utilizing only external anatomic landmarks. The success rate is highly dependent on physician experience and knowledge of the underlying anatomy. This landmark technique has a significant complication rate that varies from 2%-19% and may be as high as 40% if cannulation failure is included [2]. Evidence has demonstrated that the use of dynamic ultrasound guidance (USG) for CVC significantly decreases attempts, failures, and complication rates by 57%-78% when compared to using the landmark technique [3]. USG-CVC is also faster to insert than traditional landmark techniques [4]. As a result, a number of medical societies (i.e., the American College of Chest Physicians, the British National Institute of Clinical Excellence, the Agency for Healthcare Research and Quality, and the College of Physicians and Surgeons of Ontario Patient Safety Review Committee) have issued guidelines in support for real-time ultrasound use with CVC insertion.
Despite national organizations recommending the use of USG and its increasing availability, USG is used inconsistently and non-uniformly. A recent survey of cardiovascular anesthesiologists in North America found that 66% of respondents never or rarely used ultrasound for CVC insertion and only 15% used it systematically [2]. Continuing professional development is effective to learn USG-CVC, but mannequin-based training may be cumbersome and challenging to organize [5]. Online USG-CVC may be appealing but does not allow the practice of skills.
Our study’s USG-CVC intervention focuses on the continuing professional development of the faculty and aims to train attending physicians using an online learning module. We aimed to measure the effect of an online CVC learning module on (i) USG-CVC declarative knowledge acquisition and retention, as measured by a written test, and (ii) CVC skill performance on a part-task trainer for CVC insertion, as measured using CVC checklist and global rating scores. Skill and knowledge measurements were made before and after the educational intervention to determine the extent of learning, as well as several months after the intervention to determine potential attrition of skills.
Materials & Methods
The study was a single blinded prospective interventional repeated measures study trial with three time measurements. This trial was approved by the Ottawa Health Science Network-Research Ethics Board (OHSN-REB) at the Ottawa Hospital Research Institute, Ottawa, Canada (#20120722-01H). Written informed consent was obtained from all study participants. Each subject acted as their own control, as each underwent repeated measurements of their USG-CVC declarative knowledge and skill performance. This manuscript adheres to the Transparent Reporting of Evaluations with Nonrandomized Designs (TREND) guideline.
All attending physicians from departments of The Ottawa Hospital who routinely perform CVC insertions were invited to participate in the study on a volunteer basis. These included physicians in Anesthesiology, Critical Care, Emergency Medicine, and Internal Medicine. Investigators were excluded from participating. A member of the investigative team contacted their respective departments; the information was then forwarded to potential participants. The interested participants scheduled a study time with the research staff.
CVC declarative knowledge (a multiple choice written test) and skills (simulated insertion) were measured at three time intervals. On the day of the online CVC course, all subjects completed a demographic questionnaire and pre-test (knowledge and skills) prior to the completion of the online course. Participants then took a 2.5-hour online course based on the CAE-ICCU USG-CVC curricula (www.caeiccu.com, CAE Healthcare, Montreal, Canada) [6]. Upon completion of the course, the participants were assessed for knowledge and skills in an immediate post-test. No feedback on any of the tests was provided. Six months after the completion of the course, the participants completed a retention test (knowledge and skills).
The online CAE-ICCU curriculum for CVC insertion using USG covers all of the relevant anatomy and imaging considerations [6]. It also includes training on the 'Assessment of Central and Peripheral Vessels' including both diagnostics and intervention. Study investigators reduced the CAE-ICCU course from 5.5 hours to 2.5 hours to make the time commitment more appropriate to study participants. To ensure that participants had access to the full curricula, they were provided with a complete license upon completion of the retention test.
We used the following performance measures:
Declarative knowledge tests: The repeated global declarative knowledge test included 20 multiple-choice questions that are clinically oriented to test the multiple dimensions of USG-CVC taken from the CAE-ICCU Learning Management System.
CVC skill performance tests: Participants demonstrated USG-CVC insertion into the right internal jugular vein on a part-task trainer for CVC insertion (Central Line Man Training Package with Articulating Head, SimuLab Corporation, Seattle WA, USA) and using a L38 linear transducer (5-10MHz) with a SonoSite M-Turbo ultrasound machine (FUJIFILM SonoSite Inc., Bothell, WA, USA). The CVC mannequin included an upper torso with an articulating head. A research assistant used a built-in hidden hand pump to simulate blood flow. Performances were videotaped without audio and framed to blind the physician's identity. Two CVC blinded experts, from another university, independently assessed each test performance using established metrics for procedural skills. A modified, previously validated CVC checklist and global rating scale (GRS), excluding the item for ‘use of assistants’, were used to assess the CVC insertion [7]. After the initial independent assessment, raters met to agree on a consensus for each scored item that had more than 1 point difference between the 2 raters. The average score was used when the difference between the raters was one or less.
We assessed the following outcomes:
Declarative knowledge was measured at three distinct intervals: pre-test prior to the online course, immediate post-course test, and retention test six months after the completion of the online training.
CVC skill performance was measured on a simulated part-task trainer at three distinct intervals: pre-test, immediate post-course test, retention test six months after completion of the online training.
Considering a moderate effect size of 0.5 (Cohen's d) as per common effect of educational intervention, an α risk of 0.05 and power of 0.95, a total sample size of 16 subjects was necessary to detect acquisition of knowledge and skills (i.e., one group with two measurements - pre-test and immediate post-test) and 12 subjects were necessary to detect retention of knowledge and skills (i.e., one group with three measurements - pre-test, immediate post-test, and retention test) [8].
Knowledge test scores, checklist scores, and global rating scores were analyzed to detect differences in knowledge and skills at the three time points using a one-way repeated measure ANOVA followed by a post-hoc analysis if significant.
Results
A total of 17 participants completed day one, which included the pre-tests, training, and immediate post-tests. One participant did not complete the retention tests six months later. Our total sample size included in the analysis was 16 physicians (knowledge and CVC skill performance at pre-test, immediate post-tests, and retention test). Demographic details can be found in Table 1.
Declarative knowledge:
One-way repeated measures ANOVA for knowledge test data suggests that there is a significant difference (F(30,2)=42.0, P<0.005) between pre-test, immediate post-test, and retention test (Table 2). Post-hoc analysis (Bonferroni) suggests that participants improved significantly from pre-test to immediate post-test (p<0.005) following the CVC training module. Participants also increased from pre-test to retention test (p=0.035) but decreased from immediate post-test to retention test (p<0.005) (Table 2).
CVC skill performance:
Using the modified CVC checklist (10 points), there was no significant difference between the test phases (F(30,2)=0.77, P=0.47) (Table 2). Using the GRS for procedural skills (30 points), there was no difference between the test phases (F(30,2)=0.55, P=0.58) (Table 2).
Discussion
This study suggests that attending physicians have the capacity to learn and retain declarative knowledge from an online CVC training module but without any significant changes on simulation-based testing for CVC insertion at multiple time points. A ceiling effect may partially explain the lack of effect on the checklist score (pre-test score of 88%). However, regarding the GRS score, a ceiling effect is unlikely with a pre-test score of 68%. Although no definitive threshold of competency exists for the CVC checklist and GRS scores, the post-tests skill performance indicates room for improvement even after online training with 75% and 70% on the immediate post-test and retention GRS scores, respectively. Studies recruiting residents found comparable post-tests performance around 80% [7]. Studies recruiting attending physicians have demonstrated the effectiveness of training on CVC skills but baseline performance was often extremely poor [5,9]. However, all these studies included some level of deliberate practice, i.e., simulation practice and feedback, that was absent from our online course.
Conclusions
Overall, our findings support the use of online CVC training to improve the CVC declarative knowledge of physicians. Deliberate practice may be necessary to complement online training to successfully reach a virtually perfect level in CVC skills for attending physicians.
References
- Feller-Kopman D: Ultrasound-guided internal jugular access: a proposed standardized approach and implications for training and practice. Chest. 2007, 132:302–309. 10.1378/chest.06-2711
- Bailey PL, Glance LG, Eaton MP, Parshall B, McIntosh S: A survey of the use of ultrasound during central venous catheterization. Anesth Analg. 2007, 104:491–497. 10.1213/01.ane.0000255289.78333.c2
- Lalu MM, Fayad A, Ahmed O, et al.: Ultrasound-guided subclavian vein catheterization: a systematic review and meta-analysis. Crit Care Med. 2015, 43:1498-1507.
- Hind D, Calvert N, McWilliams R, et al.: Ultrasonic locating devices for central venous cannulation: meta-analysis. BMJ. 2003, 327:361. 10.1136/bmj.327.7411.361
- Nguyen BV, Prat G, Vincent JL, et al.: Determination of the learning curve for ultrasound-guided jugular central venous catheter placement. Intensive Care Med. 2014, 40:66–73. 10.1007/s00134-013-3069-7
- CAE-ICCU: CAE. www.caeiccu.com. 2013, Accessed: March 29/2016: https://www.caeiccu.com.
- Woo MY, Frank J, Lee AC, et al.: Effectiveness of a novel training program for emergency medicine residents in ultrasound-guided insertion of central venous catheters. CJEM. 2009, 11:343–348.
- Cook DA, Hatala R: Got power? A systematic review of sample size adequacy in health professions education research. Adv Health Sci Educ Theory Pract. 2015, 20:73. 10.1007/s10459-014-9509-5
- Werner HC, Vieira RL, Rempell RG, Levy JA: An educational intervention to improve ultrasound competency in ultrasound-guided central venous access. Pediatr Emerg Care. 2016, 32:1–5. 10.1097/PEC.0000000000000664
Interactive Online Learning for Attending Physicians in Ultrasound-guided Central Venous Catheter Insertion
Ethics Statement and Conflict of Interest Disclosures
Human subjects: Consent was obtained by all participants in this study. Ottawa Health Science Network-Research Ethics Board issued approval 20120722-01H. Animal subjects: All authors have confirmed that this study did not involve animal subjects or tissue. Conflicts of interest: In compliance with the ICMJE uniform disclosure form, all authors declare the following: Payment/services info: This research was supported by a 2011-2012 The Ottawa Hospital Academic Medical Organization (TOHAMO) Innovation Grant provided by the Ontario Medical Association (OMA) and the Ontario Ministry of Health and Long-Term Care (MOHLTC). During this research, Dr. Boet was supported by The Ottawa Hospital Anesthesia Alternate Funds Association. The granting agency had no role in the study design, in the collection, analysis, and interpretation of data; in the writing of the manuscript; or in the decision to submit the manuscript for publication. The M-Turbo ultrasound was provided in kind by FUJIFILM SonoSite Inc. FUJIFILM Sonosite that had no role is any aspect of the study.
. Financial relationships: All authors have declared that they have no financial relationships at present or within the previous three years with any organizations that might have an interest in the submitted work. Other relationships: All authors have declared that there are no other relationships or activities that could appear to have influenced the submitted work.
Acknowledgements
The authors thank Sam Caldbick and K. Ivy Salter for their assistance with data collection, Haytham Qosa for his assistance with preparing the study, and Devin Sydor and Jim Worthington for their initial contribution to the protocol.
Article Information
DOI
10.7759/cureus.1592
Cite this article as:
Boet S, Thompson C, Woo M Y, et al. (August 22, 2017) Interactive Online Learning for Attending Physicians in Ultrasound-guided Central Venous Catheter Insertion. Cureus 9(8): e1592. doi:10.7759/cureus.1592
Publication history
Received by Cureus: June 21, 2017
Peer review began: July 05, 2017
Peer review concluded: August 15, 2017
Published: August 22, 2017
Copyright
© Copyright 2017
Boet et al. This is an open access article distributed under the terms of the Creative Commons Attribution License CC-BY 3.0., which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
License
This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Interactive Online Learning for Attending Physicians in Ultrasound-guided Central Venous Catheter Insertion
Figures etc.
RATED BY 1 READER
CONTRIBUTE RATINGScholarly Impact Quotient™ (SIQ™) is our unique post-publication peer review rating process. Learn more here.