Abstract
Background
During the coronavirus disease 2019 pandemic, three-dimensional (3D) printing was utilized to rapidly produce face shields for frontline workers in response to an acute shortage of personal protective equipment (PPE). In this study, we examine the perceived utility and performance of 3D-printed (3DP) face shields through a survey of frontline workers in Ontario, Canada.
Methodology
Frontline workers who received community-produced 3DP face shields from the Canadian initiative “3DPPE GTHA” (March-December 2020) were invited to participate in the study. The survey response rate was 54.3%. Of 63 respondents, 39 were patient-facing and 24 were community-facing frontline workers. Participants were asked to rate performance measures in 10 categories on a five-point Likert scale. Data were categorized by organization and frontline worker type, and a t-test was used to determine statistically significant differences among subgroups.
Results
The mean preference for 3DP face shields among respondents was 3.2 out of 5 (95% confidence interval [CI]: 2.1-4.3). Community-facing respondents reported significantly greater overall utility scores for 3DP face shields (3.58, 95% CI: 3.38-3.79) compared to respondents working in a patient-facing profession (2.95, 95% CI: 2.77-3.13; p < 0.05). However, no differences were reported in portability and compatibility with other PPE. Respondents from organizations with large service volumes reported significantly lower overall utility scores (2.67, 95% CI: 2.44-2.89) than respondents in organizations with smaller service volumes (3.45, 95% CI: 3.28-3.62; p < 0.05).
Conclusions
Community-facing frontline workers and those from smaller service volume organizations endorse higher utility for 3DP face shields than patient-facing frontline workers. Despite this, frontline workers generally rate 3DP face shields positively. 3DP face shields are a viable option for personal and community use and can be used to supplement supply in a community setting.
Introduction
The emergence of the coronavirus disease 2019 (COVID-19) pandemic caused a sharp increase in the demand for medical resources on healthcare systems globally [1]. In Canada, rapidly increasing caseloads had impending downstream effects on healthcare systems and communities at large. This, coupled with disrupted supply chains, led to a sudden, acute shortage of supplies and, notably, personal protective equipment (PPE). Among the most urgent concerns was the need to provide adequate protection for high-risk groups such as frontline healthcare workers, for whom PPE is the most significant primary prevention from COVID-19 [2]. Scarcity of PPE during the early months of the COVID-19 pandemic led to rationing and recycling [3]. In the midst of this unexpected challenge, there arose an opportunity for grassroots initiatives to augment the production of PPE through the use of three-dimensional (3D) printing technology [4].
3D printing can enable rapid production of lightweight frameworks, such as face shields, ear savers, stethoscopes, and masks, with high levels of precision and design customization [5-7]. With access to open-source data, models that have been tested and approved can be utilized or modified to meet the needs of the users. The most common 3D-printed (3DP) face shield designs are universally sized and consist of two easy-to-assemble pieces [8,9]. Within Canada, the 3DPPE GTHA initiative was the largest not-for-profit program supplying over 25,000 3DP face shields to frontline organizations across the province of Ontario [10]. In this study, we examine the perceived utility of the 3DP face shields supplied by this initiative, with a focus on 10 categories, as reported through evaluations from frontline workers who received 3DP face shields. To the best of our knowledge, this study is the largest in the literature examining the perceived utility of 3DP face shields by a broad range of frontline workers and provides future direction for the development, production, and distribution of 3DP PPE.
Materials & Methods
The methodology was informed by the Checklist for Reporting Results of Internet E-Surveys (CHERRIES) guidelines and peer-reviewed guides on the assessment of the quality of online surveys (Appendix A) [11,12]. Ethics approval was obtained from the University of Toronto’s Research Ethics Board, Protocol #23085. Participants were informed of the study details, potential risks and benefits, confidentiality information, and their right to withdraw from participation. Written documentation of informed consent was completed by participants through an online form prior to survey completion. Survey responses were deidentified and separated from participant names.
Eligibility criteria and recruitment
Frontline workers who utilized 3DP face shields provided by 3DPPE GTHA for patient care or workplace safety from March to December 2020 were invited by email to participate in the research survey. From a decentralized collection of over 300 contacts, a total of 116 patient-facing and community-facing frontline workers were screened and selected by the study team based on the likelihood of response (i.e., known responders versus central inboxes) and heterogeneity of respondents. Attempts to reach participants were made up to three times.
Study design
Study participants had the opportunity to fill an online survey exploring their evaluation of the efficacy of 3DP face shields (Figures 1, 2) compared to conventional face shields (Figure 3) from December 20, 2021 to March 31, 2021 (Appendix B). The survey collected information about the work setting of respondents, including the type of facility, the number of healthcare workers within the organization, healthcare discipline, and volume of service. Items pertaining to the utility of 3DP face shields were generated by the committee, by the authors. Similar categories were combined and categories deemed irrelevant were dropped in consultation with the senior author (PRK). Survey items included 10 distinct characteristics such as comfort, visibility, durability, and protectiveness, as well as the cumulative assessment of preference for 3DP face shields compared to a conventional face shield (Table 1, Appendix C). Each item was rated on a Likert scale from 1 (worst) to 5 (best) on the survey scale with an option to answer n/a on any item.
Analysis
Means and 95% confidence intervals (95% CI) were calculated for each survey category outcome. The anonymized data collected from the survey were categorized by organization type, organization size, and worker type. Subgroups were defined as medical (i.e., patient-care oriented) versus nonmedical (i.e., community) organizations, large (i.e., organizations serving >200 clients/day) versus small organizations, and patient-facing versus community-facing frontline workers. A t-test was conducted to determine statistically significant differences in the subgroup analysis. A p-value of <0.05 was considered statistically significant. All data analysis was carried out using the StatTools software (Version 8.1, New York, United States). Incomplete responses were excluded from the dataset. There were no missing data.
Results
A total of 116 selected frontline workers from the 3DPPE GTHA recipient database were recruited with personalized email invitations to complete the survey. The overall survey response rate was 56.0%. Two incomplete responses (i.e., less than 20% of survey questions answered) were removed from the final analysis, resulting in a total of 63 unique responses to the survey and a final response rate of 54.3%.
Demographic characteristics of respondents
All 63 respondents were grouped into seven major organization types and nine major frontline worker types (Table 2). Organizations consisted of hospitals (n = 10), food banks (n = 7), outpatient medical clinics (n = 9), educational or day-care facilities (n = 6), dental clinics (n = 10), and first responders (n = 1). Frontline workers were grouped into medical frontline workers (n = 30) and community frontline workers (n = 33). Patient-facing frontline workers consisted of medical professionals such as physicians, nurses, pharmacists, dentists, and therapists. Community-facing frontline workers included those working in a community service environment not constituting patient care such as food banks, daycares, or shelters. Over half of all organizations (n = 34, 54%) had a client volume of 10 to 50 patients per day, while fewer had volumes of greater than 50 clients per day (n = 21, 33.3%) or less than 10 clients per day (n = 8, 12.7%).
Mean survey results
The mean scores of survey respondents for comfort, stability, visibility, durability, protectiveness, ease of assembly, portability, compatibility, ability to communicate, and overall preference are demonstrated in Figure 4 and Table 3. The mean preference for 3DP face shields among all respondents was 3.2 (95% CI: 2.1-4.3). The highest mean score for all respondents was 4.5 (95% CI: 3.8-5) for ease of assembly. The lowest mean score for all respondents was 3.1 (95% CI: 1.8-4.4) for visibility.
Subgroup analyses
Frontline workers from nonmedical organizations rated 3DP face shields more positively than frontline workers from medical organizations. Respondents from medical organizations found 3DP face shields inferior to conventional face shields in several categories, including comfort, stability, visibility, and sterile field compatibility (p < 0.05) and reported an overall preference toward conventional face shields compared to workers from nonmedical organizations (Table 4). The overall preference of 2.7 (95% CI: 2.54-2.86) for respondents from medical organizations was significantly lower than that of respondents from nonmedical organizations at 3.64 (95% CI: 3.44-3.83; p < 0.05).
Frontline Workers From Smaller Service Volume Organizations Rated 3DP Face Shields More Positively Than Larger Service Volume Counterparts
Frontline workers from large-volume organizations, which included hospitals and long-term care homes, had an overall preference of 2.67 (95% CI: 2.44-2.89) for 3DP face shields, which was significantly lower than 3.45 (95% CI: 3.28-3.62) as reported by respondents from smaller-volume organizations, which included outpatient clinics, pharmacies, and daycare facilities. Frontline workers from smaller organizations reported 3DP shields to be more favorable in terms of communication (p < 0.05) and protectiveness (p < 0.05), while frontline workers from larger organizations found shields easier to assemble compared to those from smaller organizations (p < 0.05) (Table 5).
Community-Facing Frontline Workers Found 3DP Face Shields Superior Compared to Patient-Facing Frontline Workers
Patient-facing respondents, who were categorized by their profession, included physicians, pharmacists, nurses, paramedics, and dentists. Staff or volunteers in daycare facilities, shelters, or food banks were considered community-facing as they primarily interacted with healthy individuals. The overall preference for respondents employed in patient-facing professions was 2.95 (95% CI: 2.77-3.13), which was significantly lower than respondents from nonpatient-facing professions at 3.58 (95% CI: 3.38-3.79). T-test analysis revealed that patient-facing respondents found 3DP face shields to be less preferred than conventional face shields compared to community-facing respondents (p < 0.05) (Table 6). Community-facing respondents had significantly higher ratings for comfort, stability, visibility, durability, and protectiveness (p < 0.05).
Discussion
3D printing technology has been increasingly used during the COVID-19 pandemic to produce medical supplies including PPE. Early in the pandemic, there was an increased focus on innovative but simple designs for 3DP face shields among researchers across the globe. Several of these designs were shared on open-source communities and eventually underwent review by the National Institutes of Health for use in the clinical setting [8,9]. The 3DPPE GTHA initiative opted to produce the popular 3DVerkstan face shield design and distributed face shields to healthcare facilities across Ontario, Canada [9,10]. While the use of 3DP face shields by frontline workers has increased exponentially, there remains a paucity of literature evaluating utility outcomes of 3DP PPE to date. One study by Wierzbicki et al. has examined the use of 3D printing to rapidly produce various open-source face shields for healthcare workers [5,6]. Sapoval et al. adapted the open-source PRUSA design and investigated the use of the face shield in a procedural setting, assessing for visual comfort and tolerance among interventional radiologists [13]. The authors found good acceptance of 3DP face shields within their realm of practice. The present study is the largest in the literature reporting on the broad utility of 3DP face shields about 10 outcomes, as rated by a range of Canadian frontline workers.
Professions that routinely require personal protective equipment preferred conventional face shields
Our results demonstrate that 3DP face shields were perceived more positively by community-facing frontline workers than patient-facing frontline workers (Tables 4, 6). For example, there were significantly higher ratings by community-facing workers in categories of comfort, stability, protectiveness, and visibility. These findings may be attributable to the familiarity medical workers have with conventional face shields due to their routine use of this type of equipment before the COVID-19 pandemic. As such, the expectations of clinical workers may have been higher, or they may have been more alert to how 3DP models deviate from conventional face shields. Additionally, there may be differing expectations for the level of protectiveness required from the PPE medical frontline workers utilized as a result of the level of COVID-19 transmission risk associated with their roles. Differing expectations of the level of protection provided by PPE are exacerbated by the stress healthcare workers experience amid uncertainty about the mode of transmission of severe acute respiratory syndrome coronavirus 2 and fear due to lack of industry-grade PPE [14,15]. These perceptions may explain the higher preference for 3DP face shields by community-facing frontline staff and nonmedical organizations compared to their clinical counterparts. Smaller service volume organizations provided lower ratings for ease of assembly, which is an unexplained finding, but it remains possible that larger organizations such as hospitals had personnel available to help distribute and assemble face shields.
Considerations and barriers to implementation
3DP PPE may help meet individual or local needs during supply shortages. During the COVID-19 pandemic, various grassroots initiatives successfully mobilized individuals of varying skill levels, from academics and professionals to hobbyists, to provide thousands of 3DP face shields to healthcare facilities and organizations. The print job can be completed with standard, cost-friendly printers and available open-source designs such as the one assessed in this study (i.e., 3DVerkstan) [9]. Printing open-source designs requires some computer literacy but not extensive technical or design expertise. 3DP face shields are also comparatively more simple to print than complex designs such as nasal swabs [16]. With access to 3D printers, individuals and organizations would have the capacity to rapidly prototype and manufacture tens to hundreds of face shields on demand and reduce lag time for organizations to access PPE during times of high strain on supply chains.
While 3D printers are cheap and readily available, the inability to complete quality testing and safety assessment remains a barrier to mainstream use. In comparison to conventional face shields, 3DP face shields do not undergo rigorous testing to ensure adequate droplet protection. Current 3D printing technology is most suitable for rapid prototyping and assessing the feasibility of proof-of-concept designs as opposed to manufacturing large volumes of prints. Therefore, 3D printing alone would not suffice in meeting the demands of PPE for large organizations, which may require hundreds of new face shields daily. Given these challenges, and the differences in rating between larger, clinical versus smaller community organizations, we find that smaller and independent community-facing organizations with a fixed need for PPE will benefit most from the use of 3DP face shields.
Limitations
This study had several limitations. First, the results of this survey relate to one particular 3DP face shield model, 3DVerkstan, distributed to frontline workers in Ontario, Canada. Although the most common designs are similar in concept, some outcomes may not be generalizable to other 3DP models. Second, our survey population is not a random sample as those surveyed were particularly recipients of the 3DPPE GTHA face shield donations who received donations upon request. Third, without data on specific professions and work duties (i.e., professional subspecialties and exposure), a multitude of frontline workers were self-identified and ultimately categorized upon the conclusion of the data collection phase by researchers into broad groups such as “medical” versus “nonmedical.” This classification was necessary as the study analysis required a broad distinction between the two groups. Despite these limitations, this study is one of very few in the current literature [2,3] reporting on outcomes of frontline workers using 3DP face shields.
Conclusions
The community response toward COVID-19 has yielded an increase in the use of 3D printing to produce PPE. While numerous studies have reported the use of 3D printing for PPE, the present study is the largest in the literature survey of frontline workers demonstrating that, in general, nonmedical frontline workers and organizations appraised 3DP face shields more favorably than medical frontline workers. Reasons for this may include differing expectations for levels of protectiveness and comfort, as well as prior familiarity with conventional equipment. Relatively higher utility ratings from community-facing frontline workers, and potential barriers to high-volume, quality-controlled 3D printing, suggest that 3DP face shields are most suitable for use in independent, community organization settings. Furthermore, during potential shortages of PPE, an effective strategy may involve the distribution of community-manufactured 3DP face shields to nonclinical organizations while conventional face shields are allocated to hospitals and other large clinical facilities. Further study in this area may provide insights on optimizing the utility of community contributions.
References
- Vordos N, Gkika DA, Maliaris G, Tilkeridis KE, Antoniou A, Bandekas DV, Ch Mitropoulos A: How 3D printing and social media tackles the PPE shortage during Covid - 19 pandemic. Saf Sci. 2020, 130:104870. 10.1016/j.ssci.2020.104870
- Galanis P, Vraka I, Fragkou D, Bilali A, Kaitelidou D: Impact of personal protective equipment use on health care workers' physical health during the COVID-19 pandemic: a systematic review and meta-analysis [In Press]. Am J Infect Control. 2021, 10.1016/j.ajic.2021.04.084
- Bauchner H, Fontanarosa PB, Livingston EH: Conserving supply of personal protective equipment-a call for ideas. JAMA. 2020, 323:1911. 10.1001/jama.2020.4770
- Miller DG, Pierson L, Doernberg S: The role of medical students during the COVID-19 pandemic. Ann Intern Med. 2020, 173:145-6. 10.7326/M20-1281
- Wierzbicki J, Nowacki M, Chrzanowska M, et al.: Additive manufacturing technologies enabling rapid and interventional production of protective face shields and masks during the COVID-19 pandemic. Adv Clin Exp Med. 2020, 29:1021-8. 10.17219/acem/126296
- Pavlosky A, Glauche J, Chambers S, Al-Alawi M, Yanev K, Loubani T: Validation of an effective, low cost, free/open access 3D-printed stethoscope. PLoS One. 2018, 13:e0193087. 10.1371/journal.pone.0193087
- Tarfaoui M, Nachtane M, Goda I, Qureshi Y, Benyahia H: 3D printing to support the shortage in personal protective equipment caused by COVID-19 pandemic. Materials (Basel). 2020, 13:3339. 10.3390/ma13153339
- Prusa: Prusa3D - open source 3D printers by Josef Prusa. (2021). Accessed: August 5, 2021: https://www.prusa3d.com/.
- 3DVerkstan: 3D-printed protective visor. (2021). Accessed: August 5, 2021: https://3dverkstan.se/protective-visor/.
- Zhang PC, Ahmed Y, Hussein IM, Afenu E, Feasson M, Daud A: Optimization of community-led 3D printing for the production of protective face shields. 3D Print Med. 2020, 6:35. 10.1186/s41205-020-00089-y
- Burns KE, Kho ME: How to assess a survey report: a guide for readers and peer reviewers. CMAJ. 2015, 187:E198-205. 10.1503/cmaj.140545
- Eysenbach G: Improving the quality of Web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J Med Internet Res. 2004, 6:e34. 10.2196/jmir.6.3.e34
- Sapoval M, Gaultier AL, Del Giudice C, et al.: 3D-printed face protective shield in interventional radiology: evaluation of an immediate solution in the era of COVID-19 pandemic. Diagn Interv Imaging. 2020, 101:413-5. 10.1016/j.diii.2020.04.004
- Spoorthy MS, Pratapa SK, Mahant S: Mental health problems faced by healthcare workers due to the COVID-19 pandemic-a review. Asian J Psychiatr. 2020, 51:102119. 10.1016/j.ajp.2020.102119
- Aranaz-Andrés JM, McGee-Laso A, Galán JC, Cantón R, Mira J, On Behalf Of The Team Of Work Covid-: Activities and perceived risk of transmission and spread of SARS-CoV-2 among specialists and residents in a third level university hospital in Spain. Int J Environ Res Public Health. 2021, 18:2838. 10.3390/ijerph18062838
- Zastrow M: Open science takes on the coronavirus pandemic. Nature. 2020, 581:109-10. 10.1038/d41586-020-01246-3
Appendices
Appendix A: Checklist for Reporting Results of Internet E-Surveys (CHERRIES)
Appendix B: Survey questions
This survey should take five minutes to complete. Your responses are anonymous. Your name will be kept separate from your survey responses, only for the purposes of documenting informed consent.
Appendix C: Category descriptors
Note: Photographs of the 3DP and conventional face shield are provided below for your reference.
Comfort
The highest rating (5) would mean that while using the 3D printed (3DP) face shield, it did not cause you any pain over a period of your usual daily use. You may have forgotten about its presence. It did not create pressure points, pinches, sharp pricks, etc. that caused you discomfort. The lowest rating (1) would indicate the opposite, such that you would want to remove it as soon as possible due to discomfort.
Stability
The highest rating (5) would mean that the 3DP face shield barely or did not at all feel that it would fall off of your head during your usual daily use. The lowest rating (1) would indicate that you have severe, constant difficulty keeping it in place.
Visibility
The highest rating (5) would mean that the 3DP face shield barely or did not at all disrupt your ability to see your client/work environment. The lowest rating (1) would indicate that the visor blurred, distorted, or otherwise affected your ability to see clearly. Please avoid the effect of fogging as participants may have had variability in masks.
Durability
The highest rating (5) would mean that the 3DP face shield in your view was sturdy and would not “fall apart” with use over a period of days to weeks. The lowest rating (1) was that you were concerned that the 3DP face shield was fragile such that it may not stay intact or become unusable after few or multiple uses.
Protectiveness
The highest rating (5) would mean that you had the highest degree of confidence that the 3DP shield would protect you from incoming large droplets of bodily fluids. The lowest rating (1) would indicate that you had very little faith that the 3DP face shield being able to protect you from large droplets and the use of the shield would expose you to incoming large droplets of bodily fluids.
Ease of assembly/Disassembly
The highest rating (5) would mean that the assembly or the disassembly of the plastic visor component to the 3DP face shield frame was efficient and came with a low cost of time. The lowest rating (1) would indicate that it took significant effort and time to put the two components together to a level beyond practical use.
Portability
The highest rating (5) would mean that the 3DP face shield in its assembled form was easily transported for use from the supply. The lowest rating (1) indicates that the 3DP face shield was highly difficult to transport the face shield in its assembled form.
Ability to communicate
The highest rating (5) would mean that verbal communication while wearing the face shield allows you to have clear and audible conversations. The lowest rating (1) would indicate that your attempts of communication while wearing the 3DP face shield were ineffective or nonaudible.
Compatibility with other PPE (masks, caps, etc.)
The highest rating (5) would mean that you could easily put on the 3DP face shield while wearing other forms of PPE on your head such as face masks, N95 masks, or surgical scrub caps. The lowest rating (1) indicates that you struggled greatly when attempting to wear the 3DP face shield while also donning other forms of PPE.
Sterile field compatibility
The highest rating (5) would mean that you were comfortable using the 3DP face shield during a sterile procedure. The lowest rating (1) would indicate that you were highly concerned that the 3DP face shield would contaminate sterile equipment or surfaces.
Relative face shield preference
A rating of 5 would mean that, if given the choice, you would strongly prefer a 3DP face shield for your daily activities over the conventional face shield (e.g., a face shield with an elastic band and foam headband pictured below). A rating of 1 would indicate that if given the choice, you would strongly prefer a conventional face shield for your daily use over the 3DP face shield. A rating of 3 would indicate that you have no preference or that you would equally prefer either one.
3D-Printed Personal Protective Face Shields During the COVID-19 Pandemic: A Survey of Canadian Frontline Workers
Ethics Statement and Conflict of Interest Disclosures
Human subjects: Consent was obtained or waived by all participants in this study. University of Toronto Office of Research Ethics issued approval 23085. Animal subjects: All authors have confirmed that this study did not involve animal subjects or tissue. Conflicts of interest: In compliance with the ICMJE uniform disclosure form, all authors declare the following: Payment/services info: The University of Toronto COVID-19 Initiatives Grant was received to support research costs associated with the 3DPPE GTHA initiative for a total amount of CAD $3,000. Financial relationships: All authors have declared that they have no financial relationships at present or within the previous three years with any organizations that might have an interest in the submitted work. Other relationships: All authors were volunteer members of the now concluded 3DPPE GTHA grassroots not-for-profit initiative. No personal benefits in any form have been received or will be received from a commercial party related directly or indirectly to the subject of this article.
Acknowledgements
We acknowledge the contributions of the professional and undergraduate students from McMaster University and the University of Toronto who belong to the 3DPPE GTHA team, in alphabetical order: Hassaan Abdel-Khalik, Andy Afenu, Junaid Ahmad, Juweiriya Ahmed, Yazad Bhatena, Fowad Daud, Kashif Daud, Arjan Dhoot, Sophie Emerson, Manon Feasson, Heba Hussein, Lanujan Kaneswaran, Maroof Khalid, Maham Khalid, Carlos Khalil, John Kim, Alysha Laviolette, Lucia Lee, David Lee, Maria Leis, Tiange Li, Shah Malik, Chris McChesney, Miranda McDermott, Sagar Patel, Danny Quan, Mahsa Rad, Sinthu Senthillmohan, Samveg Shah, Harris Sheikh, Max Solish, Gaurav Talwar, Kartikay Tyagi, Danning Zhang, Michael Zon. Most importantly, the authors wish to extend our endless gratitude to the front-line healthcare workers who are risking their lives to protect citizens in the fight against COVID-19.
Article Information
DOI
10.7759/cureus.18141
Cite this article as:
Daud A, Hussein I M, Zhang P, et al. (September 20, 2021) 3D-Printed Personal Protective Face Shields During the COVID-19 Pandemic: A Survey of Canadian Frontline Workers. Cureus 13(9): e18141. doi:10.7759/cureus.18141
Publication history
Peer review began: September 03, 2021
Peer review concluded: September 18, 2021
Published: September 20, 2021
Copyright
© Copyright 2021
Daud et al. This is an open access article distributed under the terms of the Creative Commons Attribution License CC-BY 4.0., which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
License
This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
3D-Printed Personal Protective Face Shields During the COVID-19 Pandemic: A Survey of Canadian Frontline Workers
Figures etc.
RATED BY 2 READERS
CONTRIBUTE RATINGScholarly Impact Quotient™ (SIQ™) is our unique post-publication peer review rating process. Learn more here.