Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Understanding the barriers and facilitators of vaccine hesitancy towards the COVID-19 vaccine in healthcare workers and healthcare students worldwide: An Umbrella Review

  • Jemma Louise McCready,

    Roles Data curation, Formal analysis, Methodology, Writing – original draft

    Affiliation Department of Social Work, Education and Community Wellbeing, Faculty of Health and Life Sciences, Northumbria University, Newcastle upon Tyne, United Kingdom

  • Bethany Nichol,

    Roles Data curation, Formal analysis, Validation, Writing – review & editing

    Affiliation Department of Social Work, Education and Community Wellbeing, Northumbria University, Newcastle upon Tyne, United Kingdom

  • Mary Steen,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Department of Nursing, Midwifery and Health, Faculty of Health and Life Sciences, Northumbria University, Newcastle upon Tyne, United Kingdom

  • John Unsworth,

    Roles Conceptualization, Funding acquisition, Writing – review & editing

    Affiliation Department of Nursing, Midwifery and Health, Faculty of Health and Life Sciences, Northumbria University, Newcastle upon Tyne, United Kingdom

  • Dania Comparcini,

    Roles Data curation, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Politecnica delle Marche University of Ancona, Ancona, Italy

  • Marco Tomietto

    Roles Conceptualization, Funding acquisition, Methodology, Project administration, Resources, Supervision, Writing – review & editing

    marco.tomietto@northumbria.ac.uk

    Affiliations Department of Nursing, Midwifery and Health, Faculty of Health and Life Sciences, Northumbria University, Newcastle upon Tyne, United Kingdom, Research Unit of Nursing Science and Health Management, University of Oulu, Oulu, Finland, University of Bari “Aldo Moro”, Bari, Italy

Abstract

Background

Healthcare workers (HCWs) and healthcare students display high levels of vaccine hesitancy with impact on healthcare provision, patient safety, and health promotion. The factors related to vaccine hesitancy have been reported in several systematic reviews. However, this evidence needs to be synthesised, as interventions to reduce vaccination hesitancy in this population are needed.

Methods

This Umbrella Review aimed to explore the barriers and facilitators of vaccine hesitancy toward the COVID-19 vaccine for HCWs and healthcare students. The review was performed and reported in accordance with Joanna Briggs Institutes guidelines and the Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) guidelines. A protocol was preregistered on PROSPERO (CRD42022327354). Eight databases were searched from November 2019 to 23rd May 2022 to identify any systematic reviews that explored factors associated with hesitancy towards the COVID-19 vaccine for HCWs or healthcare students.

Results

A total of 31 studies were included in the review. The majority of studies (71%) were appraised as strong or moderate quality and there was a slight degree of overlap (<5%) of primary studies between the reviews. Vaccine hesitancy was more common among HCWs and healthcare students in specific occupational roles (e.g. nurses) than others (e.g. physicians). Frequent reasons for hesitancy were related to sociodemographic factors (gender, age, ethnicity), occupational factors (COVID-19 exposure, perceived risk, mandatory vaccination), health factors (vaccination history), vaccine-related factors (concerns about safety, efficacy, side-effects, rapid development, testing, approval and distribution of the vaccine), social factors (social pressure, altruism and collective responsibility), distrust factors (key social actors, pandemic management), information factors (inadequate information and sources, exposure to misinformation).

Conclusion

The results from this Umbrella Review have wide-reaching implications for the research area, healthcare systems and institutions and governments worldwide. Designing tailored strategies for specific occupational groups is pivotal to increasing vaccine uptake and securing a safe healthcare provision worldwide.

1. Introduction

A delay or refusal to get vaccinated despite the availability of vaccines, also known as vaccine hesitancy, is considered one of the top ten threats to global health by the World Health Organization (WHO) [1]. Reasons for hesitancy are complex and are driven by both an individual’s perceptions and attitudes towards a particular vaccine or vaccines in general, their sociodemographic characteristics (e.g. gender, ethnicity) and contextual factors (e.g. trust in experts, perceived risk) [2]. The indecision and uncertainty about vaccination are amenable to change should emerging concerns be addressed adequately [3]. The importance of understanding the factors driving vaccine hesitancy has become increasingly apparent throughout the current global outbreak of coronavirus disease 2019 (COVID-19). As COVID-19 spread around the globe and the number of active infections and death tolls increased, the need for a vaccine to fight the pandemic became increasingly more critical. However, the rapidity of vaccine development and approval and concerns regarding the vaccine’s safety, effectiveness and side effects have contributed to a lack of vaccine confidence and lower vaccination uptake rates in the general population [4].

Research has identified that healthcare workers (HCWs) and healthcare students are one such sub-group which are displaying considerable hesitancy towards accepting a COVID-19 vaccine. For example, a review exploring the prevalence of hesitancy in more than 75,000 HCWs worldwide found that a fifth of professionals were reluctant to accept a COVID-19 vaccine [5]. For healthcare students, rates of hesitancy were found to mimic those of practising professionals, whereby nearly a fifth of healthcare students (~20,000 students across 39 countries) were also hesitant to accept a COVID-19 vaccination [6]. The high rates of hesitancy in this population are of significant concern for several reasons. Firstly, HCWs and healthcare students are at an increased risk of contracting the virus, which would result in greater staff absence at a time when healthcare is in greater demand [7]. Secondly, HCWs and healthcare students are more likely to be a vector of the virus, transmitting infections to clinically vulnerable patients, the elderly, family members and colleagues, increasing active infections [8]. Furthermore, vaccination recommendations from HCWs have been shown to increase vaccine acceptance in the general population [9, 10]. Therefore, understanding the factors contributing to vaccine hesitancy and implementing effective strategies to tackle this problem is pivotal in reducing the transmission of COVID-19, increasing vaccination uptake in the general population, and maintaining a safe healthcare provision. Over the last 18 months, there has been a rapid growth of primary studies exploring factors associated with COVID-19 vaccine hesitancy for this population in various countries worldwide. As a result, numerous systematic reviews and meta-analyses have also been conducted between the years 2020 and 2022. However, these reviews failed to provide conclusive and univocal evidence on the COVID-19 vaccine acceptance rate, by reporting a variation from 41.84% [29] to 80.41% [45] in HCWs and from 53.85% [29] to 82.37% [35] in healthcare students. Moreover, when systematic reviews and meta-analyses on the same topic are conducted and published in the same years, there is a greater risk of inconclusive results, which, therefore, may have consequences for the clinical decision-making process at both individual and organizational levels. As intervention strategies depend upon this evidence, despite the several reviews published on the topic, there is a need to compile evidence from previously published systematic reviews and meta-analyses to provide an overview of the topic. Therefore, an Umbrella Review will be undertaken to synthesize evidence on the factors associated with hesitancy and acceptance of the COVID-19 vaccine for HCWs and healthcare students. Additionally, suggestions to address the identified drivers will be discussed.

2. Methods

A systematic literature search was performed and reported in accordance with the Joanna Briggs Institutes (JBI) guidelines for Umbrella Reviews [11]. The Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) guidelines were utilised to report the results [12]. A protocol was registered with PROSPERO prior to the commencement of the review (registration no: CRD42022327354). The search strategy and syntax were peer-reviewed by an expert librarian using the Peer Review of Electronic Search Strategies (PRESS) checklist [13] and modifications were implemented prior to the commencement of searches.

2.1 Eligibility criteria

The inclusion and exclusion criteria are outlined in Table 1. Studies were eligible for inclusion if they: (i) conducted a systematic review (with or without meta-analysis); (ii) included primary sources utilising a quantitative methodology; (iii) investigated factors related to COVID-19 vaccine hesitancy or vaccine uptake; (iv) included a population or subpopulation of HCWs or healthcare students aged between 18–65 years; (v) were published after 2019 (due to the nature of the topic); (vi) and published in the English language. This review will include peer-reviewed and pre-printed material due to the fast nature of the research surrounding the COVID-19 pandemic. Other non-peer-reviewed material will be excluded (e.g. letters to editors, opinion pieces, commentaries).

thumbnail
Table 1. Inclusion and exclusion criteria for eligibility in the review.

https://doi.org/10.1371/journal.pone.0280439.t001

2.2 Information sources and search strategy

A systematic search was conducted on the following databases: CINAHL, Cochrane Library, PubMed, ProQuest (COVID-19 Database and International Bibliography of Social Sciences (IBSS)), ScienceDirect, Web of Science, Google Scholar and Epistemonikos. Databases were searched from November 2019 up to 23rd May 2022. The search syntax (Table 2) was entered into the databases as free text rather than MeSH terms. Boolean operators and truncation were utilised if supported by the database. The reference lists of included papers were hand-searched to identify citations not retrieved in the initial searches.

2.3 Selection of sources of evidence

All retrieved citations were imported into EndNote and duplicates were removed per the de-duplication process proposed by Bramer and colleagues [14]. The remaining articles were exported to an EndNote-generated XML file format and uploaded into Rayyan, which was used to facilitate screening processes [15]. The titles and abstracts of all retrieved citations were independently screened for eligibility against the inclusion criteria (JM). A random allocation of 10% of citations was screened by a second reviewer (BN). Inter-rater agreement, assessed using Cohen’s Kappa (κ), was considered to be ‘good’ (κ = 0.61; 95% CI 0.48–0.74) [16]. Full-texts for the eligible citations were retrieved and independently screened for relevance to the review aim (JM). A second reviewer (BN) independently screened a random allocation (25%) of full-texts for eligibility. The inter-rater agreement for full-text screening was considered to be ‘moderate’ (κ = 0.41; 95% CI 0.07–0.76) [16]. Disagreements were resolved by a third reviewer (MT). In this study, the inter-rater agreement was satisfactory. For this reason and according to the guidelines [16], the random allocation of 10% of citations has been considered adequate for screening.

2.4 Assessment of methodological quality

Methodological quality of the reviews was assessed using the JBI Critical Appraisal Checklist for Systematic Reviews and Research Syntheses [17]. The 11-question checklist was used to assess the possibility of bias in three areas of the review: 1) design (i.e. explicitness of review questions, appropriateness of inclusion criteria and search strategy, adequacy of search sources and appropriateness of critical appraisal tool); 2) conduct (i.e. minimisation of bias during critical appraisal processes and data extraction and assessment of publication bias); and 3) analysis (i.e. appropriateness of synthesis, support for policy recommendations and appropriateness of research directives) [17]. The quality ranking framework, devised by Kilich and colleagues [18], was used to score and interpret the quality of the reviews. The 4-item response scale was scored as follows: ‘yes’ = 2 points, ‘no’ = -2 points, ‘unclear’ = -1 point and ‘not applicable’ = 0 points. Scores were summed to derive a total score which was used to categorise the review as either ’very low quality’ (<0), ’low quality’ (0 ≤—< 5), ’moderate quality’ (5 ≤—< 10) or ’strong quality’ (≥ 10) [18]. As the aim of an umbrella review is to provide a comprehensive overview of the literature [11, 17], results from the quality assessment were not used to define inclusion or exclusion as the methodological standards for a systematic or a scoping review were assured for each paper included. Accordingly, the inclusion and exclusion criteria focused on the research aim and questions of this umbrella review [17]. One reviewer (JM) conducted the critical appraisal assessment in full and a random allocation of 10% of the reviews was critically appraised by the second reviewer (BN). Both reviewers conducted the quality assessment independently and discrepancies were resolved by a third reviewer (MT).

2.5 Assessment of overlap

The degree to which the included reviews contained the same primary studies was assessed using the Corrected Covered Area (CCA) method recommended by Pieper and colleagues [19]. An excel sheet was created which cross-linked the individual reviews with all of the primary publications included in the reviews. Tick marks were used to indicate which reviews included which primary studies. Only the primary studies relating to HCWs, or healthcare students were included in the assessment, as including primary studies irrelevant to the review aim (e.g. for other populations) would result in an inaccurate estimation of the degree of overlap. The total number of primary studies (N), total number of unique primary studies (R) and the number of reviews included (C) were used to calculate the CCA ((N–R)/((RxC)–R)). The CCA score was interpreted as follows: 0–5 = ‘Slight overlap’; 6–10 = ‘Moderate overlap’; 11–15 = ‘High overlap’; and >15 = ‘Very high overlap [19].

2.6 Data collection

The JBI Data Extraction Form for Review of Systematic Reviews and Research Syntheses [11] was used to capture the following data: study details (author/year, objectives, participants (characteristics/total number), setting/context, description of interventions/phenomena of interest), Search details (sources searched, search date range, date range of included studies), descriptive details of the included studies (number of studies, types of studies, country of origin), Critical appraisal details (appraisal instruments used, appraisal rating) and Analysis (method of analysis, outcome assessed, results/findings, significance/direction, heterogeneity).

One reviewer (JM) independently extracted the required data from the included articles into the data extraction form created in Excel. Another research team member (BN) independently extracted data from a random subset (10%) of the included articles. Both data extraction forms were cross-checked for accuracy and discrepancies were resolved by a third reviewer (MT).

2.7 Data summary

Firstly, tabular summaries describing the characteristics of the included reviews and the sociodemographic characteristics of the participants were created. Secondly, the results from the reviews were thematically analysed to identify patterns across the evidence base. The determinants of vaccine hesitancy and acceptance were organised into categories (e.g. sociodemographic factors, vaccine-specific factors) and narrative summaries for each population group were produced.

3. Results

3.1 Selection of included studies

The search strategy generated 12,774 citations, of which 11,191 were unique. Following title and abstract screening, 11,125 citations were eliminated as they did not meet the initial inclusion criteria. Full-text screening was conducted on 66 papers and 39 were excluded. Main reasons for exclusion were that the review did not include populations of interest (e.g. HCWs or healthcare students), vaccination of interest (e.g. COVID-19), outcomes of interest (e.g. barriers of facilitators of vaccine hesitancy) or were of an unsuitable publication type (e.g. letters to editors, commentaries). Hand-searching the reference lists of the 27 eligible reviews identified 15 citations of interest; however, after full-text screening, only 1 citation was eligible for inclusion. Monitoring of database search alerts for 30 consecutive days identified an additional three eligible articles. A total of 31 reviews met the inclusion criteria and were included (Fig 1).

thumbnail
Fig 1. PRISMA flowchart [12] detailing the identification and selection of research syntheses for inclusion in the Umbrella Review.

https://doi.org/10.1371/journal.pone.0280439.g001

3.2 Characteristics of included studies

Characteristics of the included reviews are outlined in Table 3. Of the 31 reviews included, 27 were published as peer-reviewed journal articles, three were published on pre-print servers [2022] and one was a peer-reviewed pre-proof [23]. There were eight systematic reviews and meta-analyses [2431], 16 systematic reviews [20, 21, 3240] (five categorised as rapid [4145]), six scoping reviews [5, 22, 4649] and one integrative review [23]. All reviews included quantitative, cross-sectional primary studies, while three included longitudinal study designs [32, 35, 45] and one included mixed-method surveys [45]. Nineteen reviews were published in 2021 and 12 in 2022, which captured primary studies published from February 2020 to August 2021 [31]. Nine reviews were published in Asia (China [26, 28, 42], Jordan [32], Thailand [33], Malaysia [27], Bangladesh [29], Pakistan [40], Iran [41]), eight in the USA [5, 23, 30, 36, 43, 45, 47, 48], seven in Europe (Italy [35, 38], The Netherlands [22, 49], Greece [25], Czech Republic [37], Slovakia [31]), six in Africa (Ethiopia [21, 34, 39], Ghana [24], Nigeria [44], Burkina Faso [20]) and one in Canada [46]. Of the 31 reviews, 14 assessed the methodological quality of the primary studies included in their review. Commonly used appraisal tools were the JBI critical appraisal tool for cross-sectional studies [25, 27, 29, 30, 42] and the Newcastle-Ottawa scale (NOS) for cross-sectional studies [21, 24, 26, 39]. Where used, a large proportion of the primary studies were assessed as ‘high to moderate quality’ (JBI tool) or as ‘low to moderate risk of bias’ (NOS tool).

thumbnail
Table 3. Main characteristics of studies included in the Umbrella Review.

https://doi.org/10.1371/journal.pone.0280439.t003

3.3 Characteristics of participants

The sociodemographic characteristics of the populations included in the reviews are outlined in Table 4. Nine reviews focused on HCWs [5, 2225, 28, 34, 42, 48], three reviews focused on healthcare students [26, 27, 31] and 19 included a mixed population either containing a subset of HCWs [21, 30, 32, 33, 41, 43, 44, 47, 49] or subsets of both HCWs and healthcare students [20, 29, 3540, 45, 46]. There was large variability in occupational roles reported for the HCWs, but Physicians, Nurses, Dentists, Pharmacists, Midwives, Physiotherapists and General Practitioners were the most commonly cited occupational roles across the reviews. The most frequently reported trainee courses for healthcare students were dentistry, nursing and medicine. The total sample size (where reported) for HCWs was 639,699 (Range = 1941–76,741) and for healthcare students the total number of participants was 70,711 (Range = 934–19,123). Of the 11 reviews reporting sex distributions, all 11 reported a female predominance (>50%) of participants in their primary studies [2327, 3335, 38, 40, 48].

thumbnail
Table 4. Sociodemographic characteristics of populations included in the Umbrella Review.

https://doi.org/10.1371/journal.pone.0280439.t004

3.4 Critical appraisal of included studies

Results from the JBI quality assessment showed that 15 reviews were of ’strong quality’ (score: ≥10), seven were of ’moderate quality’ (score: 5–9), five were of ’low quality’ (score: 0–4) and four were of ’very low quality’ (score: ≤0) (S1 Table). Common quality problems were related to a lack of critical appraisal tools and assessment rigour, lack of strategies to minimise errors during data extraction and no assessment of publication bias. The inter-rater agreement score, assessed using Cohen’s Kappa coefficient, was considered ’moderate’ (κ = 0.45; 95% CI 0.31–0.60) [16].

3.5 Assessment of overlap

The degree to which the 31 reviews included in this Umbrella Review contained the same primary studies was assessed using the CCA method [19]. A total of 462 primary studies (N) were cited across the 31 reviews (C). Of these, 212 were unique citations (R). Results from the CCA calculation ((N–R)/((RxC)–R)) found there was a slight overlap between the reviews (CCA = 3.93%) (S2 Data).

3.6 Findings of the review

3.6.1 Vaccine acceptance rates.

Vaccine acceptance rates (as a pooled average) were reported in 19 studies [5, 2331, 3537, 39, 41, 45, 46, 48, 49] (Table 4). For HCWs, acceptance rates ranged from 20.7% [48] to 81.1% [27]. When broken down by occupational role, Nurses (Pooled average range = 20.7%-40%) and Allied health professionals (Pooled average = 31.6%) had the lowest acceptance rates. In contrast, Dental practitioners (Pooled average = 81.1%), Direct medical providers (Pooled average = 80.4%) and Physicians (Pooled average = 80%) had the highest acceptance rates. For healthcare students, acceptance rates ranged from 34% [24] to 82.4% [35]. Nursing and Dental students both had an acceptance rate of 60% [26].

3.6.2 Determinants of vaccine hesitancy for HCWs.

The factors associated with vaccine hesitancy and vaccine acceptance for HCWs are displayed in Table 5.

thumbnail
Table 5. Factors associated with vaccine hesitancy and vaccine acceptance for HCWs.

https://doi.org/10.1371/journal.pone.0280439.t005

Vaccine-related factors: HCWs who had concerns regarding the adverse long-term side effects of the vaccine [5, 20, 22, 24, 3234, 36, 40, 42, 4649], as well as concerns about the tolerability of vaccine side effects [20] and its impacts on fertility [48] were more hesitant to accept a COVID-19 vaccine. As were those who had concerns about the safety [5, 2224, 30, 3234, 36, 38, 4248], quality [33, 47, 48] and effectiveness or efficacy [5, 20, 22, 24, 30, 32, 33, 36, 38, 4248] of COVID-19 vaccines. Alternatively, HCWs who displayed less concern for serious vaccine side-effects [36] and perceived the vaccine to be safe [20, 34, 39, 48, 49] and effective [20, 21, 3234, 36, 46, 48] were more accepting of a vaccine. Greater hesitancy was also shown by individuals who had concerns about the rapid development [5, 22, 33, 41, 42, 48, 49] and approval [42, 48] of COVID-19 vaccines, as well as the short duration of clinical trials [20, 24, 33, 34, 48]. Moreover, distrust of the expedited vaccine production, healthcare policies and regulatory policies [34, 42] and perceived politicisation of the vaccines [5, 23, 42] were associated with greater hesitancy in HCWs. Individuals who had confidence in the vaccine development process [48] and trusted the vaccine manufacturing country [33] were more likely to accept a COVID-19 inoculation. Hesitancy was also associated with concerns regarding the financial cost of the vaccine [33] and concerns regarding vaccine storage [36]. A lack of payment [34] and easy logistics to get vaccines [34] was associated with greater vaccine uptake. HCWs who perceived more vaccine benefits [5, 36, 39, 45, 48] were more accepting than those who perceived a lack of benefits [36, 48]. Individuals who perceived greater risks, such as contracting COVID-19 infection from the vaccine [24, 30, 33, 48], were more hesitant to accept an inoculation.

Information and sources: HCWs who perceived a lack of information about the vaccine [22, 24, 33, 36, 42, 48] and its side effects [24] exhibited more hesitancy towards a COVID-19 vaccine. As did those concerned about a lack of scientific information [48] or perceived a lack of adequate information available to support an informed decision [48, 45]. HCWs with a lack of knowledge about COVID-19 [48] and COVID-19 vaccines [33, 48] were more hesitant than HCWs who had sufficient knowledge about COVID-19 [5, 21, 48] and COVID-19 vaccines [25, 48]. HCWs who utilised social media [30] or non-authentic information sources [48] were more hesitant than HCWs who retrieved their COVID-19 related information from scientific literature [36], health authorities and associated websites [34, 36, 39, 49], national or local TV [45], national newspapers [45], Facebook [21, 34] or other reliable sources of information [48]. Exposure to misinformation about COVID-19 and the vaccines on social media was associated with vaccine hesitancy [5, 22, 24, 32, 33, 36, 44, 48]. Similarly, receiving conflicting or unclear information about COVID-19 [30] and its side effects [48], especially by public health authorities [20], was also found to contribute to vaccine hesitancy.

Health factors: HCWs who had not previously contracted a COVID-19 infection were more accepting of a COVID-19 vaccine [5, 48]. However, a history of COVID-19 infection was associated with both vaccine hesitancy [5, 34, 45, 47, 48] and acceptance [20, 22, 25, 39, 45, 48]. Having a chronic health condition was both a determinant of vaccine hesitancy [5, 23, 36, 42, 45, 48] and acceptance [5, 21, 22, 25, 32, 34, 38, 39, 42, 43, 4648]. Individuals with no chronic health conditions [48] were more likely to accept a COVID-19 vaccination. HCWs who had previously accepted an influenza vaccination [5, 21, 25, 28, 30, 3234, 36, 38, 39, 42, 43, 4548] or other inoculations [5, 22, 25, 29, 30, 34, 39, 46, 48] were more likely to accept a COVID-19 vaccine than HCWs who had not accepted an inoculation [23, 43] such as the influenza vaccine [22, 29, 34, 36, 45] previously. Fear of injections was also associated with hesitancy [33, 48]. An individual’s smoking status [21, 45, 48], allergen history [21, 34, 48], BMI status [45] and depression history [26, 34] were all factors associated with vaccine acceptance. Individuals who were pregnant [33, 45] or trying to conceive [45] were hesitant to accept a COVID-19 inoculation.

Sociodemographic factors: This review found that gender [21, 45], specifically, male [5, 22, 23, 25, 2834, 36, 3840, 42, 43, 46, 47] and non-binary female [23] was associated with vaccination acceptance. Being female was found to be both a barrier [22, 23, 34, 36, 40, 43, 45] and facilitator [20, 23, 29, 34, 36, 48] of vaccine uptake. An individual’s ethnicity/race [20, 21, 45] contributed to vaccination intentions. In particular, White ethnicity/race [5, 23, 25, 45, 48] (including White/Asian race [5, 34, 39, 42] and Non-Hispanic White [40]) was associated with vaccine acceptance, while Black ethnicity/race [30, 34, 45] (including Black and Hispanic [23, 42], Non-Hispanic Black [45] and Black/African American [40] ethnicities) was associated with vaccine hesitancy. Asian ethnicity was found to be both a barrier [23, 45] (including Asian and Latino [45] and Non-Hispanic Asian [45] ethnicities) and a facilitator [23] of vaccine acceptance. Latinx ethnicity [34] (including Hispanic/Latinx [45] ethnicities) was also associated with vaccine hesitancy. Both younger (<40) and older age (>45) were associated with vaccine hesitancy [20, 22, 25, 36, 45] and acceptance [5, 2023, 25, 2830, 3234, 36, 39, 42, 43, 4548]. Higher educational attainment [5, 22, 25, 30, 34, 36, 39, 42, 45, 48] was associated with vaccine acceptance and lower educational attainment with vaccine hesitancy [23, 32, 36, 45, 48]. Increased or higher income [5, 25, 34, 39, 42] and lower income [20, 48] were associated with vaccine acceptance and hesitancy, respectively. HCWs residing in upper-middle and lower-middle countries [27], or the Democratic Republic of Congo [35], Southeast Asia [27], Europe [27] and South Africa [36] were more likely to be hesitant towards a COVID-19 vaccine than HCWs residing in high-income countries [27], Eastern Asian countries (China, India, Republic of Indonesia, Singapore, Vietnam and Bhutan) [35] and Middle East countries [27]. Residing in the USA was a barrier [35] and facilitator [42] of vaccine acceptance. HCWs who were married [20, 48] were more accepting of a COVID-19 vaccine than those who were single [20]. Having a child or children was a barrier [47] and a facilitator of vaccine acceptance [36, 48]. An individual’s religious or political beliefs could be both a barrier [22, 42, 48] and a facilitator [5, 22, 34, 42, 45, 48] of acceptance of a COVID-19 vaccination.

Occupational factors: Vaccine acceptance was associated with working in public/government institutes [29], a medical faculty [42], or in the healthcare profession [21, 22, 3234, 36, 39, 43, 45, 46, 48]. In particular, Physicians [20, 22, 23, 25, 32, 34, 36, 4143, 46], General practitioners [46], Pharmacists [45], prescribing Physicians [23, 42, 45], Emergency department/room workers [48], Clinical or frontline workers [5], Dentists [25, 29], Dental practitioners [27], Rehabilitation centre workers [34], non-MD health professionals [21, 34], Scientists [41] and Research scientists [42] displayed more vaccine acceptance. Whereas Nurses [20, 22, 23, 25, 29, 33, 36, 41, 45, 46], assistant nurses [46], Paramedical staff [25], Allied health professionals [20, 41, 45], Trainees [45] and those in non-clinical roles [45] were found to be more hesitant towards a COVID-19 inoculation. HCWs involved in COVID-19 duties (e.g. caring for COVID-19 patients [29, 32, 39, 41, 42, 48], working in a designated hospital [34]) and were exposed to COVID-19 through patient [5, 25, 34, 39, 42, 47] or colleague interactions [42] were more likely to accept a COVID-19 vaccine. Contrastingly, individuals who did not care for COVID-19 patients [32, 41] were more hesitant. HCWs who displayed unfavourable attitudes towards workplace infection control policies [30, 46] and a lack of personal protective equipment (PPE) [46] were more accepting of a vaccine than those HCWs who were satisfied with workplace PPE [48]. Attitudes toward compulsory vaccination for HCWs were both a barrier [33, 36] and facilitator [21, 22, 32, 36] of vaccine uptake, depending upon an individual’s level of agreement. Retired [32, 43] and hourly paid HCWs [45] were less accepting of a vaccine. HCWs unemployed due to COVID-19 were more accepting of a vaccine [36, 39, 41, 43].

Trust factors: HCWs that had a lack of trust in key social actors, such as the government [23, 24, 30, 36, 42, 48], vaccine manufacturers [23, 24, 33, 48], pharmaceutical companies [5, 20, 48], health authorities [5, 30, 42, 48], health experts [5, 30, 36, 42] and scientists [48] were more hesitant to accept a COVID-19 vaccine. Whereas HCWs that had higher levels of trust in these social actors, as well as non-health leaders [48], mass media [32], science [25, 48] and public health websites or providers [48], were more accepting of inoculation. Additionally, higher levels of trust in pandemic management [20, 21, 34] and health promotion strategies [36] were associated with vaccine acceptance. Individuals with a lack of trust or confidence in vaccines [48] and their safety [36] displayed more hesitancy than individuals that were more trusting of vaccines [5, 25, 46, 48].

Belief factors: Individuals that perceived themselves to be at higher risk of contracting a severe COVID-19 infection [5, 20, 25, 30, 3234, 36, 39, 4143, 4548] were more accepting of a vaccination than those perceiving themselves to be less susceptible [20, 23, 43, 48] or less concerned with contracting COVID-19 [36, 42, 45]. HCWs that had negative perceptions regarding COVID-19, for example, that the disease does not exist [5], that symptoms are mild [20, 30, 33, 48] and a vaccine is not necessary [32, 38, 42, 43, 4648], were also more hesitant to accept a COVID-19 inoculation. As were those who held anti-vaccination beliefs [22, 46, 48] and preferred natural immunity [29, 33, 42, 48] or other COVID-19 preventative measures [48]. Alternatively, individuals with positive perceptions of COVID-19 [32, 46] and the benefits [5, 20, 39, 45], safety [20, 29] and efficacy [20, 48] of a COVID-19 vaccine [5, 25, 36, 39, 42, 48] were more likely to accept an inoculation. HCWs that perceived COVID-19 to be a serious disease [5] and believed in the importance of pandemic management strategies, such as compulsory vaccination for the public [29, 34], isolation as an effective transmission reduction strategy [46] and had confidence in and expectations about PPE and other preventative behaviours [24, 45] were more accepting of a COVID-19 vaccine.

Emotional factors: Higher levels of negative emotional responses (e.g. anxiety, doubts, fear and worry) were found to be a driver of vaccine hesitancy for some individuals [24, 30, 44, 48] and vaccine acceptance for others [5, 22, 25, 26, 32, 34, 36, 39, 42, 46].

Social factors: Individuals who expressed high levels of altruism towards protecting others [32, 45, 48] or perceived vaccination as a collective responsibility [5, 22, 25, 39, 46, 48] were more likely to accept an inoculation. HCWs concerned about transmitting COVID-19 to family members, relatives or friends [5, 22, 26, 34, 48], or those who lived with elderly relatives [5, 25, 36, 48] or vulnerable individuals [5, 21, 25, 36, 48] were more accepting of a COVID-19 vaccine. As were those individuals who had a family member or friend who had been diagnosed with [20, 22, 48] or had died from COVID-19 [20, 45, 48]. Vaccination recommendations from healthcare professionals [29, 48] or encouragement from social networks [5, 33, 36, 48], experts [36], or news media [36] all contributed to vaccine acceptance. In contrast, individuals experiencing less social pressure were more likely to be hesitant to accept an inoculation [48]. Similarly, individuals were more likely to be hesitant if they had been exposed to anecdotes regarding negative reactions to a COVID-19 vaccination [20].

Behavioural factors: HCWs who exhibited proactive behaviours, such as engaging in preventative behaviours [34] and testing procedures [34, 39], were more accepting of vaccination, as were those who recommended the vaccine to parents [34], elderly individuals [34] and the general population [5, 29] and had dispensed the inoculation to their children [34]. Individuals more accepting of a COVID-19 vaccine were more likely to do so to inspire confidence in vaccine safety [45] and contribute to herd immunity [45].

Environmental factors: Vaccine acceptance was associated with the severity of the local epidemic situation and local COVID-19 mortality figures [48]. HCWs who were hesitant to accept the vaccine reported a lack of time to seek out vaccination [32, 42, 43, 47, 48] or make a decision [34] and preferred to wait until others had received the vaccine first [33, 34]. An initial delay in accepting a vaccine was also associated with vaccine acceptance at a subsequent timepoint [35].

3.6.3 Determinants of vaccine hesitancy for healthcare students.

The amalgamation of results from the ten reviews that included populations of healthcare students found various factors associated with hesitancy or acceptance of a COVID-19 vaccine (Table 6).

thumbnail
Table 6. Factors associated with vaccine hesitancy and vaccine acceptance for healthcare students.

https://doi.org/10.1371/journal.pone.0280439.t006

Sociodemographic factors: This review found that female students [31] were more hesitant than male students [20, 21, 29, 45, 46]. Although, one review reported that being female was a factor associated with acceptance [39]. With regards to ethnicity, Black/African American students [40] displayed more hesitancy towards the vaccine than non-Hispanic White students [40] or those from underrepresented minorities [45]. Additional sociodemographic factors associated with vaccine acceptance in this population were older age [40, 45, 46], having a higher income [36], higher socioeconomic status [36] or whose marital status was single [20, 29, 39]. Vaccine acceptance was lower in students residing in Egypt [35] and higher in students residing in the USA [35].

Educational factors: Dental students [40] and non-medical students [35] exhibited more hesitancy, whereas pharmacy students [29], medical students [35, 40] and both healthcare and non-healthcare students [46] were more accepting of a vaccine. Other vaccine-accepting populations were academics, students, support staff [46] and individuals working in a medical faculty [46]. Additionally, students in their first or second year of study [31] were more hesitant than students in their third year (or above) of study [21, 29] or were graduate students [29, 45]. Healthcare students who disagreed with compulsory vaccination for healthcare professionals were more hesitant than those in support of a compulsory COVID-19 vaccine [26, 31].

Health factors: Perceptions of good health were found to determine vaccine hesitancy [46] and acceptance [29]. Alternatively, students with a history of previous illnesses [40] who were immunocompromised or had a family member with a compromised immune system [46] were more likely to accept a COVID-19 vaccine. Individuals previously infected with COVID-19 [26] were hesitant, as were those who engaged in homoeopathy or naturopathy practices [46]. Students who exhibited general opposition to vaccines [46] and previous hesitancy towards other vaccinations [26] were also more likely to exhibit hesitancy towards a COVID-19 vaccine. Alternatively, students who had received an inoculation in the past five years [29, 39] or were willing to accept an influenza shot [46] were more likely to accept a COVID-19 inoculation. Individuals who perceived themselves at higher risk of a severe COVID-19 infection now and in the future were more likely to accept a COVID-19 inoculation [20, 29, 39].

Vaccine-related factors: Healthcare students that expressed more worries and concerns about the efficacy of the vaccine [20, 40], the safety of the vaccine [36, 40] and the adverse side effects from the vaccine [20, 26, 40, 45, 46] were more hesitant to accept the COVID-19 vaccine. Alternatively, healthcare students less concerned about adverse side effects [45] and who perceived the vaccine to be effective [39, 46] and beneficial [36] were more accepting of an inoculation. Additionally, a fee-based vaccine was associated with more hesitancy than a freely available vaccine [35].

Information and sources: Students who perceived a lack of information about the vaccine [20, 36, 40] and data on its side effects [20, 36] exhibited more hesitancy towards a COVID-19 vaccine. Individuals who perceived sufficient knowledge regarding COVID-19 [26, 29, 45] and realised the importance of COVID-19 [26] and an associated vaccine [45] were more likely to accept an inoculation. Evidence suggests that using social media for COVID-19 vaccine-related information was found to be both a barrier [26] and a facilitator [39] of vaccine acceptance. Furthermore, the use of scientists [45] or pharmaceutical companies [45] as a source of information about COVID-19 vaccines was associated with vaccine uptake. Contrastingly, exposure to conspiracy theories was associated with greater hesitancy [46].

Trust factors: Higher levels of vaccine acceptance were associated with higher levels of trust or confidence in the government [36, 46], mass media [45, 46], social media [45], healthcare systems and agencies [45, 46], public health experts [45], health promotion strategies [36], scientists [45] or pharmaceutical companies [45].

Social factors: Social factors associated with vaccine acceptance were the presence of COVID-19 infection within a close social network [29], having family members that had received a COVID-19 vaccine [40] and suffering from distance to friends during pandemic containment [26]. Additionally, students expressing fear of death rates were more accepting of a vaccine [26].

3.6.4 Results from meta-analyses.

Four reviews conducted a meta-analysis exploring the role sociodemographic variables have on determining COVID-19 vaccine hesitancy or acceptance in HCWs or healthcare students. For HCWs, the only variables found to significantly predict vaccine acceptance was being male [28, 29], aged 30 years or older [28], having a history of prior influenza vaccination [28] and perceived risk of COVID-19 infection [29] (S2 Table). Unlike HCWS, age [26] and gender [26, 31] were not significant predictors of vaccine acceptance for healthcare students. Factors related to vaccine uptake for this population were being a student in a medical field [26], supporting compulsory vaccination [26, 31], perceived risk of COVID-19 infection [26], perceived sufficient knowledge of COVID-19 [26] and recognition of the importance of COVID-19 vaccination for individuals [26]. Alternatively, healthcare students previously infected with COVID-19, those worried about the vaccine’s adverse effects, or those with negative attitudes toward compulsory vaccination [26] were significantly more hesitant to accept a COVID-19 vaccination (S3 Table).

4. Discussion

This is the first comprehensive Umbrella Review that has compiled the evidence pertaining to vaccine hesitancy and acceptance of a COVID-19 vaccine for HCWs and healthcare students. This review found that vaccine hesitancy rates were variable across occupational roles, whereby some professions, such as physicians [49] and dental practitioners [27], were more accepting of a COVID-19 vaccine than other occupations, for instance, nurses [41, 46, 48]. In several reviews where acceptance rates were compared to the general public, HCWs displayed more hesitancy toward the COVID-19 vaccine [28, 37, 29]. Most reviews exploring hesitancy in healthcare students found that medical students were less hesitant toward a COVID-19 vaccine than non-medical students [22, 35, 46]. Dental students exhibited more hesitancy than dental practitioners [27], and nursing students displayed higher acceptance rates than nurses [26]. The variability in hesitancy rates across various occupational groups suggests a need for tailored intervention strategies that address the barriers contributing to vaccine hesitancy for each occupational group. Previous research has found that educational sessions delivered by less hesitant HCWs effectively increased vaccine acceptance rates in previously hesitant HCWs [50, 51]. Implementing COVID-19-related information sessions across hospitals or departments that enable HCWs, such as nursing staff, to discuss concerns and questions with other HCWs (e.g. physicians) may be efficacious in improving COVID-19 vaccine uptake in more hesitant groups of HCWs. Similarly, educational interventions with healthcare students throughout their training courses may be a way to help address hesitancy and promote and maintain vaccine acceptance throughout their medical careers and beyond.

Many factors associated with vaccine hesitancy were identified, one of the most commonly explored and reported drivers was related to sociodemographic factors. Although there is an abundance of evidence pertaining to gender and age, the evidence is inconsistent. Regarding gender, being a male HCW was associated with vaccine acceptance [5, 22, 23, 25, 2834, 36, 3840, 42, 43, 46, 47], and was a significant predictor of COVID-19 vaccine uptake in two meta-analyses [28, 29]. However, being a female HCW was associated with both vaccine hesitancy [22, 23, 34, 36, 40, 43, 45] and vaccine acceptance [20, 23, 29, 34, 36, 48]. This pattern was also identified in healthcare students, whereby males were more accepting of an inoculation [20, 21, 29, 45, 46] and being female was both a barrier [31] and facilitator [39] of vaccination uptake. However, the results from two meta-analyses found that gender was not a significant predictor of vaccine acceptance for healthcare students [26, 31]. Regarding age, younger age (<40) and older age (>45) were both a barrier [20, 22, 25, 36, 45] and a facilitator [5, 2023, 25, 2830, 3234, 36, 39, 42, 43, 4548] of vaccine uptake in HCWs. One meta-analysis found that being 30 years or older was a significant predictor of vaccine acceptance in this population [28]. For healthcare students, older age was associated with acceptance [40, 45, 46]. However, a meta-analysis did not find age to predict vaccine uptake for healthcare students [26] significantly. For ethnicity, this review suggests that HCWs from White ethnic backgrounds [5, 23, 34, 40] were more accepting of a COVID-19 inoculation than those from Black [23, 30, 40, 42, 45] or Latin ethnic backgrounds [34, 45]. Being from an Asian ethnic background was a barrier [23, 45] and facilitator [23] of vaccine uptake in HCWs. Similarly, healthcare students from a Non-Hispanic White background were more accepting of a COVID-19 vaccine than healthcare students from a Black/African American background [40]. Other individual factors found to be associated with vaccine hesitancy for both HCWs and healthcare students were lower educational attainment [23, 31, 32, 36, 45, 48], lower income [20, 36, 48], or residing in low-and middle-income countries [27, 35]. In fact, literature highlighted that in some low and middle-income countries, the vaccine coverage is less than 20% and, in the general population, evidence suggests that people hesitant to COVID-19 vaccine belong to low socioeconomic groups, or to Asian and black ethnic groups, Muslims, and Buddhists [52, 53] It is possible that disinformation, in association with some religious beliefs, could discourage people to take the COVID-19 vaccine [53]. Also, studies carried out in Islamic regions, have shown that the willingness to purchase the covid-19 vaccine could be one of the influencing factors regarding the acceptance of the vaccine. A recent study [54], carried out in Indonesia, showed that only a small percentage of the population was willing to purchase a COVID-19, even if, the overall acceptance rate of a COVID-19 vaccine varied based on its effectiveness and the related risk of adverse effects. Further studies should explore more deeply and specifically the association of these variables with the level of vaccine hesitancy and acceptance of a COVID-19 vaccine for HCWs and healthcare students. To reduce hesitancy, vaccination programs and public health campaigns should tailor messages to reflect the variation in sociodemographic characteristics and the social and cultural norms surrounding the target group. The information and message delivered to the target group should be presented in a format that the target group can relate to and access.

Another driver of hesitancy in HCWs and healthcare students was related to concerns about the safety, efficacy and potential side-effects of a COVID-19 vaccine [5, 20, 36, 40, 48]. Moreover, the rapid development of the vaccine, perceived lack of clinical trials and an expedited approval and production process led to greater hesitancy in HCWs [33, 42, 48]. For healthcare students, financial barriers to the vaccine also increased hesitancy [35]. Confidence or trust in the safety and efficacy of a vaccine and the systems that develop, manufacture and distribute vaccines is an integral part of the decision-making process surrounding vaccine behaviours not just for HCWs and healthcare students but for the general population as well [21, 55]. Restoring confidence and trust in the COVID-19 vaccine can be achieved by increasing transparency and awareness of scientific rigour throughout the development, approval and distribution processes [56]. Tailored communication strategies that disseminate information regarding the progress of COVID-19 vaccines, as well as scientific data about the safety and efficacy of the vaccines to HCWs, may increase trust, help to expedite the decision-making process and lead to faster uptake of a COVID-19 inoculation in this sub-population [57].

This review also found that an individual’s previous vaccination behaviours were associated with current vaccination intentions [5, 25, 26, 30, 39, 48]. A meta-analysis found that previous history of influenza vaccine uptake was a significant determinant of vaccine acceptance in HCWs [28]. These findings highlight the importance of continuously promoting favourable behaviours and attitudes toward vaccination programmes throughout an individual’s healthcare career. Vaccine promotion campaigns continuously rolled out within healthcare institutions could also play a critical role in shaping future vaccination intentions and facilitate HCWs’ willingness to vaccinate without delay in response to future infectious disease outbreaks [58]. Another driver of vaccine intentions was a history of a COVID-19 infection. HCWs and healthcare students who had already contracted COVID-19 were more hesitant to accept vaccination [26, 34, 45, 47, 48]. More than likely due to the belief that natural immunity offers a level of protection against further infections, reducing the perceived need for an inoculation [59]. However, research has found that around a third of individuals do not develop natural immunity after recovering from a COVID-19 infection [60], and in those that do, natural immunity may wane quicker than vaccine-induced immunity [61]. Similarly, the risk of re-infection is increased [62] and the chances of long-term damage (long-COVID) also increase in unvaccinated individuals [63]. Educating HCWs and healthcare students about the increased risk of re-infection due to occupational exposure and the negative health impacts of repeated exposure may be an effective strategy to encourage uptake in previously hesitant HCWs.

Several drivers related to workplace settings were also found to affect vaccination behaviours. For example, being involved in COVID-19-related duties [29, 41, 48], being in regular contact with COVID-19 infected patients [25, 34, 39, 47], perceiving a lack of PPE and inadequacies in workplace infection control policies [46] were all factors found to increase uptake behaviours in HCWs. Meta-analyses found that perceived risk of COVID-19 infection was a significant determinant of vaccine intentions for HCWs and healthcare students [26, 29]. Specifically, individuals perceiving themselves as at higher risk of contracting a COVID-19 infection were more willing to accept a vaccine [26, 29]. Negative perceptions of risk may be due to a perceived lack of likelihood, susceptibility and severity of infection within the workplace [64]. Strategies to improve uptake in HCWs have focused on implementing mandatory vaccinations; however, this strategy may be counterproductive for some individuals. For example, this review found that HCWs and healthcare students who disagreed with compulsory vaccination were more hesitant than those supporting mandatory policies [26, 31, 33, 36]. A meta-analysis found disagreement with compulsory vaccination to be a significant predictor of hesitancy in healthcare students [26]. Mandatory vaccination policies may not be the most effective approach to reduce hesitancy in this population and implementing such enforcements could have additional consequences on staffing levels and care provisions in some already-stretched medical institutions [65]. Alternative strategies focused on building trust and addressing the concerns of hesitant HCWs and healthcare students may yield greater results.

Moreover, an individual’s social network was instrumental in promoting vaccine acceptance, and this may be a potential avenue to model intervention strategies. For example, HCWs that received encouragement or recommendations to vaccinate from their close social networks, colleagues, or other healthcare professionals were more willing to accept an inoculation [29, 33, 36, 48]. Moreover, HCWs who displayed higher levels of altruism [32, 45, 48] and perceived vaccination as a collective responsibility [22, 39, 48] were more likely to accept a COVID-19 vaccine. Previous research has found that influence and pressure from social networks can be instrumental in changing behaviour [66]. For example, when close social networks engage in preventative measures (e.g. social distancing, face-mask wearing) [67] and adherence to rules is a norm endorsed by the social network [68, 69], then individuals are more likely to follow and engage in the behaviours exhibited by the social group. Therefore, strategies encouraging vaccinated HCWs and family members of HCWs to advocate for adherence to vaccination recommendations may apply social pressure and, as a result, coax hesitant HCWs into accepting a COVID-19 inoculation. Moreover, occupational communication and incentives could focus on lauding vaccinated individuals for their altruistic and collectivistic values, which may motivate hesitant HCWs to receive COVID-19 vaccination to be perceived as contributing to society’s collective behaviours.

Perceptions of the availability and adequacy of COVID-19 information and data and the sources used to seek out COVID-19-related information were found to be drivers of vaccination intentions for HCWs and healthcare students. For example, individuals who perceived a lack of adequate scientific information about the vaccine and its side effects were more hesitant to accept a COVID-19 inoculation [20, 24, 36, 48], as were those whose primary source of COVID-19 information came from social media platforms [26, 30]. Alternatively, HCWs and healthcare students who utilised reliable sources for COVID-19-related information [36, 39, 45] and perceived the information to be adequate [20, 24, 36, 48] were more accepting of a COVID-19 vaccine. This finding would suggest that levels of health literacy, defined as “the degree to which individuals have the capacity to obtain, process and understand basic health information needed to make appropriate health decisions” [70, pg. 6], may be lower in some HCWs and healthcare students. Interventions aimed at improving health literacy and digital health literacy may be efficacious in increasing vaccine acceptance in this population. For example, equipping an individual with skills to enhance their information-seeking behaviours will improve perceptions and adequacy of information and inform decision-making processes, potentially leading to voluntary uptake. Another driver of hesitancy for HCWs and healthcare students was exposure to misinformation or conspiracy theories on social media [5, 22, 32, 46]. Although efforts have been made to manage the spread of COVID-19 misinformation on social media platforms (e.g. fact-checking, misinformation awareness campaigns) [71], more could be done at an individual and occupational level to reduce the impact misinformation has on the vaccination behaviour of HCWs and healthcare students. One potential strategy would be to utilise pre-bunking; this is where the impacts (changes in beliefs and behaviours) of misinformation are neutralised by pre-exposure to accurate information [72]. As such, strategies to regularly expose HCWs and healthcare students to scientific, accurate information about COVID-19 and the vaccines from trusted medical bodies within the workplace may reduce the influence misinformation may have on the vaccination intentions of HCWs and healthcare students. Moreover, media literacy resources, such as “Go Viral”, an interactive game supported by the WHO that teaches individuals to identify and resist being influenced by COVID-19 misinformation [73], could be recommended to HCWs and healthcare students which could also reduce the likelihood of hesitancy towards COVID-19 vaccines as a result of exposure to misinformation on social media platforms.

Furthermore, the level of trust HCWs and healthcare students held towards key social actors, such as the government, public health authorities, health experts, vaccine manufacturers, pharmaceutical companies and scientists, was pivotal in shaping vaccination intentions. Specifically, a lack of trust in these social actors was associated with hesitancy toward accepting a COVID-19 vaccine [5, 36, 42, 45, 46, 48]. Moreover, a lack of trust in pandemic management [20, 21, 34] and health promotion strategies [36], as well as exposure to conflicting or unclear COVID-19 information by the government or public health figures [30, 48], lead to greater hesitancy for HCWs. Strategies that improve and build trust towards the government, health authorities and other influential social actors are imperative to ensure that vaccine uptake remains high in populations of HCWs and healthcare students. To enhance trust in COVID-19 vaccination, governments should strive to be transparent about vaccination strategies and maintain integrity and accountability throughout vaccine development, approval, distribution and administration. Information regarding these stages must be released in a timely, accurate and accessible manner to the general public and healthcare professionals. Moreover, health communication messages and campaigns delivered by the government or health officials must strive to be coherent, authoritative and free of ambiguity or conflicting information. These strategies would contribute to an individual’s decision-making process and foster trust and confidence in key social actors, ultimately leading to greater uptake of COVID-19 vaccinations in HCWs, healthcare students, and the general population [74].

In summary, this review has synthesised the most commonly reported factors associated with COVID-19 vaccine acceptance and hesitancy for HCWs and healthcare students. Frequent reasons associated with vaccination intentions were related to sociodemographic factors, COVID-19 exposure, perceived risk, attitudes towards mandatory vaccination, vaccination history, perceptions regarding the safety, efficacy and side-effects of the COVID-19 vaccine, perceptions about the rapid development, testing, approval and distribution of the vaccine, social pressure, altruism, collective responsibility, trust of key social actors, perceptions of pandemic management, perceived adequacy of information, usage of social media and exposure to misinformation. Although identifying these factors may provide potential areas for intervention, there are several points to consider. Firstly, most of the reviews included in this synthesis investigated prospective attitudes and behavioural intentions toward a COVID-19 vaccine, which does not always translate to actual behaviour [75, 76]. For example, research exploring the relationship between HCWs intentions and future acceptance of an influenza vaccine found that 42% of HCWs who intended to accept the vaccine failed to act on those intentions [77]. Future research exploring the factors that lead to changes in intentions is needed as these drivers may be pivotal to developing effective intervention strategies. Moreover, the evidence in this review only considers a single inoculation; however, some COVID-19 vaccines require multiple doses and booster shots. Hesitancy towards additional inoculations may hamper current vaccination progress and contribute to the circulation of the virus and the development and spread of new variants [78]. Therefore, future research should explore acceptance intentions towards multiple inoculations.

4.1 Limitations of the review

There are several limitations to this review. Firstly, a summary of the sociodemographic and occupational data for the populations included within a review was inconsistently reported. Regarding sociodemographic characteristics, there was a lack of summary data that described the participants in the primary studies in their review. For example, of the 31 reviews, 11 reported gender, seven reported age and only two reported ethnicities. Therefore, this review’s representativeness and generalisability are impeded due to a lack of transparency in reporting this information. Regarding the occupational data, there was variation in the occupational groups included in the primary studies. For example, most reviews did not focus on one particular healthcare role but included various roles ranging from frontline healthcare workers to hospital administrative staff and non-medical personnel. Moreover, seven reviews used the umbrella term HCWs and did not provide any breakdown of occupational roles. As a result, the generalisability and applicability of the determinants identified may not be entirely representative of the population under investigation. Secondly, the reviews reporting data on associations did not indicate the significance or effect sizes of the associations between the determinants and vaccine hesitancy or acceptance found in the primary studies. There was also no transparency around the factors found to be non-significant. The selective reporting within the reviews may have introduced bias surrounding the determinants reported in this synthesis, limiting our interpretation. Also, the correlational design of the primary studies impedes this review’s ability to draw any inferences regarding cause or effect. Although the results from the overlapping assessment were considered low, the impact this may have had on the amount of evidence provided for each determinant and the conclusions drawn in this review cannot be discounted. Moreover, this synthesis also included other types of reviews (e.g. scoping reviews), which could be argued to have reduced the quality of evidence and implications of this synthesis [17]. However, the methodological appraisal found that five out of six scoping reviews were of ‘moderate’ or ‘strong quality’ and were more methodologically rigorous than some of the included systematic reviews. Finally, there is a possibility that the search strategy may have missed eligible reviews. Although steps were taken to minimise this risk (i.e. consultations with an expert librarian and updated searches), selection bias is still possible. Future research should consider more specific search strategies so as to focus on specific occupational roles and determinants and perform a meta-analysis to provide a quantitative synthesis.

5. Conclusion

Individual decision-making regarding vaccination is a complex process, driven by a mix of scientific, social, behavioural, cultural, emotional, environmental and psychological factors. HCWs and healthcare students are key populations to consider when planning vaccination campaigns. The determinants of vaccination hesitancy among HCWs are mainly related to concerns about the vaccine’s side effects or lack of scientific information about the vaccine itself along with being affected by chronic conditions or not. Among healthcare students, non-medical students showed higher hesitancy, while students living with relatives in vulnerable conditions are less hesitant. In both populations, the lack of scientific information or the social media usage is related to vaccination hesitancy.

Strategies to reduce COVID-19 vaccine hesitancy in this population require a multifaceted approach targeting amenable drivers at the individual, occupational and societal level. At the individual level, educational interventions aimed at improving health literacy, knowledge of COVID-19 and associated vaccines, reducing susceptibility to misinformation and promoting pro-vaccination behaviours during medical training might increase COVID-19 vaccination uptake in both HCWs and healthcare students. At the occupational level, strategies to minimise vaccine hesitancy in this population may consist of distributing and ensuring access to accurate scientific information, promoting and rewarding pro-vaccination behaviours, implementing mandatory training sessions to improve health literacy, recommending engagement with media literacy resources, as well as facilitating regular interactive sessions lead by pro-vaccination HCWs to educate and address the vaccine-related concerns held by hesitant HCWs and healthcare students. At the societal level, hesitancy could be addressed through the delivery of sociodemographic-specific vaccination programs and public health campaigns, the dissemination of scientific information regarding COVID-19 vaccine progress reports to medical institutions and staff, through transparent and accurate communication messages from government and other trusted social actors, avoidance of unclear or conflicting messages to HCWs, as well as social pressure from other HCWs and broader social networks. There is evidence to suggest that these interventions may be effective at improving COVID-19 vaccine uptake; however, further research is needed to assess the efficacy of these strategies with HCWs and healthcare students.

Supporting information

S1 Table. Critical appraisal results for included reviews using the JBI critical appraisal checklist for systematic reviews and research syntheses.

https://doi.org/10.1371/journal.pone.0280439.s002

(DOCX)

S2 Table. Results from meta-analyses exploring sociodemographic characteristics as determinants of vaccine acceptance in HCWs.

https://doi.org/10.1371/journal.pone.0280439.s003

(DOCX)

S3 Table. Results from meta-analyses exploring sociodemographic characteristics as determinants of vaccine acceptance or hesitancy in healthcare students.

https://doi.org/10.1371/journal.pone.0280439.s004

(DOCX)

S2 Data. Overlap spreadsheet.

Assessment of overlap between studies.

https://doi.org/10.1371/journal.pone.0280439.s006

(XLSX)

Acknowledgments

Authors acknowledge Dr Giancarlo Cicolini (University of Bari) for his support and advice.

References

  1. 1. World Health Organization. Top ten threats to global health in 2019: Vaccine hesitancy. (https://www.who.int/news-room/spotlight/ten-threats-to-global-health-in-2019). (Accessed July 12, 2022).
  2. 2. Larson HJ, Gakidou E, Murray CJ. The vaccine-hesitant moment. N Engl J Med. 2022 Jul 7;387(1):58–65. pmid:35767527
  3. 3. Larson HJ, Broniatowski DA. Volatility of vaccine confidence. Science. 2021 Mar 26;371(6536):1289. pmid:33766861
  4. 4. de Miguel-Arribas A, Aleta A, Moreno Y. Impact of vaccine hesitancy on secondary COVID-19 outbreaks in the US: An age-structured SIR model. BMC Infectious Diseases. 2022 Dec;22(1):1–2. pmid:35650539
  5. 5. Biswas N, Mustapha T, Khubchandani J, et al. The nature and extent of COVID-19 vaccination hesitancy in healthcare workers. Journal of Community Health. 2021 Dec;46(6):1244–51. pmid:33877534
  6. 6. Mustapha T, Khubchandani J, Biswas N. COVID-19 vaccination hesitancy in students and trainees of healthcare professions: A global assessment and call for action. Brain, Behavior, & Immunity-Health. 2021 Oct;16; 100289. pmid:34226892
  7. 7. Grochowska M. A comparison of the level of acceptance and hesitancy towards the influenza vaccine and the forthcoming COVID-19 vaccine in the medical community. Vaccines. 2021;9(5):475. pmid:34066790
  8. 8. Asad H, Johnston C, Blyth I, et al. Health care workers and patients as Trojan horses: A COVID19 ward outbreak. Infection Prevention in Practice. 2020 Sep 1;2(3):100073. pmid:34316562
  9. 9. Reiter PL, Pennell ML, Katz ML. Acceptability of a COVID-19 vaccine among adults in the United States: How many people would get vaccinated? Vaccine. 2020 Sep 29;38(42):6500–7. pmid:32863069
  10. 10. Tomietto M, Simonetti V, Comparcini D, et al. A large cross‐sectional survey of COVID‐19 vaccination willingness amongst healthcare students and professionals: Reveals generational patterns. J Adv Nursing. 2022 Mar 17. pmid:35301774
  11. 11. Aromataris E, Fernandez R, Godfrey C, et al. Methodology for JBI umbrella reviews. Joanna Briggs Institute Reviewers’ Manual. 2014;1–34. (https://ro.uow.edu.au/smhpapers/3344). (Accessed April 11, 2022).
  12. 12. Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. pmid:33782057
  13. 13. McGowan J, Sampson M, Salzwedel DM, et al. PRESS peer review of electronic search strategies: 2015 guideline statement. J Clin Epidemiol. 2016 Jul 1;75:40–6. pmid:27005575
  14. 14. Bramer WM, Giustini D, de Jonge GB, et al. De-duplication of database search results for systematic reviews in EndNote. JMLA. 2016 Jul;104(3):240. pmid:27366130
  15. 15. Ouzzani M, Hammady H, Fedorowicz Z, et al. Rayyan—a web and mobile app for systematic reviews. Systematic reviews. 2016 Dec;5(1):1–0. pmid:27919275
  16. 16. Altman DG. Practical Statistics For Medical Research. CRC press; 1990 Nov 22.
  17. 17. Aromataris E, Fernandez R, Godfrey CM, et al. Summarizing systematic reviews: Methodological development, conduct and reporting of an umbrella review approach. JBI Evidence Implementation. 2015 Sep 1;13(3):132–40. pmid:26360830
  18. 18. Kilich E, Dada S, Francis MR, et al. Factors that influence vaccination decision-making among pregnant women: A systematic review and meta-analysis. PloS one. 2020 Jul 9;15(7):e0234827. pmid:32645112
  19. 19. Pieper D, Antoine SL, Mathes T, et al. Systematic review finds overlapping reviews were not mentioned in every other overview. J Clin Epidemiol. 2014 Apr 1;67(4):368–75. pmid:24581293
  20. 20. Ngangue P, Pilabre AH, Barro A, et al. Public attitudes towards COVID-19 vaccines in Africa: A systematic review. MedRxiv. 2022 Jan 1. pmid:35720806
  21. 21. Wake A. Pro-vaccination attitude and associated factors towards COVID-19 vaccine among healthcare workers and non-healthcare workers: “A call for action”- A systematic review. Research Square. 2021.
  22. 22. Willems LD, Dyzel V, Sterkenburg P. COVID-19 vaccination intentions amongst care-professionals in the field of intellectual disability: A scoping review. PsyArXiv Pre-prints. 2022 Jan 19.
  23. 23. Caiazzo V, Stimpfel AW. Vaccine hesitancy in American healthcare workers during the COVID-19 vaccine roll out: An integrative review. Public Health, 2022 June; 207:94–104. pmid:35594808
  24. 24. Ackah BB, Woo M, Ukah UV, et al. COVID-19 vaccine hesitancy in Africa: A scoping review. Research Square. 2021 Aug 16:1–19.
  25. 25. Galanis P. Vraka I, Fragkou D, et al. Intention of healthcare workers to accept COVID-19 vaccination and related factors: A systematic review and meta-analysis. Asian Pacific Journal of Tropical Medicine. 2021;14(12):543–554.
  26. 26. Geng H, Cao K, Zhang J, et al. Attitudes of COVID-19 vaccination among college students: A systematic review and meta-analysis of willingness, associated determinants, and reasons for hesitancy. Hum Vaccin Immunother. 2022 Apr 21:1–3. pmid:35438612
  27. 27. Lin GSS, Lee HY, Leong JZ, et al. COVID-19 vaccination acceptance among dental students and dental practitioners: A systematic review and meta-analysis. Plos One. 2022 Apr 19;17(4):e0267354. pmid:35439274
  28. 28. Luo C, Yang Y, Liu Y, et al. Intention to COVID-19 vaccination and associated factors among health care workers: A systematic review and meta-analysis of cross-sectional studies. Am J Infect Control. 2021 Oct 1;49(10):1295–304. pmid:34273461
  29. 29. Patwary MM, Alam MA, Bardhan M, et al. COVID-19 vaccine acceptance among low-and lower-middle-income countries: A rapid systematic review and meta-analysis. Vaccines. 2022 Mar 11;10(3):427. pmid:35335059
  30. 30. Pekcan B, Cai P, Olivas P. COVID-19 Vaccine hesitancy and acceptance in the global context: A systematic review and meta-analysis. The Columbia University Journal of Global Health. 2021;11(2).
  31. 31. Ulbrichtova R, Svihrova V, Svihra J. Prevalence of COVID-19 vaccination among medical students: A systematic review and meta-analysis. Int J Environ Res Public Health. 2022 Mar 29;19(7):4072. pmid:35409755
  32. 32. Al‐Amer R, Maneze D, Everett B, et al. COVID‐19 vaccination intention in the first year of the pandemic: A systematic review. J Clin Nurs. 2022 Jan;31(1–2):62–86. pmid:34227179
  33. 33. Dadras O, SeyedAlinaghi S, Karimi A, et al. Public acceptability of COVID-19 vaccines and its predictors in Middle‎ Eastern/North African (MENA) countries: A systematic review‎. Hum Vaccin Immunother. 2022 Mar 21:1–6. pmid:35318872
  34. 34. Hajure M, Tariku M, Bekele F, et al. Attitude towards COVID-19 vaccination among healthcare workers: A systematic review. Infection and Drug Resistance. 2021;14:3883. pmid:34584432
  35. 35. Salomoni MG, Di Valerio Z, Gabrielli E, et al. Hesitant or not hesitant? A systematic review on global COVID-19 vaccine acceptance in different populations. Vaccines. 2021 Aug 6;9(8):873. pmid:34452000
  36. 36. Shakeel CS, Mujeeb AA, Mirza MS, et al. Global COVID-19 vaccine acceptance: A systematic review of associated social and behavioral factors. Vaccines. 2022 Jan 12;10(1):110. pmid:35062771
  37. 37. Snehota M, Vlckova J, Cizkova K, et al. Acceptance of a vaccine against COVID-19: A systematic review of surveys conducted worldwide. Bratisl Lek Listy. 2021 Jan 1;122(8):538–47. pmid:34282618
  38. 38. Troiano G, Nardi A. Vaccine hesitancy in the era of COVID-19. Public Health. 2021 May 1;194:245–51. pmid:33965796
  39. 39. Wake AD. The willingness to receive COVID-19 vaccine and its associated factors: “Vaccination refusal could prolong the war of this pandemic”–A systematic review. Risk Manage Healthc Policy. 2021;14:2609. pmid:34188572
  40. 40. Yasmin F, Najeeb H, Moeed A, et al. COVID-19 vaccine hesitancy in the United States: A systematic review. Front Public Health. 2021;9:770985. pmid:34888288
  41. 41. Fattah A, Fazli B, Eshkil S, et al. Factors associated with COVID‐19 vaccine acceptance worldwide: A rapid review. Med Edu Bull. 2022 Feb 7; 3(1):375–385.
  42. 42. Li M, Luo Y, Watson R, et al. Healthcare workers’(HCWs) attitudes and related factors towards COVID-19 vaccination: A rapid systematic review. Postgrad Med J. 2021 Jun 30. pmid:34193545
  43. 43. Lin C, Tu P, Beitsch LM. Confidence and receptivity for COVID-19 vaccines: A rapid systematic review. Vaccines. 2020 Dec 30;9(1):16. ( pmid:33396832
  44. 44. Olu-Abiodun O, Abiodun O, Okafor N. COVID-19 vaccination in Nigeria: A rapid review of vaccine acceptance rate and the associated factors. PloS One. 2022 May 11;17(5):e0267691. pmid:35544545
  45. 45. Wang Y, Liu Y. Multilevel determinants of COVID-19 vaccination hesitancy in the United States: A rapid systematic review. Preventive Medicine Reports. 2021 Dec 16:101673. pmid:34934611
  46. 46. AlShurman BA, Khan AF, Mac C, et al. What demographic, social, and contextual factors influence the intention to use COVID-19 vaccines: A scoping review. Int J Environ Res Public Health. 2021 Sep 4;18(17):9342. pmid:34501932
  47. 47. Joshi A, Kaur M, Kaur R, et al. Predictors of COVID-19 vaccine acceptance, intention, and hesitancy: A scoping review. Front Public Health. 2021;9:698111. pmid:34485229
  48. 48. Khubchandani J, Bustos E, Chowdhury S, et al. COVID-19 vaccine refusal among nurses worldwide: Review of trends and predictors. Vaccines. 2022 Feb 2;10(2):230. pmid:35214687
  49. 49. Machado MD, Roberts B, Wong BL, et al. The relationship between the COVID-19 pandemic and vaccine hesitancy: A scoping review of literature until August 2021. Front Public Health. 2021;9:747787. pmid:34650953
  50. 50. Berry SD, Johnson KS, Myles L, Herndon L, Montoya A, Fashaw S, et al. Lessons learned from frontline skilled nursing facility staff regarding COVID‐19 vaccine hesitancy. J Am Geriatr Soc. 2021 May;69(5):1140–6. pmid:33764497
  51. 51. Gakuba C, Sar A, Gaborieau I, Hanouz JL, Verger P. Willingness to get a COVID-19 vaccine among critical care non-medical healthcare workers and impact of a vaccine information session. Anaesth Crit Care Pain Med. 2021 Jun;40(3):100860. pmid:33848874
  52. 52. Razai MS, Chaudhry UA, Doerholt K, Bauld L, Majeed A. Covid-19 vaccination hesitancy. BMJ. 2021 May 20;373. pmid:34016653
  53. 53. Hassan W, Kazmi SK, Tahir MJ, Ullah I, Royan HA, Fahriani M, et al. Global acceptance and hesitancy of COVID-19 vaccination: A narrative review. Narra J. 2021 Dec 7;1(3).
  54. 54. Rayhan MA, Mudatsir M, Nurjannah N, Ichsan I, Amir-Behghadami M, Khader YS, et al. Acceptance and willingness to purchase a hypothetical COVID-19 vaccine in a region under Shariah law: A cross-sectional study in Aceh, Indonesia. Narra J. 2022 Aug 1;2(2).
  55. 55. AP-NORC Center for Public Affairs Research. Safety concerns remain the main driver of vaccine hesitancy. (https://apnorc.org/projects/safety-concerns-remain-main-driver-of-vaccine-hesitancy/). (Accessed July 4, 2022).
  56. 56. Lazarus JV, Ratzan SC, Palayew A, Gostin LO, Larson HJ, Rabin K, et al. A global survey of potential acceptance of a COVID-19 vaccine. Nat Med. 2021 Feb;27(2):225–8. pmid:33082575
  57. 57. Shekhar R, Sheikh AB, Upadhyay S, Singh M, Kottewar S, Mir H, et al. COVID-19 vaccine acceptance among health care workers in the United States. Vaccines. 2021 Feb 3;9(2):119. pmid:33546165
  58. 58. Reñosa MD, Landicho J, Wachinger J, Dalglish SL, Bärnighausen K, Bärnighausen T, et al. Nudging toward vaccination: A systematic review. BMJ Glob Health. 2021 Sep 1;6(9):e006237. pmid:34593513
  59. 59. Betton M, Livrozet M, Planas D, Fayol A, Monel B, Védie B, et al. Sera neutralizing activities against severe acute respiratory syndrome coronavirus 2 and multiple variants 6 months after hospitalization for coronavirus disease 2019. Clin Infect Dis. 2021 Sep 15;73(6):e1337–44. pmid:33851216
  60. 60. Liu W, Russell RM, Bibollet-Ruche F, Skelly AN, Sherrill-Mix S, Freeman DA, et al. Predictors of nonseroconversion after SARS-CoV-2 infection. Emerg Infect Dis. 2021 Sep;27(9):2454. pmid:34193339
  61. 61. John Hopkins Medicine. COVID Natural Immunity: What you need to know. (https://www.hopkinsmedicine.org/health/conditions-and-diseases/coronavirus/covid-natural-immunity-what-you-need-to-know). (Accessed July 30, 2022).
  62. 62. Cavanaugh AM, Spicer KB, Thoroughman D, Glick C, Winter K. Reduced risk of reinfection with SARS-CoV-2 after COVID-19 vaccination—Kentucky, May–June 2021. Morbidity and Mortality Weekly Report. 2021 Aug 8;70(32):1081. pmid:34383732
  63. 63. John Hopkins Medicine. Long COVID: Long-term effects of COVID-19. (https://www.hopkinsmedicine.org/health/conditions-and-diseases/coronavirus/covid-long-haulers-long-term-effects-of-covid19). (Accessed July 30, 2022).
  64. 64. Darker C. Risk perception. In: Gellman M.D., Turner J.R. (eds) Encyclopedia of Behavioral Medicine. Springer, New York, NY. (https://doi.org/10.1007/978-1-4419-1005-9_866). (Accessed July 30, 2022).
  65. 65. Rodger D, Blackshaw BP. COVID-19 vaccination should not be mandatory for health and social care workers. New Bioeth. 2022 Jan 2;28(1):27–39. pmid:35049419
  66. 66. Tunçgenç B, El Zein M, Sulik J, Newson M, Zhao Y, Dezecache G, et al. Social influence matters: We follow pandemic guidelines most when our close circle does. Br J Psychol. 2021 Aug;112(3):763–80. pmid:33474747
  67. 67. Oosterhoff B, Palmer CA, Wilson J, Shook N. Adolescents’ motivations to engage in social distancing during the COVID-19 pandemic: Associations with mental and social health. J Adolesc Health. 2020 Aug 1;67(2):179–85. pmid:32487491
  68. 68. Borgonovi F, Andrieu E. Bowling together by bowling alone: Social capital and Covid-19. Soc Sci Med. 2020 Nov 1;265:113501. pmid:33203551
  69. 69. Lin CY, Imani V, Majd NR, Ghasemi Z, Griffiths MD, Hamilton K, et al. Using an integrated social cognition model to predict COVID‐19 preventive behaviours. Br J Health Psychol. 2020 Nov;25(4):981–1005. pmid:32780891
  70. 70. Ratzan SC, Parker RM. Health literacy. National library of medicine: Current bibliographies in medicine. Bethesda: National Institutes of Health, US Department of Health and Human Services. 2000 Feb. (https://webharvest.gov/peth04/20041105213541/ http://www.nlm.nih.gov/pubs/cbm/hliteracy.pdf) (Accessed July 4, 2022).
  71. 71. World Health Organization. Fighting misinformation in the time of COVID-19, one click at a time. (https://www.who.int/news-room/feature-stories/detail/fighting-misinformation-in-the-time-of-covid-19-one-click-at-a-time) (Accessed July 4, 2022).
  72. 72. Jolley D, Douglas KM. Prevention is better than cure: Addressing anti‐vaccine conspiracy theories. Journal of Applied Social Psychology. 2017 Aug;47(8):459–69.
  73. 73. Basol M, Roozenbeek J, Berriche M, Uenal F, McClanahan WP, Linden SV. Towards psychological herd immunity: Cross-cultural evidence for two prebunking interventions against COVID-19 misinformation. Big Data & Society. 2021 May;8(1):20539517211013868.
  74. 74. Organisation for Economic Co-operation and Development (OECD). OECD Policy responses to Coronavirus (COVID-19): Enhancing public trust in COVID-19 vaccination: The role of governments. (https://www.oecd.org/coronavirus/policy-responses/enhancing-public-trust-in-covid-19-vaccination-the-role-of-governments-eae0ec5a/) (Accessed July 8, 2022).
  75. 75. Gollwitzer PM, Sheeran P. Implementation intentions and goal achievement: A meta‐analysis of effects and processes. Advances in Experimental Social Psychology. 2006 Jan 1;38:69–119.
  76. 76. Webb TL, Sheeran P. How do implementation intentions promote goal attainment? A test of component processes. Journal of Experimental Social Psychology. 2007 Mar 1;43(2):295–302.
  77. 77. Ernsting A, Gellert P, Schneider M, Lippke S. A mediator model to predict workplace influenza vaccination behaviour–an application of the health action process approach. Psychol Health. 2013 May 1;28(5):579–92. pmid:23259583
  78. 78. Pal S, Shekhar R, Kottewar S, Upadhyay S, Singh M, Pathak D, et al. COVID-19 vaccine hesitancy and attitude toward booster doses among US healthcare workers. Vaccines. 2021 Nov 19;9(11):1358. pmid:34835289