Health New Media Res > Volume 8(2); 2024 > Article
Weerasinghe, Oyebode, and Orji: “No claims, no trials, no compensation. Just roll up your sleeve”: social media communication on vaccine uptake sentiments in Canada

Abstract

Social media platforms are data-rich sources of communication. We analysed 20,000 Canadian COVID vaccine tweets at two Canadian geographic and temporal levels of before and after vaccine arrivals in two provinces of British Columbia (BC) with the highest COVID vaccine uptake and Ontario (ON) with the lowest uptake. Using machine learning based sentiment analysis and topic modeling and drawing on framing theory, the positive and negative emotional sentiment were framed into actionable subframes to inform future vaccine propagation efforts. The vaccine negative sentiments that emerged were framed from a constellation of insecurities and categorized into four intertwined frames and themes: health information mavenism framed misinformation and conspiracy beliefs (20% and 16% post-vaccine reduction in BC and ON); constellation of insecurities framed antivaccine expressions and hesitancy (9% and 6% drop in BC and ON post-vaccine); pandemic of mistrust and opinions framed lack of faith and skepticism (post-vaccine arrival increased by 19% in BC and dropped by 6% in ON) and opinions and perceptions framed fear, death and worry (stable over time in BC and 20% increased in ON). Vaccine propagation efforts should consider over time disappearing misinformation and conspiracies while attentive to lingering conspiracies creating fears and worries of death.

Introduction

At the outset of the COVID-19 pandemic, there was unprecedented social media use, especially from the young and adults conversing opinions through these platforms as their sole communication forums and continued during the pandemic when other personal communication outlets like person-to-person communications were limited due to the lockdown restrictions. This trend continued throughout the vaccination phase to the end of the three prominent waves of the pandemic. The public health governance sector used Twitter (now X) as one of its outreach outlets (Slavik et al., 2021). These rapidly growing communication platforms soon became the sources for researchers and public health governance sectors to uncover public concerns about surveillance efforts. Researchers suggest Covid-19 vaccine uptake data collected from these communication platforms provides real-time insights (Slavik et al., 2021). Social media-based communication has proven to be a valid source of opinions. A US study confirmed a positive significant correlation between vaccine tweet counts and vaccine uptakes. Therein, Tweet opinions is shown to be in alignment with public vaccine uptake (Nelson et al., 2024).
The first COVID-19 vaccine was approved in Canada on December 9, 2020, and vaccination started on 21, December 2020 in British Columbia (BC) and on December 15, 2020, in Ontario (ON)(Health Infobase, 2024), the two study provinces. Throughout the vaccine and delivery processes, the general public and government officials used social media platforms to launch mass media campaigns, exchange public opinions, deliver government announcements, and even to respond to public reactions toward vaccines. Twitter (the platform now known as X) was one of the most widely used social media platforms in Canada and between 2019-2021, 7.4 million Canadians used Twitter and the gender distribution in 2016 showed 48% of female users (Statista, 2023), thus depicting almost equal gender representation. Negative attitudes towards vaccine safety and efficacy played a key role in vaccine hesitancy and social media championed in vaccine-related communication arenas (Cascini et al., 2022). Even further, the ability of social media content to uncover public sentiments towards vaccine communication for social research purposes has been demonstrated (Rotolo et al., 2022a). These previous research-based evidence sets the basis of the current research.
According to the Government of Canada, (Government of Canada, 2024a) the overall fully vaccine rate in Canada is 16.3%. The percentage of people vaccinated with at least one dose is 87%, and Canada falls among the most highly vaccinated countries in the world (World Health Organization, 2024). The percentage of fully vaccinated varies by province and British Columbia (BC) reported the highest (26%) and Ontario the lowest (11.1%) (Government of Canada, 2024a). COVID-19 vaccination began in Canada on December 14, 2020, (Government of Canada, 2024b). The current study period of before and after vaccine analysis includes 01-12-2020 to 23-12-2020.
Demographic characteristics and political attitudes were found to correlate with vaccine attitudes in Canada (Gravelle et al., 2008). Due to the overwhelming social media use, these outlets became a major driver for influencing the attitudes toward vaccine uptake in Canada (Boucher et al., 2021). One of the attitudes that received mixed opinions among global social media users was the proof of vaccine, of which positive attitudes were geared towards ease of traveling and negative attitudes were around depriving human rights and freedom (Khan et al., 2022). To achieve future vaccine campaign success, public health officials need to be aware of the context and patterns of public communication on social media. Canadian Twitter data sentiment analysis on COVID-19 vaccine attitudes revealed a mixture of negativity, expressing possible side effects and positivity depicting optimism, communicating vaccination as the only way to end the pandemic(Jang et al., 2022). However negative attitudes expressed on social media were strongly influential in vaccine uptake decision making. Twitter data analysis of Canadian vaccine hesitancy expressions found, among other factors, a link to a lack of public knowledge and the government’s inability to communicate safety and efficiency information (Griffith et al., 2021). These geographic and temporal variants of vaccine attitudes between and within countries hinder international and national efforts to launch a successful vaccine campaign. One Canadian qualitative study that analyzed vaccine-related newspaper editorial cartoons found an attitude shift from positive to negative, over a span of time, expressing high hopes at the beginning and dissatisfaction at the end (Pelletier et al., 2023) and thus endorses the need to explore temporal variations in research. The above study researchers procrastinated on possible challenges this temporal shift may impose on maintaining a high vaccine uptake (Pelletier et al., 2023).
Social media platforms have become a free-flowing data-rich source. Uninterrupted by researchers questioning and thereby guiding the thoughts in one direction, these natural flows of rapidly growing ideas on a topic provide opportunities for digital health researchers to uncover existing trends and patterns related to the current topic of public interest. The caveat to this source is the reliability of information and ability to detect prevalence of misinformation and disinformation sharing, (Patrick et al., 2022), which may lead to subsequential influence of public discourse towards undesirable directions. Health misinformation circulation in social media consists mostly of the unverified content by subject experts, that can be categorized as “false, inaccurate, or misleading” (Gottlieb & Dyer, 2020). Next to that is the lack of analytical tools and frameworks to identify and verify the reliability of information to be used in public health decision-making (Fernández-Luque & Bau, 2015). Cognitive bias stemming from social media framing of vaccine (mis)information is well documented in the literature and the need for public health experts to intervene is recommended (Patrick et al., 2022; Skafle et al., 2022).
The aim of this paper is to explore the framing of COVID-19 vaccine communication via tweets in the two provinces with high and low vaccine uptake in Canada. Using the time trends (before and after vaccine arrival) associated with social media health communication polarity, related to negative and positive sentiment expressions to vaccine uptake, we investigate the geographical-level ecological relationship between Twitter sentiments and vaccine uptake at the provincial level. We chose the two Canadian provinces British Columbia (BC) with the highest vaccine uptake and Ontario (ON) with the lowest vaccine uptake for this geographic-level ecological investigation (Health Infobase, 2024). Motivated by our previous research that revealed the association between COVID-19 caseloads and emotional exacerbations measured through sentiments expressed via Twitter data (Weerasinghe et al., 2023a), this paper demonstrates the use of AI-based machine language analytical tools and frameworks to uncover emerging salient topics unfiltered by researchers’ judgments. Our dataset contained 543,630 tweets covering the period of 01-12-2020 to 23-12-2020.
Through the lens of framing theory, we analyzed 20,000 Canadian Tweets related to vaccines to uncover positive and negative emotional sentiments and frame these themes into meaningful actionable subframes to inform future vaccine propagation efforts. The sentiment analysis results illustrated in the current paper will primarily on the negative emotions, to make recommendations to improve vaccine uptake in future vaccine delivery efforts. We will outline pro-vaccine expressions to understand the pattern to provide guidance for future vaccine promotion efforts. This article contributes new knowledge on how social media framing relates to health interventions and public health policy changes, across geographies and periods in Canada. We first illustrate negative sentiment changes over time and geography, and then illustrate counteractive positive sentiments around public health surveillance decisions of vaccine mandate and delivery.
COVID-19 vaccine safety and efficacy were two of the most public health controversies that arose during the pandemic in Canada (Dubé et al., 2022). There were massive public campaigns against vaccine propaganda in Canada and social media has been extensively used to mitigate antivaccine and pro-vaccine messaging. The following literature review provides a summary of research-based evidence on COVID-19 vaccination, primarily focusing on Canada, but also covering global evidence on social media communications. We intend to cover both pro- and anti-vaccine polarized environments. Analytical frameworks and social theories pertaining to the topic are also reviewed.

Literature Review

Several Canadian vaccine communication studies have used social media platform data. A qualitative study that analyzed contents covered in the Canadian Broadcasting Cooperation news and commentaries, categorized relevant comments into concerns mostly arising along the line of vaccine safety and effectiveness; criticism of the government; sources of information used to support posts, and challenges and misinterpretations (Rotolo et al., 2022b). The analysis led to recommendations towards taking action to communicate facts, quoting evidence-based information to foster vaccine acceptance (Rotolo et al., 2022b). Another Canadian vaccine study that used 605 tweets collected from December 18 to December 23rd, 2020, analyzed the contents using the theoretical domain framework and found issues related to vaccine safety, lack of knowledge, political influence, antivaccine messaging, and lack of liability from vaccine companies (Griffith et al., 2021). A qualitative study that analyzed cartoons that appeared in Canadian newspapers, from January 2020 to August 2022, noted criticism about unvaccinated and the effectiveness, among other themes, in which the criticism was framed as coming from vaccine fatigue (Pelletier et al., 2023). Through the contents of these study findings that analyzed vaccine social media communications at different time frames, safety and effectiveness, government involvement, and issues with information sources were common themes that emerged. However, the discrepancies noted in the Canadian literature were time- and geography-sensitive.
A study that included Twitter and Reddit vaccine sentiments, compared four countries, Canada, the UK, the US and India, and revealed, that in the middle of the year 2021, Canadian Tweets were the most pessimistic, and hesitancy expressions were second highest in Canada (Kaushal et al., 2023). Researchers recommended tracking public attitudes towards vaccines, considering geographic variations to respond to geo-community-specific concerns (Kaushal et al., 2023). Another multicounty study that compared vaccine-negative Tweets across different vaccine types among Canada, the UK and the US found variations over country, time, and vaccine types (Yiannakoulias et al., 2022). The current study fills the gap in Canadian knowledge on temporal and geographic variations in vaccine sentiment communications.

Conspiracy theory and misinformation

A popular conspiracy theory belief underlines the social media influence of (mis)information spread about COVID-19 vaccines worldwide (Farhart et al., 2022), and few studies have confirmed the negative impact on diverse communities in Canada (Burns et al., 2024). Besides the conspiracy theorists have argued a two-pronged contextualization. First contextualization was, one conspiracy has been resulting from or rooted in a belief in a different conspiracy, and the second formulation is that a conspiracy is rooted in the social context wherein stigmatized marginalized groups are becoming subject to the social media and political influences (van Prooijen & Douglas, 2018). Those who believed in or experienced adverse reactions to previous vaccines may spread (mis)information about the COVID-19 vaccine through social media. On the other hand, certain marginalized groups, with diminished institutional trust may cast doubt on the effectiveness of the vaccine. A scoping review of 19 articles reported approximately 96% of Canadians receive misinformation through social media platforms indicating vaccines will be harmful to some racial minorities (Kemei et al., 2022).

Theoretical frameworks

Several theoretical frameworks have been used within the global vaccine research context. The most used was the framing theory. Social media messaging research has used the theory to “identify and label” shared experiences and opinions and applied it to vaccine information exchange via social media platform advertisements (Bradshaw, 2023) and another researcher has framed this as infodemic, a concept used to elaborate the wide use (Mohammadi et al., 2022). Framing theory and there upon the framing analysis, equip communication in to systemized concepts of frames to identify and label perception of events circulating in the social world (Entman, 1993). Within the context of this paper, researchers who reviewed health communication related published articles that included framing theory cited vaccine communication as one of the most areas of the application among others like cancer, nutrition and obesity (Guenther et al., 2021). However, very few studies have applied the theory to social media Tweet analysis for COVID vaccine hesitancy. One study that used Amazon Mechanical Turk social media platform data applied framing analysis to COVID vaccine willingness and they highlighted complexities associated with willingness impact framing and identified dependency on skepticism (Ademu et al., 2023).Research on COVID-related news media coverage applied the framing theory to identify the common problems “framed” in the text data and the major components arose were identified depicting “dominant frames”(Reynolds, 2022). Based on the applications to social media news coverage, the theory has shown flexibility and capability to capture the chronological variations in the frames (Reynolds, 2022) and this applies to our proposed study framework wherein we intend to capture the health communication messaging influence on vaccine uptake temporal variations. The intermediate process of social media coverage of vaccine sentiments and vaccine uptake messaging was the mass advocacy campaigns launched in Canada, inclusive of those who were both pro and against COVID-19 vaccination. The framing theory has been applied to those situations, capturing social movement framing influence identification in social media research during the pandemic (Sorce & Dumitrica, 2023). Further research revealed that the outcomes produced, in the current study context, the choice of vaccine, and the decision to get vaccinated, can be influenced by the way the media frame the problem, in either direction, positively or negatively (Park & Reber, 2010). Two research groups used the psychological principle of the perception changes depending on the way the situation is framed (Park & Reber, 2010; Tversky & Kahneman, 1981). The current study adopted framing theory as the theoretical framework suitable for Tweet data analysis and interpretations.

Methods

Figure 1 shows the methodological steps for acquiring and processing COVID-19 vaccine-related tweets. Permission was obtained from X Corp. (formerly Twitter Inc.) through their Academic Research Track to perform a full-archive tweet search over a long period. For this article, we used a subset of tweets covering the period of 01-12-2020 to 23-12-2020 using geo-tagged tweets from Ontario and British Columbia. The first phase of Twitter data extraction shown in Figure 1, is described in detail elsewhere (Weerasinghe et al., 2023b).
In Phase 1, we extracted tweets and associated metadata (within the period 01-Dec-2020 to 28-Feb-2021) using the following hashtags: #Vaccine, #Vaccines, #CovidVaccine, #ImVaccinated, #IGotVaccinated, #VaccinesSaveLives, #VaccinesWork, #Vaccinated, #VaccineForAll, #GetVaccinated, #vaccination, #vaccineinjury, #VaccineEquity, #covax, #COVIDvaccine, #GetTheShot, and #KeepVaccinating. In addition, keywords related to vaccine were used in the search query, such as vaccine, vaccines, vaccination, immunize, immunise, immunization, immunisation, inoculate, and inoculation. To ensure that extracted tweets are related to COVID-19, we included additional criteria to retain only tweets that contain at least one of the following keywords: coronavirus, covid-19, covid19, and SARS-CoV-2.
Next, we preprocessed the extracted tweets (n=13,433,615) by applying the following natural language processing (NLP) techniques using the Natural Language Toolkit (NLTK) and Python: (1) Removal of hashtags, mentions, and URLs, (2) Removal of punctuation and other special characters, (3) Removal of numbers, (4) Removal of stop words, (5) Lemmatizing words to convert them to their root form, and (6) Removal of duplicates. Afterwards, we geotagged the preprocessed tweets (n=7,638,361) using our GEOTAGGING algorithm described in (Weerasinghe et al., 2023b). Of the 543,630 tweets that originated from Canada, 67,923 and 214,768 tweets emanated from British Columbia (BC) and Ontario (ON), respectively. Of these, we sequentially selected 10000 distinct Tweets related to the COVID vaccine, in each province, which included 5000 tweets covering the before-vaccine arrival period of 01-Dec-2020 to 09-Dec_2020 and another 5000 Tweets covering the after-vaccine arrival period of 20-Dec-2020 to 28-Feb-2021 in BC and in ON. Altogether we analyzed 20,000 tweets in both provinces. Altogether we analyzed 20,000 tweets in both provinces. Rationale for choosing 5000 Tweets is firstly to accommodate analytical capacity of the software that we used for analysis (RapidMiner) and we limited to one week of data acquisition period of the event of interest, which seems to be in par with the time period of other Tweet studies.
Phase 2 analysis (Figure 1) involves machine language-based analysis which was carried out using RapidMiner software (Mierswa, Ingo, 2018). Data preprocessing was carried out first subsetting BC and ON tweets from the Canadian Tweets and then filtering out vaccine-unrelated terms. We used the remove duplicate operator in RapidMiner, to remove duplicates and selected the first 5000 tweets (from 01-Dec-2020 to 09-Dec-2020) and the last 5000 tweets (from 20-Dec-2020 to 28-Feb-2021) covering the two study periods in BC and ON. We used the natural language processing-based sentiment classification system, VADER (Valence Aware Dictionary for sentiment Reasoning) (Hutto C.J. and Gilbert, 2014) to uncover positive and negative sentiments in the Tweets using the extract sentiment operator in RapidMiner. The VADER assigned a score between -4 and +4 based on the sentiment expressed in the Tweets; higher numbers represent greater sentiment strength, and the sign represents the direction of the valence, a negative sign indicates a negative sentiment, and a positive sign indicates positive sentiments. Zero was assigned to neutral sentiments. Then we removed neutral sentiments and positive and negative sentiments were used for Latent Dirichlet Allocation (LDA) topic modeling.
Topic modeling has been widely used in social media health communication research data analysis. Two of such applications are early COVID pandemic assessment (Chipidza et al., 2022) and a special application to Tweet data analysis that compares several media coverage within a given period and found high level of coherence(Pinto et al., 2019). LDA is a widely used method for social media data topic modeling (Blei et al., 2003), in which documents are automatically classified into salient topic groupings, using a method called TF-IDF, which stands for term frequency-inverse document frequency(Ljajić et al., 2022). TF-IDF is a widely used method in natural language processing to uncover the importance of a topic in relation to all the topics, in the document. Salient groupings that emerged, containing topics with higher weights (TF-IDF values) were obtained at each period for each province. After obtaining automated groupings we used framing theory to provide meaningful interpretations to the groups. LDA remains a valuable tool for topic modelling where topics are distributions over words and documents are distributions over topics, thereby making the results interpretable (Blei et al., 2003). However, LDA treats documents as unordered collections of words, ignoring word order and context, which can limit semantic understanding. BERT-based models address this gap by incorporating semantic context through deep learning in that they use transformer architectures to capture word context and semantics, considering word order and surrounding words. Yet, BERT-based models are not only resource-intensive but also black boxes, which makes it harder to interpret how topics are formed compared to LDA’s probabilistic distributions. Therefore, the choice between LDA and BERT-based models depends on the specific requirements of the task, such as the importance of interpretability versus the need for capturing nuanced semantic relationships.

Results

Before vaccine arrival in BC, the province with the highest vaccine uptake in Canada, there were 1313 (26%) negative, 2294 (46%) positive and the rest were neutral sentiments. During the same period in ON, the province with the lowest vaccine uptake, there were 1158 (23%) negative and 2663 (53%) positive sentiments, before vaccine arrival. In ON negative sentiments increased after vaccine arrival to 34% and positive sentiments decreased to 41%, after vaccine arrival. In BC negative and positive sentiments were roughly the same after vaccine arrival (28%) and (44%). Figure 2 shows topic modeling results and we noticed appearance of some recurrent topics across geographies and periods. Dominant negative sentimental topics that emerged were categorized into four intertwined frames: Misinformation and conspiracy beliefs; Antivaccine and hesitancy; Lack of faith and skepticism and Fear, death and worry.
In BC, misinformation and conspiracy sentiments declined by 20%, after vaccine arrival, and antivaccine and hesitancy communications dropped by 9% (Table 1). However, after the vaccine arrival, lack of faith and skepticism grew by 19% in BC. Though fear, death and worry sentiment prevalence increased in BC by 41%, 11% of those sentiments took a positive spin stating “not to worry” about the vaccine. After removing double negating expressions, the after-vaccine negative sentiments in this category rose to 57%, still showing a remarkable increase from before-vaccine arrival sentiment percentage. Following the same trend as in BC, in ON, the misinformation and conspiracy belief communications declined by 16% after vaccine arrival. So did the antivaccine and hesitancy sentiments in ON dropped by 18%. Unlike in BC, lack of faith and skepticism dropped down in ON by 6%. However, fear, death and worry increased by 22% of which worry was mostly associated with negating (38%) in Ontario, stating “not to worry” about the vaccine. Taking this into account “fear, death and worry” increased by 22% in ON after vaccine arrival and was stable in BC (Table 1).

Health information mavenism-Misinformation and conspiracy beliefs

Rooted in the market information exchange, mavenism has been introduced to health communication pattern exploration among the public via interpersonal connections (Hayashi et al., 2019). In that venue, mavens, defined as those who spread information, are considered to have limited subject expertise (Hayashi et al., 2019) and a recent study defined as opinion leaders in a healthcare community who share up-to-date health knowledge (Smith et al., 2022a).
Even before vaccine arrival, social media users in Canada expressed concerns about the spread of misinformation and conspiracy beliefs around the COVID-19 vaccine. A few examples of misinformation circulated among tweeters are listed in Table 2. These Tweets came as warning messages to the government. Tweeters pointed out the consequences of misinformation, as hindering government efforts to combat the spread of the virus. Social media users framed misinformation as “fake news” and stated this became a “second pandemic” and quoted reliable sources of world organization news pages pleading with government organizations to take necessary steps to stop the spread of this so-called “second pandemic”. Tweeters not only express their own opinions, and they are always backed by sources of information link sharing. The conspiracy theory is framed in two ways, by “a weird pseudo” theory and by the QAnon theory (Table 2). Though no strong evidence is available to show that the social media platform has been used to spread misinformation, there are some news flashings without concrete evidence. Conversely, the myths were also busted with scientific evidence by some tweeters.
After vaccine arrival and delivery social media users continued communicating devastating consequences of misinformation but on a lighter tone. They also added, “Misinformation online can have devastating consequences”. Like BC Tweeters, Ontarians articulated the responsibility of social media. Furthermore, the evolving types of conspiracy beliefs were also identified, in ON and one conspiracy theory has led to another as Ontario tweets related the conspiracies moved from United States such as QAnon, a widespread unfounded theory (Table 2).

Constellation of insecurities - Antivaccine and hesitancy sentiments

Before vaccine arrival in both BC and ON, antivaccine movement was noted as a big threat to government campaigns in BC and this was seen as hostile propaganda coming from social media outlets such as Facebook in Ontario. Labeling as an “anti-vaxxer” is seen as an insult in some cases and racially motivated to label some marginalized groups who are hesitant to receive the vaccine (Table 3).
At the planning stage of vaccine delivery, the priority groups were identified. The healthcare professionals were at the forefront of the priority list, due to their high level of exposure to COVID-19 patients and to avoid transmission through them to other patients. As BC Tweeter said healthcare professionals’ hesitancy came from the undesirable notion of becoming experimental subjects, another misunderstanding (Table 3). Based on an Ontario tweets there were expressions related to government taking precautionary measures to mitigate reassurance among the skeptic healthcare workers. Pro-vaccine groups identified anti-vaxxer as an insult used by hostile propaganda and misinformed movement.
After vaccine arrival, the hesitance continued in Ontario as one Tweeter put it is a constellation of multiple negative personal emotional sentiments (Table 3). There is a shift of sentiments from being more objective before vaccine arrival to becoming more subjective after, perhaps because misinformation that was circulated has been replaced by scientific data later. The need to overcome vaccine hesitancy over the issue of antivaccine and the issue of historically marginalized groups becoming experimental subjects of vaccine testing in the past were emphasized as fundamental issues to be addressed. Information sources for mitigating the challenges of anti-vaccine misinformation were also highlighted.

Pandemic of mistrust-Lack of faith and skepticism

The Tweet communications revealed mistrust and lack of faith in the public health systems, and this is framed as creating skepticism about vaccine delivery and administering mechanisms that hinder safety and efficiency (Table 4). Tweeters indicated these lingering sentiments are not about vaccines but related to systemic issues. In Ontario, lack of faith was tied to mistrust over the authorities who share information which is seen as hampering vaccine distribution efforts. The tweeters framed it as a pandemic of mistrust. Vaccine skepticism is another concept that is centered around the public health system. In Ontario, skepticism came from other countries such as the UK being one of the first countries to approve the vaccine without proper regulatory approval.
After vaccine arrival, Tweeters noted escalating death tolls and while the public was losing faith public health officials were putting faith in vaccines by showing them receiving vaccines on mass media.

Opinions and perceptions - Fear, death and worry

Fearing was related to rising COVID-19 deaths and doubts about vaccine effectiveness and these perceptions were more prominent before than after vaccine arrival (Table 5). Lingering conspiracy theories of genetically engineered vaccines and people dying during vaccine trials added to the fear and worry. Contrary to Ontarian Tweeters expressing negative sentiments about their worries, BC communications were geared toward minimizing worrying about vaccine efficacy instead of prevention efforts of the virus spreading and accessibility to vaccines.
After the vaccine’s arrival, a sense of relief was expressed by those medically vulnerable, and “fear of needles” was also expressed by some. There was added fear and worry about mandating to carry vaccine cards, what was framed as “immunity passports”. So fear and worry take different facets at different stages of the vaccination campaign. In Ontario, vaccine delay was seen as comforting to those who fear needles. Also, vaccination is seen as a government effort to lift lockdown, and fear of death due to rising COVID was expressed.

Discussion

Our social media study on vaccine Tweet communication exchange text mining and framing analysis using topic modeling revealed time and geographic varying patterns of negative and positive sentiment exchange, before and after vaccine arrival in two geographies in Canada with the highest (BC) and lowest (ON) vaccine uptake. Our machine learning-based sentiment analysis and topic modeling suggest geographic differences in antivaccine sentiments and hesitancy expressions before vaccine arrival, with the lowest uptake province showing higher negative sentiments, across the period. The four negative sentiment topics that emerged were framed as: health information mavenism; the constellation of insecurities; the pandemic of mistrust and opinions and perceptions.
Three types of misinformation found in a review of 45 articles based on 7 countries’ social media misinformation exchange were vaccine development, medical information, and conspiracy claims (Skafle et al., 2022) coincides with the misinformation that we uncovered within two Canadian provinces. A study that analyzed masks and vaccine-related Tweets during the first 6 months of the pandemic found tweets with misinformation on vaccines were mostly on political nature (Trotochaud et al., 2023). The current study Tweets were collected during December 2020, six months after the aforementioned study and similar misinformation were lingering in tweets. Conspiracy beliefs and misinformation spread framed as health information mavenism in the current study suggested two types of vaccine-related health mavenism: misinformation circulation from the public and retweeting by subject experts and government officials demystifying with scientific evidence. These two types align with the literature-suggested definition of health mavens as opinion leaders of health communication (Smith et al., 2022b). There is evidence in the literature that conspiracy and misinformation or disinformation spread on social media threaten compliance and correlates with vaccine hesitancy and uptake (Skafle et al., 2022). Though the same individuals were not followed over time, we found a decline in misinformation circulation in both provinces, more so in BC with the highest vaccine uptake than in ON (the capital city) with the lowest uptake. Ontario’s misinformation came from opposition political parties showing the government’s inability to guarantee vaccine safety. The health mavens who demystify the misinformation were stronger communicators in the two study provinces than the public who communicated vaccine side effects misinformation.
Our study data framed both anti-vaccine sentiments and vaccine hesitancy, as arising from a constellation of insecurities, all of which decreased after vaccine arrival (Table 1). The contributing factors to the constellation were, historical exposure of Black people as vaccine experimental subjects, fear of needles, side effects and anti-vaccine conspiracy theories, which was noted as the strongest contributor of vaccine hesitancy through online sample surveys (Farhart et al., 2022). The COVID vaccine hesitancy cross-sectional Canadian study results, found ethnicity, political affiliation, and beliefs in vaccine conspiracies were associated with hesitancy (Burns et al., 2024). Another online survey among participants from UK, US and Canada found Canadian and US participants’ COVID vaccine hesitancy is more related to political affiliation than in the UK (Gravelle et al., 2008). Our data also suggest vaccine supporters condemning the propaganda against anti-vaccine movements and this is similar to the findings of two studies on Canadian vaccine tweet analysis (Gravelle et al., 2008; Griffith et al., 2021). Congruence of these survey study findings add to the credibility of our findings on social media vaccine hesitancy.
Pre-vaccine arrival lack of faith and skepticism expressions percentage, which was higher in ON than BC, declined post-vaccine arrival as opposed to a post-vaccine increase shown in BC. The tweet expressions of lost faith and skepticism were related to how government officials were handling vaccine delivery mechanisms and regulatory approval processes. A four-country twitter data analysis noted the highest rate of time-varying attitudes towards vaccines in Canada compared to UK, US and India (Kaushal et al., 2023). Lack of faith, sprouted from mistrust around safety concerns were the lowest rated in our study contrasting another study on Canadian tweets which noted trust as the most dominant emotion tweet (Jang et al., 2022). Another Canadian Tweet study noted vaccine manufacturers release of effectiveness information diminished lack of faith and skepticism (Lyu et al., 2021). Health mavens may have played a role to increase faith and decrease skepticism, as noted in the literature (Smith et al., 2022a). Though our study was the first Canadian study that pointed out a lack of faith and skepticism due to system issues contributing to hesitancy, a study in India found regulatory agencies’ lack of transparency and inappropriate expedited processes generating skepticism (Sarkar et al., 2021).
Our last frame of fear of death and worry about the COVID-19 vaccine side effects received the lowest ranking in both study provinces, which increased in Ontario, after vaccine arrival. Our data suggest time-varying contexts of fear and worry, started from conspiracy theories and misinformation about death due to vaccine, worrying about vaccine efficacy, fear of needles, worrying about vaccine passport mandates and possibilities of rising death tolls due to post-vaccine lifting of lockdown measures. A longitudinal study conducted in UK confirmed continuing fear and worry about COVID to the level that impairs peoples’ sleep quality (Quigley et al., 2023). There was no other Canadian study that explored effects of COVID vaccine-related fears and worries, but confined to COVID death (Taylor et al., 2020).

Conclusion

The temporal and geographic patterns expressed through social media platform Twitter resonate with public opinion on vaccine hesitancy and uptake and provide a basis for future public health surveillance program planning. The current study finding of misinformation and conspiracy claims was comparable to the other social media studies in different countries and periods. However, no study has shown patterns of variations before and after public health intervention of vaccination across distinct frames and themes. The current study adds to the growing literature in this area about the potential of social media in public health surveillance and possibilities of subject experts and government officials demystifying vaccine myths using scientific evidence to reduce the influence of misinformation mavenism. Additionally, our study adds to the body of knowledge about within-country geographic differences in the vaccine hesitancy movements and some frontline healthcare professionals feeling hesitant due to being in the vaccine priority group because there is a lack of long-term effects studied. Even further, our study was the first Canadian study that pointed out a lack of faith and skepticism due to system issues impeding vaccine uptake and also uncovered fears and worries arising due to lifting lockdown measures.

Limitation

The study on social media communication data analysis has several inherent limitations that are common to other similar studies. VADER sentiment analysis was not sensitive to capture sarcasm and manual coding of salient topics that combine string of words is strongly advised. Foremost there are no demographic diversity captured in the tweets and research suggest low sensitivity (68%) in geotagging for location detection (Compton, R., Jurgens, D., & Allen, 2014). Though tweets mention about racial minority and gender specific information the demographic diversity of individuals who expressed vaccine sentiments were not captured. Further research may need to confirm the social media study findings using online sample survey data to better understand demographic diversity.

Data Availability Statment

No permission was obtained from X Corp. (formerly Twitter Inc.) to redistribute original tweets. Aggregated topic modelling data in the form of dominant topics and prominent word lists are available from the corresponding author on reasonable request.

Acknowledgement

Authors acknowledge Dr. Stan Matwin for his contribution of conceptualization of the COVID Tweet project and guidance on tweeter data acquisition and analysis.

Notes

Funding Information

This study did not receive any funding from industry, private or public sector for the data analysis and writing.

Conflict of Interest

Authors declare no conflict of interest for this study data analysis and interpretation of results.

Figure 1
Methodological steps
hnmr-2024-00129f1.jpg
Figure 2
Top ten negative sentiment topics before and after vaccine arrival, across geographies
hnmr-2024-00129f2.jpg
Table 1
Topic modeling and emerging frames in two geographies at two-time points.
Frame and related sentiment topics Before vaccine arrival (%)* After vaccine arrival (%)*

British Columbia Ontario British Columbia Ontario
Misinformation and conspiracy beliefs 96% 97% 76% 81%
Antivaccine expressions and hesitancy 79% 91% 70% 73%
Lack of faith and Skepticism 45% 91% 64% 85%
Fear, Death and Worry 27% 31% 30% 53%

*Percentage shows the topic occurrence from the total Tweets within the frame

Table 2
Misinformation and conspiracy beliefs frames and related tweets
Vaccine Arrival Time Frame British Columbia Ontario
Before “The fervour, the fear, the rage and the anger fuelling bizarre beliefs on all sides, from athletes all developing myocarditis, to vaccines making us infertile, and all the other fanciful scare stories can be so tiring.” “Pathogenic priming likely contributes to serious and critical illness and mortality”; “COVID vaccine can make you sick & even kill you and sterilize you and your daughter” in BC and INTERPOL warns of organized crime threat to COVID-19 vaccines.
“Here we go... With no evidence, vaccine injuries and deaths will be spun as ‘incidental’ correlations. That’s vaccine ‘Science’ for you.” “Mico Defense will not protect you from COVID-19. Neither will vitamin D. What WILL protect you from getting COVID-19, is getting the vaccine.” A Ph.D. microbiologist.
After “Can you release the vaccine contracts, so we don’t have to rely on misinformation. After being told that masks are bad for you and that border closure is racist & #covid19 would be rare in Canada, we can’t believe anything the liberals say.” “I’ve been seeing more people questioning vaccines using QAnon theories. Mind you these same people were all anxiously awaiting for a ‘light at the end of the tunnel’ to appear and now misinformation seems to be winning.”
“Misinformation in the wrong hands can be extremely dangerous. For women who are worried about infertility or miscarriages from the #COVID-19 vaccine, the allegation is baseless and has been dismissed by experts.” “It is up to people on social media NOT to share disinformation & misinformation about vaccines.”
Table 3
Antivaccine and hesitancy frames and related tweets
Vaccine Arrival Time Frame British Columbia Ontario
Before “It will be bigger than anything we’ve ever seen from the anti-vax movement.” “We must distinguish between the #vaccine-hesitant &; #antivaxxers and focus on winning over the former group if we are to bring #COVID19 under control.”
“Some health care professionals said they are hesitant to take a Covid-19 vaccine that was so quickly developed. “Thus far it’s been a unanimous ‘hell no,’” said an emergency room nurse. “Why, are we guinea pigs?” “Horrific events in history and the unethical treatment of Black and Indigenous peoples could be the reason why some from these communities could be hesitant to get the COVID-19 vaccine, according to some academics.”
After “We must distinguish between the #vaccine-hesitant &; #antivaxxers and focus on winning over the former group if we are to bring #COVID19 under control.” Dissent. Deliberation. Distrust. Indifference. #Vaccine hesitancy is not one thing. ... It is a constellation of motivations, insecurities, reasonable fears, and less reasonable conspiracy theories.”
“Horrific events in history and the unethical treatment of Black and Indigenous peoples could be the reason why some from these communities could be hesitant to get the COVID-19 vaccine, according to some academics.” “If someone says there’s aluminum in that, you can say, ‘not in this one.’ And if someone says there’s mercury in that, you can say, ‘not in this one. My talk with the author of the Antivaxxers: How to Challenge a Misinformed Movement.”
Table 4
Lack of faith and skepticism frames and related tweets
Vaccine Arrival Time Frame British Columbia Ontario
Before As we move forward with delivery of the #COVID19 vaccines, understand: Most Black people who are hesitant about vaccinations are not “anti-vaxxers.” They do not deny facts, or science, or endorse conspiracy theories. Their lack of faith in vaccines isn’t about vaccines at all.” But this coming from a writer who just recently declared that he [government authority] was doing holidays in person despite knowing better and does NOTHING to combat it [vaccine hesitancy] and further sows mistrust. In fact, he gets fundamental aspects of SARS-CoV-2 vaccines wrong.”
The shift in messaging from supporting science to vaccine skepticism is dangerous. This is not appropriate and does not justify or excuse the government’s delay in vaccine procurement.” However lots of criticism/skepticism from some (EU) voices about the lack of a robust review process before UK regulatory approval.”
After This is what I’m waiting to hear. Every day those numbers get higher, I get more discouraged and lose faith in humanity.” “Faith-heads conflicted over the morality of Covid-19 vaccines. Fine!,,, They know where the end of the line is, right?”
Put me down as a pro-vaccination skeptic. “some experts say it is important for people to understand there might be differences between vaccines in preventing moderate cases of covid-19, because even those infections could have long-term consequences Interesting theory: Historic, unethical treatment of Black, Indigenous peoples behind COVID-19 vaccine mistrust.
Table 5
Fear, death and worry frames and related tweets
Vaccine Arrival Time Frame British Columbia Ontario
Before I’m now going to say some things. It’s important. So, we’re not far from receiving vaccines and we’re also seeing major daily spikes in Covid-19 It’s a difficult time. Here’s the thing. You have to worry about you, and the people in your bubble, plus the family you love.” Now 3 months into Ontario’s 2nd wave, 380 #LTC home residents have died of #COVID19 with 273 deaths in the month of November alone. While vaccines are on the horizon, there is a “long darkness before dawn”—urgent action is needed to mitigate this tragedy.”
“Poor communities of color that don’t have many pharmacies within walking distance worry they may be left behind when #COVID19 #vaccines roll out to the general public next year.” Read about how COVID-19 was genetically engineered to provoke fear and terror among the masses to get them to be all bar-coded in a mass vaccination program.”
Six people died in late-stage testing of phizer vaccine. But don’t worry, they’re still making the vaccine mandatory because they don’t give a shit.”
After I felt surrounded by the virus, to the point that my own illness seemed inevitable. Once I was vaccinated, I was delivered from this fear. Yet accepting my dose at the front of the line, I’m stuck with the reality of my privilege.” Looks like I have until next spring to overcome my fear of needles.”
Contrary to media reports, COVID-19 vaccines have caused paralyzing facial condition. The Jab only increases your risk of facial paralysis by 350 - 700 %. Nothing to worry about ! Right ?” “Ottawa health We’re going to need that vaccine, since OPH is trying to make sure Covid19 stays in Ottawa forever by trying to break a Province-wide 28-day Lockdown. Disgraceful conduct. There will be wrongful death lawsuits I imagine...”

References

Blei, D. M., Ng, A. Y., & Edu, J. B. (2003). Latent Dirichlet Allocation Michael I. Jordan. Journal of Machine Learning Research, 3.
Boucher, J.-C., Cornelson, K., Benham, J. L., Fullerton, M. M., Tang, T., Constantinescu, C., Mourali, M., Oxoby, R. J., Marshall, D. A., Hemmati, H., Badami, A., Hu, J., & Lang, R. (2021). Analyzing Social Media to Explore the Attitudes and Behaviors Following the Announcement of Successful COVID-19 Vaccine Trials: Infodemiology Study. JMIR Infodemiology, 1(1), e28800. https://doi.org/10.2196/28800
crossref pmid pmc
Bradshaw, A. S. (2023). To Share or Not to Share: A Framing Analysis of Paid Vaccine Advertisements on Facebook during COVID-19 and Pro-Vaccine Mothers’ Willingness to Promote Vaccines within Their Peer Networks, https://doi.org/10.1080/10641734.2022.2153392
Burns, K. E., Dubé, È, Godinho Nascimento, H., & Meyer, S. B. (2024). Examining vaccine hesitancy among a diverse sample of Canadian adults. Vaccine, 42(2), 129-135. https://doi.org/10.1016/j.vaccine.2023.12.030
crossref pmid
Cascini, F., Pantovic, A., Al-Ajlouni, Y. A., Failla, G., Puleo, V., Melnyk, A., Lontano, A., & Ricciardi, W. (2022). Social media and attitudes towards a COVID-19 vaccination: A systematic review of the literature. EClinicalMedicine, 48, 101454. https://doi.org/10.1016/j.eclinm.2022.101454
crossref pmid pmc
Compton, R., Jurgens, D., & Allen, D. (2014). Geotagging one hundred million Twitter accounts with total variation minimization. In: Big Data : 2014 IEEE International Conference on Big Data; 27-30 October 2014; Washington, DC, USA. pp 8 https://doi.org/10.1109/BigData.2014.7004256
crossref
Dubé, E., Gagnon, D., & MacDonald, N. (2022). Between persuasion and compulsion: The case of COVID-19 vaccination in Canada. Vaccine, 40(29), 3923-3926. https://doi.org/10.1016/j.vaccine.2022.05.053
crossref pmid pmc
Farhart, C. E., Douglas-Durham, E., Lunz Trujillo, K., & Vitriol, J. A. (2022). Vax attacks: How conspiracy theory belief undermines vaccine support. Progress in Molecular Biology and Translational Science, 188(1), 135-169. https://doi.org/10.1016/bs.pmbts.2021.11.001
crossref pmid pmc
Fernández-Luque, L., & Bau, T. (2015). Health and social media: perfect storm of information. Healthcare Informatics Research, 21(2), 67-73. https://doi.org/10.4258/hir.2015.21.2.67
crossref pmid pmc
Gottlieb, M., & Dyer, S. (2020). Information and Disinformation: Social Media in the COVID-19 Crisis. Academic Emergency Medicine : Official Journal of the Society for Academic Emergency Medicine, 27(7), 640-641. https://doi.org/10.1111/acem.14036
crossref pmid pmc
Government of Canada (2024a). COVID-19 vaccination:Vaccine coverage. Report. https://health-infobase.canada.ca/covid-19/vaccination-coverage/
Government of Canada (2024b). COVID-19 vaccination:Vaccine coverage. Report. https://health-infobase.canada.ca/covid-19/vaccination-coverage/
Gravelle, T. B., Phillips, J. B., Reifler, J., & Scotto, T. J. (2008). Estimating the size of ‘anti-vax’ and vaccine hesitant populations in the US, UK, and Canada: comparative latent class modeling of vaccine attitudes, 18(1). https://doi.org/10.1080/21645515.2021.2008214
Griffith, J., Marani, H., & Monkman, H. (2021). COVID-19 Vaccine Hesitancy in Canada: Content Analysis of Tweets Using the Theoretical Domains Framework. Journal of Medical Internet Research, 23(4), e26874. https://doi.org/10.2196/26874
crossref pmid pmc
Hayashi, H., Tan, A. S. L., Kawachi, I., Ishikawa, Y., Kondo, K., & Kondo, N. (2019). Toru Tsuboya & Kasisomayajula Viswanath (2020) Interpersonal Diffusion of Health Information: Health Information Mavenism among People Age 65 and over in Japan. Health Communication, 35(7), 804-814. https://doi.org/10.1080/10410236.2019.1593078
crossref pmid
Health Infobase, G. of C. (2024). COVID-19 vaccination: Vaccine coverage. Report. https://health-infobase.canada.ca/covid-19/vaccination-coverage/
Hutto, C. J., & Gilbert, E. (2014). VADER: A Parsimonious Rule-based Model for Sentiment Analysis of Social Media Text. In: Proceedings of the Eighth International AAAI Conference on Weblogs and Social Media; pp 216-225.
crossref pdf
Jang, H., Rempel, E., Roe, I., Adu, P., Carenini, G., & Janjua, N. Z. (2022). Tracking Public Attitudes Toward COVID-19 Vaccination on Tweets in Canada: Using Aspect-Based Sentiment Analysis. Journal of Medical Internet Research, 24(3), e35016. https://doi.org/10.2196/35016
crossref pmid pmc
Kaushal, A., Mandal, A., Khanna, D., & Acharjee, A. (2023). Analysis of the opinions of individuals on the COVID-19 vaccination on social media. Digital Health, 9, 20552076231186250. https://doi.org/10.1177/20552076231186246
crossref pmid pmc
Kemei, J., Alaazi, D. A., Tulli, M., Kennedy, M., Tunde-Byass, M., Bailey, P., Sekyi-Otu, A., Murdoch, S., Mohamud, H., Lehman, J., & Salami, B. (2022). A scoping review of COVID-19 online mis/disinformation in Black communities. Journal of Global Health, 12, 5026. https://doi.org/10.7189/jogh.12.05026
crossref pmid pmc
Khan, M. L., Malik, A., Ruhi, U., & Al-Busaidi, A. (2022). Conflicting attitudes: Analyzing social media data to understand the early discourse on COVID-19 passports. Technology in Society, 68, 101830. https://doi.org/10.1016/j.techsoc.2021.101830
crossref pmid pmc
Ljajić, A., Prodanović, N., Medvecki, D., Bašaragin, B., & Mitrović, J. (2022). Uncovering the Reasons Behind COVID-19 Vaccine Hesitancy in Serbia: Sentiment-Based Topic Modeling. Journal of Medical Internet Research, 24(11), e42261. https://doi.org/10.2196/42261
crossref pmid pmc
Lyu, J. C., Han, E Le, & Luli, G. K. (2021). COVID-19 Vaccine-Related Discussion on Twitter: Topic Modeling and Sentiment Analysis. Journal of Medical Internet Research, 23(6). https://doi.org/10.2196/24435
crossref
Mierswa Ingo, R. K. (2018). RapidMiner software (Education License, AI Studio 2024.0). Altair Engeering Inc: https://my.rapidminer.com/nexus/account/index.html#licenses/request
Mohammadi, E., Tahamtan, I., Mansourian, Y., & Overton, H. (2022). Identifying Frames of the COVID-19 Infodemic: Thematic Analysis of Misinformation Stories Across Media. JMIR Infodemiology, 2(1), e33827. https://doi.org/10.2196/33827
crossref pmid pmc
Nelson, V., Bashyal, B., Tan, P.-N., & Argyris, Y. A. (2024). Vaccine rhetoric on social media and COVID-19 vaccine uptake rates: A triangulation using self-reported vaccine acceptance. Social Science & Medicine (1982), 348, 116775. https://doi.org/10.1016/j.socscimed.2024.116775
crossref pmid
Park, H., & Reber, B. H. (2010). Using public relations to promote health: a framing analysis of public relations strategies among health associations. Journal of Health Communication, 15(1), 39-54. https://doi.org/10.1080/10810730903460534
crossref pmid
Patrick, M., Venkatesh, R. D., & Stukus, D. R. (2022). Social media and its impact on health care. Annals of Allergy, Asthma & Immunology : Official Publication of the American College of Allergy, Asthma, & Immunology, 128(2), 139-145. https://doi.org/10.1016/j.anai.2021.09.014
crossref pmid
Pelletier, C., Labbé, F., Bettinger, J. A., Curran, J., Graham, J. E., Greyson, D., MacDonald, N. E., Meyer, S. B., Steenbeek, A., Xu, W., & Dubé, È (2023). From high hopes to disenchantment: A qualitative analysis of editorial cartoons on COVID-19 vaccines in Canadian newspapers. Vaccine, 41(30), 4384-4391. https://doi.org/10.1016/j.vaccine.2023.06.002
crossref pmid pmc
Quigley, M., Whiteford, S., Cameron, G., Zuj, D. V., & Dymond, S. (2023). Longitudinal assessment of COVID-19 fear and psychological wellbeing in the United Kingdom. Journal of Health Psychology, 28(8), 726-738. https://doi.org/10.1177/13591053221134848
crossref pmid pmc
Reynolds, J. (2022). Framings of risk and responsibility in newsprint media coverage of alcohol licensing regulations during the COVID-19 pandemic in England. Drug and Alcohol Review, https://doi.org/10.1111/dar.13532
crossref
Rotolo, B., Dubé, E., Vivion, M., MacDonald, S. E., & Meyer, S. B. (2022a). Hesitancy towards COVID-19 vaccines on social media in Canada. Vaccine, 40(19), 2790-2796. https://doi.org/10.1016/j.vaccine.2022.03.024
crossref pmid pmc
Rotolo, B., Dubé, E., Vivion, M., MacDonald, S. E., & Meyer, S. B. (2022b). Hesitancy towards COVID-19 vaccines on social media in Canada. Vaccine, 40(19), 2790-2796. https://doi.org/10.1016/j.vaccine.2022.03.024
crossref pmid pmc
Sarkar, M. A., Ozair, A., Singh, K. K., Subash, N. R., Bardhan, M., & Khulbe, Y. (2021). SARS-CoV-2 Vaccination in India: Considerations of Hesitancy and Bioethics in Global Health. Annals of Global Health, 87(1), 124. https://doi.org/10.5334/aogh.3530
crossref pmid pmc
Skafle, I., Nordahl-Hansen, A., Quintana, D. S., Wynn, R., & Gabarron, E. (2022). Misinformation About COVID-19 Vaccines on Social Media: Rapid Review. Journal of Medical Internet Research, 24(8), e37367. https://doi.org/10.2196/37367
crossref pmid pmc
Slavik, C. E., Buttle, C., Sturrock, S. L., Darlington, J. C., & Yiannakoulias, N. (2021). Examining Tweet Content and Engagement of Canadian Public Health Agencies and Decision Makers During COVID-19: Mixed Methods Analysis. Journal of Medical Internet Research, 23(3), e24883. https://doi.org/10.2196/24883
crossref pmid pmc
Smith, R. A., Bone, C., Visco, A., Calo, W. A., Wright, J., Groff, D., & Lennon, R. P. (2022a). Skeptical Health Mavens May Limit COVID-19 Vaccine Diffusion: Using the Innovation Diffusion Cycle to Interpret Results of a Cross-sectional Survey among People Who are Socially Vulnerable. Journal of Health Communication, 27(6), 375-381. https://doi.org/10.1080/10810730.2022.2111619
crossref pmid
Smith, R. A., Bone, C., Visco, A., Calo, W. A., Wright, J., Groff, D., & Lennon, R. P. (2022b). Skeptical Health Mavens May Limit COVID-19 Vaccine Diffusion: Using the Innovation Diffusion Cycle to Interpret Results of a Cross-sectional Survey among People Who are Socially Vulnerable. Journal of Health Communication, 27(6), 375-381. https://doi.org/10.1080/10810730.2022.2111619
crossref pmid
Sorce, G., & Dumitrica, D. (2023). \#fighteverycrisis: Pandemic Shifts in Fridays for Future’s Protest Communication Frames. Environmental Communication, 17(3), 263-275. https://doi.org/10.1080/17524032.2021.1948435
crossref
Statista. (2023). Number of Twitter Users in Canada from 2012-2021. Social Media and User Generated Content. https://www.statista.com/statistics/303875/number-of-twitter-users-canada/
Taylor, S., Landry, C. A., Paluszek, M. M., Rachor, G. S., & Asmundson, G. J. G. (2020). Worry, avoidance, and coping during the COVID-19 pandemic: A comprehensive network analysis. Journal of Anxiety Disorders, 76, 102327. https://doi.org/10.1016/j.janxdis.2020.102327
crossref pmid pmc
Trotochaud, M., Smith, E., Hosangadi, D., & Sell, T. K. (2023). Analyzing Social Media Messaging on Masks and Vaccines: A Case Study on Misinformation During the COVID-19 Pandemic. Disaster Medicine and Public Health Preparedness, 1-9. https://doi.org/10.1017/dmp.2023.16
crossref
Tversky, A., & Kahneman, D. (1981). The framing of decisions and the psychology of choice. Science (New York, N.Y.), 211(4481), 453-458. https://doi.org/10.1126/science.7455683
crossref pmid
van Prooijen, J.-W., & Douglas, K. M. (2018). Belief in conspiracy theories: Basic principles of an emerging research domain. European Journal of Social Psychology, 48(7), 897-908. https://doi.org/10.1002/ejsp.2530
crossref pmid pmc
Weerasinghe, S., Oyebode, O., Orji, R., & Matwin, S. (2023a). Dynamics of emotion trends in Canadian Twitter users during COVID-19 confinement in relation to caseloads: Artificial intelligence-based emotion detection approach. DIGITAL HEALTH, 9, 205520762311714. https://doi.org/10.1177/20552076231171496
crossref pmid pmc
Weerasinghe, S., Oyebode, O., Orji, R., & Matwin, S. (2023b). Dynamics of emotion trends in Canadian Twitter users during COVID-19 confinement in relation to caseloads: Artificial intelligence-based emotion detection approach. DIGITAL HEALTH, 9, 205520762311714. https://doi.org/10.1177/20552076231171496
crossref pmid pmc
World Health Organization (2024). WHO COVID-19 Dashboard. Report. https://data.who.int/dashboards/covid19/vaccines
Yiannakoulias, N., Darlington, J. C., Slavik, C. E., & Benjamin, G. (2022). Negative COVID-19 Vaccine Information on Twitter: Content Analysis. JMIR Infodemiology, 2(2), e38485. https://doi.org/10.2196/38485
crossref pmid pmc
TOOLS
METRICS Graph View
  • 0 Crossref
  •  0 Scopus
  • 139 View
  • 13 Download
Related articles


Editorial Office
1 Hallymdaehak-gil, Chuncheon 24252, Republic of Korea
Tel: +82-33-248-3255    E-mail: editor@hnmr.org                

Copyright © 2025 by Health & New Media Research Institute.

Developed in M2PI